The 12-year basic education curriculum has begun to change teachers’ teaching and students’ learning. However, how to evaluate the students' learning outcomes and teachers' teaching depends on the assessment tools which are exactly developed based on the new curriculum. The main purpose of this study is to develop a framework of mathematical literacy-based assessment based on the new curriculum. Then following the framework, mathematical literacy-based items are developed. These items are utilized to evaluate the students leaning outcome in the fourth learning stage. With the longitudinal design, the test results are expected to be used to evaluate and compare student’s achievements who adapted the new and the old curriculum, to analyze the effectiveness of the implementation of the new curriculum, to establish a student's learning growth database, and to explore the factors which effect the student learning outcomes. All these empirical results can be used as the evidences of suggestions for the revision of the next new curriculum.