Improving Students' Numeracy Skills Through the Development of Diagnostic and Evaluation Instruments for Numeracy Proficiency
DOI:
https://doi.org/10.31980/plusminus.v5i1.2552Keywords:
Tes Diagnostik, Kemampuan Numerasi, Budaya Melayu, Sekolah Menengah Atas, Pekanbaru, Diagnostics test, Numeracy Skill, Malay Culture, Junior High SchoolAbstract
Numerasi adalah kemampuan penting bagi siswa dan merupakan dasar untuk kesuksesan di masa depan. Penelitian ini bertujuan untuk mengembangkan instrumen dan mengevaluasi keterampilan numerasi siswa di 10 sekolah di Pekanbaru. Metode penelitian yang digunakan adalah metode R & D dan Survei. Populasi penelitian ini adalah seluruh siswa sekolah menengah pertama di Pekanbaru. Sampel penelitian terdiri dari 430 siswa yang dipilih dengan metode multiple random sampling. Teknik pengumpulan data yang digunakan dalam penelitian ini adalah pendekatan survei, dengan instrumen utama berupa tes pilihan ganda. Tujuh analisis data digunakan dalam penelitian ini: validitas konten, reliabilitas Cronbach Alpha, Analisis Faktor Konfirmatori (CFA), reliabilitas konstruk, dan deskriptif. Hasil penelitian menunjukkan bahwa analisis validitas konten terdapat empat item yang perlu direvisi karena kalimat yang ambigu. Reliabilitas Cronbach Alpha diperoleh sebesar 0,872 dengan kategori yang diterima. Analisis CFA menunjukkan bahwa 19 indikator sebagai konstruk merupakan kategori yang valid. Secara keseluruhan, keterampilan numerasi siswa dari dua belas kabupaten/kota di Provinsi Riau masih berada pada kategori yang kurang baik.
Numeracy is a crucial skill for students and serves as a foundation for future success. This study aims to develop instruments and evaluate students' numeracy skills in 10 schools in Pekanbaru. The research employed a combination of Research and Development (R&D) and survey methods. The population consisted of all junior high school students in Pekanbaru. A total of 430 students were selected as samples using multiple random sampling techniques. Data were collected through a survey approach, with the main instrument being a multiple-choice test. Seven types of data analysis were employed: content validity, Cronbach's Alpha reliability, Confirmatory Factor Analysis (CFA), construct reliability, and descriptive statistics. The results indicated that four items required revision due to ambiguous wording based on the content validity analysis. The Cronbach’s Alpha reliability was 0.872, which is considered acceptable. CFA analysis confirmed that 19 indicators were valid as constructs. Overall, the students’ numeracy skills from twelve regencies/cities in Riau Province are still in the low category.
References
Andrian, D., Kartowagiran, B., & Hadi, S. (2018). The Instrument Development to Evaluate Local Curriculum in Indonesia. International Journal of Instruction, 11(4), 921–934. https://doi.org/10.12973/iji.2018.11458a
Andrian, D., Nofriyandi, N., Indriati, M., & Abdurrahman, A. (2024). Comprehensive Numeracy Evaluation Model of Junior High Schools in Indonesia. Mosharafa: Jurnal Pendidikan Matematika, 13(3), 727-740. https://doi.org/10.31980/mosharafa.v13i3.2035
Aunio, P., Korhonen, J., Ragpot, L., Törmänen, M., Mononen, R., & Henning, E. (2019). Multi-factorial approach to early numeracy—The effects of cognitive skills, language factors and kindergarten attendance on early numeracy performance of South African first graders. International Journal of Educational Research, 97, 65–76. https://doi.org/10.1016/j.ijer.2019.06.011
Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe’s content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86. https://doi.org/10.1177/0748175613513808
Berger, J. L., & Karabenick, S. A. (2016). Construct Validity of Self-Reported Metacognitive Learning Strategies. Educational Assessment, 21(1), 19–33. https://doi.org/10.1080/10627197.2015.1127751
Bitterly, T. B., VanEpps, E. M., & Schweitzer, M. E. (2022). The predictive power of exponential numeracy. Journal of Experimental Social Psychology, 101. https://doi.org/10.1016/j.jesp.2022.104347
Bray, A., Byrne, P., & O’Kelly, M. (2020). A Short Instrument for Measuring Students’ Confidence with ‘Key Skills’’ (SICKS): Development, Validation and Initial Results.’ Thinking Skills and Creativity, 37(June), 100700. https://doi.org/10.1016/j.tsc.2020.100700
Burnett, C. M. (2016). Reconsidering the Construct Validity of “Political Knowledge.” Critical Review, 28(3–4), 265–286. https://doi.org/10.1080/08913811.2016.1239805
Chan, J. Y. C., & Scalise, N. R. (2022). Numeracy skills mediate the relation between executive function and mathematics achievement in early childhood. Cognitive Development, 62. https://doi.org/10.1016/j.cogdev.2022.101154
Chung, J. H., & Yoo, T. H. (2015). Government policy, network externalities and mobile telecommunication services: evidence from OECD countries. Applied Economics, 47(21), 2173–2183. https://doi.org/10.1080/00036846.2015.1005816
Clifton, J. D. W. (2020). Managing validity versus reliability trade-offs in scale-building decisions. Psychological Methods, 25(3), 259–270. https://doi.org/10.1037/met0000236
Cook, R. (2018). Gender differences in adult numeracy skills: what is the role of education? Educational Research and Evaluation, 24(6–7), 370–393. https://doi.org/10.1080/13803611.2018.1540992
Dawadi, S., & Shrestha, P. N. (2018). Construct validity of the Nepalese school leaving english reading test. Educational Assessment, 23(2), 102–120. https://doi.org/10.1080/10627197.2018.1430511
Dumas, H. M., Fragala-Pinkham, M. A., Rosen, E. L., & Ni, P. (2021). A content validity evaluation of the PEDI-CAT Speedy Mobility domain. Physiotherapy Theory and Practice, 37(4), 517–526. https://doi.org/10.1080/09593985.2019.1633716
Effendi, M., Khoiruli Ummah, S., & Cahyono, H. (2023). Teacher Perspective and Performance in Curriculum Prototype Implementation through the Development of Innovative Project-Based Learning Modules. Mosharafa: Jurnal Pendidikan Matematika, 12(1), 47-58. https://doi.org/10.31980/mosharafa.v12i1.751
Gashaj, V., Thaqi, Q., Mast, F. W., & Roebers, C. M. (2023). Foundations for future math achievement: Early numeracy, home learning environment, and the absence of math anxiety. Trends in Neuroscience and Education, 33. https://doi.org/10.1016/j.tine.2023.100217
Hadi, S., Andrian, D., & Kartowagiran, B. (2019). Evaluation model for evaluating vocational skills programs on local content curriculum in Indonesia: Impact of educational system in Indonesia. Eurasian Journal of Educational Research, 2019(82), 45–62. https://doi.org/10.14689/ejer.2019.82.3
Ismail, S. N., Ab Rahman, F., Zain, F. M., & Yaacob, A. (2022). The validity and reliability of quality improvement and accreditation system instrument in managing childcare center. International Journal of Evaluation and Research in Education, 11(3), 1258–1267. https://doi.org/10.11591/ijere.v11i3.22522
Istiyono, E., Dwandaru, W. S. B., Setiawan, R., & Megawati, I. (2020). Developing of computerized adaptive testing to measure physics higher order thinking skills of senior high school students and its feasibility of use. European Journal of Educational Research, 9(1), 91–101. https://doi.org/10.12973/eu-jer.9.1.91
Jayanti, R., & Cesaria, A. (2024). Pengaruh kemampuan literasi numerasi dan dukungan orang tua terhadap hasil belajar matematika soal cerita di sekolah dasar. Jurnal Inovasi Pembelajaran Matematika: PowerMathEdu, 3(2), 137-148. https://doi.org/10.31980/pme.v3i2.1441
Juengst, S. B., Terhorst, L., Dicianno, B. E., Niemeier, J. P., & Wagner, A. K. (2019). Development and content validity of the behavioral assessment screening tool (BAST β). Disability and Rehabilitation, 41(10), 1200–1206. https://doi.org/10.1080/09638288.2017.1423403
Kovacic, D. (2018). Using the Content Validity Index to Determine Content Validity of an Instrument Assessing Health Care Providers’ General Knowledge of Human Trafficking. Journal of Human Trafficking, 4(4), 327–335. https://doi.org/10.1080/23322705.2017.1364905
Krisma, D. A., Muqtada, M. R., & Khasanah, F. U. (2024). Merdeka Curriculum: How the Profile of Planning for Mathematics Learning by Teachers?. Mosharafa: Jurnal Pendidikan Matematika, 13(1), 175-186. https://doi.org/10.31980/mosharafa.v13i1.1985
Kullan, S., Mansor, M., & Ishak, R. (2022). The validity and reliability of an instrument to evaluate the practices of learning organization. International Journal of Evaluation and Research in Education, 11(4), 1725–1733. https://doi.org/10.11591/ijere.v11i4.22974
Lund, T. (2024). The Campbellian construct validity: some comments. Scandinavian Journal of Educational Research. https://doi.org/10.1080/00313831.2024.2350642
Manchaiah, V., Granberg, S., Grover, V., Saunders, G. H., & Ann Hall, D. (2019). Content validity and readability of patient-reported questionnaire instruments of hearing disability. International Journal of Audiology, 58(9), 565–575. https://doi.org/10.1080/14992027.2019.1602738
Masuwai, A., Zulkifli, H., & Hamzah, M. I. (2024). Evaluation of content validity and face validity of secondary school Islamic education teacher self-assessment instrument. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2308410
Melkamu Asaye, M., Gelaye, K. A., Matebe, Y. H., Lindgren, H., & Erlandsson, K. (2021). Assessment of content validity for a Neonatal Near miss Scale in the context of Ethiopia. Global Health Action, 14(1). https://doi.org/10.1080/16549716.2021.1983121
Mimeau, C., Coleman, M., & Donlan, C. (2016). The role of procedural memory in grammar and numeracy skills. Journal of Cognitive Psychology, 28(8), 899–908. https://doi.org/10.1080/20445911.2016.1223082
Newell, S. J., Chur-Hansen, A., & Strelan, P. (2021). A construct validity analysis of the concept of psychological literacy. Australian Journal of Psychology, 73(4), 462–474. https://doi.org/10.1080/00049530.2021.1922069
Nicolella, D. P., Torres-Ronda, L., Saylor, K. J., & Schelling, X. (2013). Validity and reliability of an accelerometer- based player tracking device. Plos, 62(4), 198–200. https://doi.org/10.7910/DVN/4WHUZH
Nofriyandi, Abdurrahman, & Andrian, D. (2023). Digital Learning Media Integrated with Malay Culture to Improve Students’ Numeration Ability and Motivation. Mosharafa: Jurnal Pendidikan Matematika, 12(2), 301-314. https://doi.org/10.31980/mosharafa.v12i2.785
OECD. (2018). PISA 2018 Worldwide Ranking – average score of mathematics, science and reading.
Oktaviana, R., Effendi, M., & Athma Putri Rosyadi, A. (2023). Analysis of Mathematics Learning Based on Minimum Competency Assessment in the 2013 Curriculum at SMP Muhammadiyah 1 Malang. Mosharafa: Jurnal Pendidikan Matematika, 12(4), 833-844. https://doi.org/10.31980/mosharafa.v12i4.1195
Oluyemiadetunji, S., & Nel, N. M. (2015). Challenges of Improving Literacy and Numeracy Skills of Prison Inmates in Nigeria. Journal of Psychology, 6(1), 66–75. https://doi.org/10.1080/09764224.2015.11885525
Persson, E., Andersson, D., Koppel, L., Västfjäll, D., & Tinghög, G. (2021). A preregistered replication of motivated numeracy. Cognition, 214. https://doi.org/10.1016/j.cognition.2021.104768
Peters, G. W., Kelly, J. R., Beckta, J. M., White, M., Marks, L. B., Ford, E., & Evans, S. B. (2021). An Evaluation of Health Numeracy among Radiation Therapists and Dosimetrists. Advances in Radiation Oncology, 6(3). https://doi.org/10.1016/j.adro.2020.10.022
Prendergast, M., Forster, A., O’Meara, N., O’Sullivan, K., & Faulkner, F. (2023). Numeracy-Meets: an innovative professional development model for adult numeracy practitioners in Ireland. Irish Educational Studies. https://doi.org/10.1080/03323315.2023.2209854
Purpura, D. J., Reid, E. E., Eiland, M. D., & Baroody, A. J. (2015). Using a Brief Preschool Early Numeracy Skills Screener to Identify Young Children With Mathematics Difficulties. School Psychology Review, 44(1), 41–59. https://doi.org/10.17105/SPR44-1.41-59
Qolbi, A. N., & Afriansyah, E. A. (2024). Capacity for mathematical literacy reviewing the learning style. Journal of Authentic Research on Mathematics Education (JARME), 6(1), 94-113.
Rezeki, S., Andrian, D., Wahyuni, A., & Nurkholisah, H. (2020). The sustainability concept of Riau cultures through development of mathematics learning devices based on Riau folklore at elementary schools. Journal of Physics: Conference Series, 1538(1). https://doi.org/10.1088/1742-6596/1538/1/012066
Safitra, M. D., Mulyono, B., & Susanti, E. (2023). Numeration-Based Teaching Materials on Algebra Shape Materials for Blended Learning. Mosharafa: Jurnal Pendidikan Matematika, 12(2), 375-388. https://doi.org/10.31980/mosharafa.v12i2.793
Sawada, T., Tomori, K., Sakaue, K., Higashikawa, Y., Ohno, K., Okita, Y., Seike, Y., Fujita, Y., & Umeda, M. (2021). Evaluating the Content Validity of a New On-Road Driving Test. Physical and Occupational Therapy in Geriatrics, 39(3), 295–315. https://doi.org/10.1080/02703181.2021.1873476
Segers, E., Kleemans, T., & Verhoeven, L. (2015). Role of Parent Literacy and Numeracy Expectations and Activities in Predicting Early Numeracy Skills. Mathematical Thinking and Learning, 17(2–3), 219–236. https://doi.org/10.1080/10986065.2015.1016819
Setiawan, A., Mardapi, D., & Andrian, D. (2019). The Development of Instrument for Assessing Students’ Affective Domain Using Self-and Peer-Assessment Models. In International Journal of Instruction (Vol. 12, Issue 3). https://doi.org/10.29333/iji.2019.12326a
Shrotryia, V. K., & Dhanda, U. (2019). Content Validity of Assessment Instrument for Employee Engagement. SAGE Open, 9(1). https://doi.org/10.1177/2158244018821751
Støren, L. A., Lundetræ, K., & Børing, P. (2018). Country differences in numeracy skills: how do they vary by job characteristics and education levels? International Journal of Lifelong Education, 37(5), 578–597. https://doi.org/10.1080/02601370.2018.1554718
Tito, A. S. D. A. P., & Muhtadi, D. (2024). Kemampuan literasi numerasi siswa dalam menyelesaikan masalah perbandingan senilai. Jurnal Inovasi Pembelajaran Matematika: PowerMathEdu, 3(1), 127-136. https://doi.org/10.31980/pme.v3i1.1721
Trickett, J., Batchelor, S., Brittle, B., Foulkes, M., Pickering, J., Slocombe, F., & Gilmore, C. (2022). The role of parent-led and child-led home numeracy activities in early mathematical skills. Cognitive Development, 63. https://doi.org/10.1016/j.cogdev.2022.101189
Valério, M., & Ferrara, S. (2022). Numeracy at the dawn of writing: Mesopotamia and beyond. Historia Mathematica, 59, 35–53. https://doi.org/10.1016/j.hm.2020.08.002
Wahyuni, A., Effendi, L. A., Angraini, L. M., & Andrian, D. (2020). Developing instrument to increase students’ geometry ability based on Van Hiele level integrated with Riau Malay culture. Jurnal Penelitian dan Evaluasi Pendidikan, 24(2), 208–217. https://doi.org/10.21831/pep.v24i2.33811
Wannenburg, E., & Curlewis, L. (2023). Exploring the need for numeracy skills in legal practice. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2023.2190307
Wright, P. M., & Craig, M. W. (2011). Tool for assessing responsibility-based education (TARE): Instrument development, content validity, and inter-rater reliability. Measurement in Physical Education and Exercise Science, 15(3), 204–219. https://doi.org/10.1080/1091367X.2011.590084
Zaki, A., Ramdhani, N., Arwadi, F., & Talib, A. (2024). Numerical Skills Analysis of Mathematics Department Students in the Kampus Mengajar Batch 7 Program. Mosharafa: Jurnal Pendidikan Matematika, 13(2), 551-562. https://doi.org/10.31980/mosharafa.v13i2.2017
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Plusminus: Jurnal Pendidikan Matematika
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
