Development of an assessment toolkit to measure higher order thinking skills among secondary school learners

Loh, S.C. and Loo, C.K. and Mamauag, M.F.M. and Arosh, S.G. (2017) Development of an assessment toolkit to measure higher order thinking skills among secondary school learners. In: Seminar Kebangsaan Majlis Dekan Pendidikan Universiti Awam 2017, 13-15 December 2017, Universiti Malaysia Sabah, Sabah.

PDF (Full Text)

Download (2MB)
Official URL:


Higher order thinking skills (HOT) emerged as the focus of student development across the primary to post-secondary levels since the publication of the Malaysian Education Blueprint (2013-2025). This blueprint outlines the need for thinking skills encompassing creativity, innovation, critical thinking, and logical reasoning for students to adapt within the ever-changing technological landscape of the new millennia (Ministry of Education, 2013). Despite MOE's effort to implement PT3 (Form 3 Assessment) and HOTS questions in national school-leaving examinations, it apparently failed to accurately measure the levels of HOTS independent of content knowledge among Malaysian students. This study, therefore, was conceived to address the need for a more valid and reliable measurement of HOTS contextualized in a Malaysian setting. This theoretical paper is an attempt to set a framework by which HOTS' underlying measurement is anchored on. Based on a review of literature, operational definitions of the constructs on critical thinking, problem-solving, and creativity were derived. Three types of measures were developed, namely: (a) syllogisms, (b) situational judgment test (SJT), and (c) creativity. Thirty (30) syllogisms items to measure critical thinking, while 50 items of situational judgment tests to measure problem-solving were generated. The creativity test is adapted from an existing measure. Translated into Bahasa Malaysia, the first two tests are currently undergoing expert review prior to pilot-testing. These tests will be standardized using modern Item Response Theory (IRT) techniques, like Rasch modeling. The essential steps moving towards the full development of the HOTS assessment toolkit for the millennials in Malaysia are further discussed.

Item Type: Conference or Workshop Item (Paper)
Additional Information: Conference paper
Uncontrolled Keywords: Higher order thinking skills (HOT); Malaysian Education Blueprint; situational judgment test (SJT); PT3 (Form 3 Assessment)
Subjects: L Education > L Education (General)
L Education > LB Theory and practice of education > LB1603 Secondary Education. High schools
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Faculty of Education
Faculty of Computer Science & Information Technology
Depositing User: Mr. Mohd Safri
Date Deposited: 08 Aug 2018 08:22
Last Modified: 08 Aug 2018 08:22

Actions (login required)

View Item View Item