Research Approach
Understanding how students think requires more than asking what they know. It requires a systematic process to develop an assessment that captures critical thinking in AI-based learning.
Research Project · 2026
Research Foundation
Belajar Bernalar is a research and development project focused on developing a web-based digital instrument to assess university students' Critical Thinking Skills in AI-based learning.
The development process combines construct reconstruction, assessment design, digital platform development, expert validation, and empirical testing.
Each stage contributes to the development of an instrument that is valid, reliable, and applicable for research and educational assessment.
Development Process
The research follows an iterative development process, from identifying assessment needs to finalizing the digital instrument.
Identifying assessment needs and reconstructing the critical thinking construct in the context of AI-based learning.
Expected Output
Construct and assessment requirements
Developing the assessment blueprint and designing items based on the identified dimensions and indicators of critical thinking.
Expected Output
Assessment blueprint and draft items
Developing authentic, contextual scenarios that represent students’ experiences when accessing, evaluating, and using AI-generated information.
Expected Output
Scenario-based assessment materials
Building a web-based assessment platform to present scenarios, deliver assessment items, and capture students’ responses and interaction data.
Expected Output
Functional digital assessment platform
Conducting expert reviews to evaluate the relevance, clarity, and appropriateness of the instrument and its assessment materials.
Expected Output
Expert validation and instrument revisions
Implementing pilot testing and the main study to collect empirical responses for evaluating the psychometric properties of the instrument.
Expected Output
Empirical response data
Analyzing the findings, refining the instrument, and preparing the final digital assessment instrument for research and dissemination.
Expected Output
Finalized digital instrument
Digital Assessment
The digital platform is designed to support the assessment process, from presenting authentic scenarios to capturing students’ responses.
It also provides opportunities to examine response time and interaction patterns as complementary information for understanding students’ thinking processes.
Presenting authentic assessment scenarios in a digital environment.
Recording students’ answers and assessment responses systematically.
Capturing response time and relevant interaction patterns.
Supporting the analysis of empirical data and instrument quality.
Expected Contribution
The project aims to contribute to the development of digital assessment through three interconnected outcomes.
A web-based assessment instrument designed to assess Critical Thinking Skills.
Evidence concerning the validity and reliability of the developed instrument.
A contribution to research and assessment practices in AI-based learning environments.
Beyond the Method
Explore the people and collaboration behind the development of the Belajar Bernalar digital Critical Thinking Skills assessment.