SLS lesson
Update 01 Feb 2021
https://docs.google.com/document/d/1wKsgw5i8vppG_qFN50CyxwOHXxStCgdR/edit
Introduction and Project Overview:
This document provides a briefing on the "Designing Interactive e-Assessment Test Items using Open Source Tools" project, funded by the Senior Specialist Track Research Fund (SSTRF) 2020. The project, initiated by the Open Educational Resources / Open Source Physics @ Singapore initiative, aims to explore the use of open source tools, specifically TAO (an e-assessment platform) and Easy JavaScript Simulation (EJSS) toolkit, for creating interactive e-assessment test items for the O-Level Exercise and Sports Science (ESS) Paper 1. The project also investigates the feasibility and security of using TAO for electronic School-Based Assessment (e-SBA) and seeks to understand the learning points in designing such interactive items.
The project leverages the fact that the ESS Paper 1 national examination is transitioning to a computer-based format, offering an opportunity to move beyond static visuals and descriptive passages towards more dynamic and authentic assessment contexts.
2. Main Themes and Important Ideas:
- Focus on Interactive e-Assessment: The central theme is the design and implementation of interactive e-assessment test items. The project aims to move beyond traditional question formats by incorporating simulations, virtual labs, and potentially games, leveraging the capabilities of EJSS and TAO/SLS.
- Initial findings suggest that students appreciate these types of e-SBA items for their potential to "enrich teaching and learning as well."
- Open Source Tools (TAO and EJSS): The project strategically utilizes open source tools for their customizability, control over the source code, flexibility for future development, and suitability for experimentation at the research stage.
- "Open source tools, like TAO and EJSS, provide the freedom to do our own customization because we can control the source code and it would be open and flexible for the future. Open sources allow experimentation and exploration by researchers at the preliminary stage of any new development."
- Target Subject: O-Level Exercise and Sports Science (ESS): ESS was chosen as the pilot subject because 2019 marked its first year of deploying Paper 1 in e-mode at the national level. This provides a timely context for exploring innovative e-assessment methods.
- "ESS was selected as 2019 is the first year that ESS will be deploying Paper 1 in e-mode at the National e-Exam level."
- Integration with Student Learning Space (SLS): The project explores the use of both TAO and the existing SLS platform for hosting and delivering these interactive e-assessment items. Efforts are underway to develop an EJSS plugin for TAO, while also utilizing the current functionalities of SLS for trialing test items.
- "Develop EJSS plugin for TAO SLS to allow embed or upload (more secure) of simulations... Using SLS current functionality to trial the test items done."
- Enhancing Teaching and Learning (T&L): A key objective is to improve the teaching and learning experiences through the use of these interactive assessments. The project anticipates that simulations and virtual labs can promote critical thinking and provide richer learning opportunities.
- "We hope to add ESS simulations, inside TAO or SLS itself (already possible as media upload or embed in SLS), a feature that we speculate, would promote critical thinking in ESS and support interactive assessment types designed using an open source tool called Easy JavaScript Simulation (EJSS) toolkit."
- Cybersecurity Considerations: The project recognizes the importance of cybersecurity for e-SBA platforms and includes an objective to evaluate the security aspects of using TAO for this purpose.
- "To surface degree of cybersecurity and implementation considerations in the use of TAO platform for interactive item types for electronic school-based assessment (e-SBA). This is important as cybersecurity ensures the integrity of the e-SBA system and student data protection and is a key consideration to the adoption of any assessment platform for e-SBA."
- Pilot Testing and User Experience: The project involves pilot testing the interactive test items in schools to gather feedback on student user experience and teachers' perspectives on the design process and student engagement.
- "Pilot interactive test items in 3 schools (3*20=60 students) to understand the student user experience for better T&L. Looking to the learning data now."
- Potential for Scalability and Wider Adoption: The project envisions that successful outcomes could lead to the scaling of the developed test items and platform to other subjects and schools as more national examinations transition to e-mode.
- "As more subjects will go e-Exams, the test items and the platform can be scaled to other subjects and for more schools."
- Addressing the Gap in e-SBA Support: The research aims to address the need for customizable and cost-effective electronic assessment platforms to support e-SBA for non-graduating cohorts.
- "To explore alternatives in supporting electronic School-based Assessment (e-SBA) for non-graduating cohort. PI is proposing to explore TAO, a customisable and popular and full-featured e-platform..."
- Impact of COVID-19: The project timeline was impacted by the COVID-19 pandemic, leading to revisions in the training schedule and considerations for fully online training if necessary.
- "Trainer is scheduled to train the team in December instead of July due to covid-19, else the team will receive training via online means."
3. Key Project Objectives and Deliverables:
The project outlines three main aims and corresponding research objectives:
- Aim 1: Develop EJSS Plugin for TAO.
- RO1: Create a new plugin for inserting EJSS into TAO.
- Deliverable: Two EJSS interactive test items administered in TAO as a prototype for e-SBA and better T&L for ESS.
- Aim 2: Explore TAO as a secure e-SBA platform.
- RO2: Surface the degree of cybersecurity and implementation considerations of using TAO for e-SBA.
- Deliverable: Installation of TAO on a secure web server and development of a new plugin to easily insert EJSS into TAO.
- Aim 3: Explicate learning points of designing e-assessment interactive item types.
- RO3: Derive learning points through pilot testing in schools, observing student and teacher experiences.
- Deliverable: Pilot/trial of crafted interactive test/exam items in one school to understand student and teacher user experience for e-SBA and better T&L, assessed through quantitative and qualitative measures.
4. Research Methodology:
The project employs a mixed-methods approach, combining:
- Quantitative Data: Surveys, test results analysis from TAO.
- Qualitative Data: Discussions, open-ended interviews with HQ officers, teachers, and students, observations of students using the interactive items.
- Technical Data: Server logs, cybersecurity expert scans and attacks.
Data analysis will involve thematic coding of qualitative feedback and analysis of quantitative data from the platform and surveys.
5. Potential Impact and Future Directions:
The project has the potential to:
- Improve the design and development of e-SBA platforms.
- Inform the creation of richer and more engaging assessment item types.
- Contribute to MOE's thought leadership on secure open source e-assessment platforms.
- Potentially lead to the central deployment of TAO for e-SBA in a cost-effective manner.
The project team anticipates that the findings and developed resources can be scaled to other subjects as e-exams become more prevalent, fostering a broader adoption of interactive and engaging e-assessment practices.
6. Project Timeline (Revised due to COVID-19):
The Gantt chart indicates key milestones and their timelines, with adjustments made due to the pandemic. Significant activities in 2020 included:
- Installation and upgrade of TAO.
- Development of the EJSS plugin for TAO/SLS.
- Design of interactive e-test items.
- Cybersecurity testing.
- Initial field testing of e-SBA in September 2020.
Activities planned for 2021 include further development, preparing for a second trial in June 2021, and report preparation, with potential rescheduling of trainer engagement depending on the COVID-19 situation.
7. Conclusion:
The "Designing Interactive e-Assessment Test Items using Open Source Tools" project represents a significant effort to innovate in the area of e-assessment in Singapore's education system. By leveraging open source tools and focusing on creating interactive and engaging test items, particularly for the evolving e-mode of the O-Level ESS Paper 1, the project aims to enhance teaching and learning, explore secure assessment platforms, and contribute valuable insights into the design and implementation of effective electronic school-based assessments. The findings have the potential for broader application across different subjects and educational levels.
Study Guide: Designing Interactive e-Assessment Test Items using Open Source Tools
Overview
This study guide is designed to help you review the key concepts and details presented in the provided source material concerning the "Designing Interactive e-Assessment Test Items using Open Source Tools" project. The project focuses on utilizing open-source tools, primarily TAO and Easy JavaScript Simulation (EJSS), within the Singapore Student Learning Space (SLS) to create interactive e-assessment items, particularly for the O-Level Exercise and Sports Science (ESS) Paper 1. The goal is to enhance teaching and learning through engaging and dynamic assessment methods while exploring the feasibility and security of these open-source platforms.
Key Themes
- Open Educational Resources (OER) and Open Source Tools: The project emphasizes the benefits of using open-source tools like TAO and EJSS for customization, flexibility, and cost-effectiveness in developing e-assessment.
- Interactive e-Assessment: The study focuses on designing engaging assessment items such as simulations, virtual labs, and games to promote critical thinking and provide a more authentic assessment experience.
- Student Learning Space (SLS): The SLS is identified as the primary platform for deploying and trialing these interactive e-assessment items.
- Exercise and Sports Science (ESS): ESS Paper 1, a computer-based assessment, serves as the initial focus for developing and piloting interactive test items.
- TAO (Test Authoring and Online Delivery): TAO is explored as a potential e-assessment platform offering features like QTI compliance, mobile device compatibility, and secure test delivery.
- Easy JavaScript Simulation (EJSS): EJSS is highlighted as the open-source toolkit used to create the interactive simulations and virtual labs to be integrated into the assessment items.
- School-Based Assessment (e-SBA): The project aims to develop and pilot practice e-SBA using these interactive item types to better prepare students for national e-exams.
- Cybersecurity: The project includes an objective to assess and address potential cybersecurity concerns related to using open-source platforms like TAO for secure e-SBA.
- Teacher Professional Development: Training and support for teachers in designing and utilizing these interactive assessment items are recognized as crucial aspects of the project.
- Research and Development: The project aims to generate insights and learning points about the usefulness and design considerations of interactive e-assessment using open-source tools.
Quiz: Short-Answer Questions
- What are the primary open-source tools being explored in this project for designing interactive e-assessment test items? Briefly describe the main function of each tool.
- For which subject and examination level in Singapore is this project initially focused on developing interactive e-assessment items? Why was this specific subject chosen?
- What is the Student Learning Space (SLS), and what role does it play in the context of this project? Mention at least one way the project utilizes the SLS.
- Explain the concept of interactive e-assessment as it is being explored in this project. Provide at least two examples of the types of interactive test items being developed.
- What are the three main aims of the "Designing Interactive e-Assessment Test Items using Open Source Tools" project? Briefly summarize each aim.
- Why does the project highlight the use of open-source tools like TAO and EJSS? Mention at least two advantages of using such tools for e-assessment development.
- What are some of the key features that TAO offers for electronic assessment, as mentioned in the source material? Name at least three such features.
- Describe one of the research objectives related to cybersecurity in this project. Why is addressing cybersecurity considered important for the project's success?
- What were some of the initial findings from the pilot testing of interactive test items in schools, according to the updated information provided in the source?
- What is the potential impact or utility of this project beyond the initial focus on ESS? Mention at least one way the project's outcomes could be beneficial in the future.
Quiz Answer Key
- The primary open-source tools are TAO, a test authoring and online delivery platform, and Easy JavaScript Simulation (EJSS), a toolkit for creating interactive simulations and virtual labs. TAO is used to create and deliver assessments, while EJSS is used to develop engaging interactive content for these assessments.
- The project is initially focused on the O-Level Exercise and Sports Science (ESS) Paper 1. ESS was chosen because 2019 was the first year it would be deploying Paper 1 in e-mode at the national e-exam level, making it a relevant area for exploring interactive digital assessments.
- The Student Learning Space (SLS) is Singapore's national online learning platform. In this project, it serves as a key platform for deploying and trialing the interactive e-assessment test items with students and teachers. The project is also exploring the possibility of integrating EJSS simulations directly into SLS or via a TAO plugin.
- Interactive e-assessment in this project involves using dynamic elements like simulations, virtual labs, and games within test items to actively engage students and assess their understanding, application, and analysis skills in a more authentic way than traditional static formats. Examples include projectile motion simulations for sports and interactive inquiry activities based on biomechanics.
- The three main aims are: 1) Develop an EJSS plugin for TAO (or SLS) to enable richer assessment item types with ESS simulations. 2) Explore TAO as a secure e-SBA platform by evaluating its cybersecurity and addressing potential issues. 3) Explicate learning points of designing e-assessment interactive item types through pilot testing and observation of student and teacher experiences.
- The project highlights open-source tools because they offer freedom for customization due to access to the source code and provide flexibility for future development and experimentation without proprietary restrictions or high costs associated with commercial software.
- Key features of TAO mentioned include: Authoring simple and advanced items (supporting QTI), compatibility with mobile devices, options for managing test-takers, control over user access, and the ability to scale from classroom to nationwide with a fail-safe for interrupted tests.
- One research objective related to cybersecurity is to surface the degree of cybersecurity and implementation considerations in using the TAO platform for interactive item types for e-SBA. This is important because cybersecurity is crucial for ensuring the integrity of the e-SBA system and protecting student data, which are fundamental for the adoption of any assessment platform.
- Initial findings suggest that students appreciate and want these kinds of interactive e-SBA item types to enrich not only assessment but also teaching and learning. The learning data from the pilot in three schools is currently being analyzed to further understand the student user experience.
- The project has the potential to be scaled to other subjects beyond ESS as more subjects transition to e-exams. The test items and platform design principles developed could serve as examples or templates for other disciplines. Furthermore, the exploration of a secure and cost-effective open-source e-assessment platform like TAO could lead to centralized deployment for non-graduating students across all schools.
Essay Format Questions
- Discuss the rationale behind using open-source tools like TAO and EJSS for designing interactive e-assessment test items in the context of the Singapore education system. What are the potential advantages and challenges of this approach compared to proprietary solutions?
- Analyze the research objectives of the "Designing Interactive e-Assessment Test Items using Open Source Tools" project. How do these objectives address the need for innovative and effective electronic school-based assessment (e-SBA) in Singapore, particularly for subjects like Exercise and Sports Science?
- Evaluate the role of interactive simulations and virtual labs, created using EJSS, in enhancing the assessment of critical thinking and application skills in subjects like Exercise and Sports Science. How might these interactive item types differ from traditional assessment methods and what are their potential benefits for student learning?
- Consider the importance of cybersecurity in the context of implementing open-source e-assessment platforms like TAO for school-based assessments. What are the potential risks and how does the project aim to address these concerns to ensure the integrity and security of the e-SBA system and student data?
- Based on the information provided, discuss the potential impact of this project on teaching and learning practices in Singapore. How might the development and use of interactive e-assessment items and open-source platforms influence pedagogy, assessment design, and student engagement in the future?
Glossary of Key Terms
- Open Educational Resources (OER): Teaching, learning, and research materials that are freely available and can be reused, remixed, revised, and redistributed.
- Open Source Tools: Software whose source code is available with a license that permits users to study, change, and distribute the software to anyone and for any purpose.
- TAO (Test Authoring and Online Delivery): An open-source platform used for creating, managing, and delivering online assessments.
- EJSS (Easy JavaScript Simulation): A free open-source tool that allows users to create interactive simulations and virtual experiments using JavaScript.
- SLS (Student Learning Space): Singapore's national online learning platform providing tools and resources for students and teachers.
- e-Assessment: The use of information and communication technologies in the assessment of student learning.
- e-SBA (electronic School-Based Assessment): The use of electronic platforms and tools for conducting school-based assessments.
- QTI (Question and Test Interoperability): An international standard for the representation of assessment content, allowing for the exchange of test items and tests between different systems.
- Plugin (computing): A software component that adds specific features or functionalities to a larger software application.
- Cybersecurity: The practice of protecting computer systems and networks from the theft of or damage to their hardware, software, or electronic data, as well as from the disruption or misdirection of the services they provide.
- API (Application Programming Interface): A set of protocols, routines, and tools for building software applications, specifying how software components should interact.
- LTI (Learning Tools Interoperability): A standard protocol that allows learning applications and content to be seamlessly integrated into learning management systems and other educational platforms.
n 2021
1. Completed e-assessment SSTRF2020 with Jean-Lawrence with 1 officer SCDC, 4 SEAB officers, mentored by CPDD Master Specailist: Pilotinteractive test items in 3 schools (3*20=60 students) to understand the student user experience for better T&L. Looking to the learning data now. https://sg.iwant2study.org/ospsg/index.php/projects/916-designing-interactive-e-assessment-test-items-using-open-source-tools-senior-specialist-track-research-fund-2020 Initial findings suggests students want these kind of e-SBA item types to also enrich teaching and learning as well. 2. make more interactive test items (simulations, virtual labs, games) for SLS , 3. support is great!
Updated 02 Dec 2020
https://docs.google.com/forms/d/1AFi2Avb55XQka7W2U_xYkN-aeVjedToL7WPDAaSGYyw/edit#responses 38 survey data
Updated 19 Sept 2020 email by Cleve
Trial on the Use of Interactive/Simulation as Active Inquiry Activity based on ESS
- Thank you for your school's interest and support in participating in a short trial on the use of interactives/simulations in SLS based on ESS to enhance teaching and learning, as well as school-based e-assessment (e-SBA). More information on this project can be found https://sg.iwant2study.org/ospsg/index.php/projects/916.
- The trial and survey are delivered through a lesson package that has already been shared with you in SLS, titled: "[WWS] Use of Interactive/Simulation as Active Inquiry Activity". The active inquiry activities in the lesson package are based on the topics found in the Biomechanics area of study.
- For the Secondary 3 ESS students to participate, please deploy the lesson package to these students and instruct them to complete:
- Task Activities 1 to 6: each task comprises a unique interactive/simulation with active inquiry activities; and
- Task Activity 7: a survey via an external link.
- To allow the researchers to monitor and collect students' responses, please ensure the deployed lesson package is shared with the following users as Collaborators that Can Edit:
Name |
|
School |
Wee Loo Kang |
MOE HQ |
|
Jean Phua Yin Chiun |
||
Cleve Chia |
- We would appreciate it if the students can complete the tasks and survey in the lesson package by 30 September 2020.
Thank you for your help and support.
Updated 20 May
Potential Impact of FHBL on implementation of my SSTRF Project in 2020 In discussion with school teachers to do FHBL intervention or in addition to face to face testing using SLS. Trainer is scheduled to train the team in December instead of July due to covid-19, else the team will receive training via online means.
|
Project Implementation Schedule (Gantt chart format)
revised due to COVID-19
Milestones
|
2020 | 2021 | ||||||||||||||||||||||
Jan | Feb | Mar | Apr | May | Jun | Jul | Aug | Sep | Oct | Nov | Dec | Jan | Feb | Mar | Apr | May | Jun | Jul | Aug | Sep | Oct | Nov | Dec | |
Install TAO and upgrade to the latest version, Using SLS current functionality to trial the test items done |
✅ | ✅ | ||||||||||||||||||||||
Develop EJSS plugin for TAO SLS to allow embed or upload (more secure) of simulations done |
✅ | ✅ | ||||||||||||||||||||||
https://vle.learning.moe.edu.sg/my-library/my-drive/a933efc2-9c7e-456f-be8b-25f84a93ea18"}{"1":111}">Design interactive e-test items with officers from PE Branch and engage trainer ✅ done, intervention test items is in SLS now |
✅ | ✅ | ✅ | ✅ | ✅ | |||||||||||||||||||
Cybersecurity testing and attacks by expert. Patches and recommendations to be reported SLS is the hosting platform, it is secure done by SLS |
✅ | ✅ | ||||||||||||||||||||||
Improve EJSS and TAO SLS surface by the project team ongoing |
✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | |||||||||||||
Prepare for field testing of e-SBA with EJSS test items, First Trial Sept 2020, Second Trail June 2021 ongoing |
✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ||||||||||||||||||
Prepare report and engage trainer first choice Dec 2020, if COVID-19 continues June 2021 or Dec 2021 [move here from July] | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
old
Milestones |
Month |
|||||||||||
Jan |
Feb |
Mar |
Apr |
May |
Jun |
Jul |
Aug |
Sep |
Oct |
Nov |
Dec |
|
done |
✅ |
✅ |
||||||||||
Develop EJSS plugin for done |
✅ |
✅ |
||||||||||
Design interactive e-test items with officers from PE Branch ✅ done, intervention test items is in SLS now
|
✅ |
✅ |
✅ |
✅ |
✅ |
|||||||
SLS is the hosting platform, it is secure done by SLS |
✅ |
✅ |
||||||||||
Improve EJSS and ongoing |
✅ |
✅ |
✅ |
✅ |
✅ |
|||||||
Prepare for field testing of e-SBA with EJSS test items ongoing |
✅ |
✅ |
✅ |
|||||||||
Prepare report and engage trainer [move here from July] |
✅ |
✅ |
✅ |
![]() |
sample screenshot of range of test items SLS URL |
![]() |
||
sample screenshot of beginning of simulation for interactive inquiry SLS URL
|
![]() |
sample screenshot of question 2 and 3 SLS URL |
Updated 9 March, 2020
https://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-V.pdf
https://www.seab.gov.sg/docs/default-source/national-examinations/syllabus/olevel/2021syllabus/6081_y21_sy.pdf
http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ
Updated Feb 20 , 2020 Catalogue of all interactives
https://sg.iwant2study.org/ospsg/index.php/interactive-resources/physical-sports-education
Update Jan, simulation 1 for sports, this is the master of which smaller ones will be crafted for targeted questions on sports.
Projectile Motion with Y Displacement, Velocity, Acceleration Graph JavaScript HTML5 Applet Simulation Model
![]() |
different angles exploration of sports of projectile. which angle of projection results in largest range? angle is 45 deg to the horizontal https://sg.iwant2study.org/ospsg/index.php/240 |
![]() |
different height exploration of sports of projectile. which height of projection results in largest range? highest height will produce maximum range to the horizontal https://sg.iwant2study.org/ospsg/index.php/240 |
Frequently Asked Questions: Interactive e-Assessment with Open Source Tools
1. What is the primary goal of the "Designing Interactive e-Assessment Test Items using Open Source Tools" project?
The main aim of this project is to explore and implement the use of open-source tools, specifically TAO (an e-assessment platform) and Easy JavaScript Simulation (EJSS), to create interactive e-assessment test items for the O-Level Exercise and Sports Science (ESS) Paper 1. The project seeks to understand the effectiveness of these tools in enhancing teaching and learning, as well as their suitability for electronic school-based assessment (e-SBA) in Singapore.
2. Why was Exercise and Sports Science (ESS) chosen as the subject for this project?
ESS was selected because 2019 marked the first year that its Paper 1 national examination would be administered electronically. This provided a timely opportunity to investigate how interactive elements, such as simulations, could enrich the e-assessment experience, offering a more dynamic and authentic context compared to traditional pen-and-paper tests that rely on static visuals.
3. What are the key benefits of using open source tools like TAO and EJSS for e-assessment?
Open source tools offer several advantages, including the freedom for customization through access to the source code, flexibility for future development and adaptation, and cost-effectiveness compared to proprietary solutions. They allow researchers and educators to experiment and explore new assessment methods at the initial stages of development without significant financial investment or vendor lock-in.
4. How does the project aim to improve the teaching and learning experience through e-assessment?
The project focuses on designing interactive test items (simulations, virtual labs, games) that can be embedded within the Student Learning Space (SLS) or TAO platform. The initial findings suggest that students appreciate these types of e-SBA items and believe they can enrich both teaching and learning. By using simulations and interactive activities, the project aims to promote critical thinking and provide more engaging and authentic assessment experiences.
5. What are the cybersecurity considerations when using open source tools like TAO for e-SBA?
The project recognizes the importance of cybersecurity in e-assessment. A key objective is to evaluate the degree of cybersecurity afforded by the TAO platform for secure e-SBA and address any potential issues. This includes cybersecurity testing and the implementation of necessary patches and recommendations to ensure the integrity of the assessment system and the protection of student data. Since SLS is also considered as a hosting platform, its existing security measures are also relevant.
6. What are the intended outcomes or deliverables of this research project?
The project aims to deliver several key outcomes:
- The design of prototype EJSS interactive test items administered within TAO for ESS, demonstrating their potential for e-SBA and enhanced teaching and learning.
- The development of a new plugin to facilitate the easy integration of EJSS simulations into the TAO platform.
- Insights into the student user experience with interactive e-assessment items and teachers' experiences in designing them.
- An evaluation of the cybersecurity aspects of using TAO for e-SBA.
- A set of learning points derived from the pilot testing of interactive item types.
7. How does this project align with the broader educational landscape and future trends in assessment?
This project aligns with the increasing adoption of e-assessments and the need for more dynamic and interactive testing methods, as seen in national e-exams and international assessments like PISA. By exploring open source tools, the project also addresses the need for cost-effective and customizable e-assessment solutions that can be scaled to other subjects and schools as more subjects transition to electronic examinations. The focus on interactive simulations supports active inquiry and aims to make assessments more aligned with teaching and learning goals.
8. What is the potential impact of this project beyond Exercise and Sports Science?
The findings and developed tools from this project have the potential to benefit other subjects as they move towards e-exams. The interactive test item designs and the developed EJSS plugin for TAO (or its integration with SLS) could serve as examples or templates for other disciplines. Furthermore, the research into the secure implementation of open source e-assessment platforms can inform broader strategies for electronic school-based assessment across various subjects and grade levels in a cost-effective and sustainable manner.
![]() |
different speed exploration of sports of projectile. which speed of projection results in largest range? highest speed https://sg.iwant2study.org/ospsg/index.php/240 |
PI: Lawrence WEE
co-PI: Jean, Cleve, and SEAB colleagues
mentor: Karen
school: Andy
Research Assistant: Johnathan - Jan to April 2020
Job Scope:
(a) To assist project team in the design of simple programming, coding and updating Easy JavaScript Simulation Modeling files for the Student Learning Space assessment system and Joomla server.
(b) To explore technology tools and to populate and digitalise possible electronic examination questions into the Student Learning Space assessment system assessment system
(c) any other duties assigned by project team and supervisor.
Designing Interactive e-Assessment Test Items using Open Source Tools
Curriculum, Assessment, Pedagogy and Instruction
Instructional Core
Abstract
The purpose of this study is to address this gap by examining the use of an open source tool, TAO or SLS itself for piloting practice e-SBA for the theory paper 1 for O-Level Exercise and Sports Science (ESS) ESS was selected as 2019 is the first year that ESS will be deploying Paper 1 in e-mode at the National e-Exam level. We hope to add ESS simulations, inside TAO or SLS itself (already possible as media upload or embed in SLS), a feature that we speculate, would promote critical thinking in ESS and support interactive assessment types designed using an open source tool called Easy JavaScript Simulation (EJSS) toolkit.
Findings from the study will inform the design and development of the e-SBA platform. Specifically, it will provide insights on how to
- Improve the teaching and learning experiences of teachers and students in using e-SBA platforms;
- Design rich assessment item types through the development of a new EJSS plugin for TAO that allows Exercise and Sports Science simulations to run inside TAO as a virtual laboratory; and
- Address possible cybersecurity issues related to the installation of TAO on a secure web server for e-SBA purposes.
In short, schools would require an electronic assessment platform (TAO or SLS) that allows them to provide practice e-SBA for graduating cohorts.
This proposal addresses this gap by experimenting and exploring (research for doing) TAO for piloting practice e-SBA with O-Level Exercise and Sports Science (ESS) for theory paper 1. ESS was selected as our focus subject because 2019 is the first year that ESS will be deploying Paper 1 in e-mode at the National e-Exam level. MOE HQ officers offer rich experience from piloting the e-mode and have developed test items from 2017. Teachers will be supported by MOE HQ officers in designing interactive item types. Designing interactive item types is cognitive demanding for teachers. MOE HQ officers would have to scaffold the process for teachers to design authentic and meaningful e-Exam test items that are rich in context, with ease of collecting data of students’ interactions. As such, project members have to be trained by an expert in the field of computing science and/or authentic interactive test item design.
We hope to add ESS simulations, inside TAO or SLS, a feature that we speculate, would promote critical thinking in ESS and support interactive assessment types designed using an open source tool called Easy JavaScript Simulation (EJSS) toolkit. The rich training connects the team with technical expertise to advise and enrich the project team about how APIs and Plugins can be designed and developed. The project team is leveled up and can then translate the knowledge acquired in the team’s projected workstream to advise or consult with SLS team on how e-assessment can be enabled within SLS.
Thus, the three aims are:
- Aim 1 (Develop EJSS Plugin for TAO) To develop a new EJSS plugin for TAO or SLS, and allow Exercise and Sports Science simulations to run inside TAO as a virtual laboratory to support richer assessment item types aligned to T&L.
- Aim 2 (Explore TAO as a secure e-SBA platform) To install TAO on a secure web server where the degree of cybersecurity that TAO affords for secure e-SBA aligned to T&L will be evaluated and addressed if needed.
- Aim 3 (Explicate learning points of designing e-assessment interactive item types) To derive a set of learning points through pilot testing in 1 school as the practice session for graduating cohorts, through observation of students using the interactive item types and teachers in creating and drafting the interactive item types.
Research Objectives
- RO1: To create a new plugin for the insertion of existing Easy JavaScript Simulation (EJSS) into the TAO examination platform for and better e-SBA aligned to T&L with consultation from Professor Félix J. García Clemente, cybersecurity computer scientist and creator of EJSS toolkit.
- RO2: To surface degree of cybersecurity and implementation considerations in the use of TAO platform for interactive item types for electronic school-based assessment (e-SBA). This is important as cybersecurity ensures the integrity of the e-SBA system and student data protection and is a key consideration to the adoption of any assessment platform for e-SBA. Thus, RO2 is necessary.
- RO3: To pilot/trial crafted interactive test/exam items in 1 school to understand the student user experience for better T&L and with teachers to better understand their test design experience and views of students user experience.
Why ESS?
The O-Level ESS Paper 1 national examination is a computer-based assessment that aims to provide a more dynamic, interactive and authentic context instead of using still pictures or descriptive passages in a pen-and-paper format. Visual stimuli on sports/exercise content will be used to test the understanding, application and analysis of the students in the national examination. If the project is supported, we are of the view that other subjects will be able to benefit from our research artefacts such as the use of TAO for e-SBA and our ESS item design as examples or templates for other subjects.
Why open source tools?
Open source tools, like TAO and EJSS, provide the freedom to do our own customization because we can control the source code and it would be open and flexible for the future. Open sources allow experimentation and exploration by researchers at the preliminary stage of any new development.
What TAO offers for ESS?
- Authoring Simple and Advanced Items, TAO supports all Question and Test Interoperability (QTI) interaction types. From multiple-choice to technology enhanced items (TEIs) you can create what you need. it also supports importing existing QTI items or tests directly into TAO if you do not want to create from scratch. Other than PISA, Cambridge Assessment has been embracing QTI as an international standard for electronic assessment (formative and summative) since 2004.
- Computer Adaptive Testing, TAO comes with a general-purpose CAT application programming interface (API) that enables you to plug-in your own proprietary or Open Source CAT engine. This way, you have full flexibility and control over which adaptive test algorithms you want to use.
- Deliver Tests to Mobile Devices, all QTI interaction types are fully compatible with mobile devices. Conduct online tests on student iPads, Android Tablets or laptops securely, by combining TAO with lock-down browsers such as the free open source Safe Exam Browser.
- Manage Test-Takers Enter candidate data directly into TAO, or import it from a CSV file. Then, verify test-takers’ identity with usernames and passwords through TAO, or via third party applications that support the OAuth standard, enabling single-sign-on (SSO) through an LMS like Moodle or Student Learning Space.
- Manage and Control User Access, define user profiles based on roles and responsibilities. Assign and restrict access to user functions as well as item and test content, ensuring your test data is fully protected.
- Scale from Classroom to Nationwide, TAO’s test delivery engine is built on a NoSQL data storage model, enabling you to scale with confidence from classroom to nationwide. If a test is unexpectedly interrupted, TAO’s built-in fail-safe ensures that candidates resume the test exactly where they paused.
Thus, our research question is:
- What are the insights on the usefulness of open source tools such as TAO or SLS and EJSS in the creation of Exercise and Sports Science e-assessment interactives for electronic school-based assessment and better T&L in Singapore?
What next after this project?
As more subjects will go e-Exams, the test items and the platform can be scaled to other subjects and for more schools.
Utility
RO1 and RO3: To understand the design considerations of interactive item types in the context of Exercise and Sports Science comparable to sample PISA 2015 Test Questions.
RO2: To expand MOE thought leadership on secure open source and Learning Tools Interoperability (LTI) compliant e-assessment platform such as TAO. This could bring about MOE centrally deploying TAO for e-SBA for all non-graduating students in all schools in a cost-effective and sustainable manner.
http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ
Figure 1: PISA 2015 Running in the Hot Weather Questions
Deliverables
RO1: To design two EJSS interactive test items administered in TAO as a prototype for e-SBA and better T&L for the subject of Exercise and Sports Science.
RO2: To install TAO on a secure web server and develop a new plugin to insert EJSS easily into TAO.
RO3. To pilot/trial crafted interactive test/exam items in 1 school to understand the student user experience and with teachers to better understand their test design experience and views of students user experience for e-SBA and better T&L . This will be conducted through quantitative (survey and test results analysis) and qualitative (interviews) measures.
Qualitative and Quantitative methods |
|
Research purpose |
Exploratory research where the research purpose is to generate insights about discoveringon the degree to which ESS was able to perform the role of a e-SBA using TAO and EJSS, the degree of cybersecurity and implementation considerations in the use of TAO platform for interactive question types for school-based assessments. |
Data needs |
|
Data sources |
|
Data collection form |
|
Sample |
|
Data collection |
|
Data analysis |
|
Inferences |
|
Impetus for Research
To explore alternatives in supporting electronic School-based Assessment (e-SBA) for non-graduating cohort. PI is proposing to explore TAO, a customisable and popular and full-featured e-platform (used in administering PISA in 60 countries as well as a growing list of adopters) with EJSS serving as interactive virtual laboratory to support test items. Other alternatives such as bespoke assessment platform and Commercial-Off-The-Shelf (COTS) platforms, are generally less customisable and a lot costlier to add new features due to the proprietary business model.
This SSTRF project is therefore well positioned to provide findings to potentially provide disruptive technology ideas and a small pool of Exercise and Sports Science interactive test items for e-SBA settings on TAO or SLS, all is possible.
Project Implementation Schedule (Gantt chart format)
Milestones |
Month |
|||||||||||
Jan |
Feb |
Mar |
Apr |
May |
Jun |
Jul |
Aug |
Sep |
Oct |
Nov |
Dec |
|
Install TAO and upgrade to the latest version, add functionality |
√ |
√ |
||||||||||
Develop EJSS plugin for TAO to allow embed or upload (more secure) of simulations. |
√ |
√ |
||||||||||
Design interactive e-test items with officers from PE Branch |
√ |
√ |
√ |
√ |
√ |
|||||||
Cybersecurity testing and attacks by expert. Patches and recommendations to be reported. |
√ |
|||||||||||
Improve EJSS and TAO surface by the project team |
√ |
√ |
√ |
√ |
√ |
|||||||
Prepare for field testing of e-SBA with EJSS test items |
√ |
√ |
√ |
|||||||||
Prepare report |
√ |
√ |
Reference:
- https://www.taotesting.com/
- https://en.wikipedia.org/wiki/Plug-in_(computing)
- https://gitlab.com/ejsS/tao-interaction prototype EJSS-TAO interaction plugin
- https://www.um.es/fem/EjsWiki/
- https://webs.um.es/fgarcia/miwiki/doku.php?id=home
- https://www.moe.gov.sg/docs/default-source/document/education/syllabuses/physical-sports-education/files/2018_olevel_exercise_and_sports_science_syllabus.pdf
- https://www.accelerate.taotesting.com/edk-uses-tao-to-ensure-consistent-nationwide-learning-standards
- https://www.taotesting.com/solutions/features/
- https://www.cambridgeassessment.org.uk/Images/140026-annual-report-04-05.pdf
- https://en.wikipedia.org/wiki/Learning_Tools_Interoperability
- http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ
- https://en.wikipedia.org/wiki/Learning_Tools_Interoperability
- https://www.taotesting.com/resources/?fwp_resource_categories=all&fwp_tags=case-study
- https://greatperformersacademy.com/entrepreneurs/30-disruptive-technologies-and-ideas-that-will-transform-industries
- https://docs.google.com/document/d/1rTlzItkUOOUs4_a4Yk2pryLHYL6UGujlwNa1KuWivJ4/edit#
end faq
{accordionfaq faqid=accordion4 faqclass="lightnessfaq defaulticon headerbackground headerborder contentbackground contentborder round5"}