SLS lesson

https://vle.learning.moe.edu.sg/mrv/my-library/lesson/view/303c5407-17a8-4df3-9c3b-775c04c9c133/cover

 

Update 01 Feb 2021

https://docs.google.com/document/d/1MxiWKBExf2cgJyfpKIGGRASPgKW_YbVv/edit?usp=sharing&ouid=111507478434537221064&rtpof=true&sd=true

https://docs.google.com/document/d/1wKsgw5i8vppG_qFN50CyxwOHXxStCgdR/edit

 

Updated 20 Jan 2021

1. Completed e-assessment SSTRF2020 with Jean-Lawrence with 1 officer SCDC, 4 SEAB officers, mentored by CPDD Master Specailist:  Pilotinteractive test items in 3 schools (3*20=60 students) to understand the student user experience for better T&L. Looking to the learning data now. https://sg.iwant2study.org/ospsg/index.php/projects/916-designing-interactive-e-assessment-test-items-using-open-source-tools-senior-specialist-track-research-fund-2020  Initial findings suggests students want these kind of e-SBA item types to also enrich teaching and learning as well. 2. make more interactive test items (simulations, virtual labs, games) for SLS , 3. support is great!

 

Updated 02 Dec 2020

https://docs.google.com/forms/d/1AFi2Avb55XQka7W2U_xYkN-aeVjedToL7WPDAaSGYyw/edit#responses 38 survey data 

 

 

Updated 19 Sept 2020 email by Cleve

Trial on the Use of Interactive/Simulation as Active Inquiry Activity based on ESS

1. Thank you for your school's interest and support in participating in a short trial on the use of interactives/simulations in SLS based on ESS to enhance teaching and learning, as well as school-based e-assessment (e-SBA). More information on this project can be found https://sg.iwant2study.org/ospsg/index.php/projects/916.

1. The trial and survey are delivered through a lesson package that has already been shared with you in SLS, titled: "[WWS] Use of Interactive/Simulation as Active Inquiry Activity". The active inquiry activities in the lesson package are based on the topics found in the Biomechanics area of study.

1. For the Secondary 3 ESS students to participate, please deploy the lesson package to these students and instruct them to complete:

1. Task Activities 1 to 6: each task comprises a unique interactive/simulation with active inquiry activities; and
2. Task Activity 7: a survey via an external link.

1. To allow the researchers to monitor and collect students' responses, please ensure the deployed lesson package is shared with the following users as Collaborators that Can Edit: 

Name	Email	School
Wee Loo Kang	This email address is being protected from spambots. You need JavaScript enabled to view it.	MOE HQ
Jean Phua Yin Chiun	This email address is being protected from spambots. You need JavaScript enabled to view it.
Cleve Chia	This email address is being protected from spambots. You need JavaScript enabled to view it.

1. We would appreciate it if the students can complete the tasks and survey in the lesson package by 30 September 2020.

Thank you for your help and support.

 

 

Updated 20 May

 

 

Potential Impact of FHBL on implementation of my SSTRF Project in 2020 In discussion with school teachers to do FHBL intervention or in addition to face to face testing using SLS.  Trainer is scheduled to train the team in December instead of July due to covid-19, else the team will receive training via online means.   Project Title:    Designing Interactive e-Assessment Test Items using Open Source Tools Name of Principal Investigator:    Lawrence WEE Does your project involve schools, if yes, kindly indicate how  Yes Term 3 lesson intervention planned.  What concerns do you have with your conduct of your research? We hope to engage the Spanish trainer/professor by December to train the team for the project goals. Originally it was July 2020. if covid-19 continues, we will cancel the face to face training, and do online training.

 

Project Implementation Schedule (Gantt chart format) 

revised due to COVID-19

Milestones

2020

2021

Jan

Feb

Mar

Apr

May

Jun

Jul

Aug

Sep

Oct

Nov

Dec

Jan

Feb

Mar

Apr

May

Jun

Jul

Aug

Sep

Oct

Nov

Dec

Install TAO and upgrade to the latest version, Using SLS current functionality to trial the test items done

✅

✅

Develop EJSS plugin for TAO SLS to allow embed or upload (more secure) of simulations done

✅

✅

https://vle.learning.moe.edu.sg/my-library/my-drive/a933efc2-9c7e-456f-be8b-25f84a93ea18"}{"1":111}">Design interactive e-test items with officers from PE Branch and engage trainer ✅ done, intervention test items is in SLS now

✅

✅

✅

✅

✅

Cybersecurity testing and attacks by expert. Patches and recommendations to be reported SLS is the hosting platform, it is secure done by SLS

✅

✅

Improve EJSS and TAO SLS surface by the project team ongoing

✅

✅

✅

✅

✅

✅

✅

✅

✅

✅

✅

Prepare for field testing of e-SBA with EJSS test items, First Trial Sept 2020, Second Trail June 2021 ongoing

✅

✅

✅

✅

✅

✅

Prepare report and engage trainer first choice Dec 2020, if COVID-19 continues June 2021 or Dec 2021 [move here from July]

✅

✅

✅

✅

✅

✅

✅

✅

✅

 

old

Milestones

Month

Jan

Feb

Mar

Apr

May

Jun

Jul

Aug

Sep

Oct

Nov

Dec

Install TAO and upgrade to the latest version, Using SLS current functionality to trial the test items  done

✅

✅

Develop EJSS plugin for TAO  SLS to allow embed or upload (more secure) of simulations done

✅

✅

Design interactive e-test items with officers from PE Branch and engage trainer ✅ done, intervention test items is in SLS now

✅

✅

✅

✅

✅

Cybersecurity testing and attacks by expert. Patches and recommendations to be reported SLS is the hosting platform, it is secure done by SLS

✅

✅

Improve EJSS and TAO  SLS surface by the project team ongoing

✅

✅

✅

✅

✅

Prepare for field testing of e-SBA with EJSS test items ongoing

✅

✅

✅

Prepare report and engage trainer [move here from July]

✅

✅

✅

 

 

Updated 9 March, 2020

https://www.oecd.org/pisa/keyfindings/pisa-2012-results-volume-V.pdf

https://www.seab.gov.sg/docs/default-source/national-examinations/syllabus/olevel/2021syllabus/6081_y21_sy.pdf

http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ

Updated Feb 20 , 2020 Catalogue of all interactives

 https://sg.iwant2study.org/ospsg/index.php/interactive-resources/physical-sports-education

 

Update Jan, simulation 1 for sports, this is the master of which smaller ones will be crafted for targeted questions on sports.

Projectile Motion with Y Displacement, Velocity, Acceleration Graph JavaScript HTML5 Applet Simulation Model

different angles exploration of sports of projectile. which angle of projection results in largest range? angle is 45 deg to the horizontal https://sg.iwant2study.org/ospsg/index.php/240

 

different height exploration of sports of projectile. which height of projection results in largest range? highest height will produce maximum range to the horizontal https://sg.iwant2study.org/ospsg/index.php/240

 

different speed exploration of sports of projectile. which speed of projection results in largest range? highest speed https://sg.iwant2study.org/ospsg/index.php/240

 

 

PI: Lawrence WEE

co-PI: Jean, Cleve, and SEAB colleagues

mentor: Karen

school: Andy

Research Assistant: Johnathan - Jan to April 2020

Job Scope:

(a) To assist project team in the design of simple programming, coding and updating Easy JavaScript Simulation Modeling files for the Student Learning Space assessment system and Joomla server.

(b) To explore technology tools and to populate and digitalise possible electronic examination questions into the Student Learning Space assessment system assessment system
(c) any other duties assigned by project team and supervisor.

 

 

Designing Interactive e-Assessment Test Items using Open Source Tools

Curriculum, Assessment, Pedagogy and Instruction

Instructional Core

Abstract

The purpose of this study is to address this gap by examining the use of an open source tool, TAO or SLS itself for piloting practice e-SBA for the theory paper 1 for O-Level Exercise and Sports Science (ESS) ESS was selected as 2019 is the first year that ESS will be deploying Paper 1 in e-mode at the National e-Exam level. We hope to add ESS simulations, inside TAO or SLS itself (already possible as media upload or embed in SLS), a feature that we speculate, would promote critical thinking in ESS and support interactive assessment types designed using an open source tool called Easy JavaScript Simulation (EJSS) toolkit.  

Findings from the study will inform the design and development of the e-SBA platform. Specifically, it will provide insights on how to

1. Improve the teaching and learning experiences of teachers and students in using e-SBA platforms;
2. Design rich assessment item types through the development of a new EJSS plugin for TAO that allows Exercise and Sports Science simulations to run inside TAO as a virtual laboratory; and
3. Address possible cybersecurity issues related to the installation of TAO on a secure web server for e-SBA purposes. 

In short, schools would require an electronic assessment platform (TAO or SLS) that allows them to provide practice e-SBA for graduating cohorts. 

This proposal addresses this gap by experimenting and exploring (research for doing)  TAO for piloting practice e-SBA with O-Level Exercise and Sports Science (ESS) for theory paper 1. ESS was selected as our focus subject because 2019 is the first year that ESS will be deploying Paper 1 in e-mode at the National e-Exam level. MOE HQ officers offer rich experience from piloting the e-mode and have developed test items from 2017.  Teachers will be supported by MOE HQ officers in designing interactive item types. Designing interactive item types is cognitive demanding for teachers. MOE HQ officers would have to scaffold the process for teachers to design authentic and meaningful e-Exam test items that are rich in context, with ease of collecting data of students’ interactions. As such, project members have to be trained by an expert in the field of computing science and/or authentic interactive test item design.

We hope to add ESS simulations, inside TAO or SLS, a feature that we speculate, would promote critical thinking in ESS and support interactive assessment types designed using an open source tool called Easy JavaScript Simulation (EJSS) toolkit. The rich training connects the team with technical expertise to advise and enrich the project team about how APIs and Plugins can be designed and developed. The project team is leveled up and can then translate the knowledge acquired in the team’s projected workstream to advise or consult with SLS team on how e-assessment can be enabled within SLS. 

Thus, the three aims are:

1. Aim 1 (Develop EJSS Plugin for TAO) To develop a new EJSS plugin for TAO or SLS, and allow Exercise and Sports Science simulations to run inside TAO as a virtual laboratory to support richer assessment item types aligned to T&L. 
2. Aim 2 (Explore TAO as a secure e-SBA platform) To install TAO on a secure web server where the degree of cybersecurity that TAO affords for secure e-SBA aligned to T&L will be evaluated and addressed if needed. 
3. Aim 3 (Explicate learning points of designing e-assessment interactive item types) To derive a set of learning points through pilot testing in 1 school as the practice session for graduating cohorts, through observation of students using the interactive item types  and teachers in creating and drafting the interactive item types.

Research Objectives

1. RO1: To create a new plugin for the insertion of existing Easy JavaScript Simulation (EJSS) into the TAO examination platform for and better e-SBA aligned to T&L with consultation from Professor Félix J. García Clemente, cybersecurity computer scientist and creator of EJSS toolkit. 
2. RO2: To surface degree of cybersecurity and implementation considerations in the use of TAO platform for interactive item types for electronic school-based assessment (e-SBA). This is important as cybersecurity ensures the integrity of the e-SBA system and student data protection and is a key consideration to the adoption of any assessment platform for e-SBA. Thus, RO2 is necessary. 
3. RO3: To pilot/trial crafted  interactive test/exam items in 1 school to understand the student user experience for better T&L and with teachers to better understand their test design experience and views of students user experience.

Why ESS?

The O-Level ESS Paper 1 national examination is a computer-based assessment that aims to provide a more dynamic, interactive and authentic context instead of using still pictures or descriptive passages in a pen-and-paper format. Visual stimuli on sports/exercise content will be used to test the understanding, application and analysis of the students in the national examination. If the project is supported, we are of the view that other subjects will be able to benefit from our research artefacts such as the use of TAO for e-SBA and our ESS item design as examples or templates for other subjects.

Why open source tools?

Open source tools, like TAO and EJSS, provide the freedom to do our own customization because we can control the source code and it would be open and flexible for the future. Open sources allow experimentation and exploration by researchers at the preliminary stage of any new development. 

What TAO offers for ESS?

1. Authoring Simple and Advanced Items, TAO supports all Question and Test Interoperability (QTI) interaction types. From multiple-choice to technology enhanced items (TEIs) you can create what you need. it also supports importing existing QTI items or tests directly into TAO if you do not want to create from scratch. Other than PISA, Cambridge Assessment has been embracing QTI as an international standard for electronic assessment (formative and summative) since 2004. 
2. Computer Adaptive Testing, TAO comes with a general-purpose CAT application programming interface (API) that enables you to plug-in your own proprietary or Open Source CAT engine. This way, you have full flexibility and control over which adaptive test algorithms you want to use.
3. Deliver Tests to Mobile Devices, all QTI interaction types are fully compatible with mobile devices. Conduct online tests on student iPads, Android Tablets or laptops securely, by combining TAO with lock-down browsers such as the free open source Safe Exam Browser.
4. Manage Test-Takers Enter candidate data directly into TAO, or import it from a CSV file. Then, verify test-takers’ identity with usernames and passwords through TAO, or via third party applications that support the OAuth standard, enabling single-sign-on (SSO) through an LMS like Moodle or Student Learning Space.
5. Manage and Control User Access, define user profiles based on roles and responsibilities. Assign and restrict access to user functions as well as item and test content, ensuring your test data is fully protected.
6. Scale from Classroom to Nationwide, TAO’s test delivery engine is built on a NoSQL data storage model, enabling you to scale with confidence from classroom to nationwide. If a test is unexpectedly interrupted, TAO’s built-in fail-safe ensures that candidates resume the test exactly where they paused.

Thus, our research question is:

• What are the insights on the usefulness of open source tools such as TAO or SLS and EJSS in the creation of Exercise and Sports Science e-assessment interactives for electronic school-based assessment and better T&L in Singapore?

What next after this project?

As more subjects will go e-Exams, the test items and the platform can be scaled to other subjects and for more schools.

Utility

RO1 and RO3: To understand the design considerations of interactive item types in the context of Exercise and Sports Science comparable to sample PISA 2015 Test Questions. 
RO2: To expand MOE thought leadership on secure open source and Learning Tools Interoperability (LTI) compliant e-assessment platform such as TAO.  This could bring about MOE centrally deploying TAO for e-SBA for all non-graduating students in all schools in a cost-effective and sustainable manner.

 http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ

Figure 1: PISA 2015 Running in the Hot Weather Questions

Deliverables

RO1: To design two EJSS interactive test items administered in TAO as a prototype for e-SBA and better T&L for the subject of Exercise and Sports Science.

RO2: To install TAO on a secure web server and develop a new plugin to insert EJSS easily into TAO. 

RO3. To pilot/trial crafted  interactive test/exam items in 1 school to understand the student user experience and with teachers to better understand their test design experience and views of students user experience for e-SBA and better T&L . This will be conducted through quantitative (survey and test results analysis) and qualitative (interviews) measures.

 

	Qualitative and Quantitative methods
Research purpose	Exploratory research where the research purpose is to generate insights about discoveringon the degree to which ESS was able to perform the role of a e-SBA using TAO and EJSS, the degree of cybersecurity and implementation considerations in the use of TAO platform for interactive question types for school-based assessments.
Data needs	Student-user data (survey, interviews, scores in TAO), Teacher-user data (survey, interviews) Server data, cybersecurity expert scans and attacks
Data sources	HQ officers, teachers, students Server logs, cybersecurity expert consultation
Data collection form	Discussions, Open ended  interviews, surveys and observations  insights on what other dynamic and authentic contexts on ESS could be developed for paper 1 focus group with students (6-8 pax) to listen to their experience in this journey and how the proposed system could be enhanced insights on the user experience and what else can be improved on the ESS paper 1   insights on what else need to be need to be done to enable other subjects to come onboard the open source tools platforms
Sample	One cybersecurity expert 3-5 teachers 40-100 Exercise and Sports Science students in one e-SBA in one school
Data collection	Reports generated by cybersecurity expert Test results, user interactions with TAO
Data analysis	TAO and server log files Informal recommendations by cybersecurity expert TAO built-in test analysis and user data Thematic coding of open-ended user feedback with up to 2 inter-rater to establish reliability
Inferences	Tentative recommendations

 

Impetus for Research

To explore alternatives in supporting electronic School-based Assessment (e-SBA) for non-graduating cohort. PI is proposing to explore TAO, a customisable and popular and full-featured e-platform (used in administering PISA in 60 countries as well as a growing list of adopters) with EJSS serving as interactive virtual laboratory to support test items. Other alternatives such as bespoke assessment platform and Commercial-Off-The-Shelf (COTS) platforms, are generally less customisable and a lot costlier to add new features due to the proprietary business model.
This SSTRF project is therefore well positioned to provide findings to potentially provide disruptive technology ideas and a small pool of Exercise and Sports Science interactive test items for e-SBA settings on TAO or SLS, all is possible.

Project Implementation Schedule (Gantt chart format)  

Milestones

Month

Jan

Feb

Mar

Apr

May

Jun

Jul

Aug

Sep

Oct

Nov

Dec

Install TAO and upgrade to the latest version, add functionality

√

√

Develop EJSS plugin for TAO to allow embed or upload (more secure) of simulations.

√

√

Design interactive e-test items with officers from PE Branch

√

√

√

√

√

Cybersecurity testing and attacks by expert. Patches and recommendations to be reported.

√

Improve EJSS and TAO surface by the project team

√

√

√

√

√

Prepare for field testing of e-SBA with EJSS test items

√

√

√

Prepare report

√

√

 

 Reference:

1.  https://www.taotesting.com/
2. https://en.wikipedia.org/wiki/Plug-in_(computing)
3. https://gitlab.com/ejsS/tao-interaction prototype EJSS-TAO interaction plugin
4.  https://www.um.es/fem/EjsWiki/
5. https://webs.um.es/fgarcia/miwiki/doku.php?id=home
6. https://www.moe.gov.sg/docs/default-source/document/education/syllabuses/physical-sports-education/files/2018_olevel_exercise_and_sports_science_syllabus.pdf
7. https://www.accelerate.taotesting.com/edk-uses-tao-to-ensure-consistent-nationwide-learning-standards
8. https://www.taotesting.com/solutions/features/
9. https://www.cambridgeassessment.org.uk/Images/140026-annual-report-04-05.pdf
10. https://en.wikipedia.org/wiki/Learning_Tools_Interoperability
11. http://www.oecd.org/pisa/PISA2015Questions/platform/index.html?user=&domain=SCI&unit=S623-RunningInHotWeather&lang=eng-ZZZ
12. https://en.wikipedia.org/wiki/Learning_Tools_Interoperability
13. https://www.taotesting.com/resources/?fwp_resource_categories=all&fwp_tags=case-study
14. https://greatperformersacademy.com/entrepreneurs/30-disruptive-technologies-and-ideas-that-will-transform-industries
15. https://docs.google.com/document/d/1rTlzItkUOOUs4_a4Yk2pryLHYL6UGujlwNa1KuWivJ4/edit#

end faq

{accordionfaq faqid=accordion4 faqclass="lightnessfaq defaulticon headerbackground headerborder contentbackground contentborder round5"}