Grok Academy's Timed Exam
Grok Academy's Timed Exam
Grok Academy's Timed Exam
UX Enhancement of Grok's Timed Exam Mode
UX Enhancement of Grok's Timed Exam Mode
UX Enhancement of Grok's Timed Exam Mode
Project Overview
Project Overview
Project Overview
Problem
Problem
Problem
As online education becomes more prevalent, ensuring a positive user experience (UX) is vital. Despite its importance, there is limited research in this new field, creating a challenge in developing user-friendly online learning platforms.
As online education becomes more prevalent, ensuring a positive user experience (UX) is vital. Despite its importance, there is limited research in this new field, creating a challenge in developing user-friendly online learning platforms.
As online education becomes more prevalent, ensuring a positive user experience (UX) is vital. Despite its importance, there is limited research in this new field, creating a challenge in developing user-friendly online learning platforms.
Goal
Goal
Goal
Evaluate the strengths and weaknesses of Grok Academy's 'Timed Exam Mode' feature and enhance its user experience by implementing design improvements based on user feedback and usability guidelines.
Evaluate the strengths and weaknesses of Grok Academy's 'Timed Exam Mode' feature and enhance its user experience by implementing design improvements based on user feedback and usability guidelines.
Evaluate the strengths and weaknesses of Grok Academy's 'Timed Exam Mode' feature and enhance its user experience by implementing design improvements based on user feedback and usability guidelines.
Solution
Solution
Solution
This design initiative introduces a model for crafting efficient and user-friendly online assessment environments. Through usability testing and gathering student feedback, key enhancements were made, such as personalised timer options, mental preparation countdown, and colour-coded question status indicators.
This design initiative introduces a model for crafting efficient and user-friendly online assessment environments. Through usability testing and gathering student feedback, key enhancements were made, such as personalised timer options, mental preparation countdown, and colour-coded question status indicators.
This design initiative introduces a model for crafting efficient and user-friendly online assessment environments. Through usability testing and gathering student feedback, key enhancements were made, such as personalised timer options, mental preparation countdown, and colour-coded question status indicators.
My Role
My Role
My Role
End-to-end UX including UI
End-to-end UX including UI
End-to-end UX including UI
Project Duration - 8 Weeks
Project Duration - 8 Weeks
Project Duration - 8 Weeks
Project Timeline
Project Timeline
Project Timeline
Secondary Research
Secondary Research
Secondary Research
Literature Review
Literature Review
Literature Review
To get a comprehensive overview of existing research and knowledge related to the topic
To get a comprehensive overview of existing research and knowledge related to the topic
To get a comprehensive overview of existing research and knowledge related to the topic
Usability Test
Usability Test
Usability Test
To evaluate the user experience of the platform and identify strengths and weaknesses
To evaluate the user experience of the platform and identify strengths and weaknesses
To evaluate the user experience of the platform and identify strengths and weaknesses
Literature Review Findings
Literature Review Findings
Lit Review Findings
1
Shifting Educational Landscape due to COVID-19: COVID-19 led to the quick adoption of remote learning adoption. Initial doubts shifted to recognising online education's advantages.
Shifting Educational Landscape due to COVID-19: COVID-19 led to the quick adoption of remote learning adoption. Initial doubts shifted to recognising online education's advantages.
Shifting Educational Landscape due to COVID-19: COVID-19 led to the quick adoption of remote learning adoption. Initial doubts shifted to recognising online education's advantages.
2
Significance of Timed Examination: COVID-19 emphasized timed online exams, testing time management and problem-solving skills.
Significance of Timed Examination: COVID-19 emphasized timed online exams, testing time management and problem-solving skills.
Significance of Timed Examination: COVID-19 emphasized timed online exams, testing time management and problem-solving skills.
3
Preference for Online Testing Systems: Studies show students prefer computer-based exams, offering flexible start times and quick feedback.
Preference for Online Testing Systems: Studies show students prefer computer-based exams, offering flexible start times and quick feedback.
Preference for Online Testing Systems: Studies show students prefer computer-based exams, offering flexible start times and quick feedback.
4
Role of Timers and Quality of Assessment: Modern trackers help students manage time well. Countdown timers boost motivation. Good time management leads to project success and discipline.
Role of Timers and Quality of Assessment: Modern trackers help students manage time well. Countdown timers boost motivation. Good time management leads to project success and discipline.
Role of Timers and Quality of Assessment: Modern trackers help students manage time well. Countdown timers boost motivation. Good time management leads to project success and discipline.
5
Gaps in Literature: Online testing growth lacks research on timed assessments. Doubts on virtual assessment reliability continue. Few studies assess video-based time tracking's effectiveness.
Gaps in Literature: Online testing growth lacks research on timed assessments. Doubts on virtual assessment reliability continue. Few studies assess video-based time tracking's effectiveness.
Gaps in Literature: Online testing growth lacks research on timed assessments. Doubts on virtual assessment reliability continue. Few studies assess video-based time tracking's effectiveness.
Usability Test
Usability Test
Usability Test
4 participants were recruited for a moderated “think-aloud” Usability Test. All participants were students at The University of Melbourne. 3 participants had used Grok’s Timed Exam Mode before.
Participants were asked to take a 7-minute test and discuss the interface.
A Pilot test was conducted before the actual usability tests.
4 participants were recruited for a moderated “think-aloud” Usability Test. All participants were students at The University of Melbourne. 3 participants had used Grok’s Timed Exam Mode before.
Participants were asked to take a 7-minute test and discuss the interface.
A Pilot test was conducted before the actual usability tests.
4 participants were recruited for a moderated “think-aloud” Usability Test. All participants were students at The University of Melbourne. 3 participants had used Grok’s Timed Exam Mode before.
Participants were asked to take a 7-minute test and discuss the interface.
A Pilot test was conducted before the actual usability tests.
4
4
participants
participants
150
150
minutes of conversation
minutes of conversation
minutes of conversation
"Timed Session Finish looks the same as Timed Session End"
"Timed Session Finish looks the same as Timed Session End"
"Timed Session Finish looks the same as Timed Session End"
"There are too many alerts"
"There are too many alerts"
"There are too many alerts"
"Its annoying to close the alerts each time"
"Its annoying to close the alerts each time"
"Its annoying to close the alerts each time"
"I never read the alerts during an exam"
"I never read the alerts during an exam"
"I never read the alerts during an exam"
"Do I submit using mark or save?"
"Do I submit using mark or save?"
"Do I submit using mark or save?"
"I want a 15-min warning"
"I want a 15-min warning"
"I want a 15-min warning"
"There should be an alert for unanswered questions"
"There should be an alert for unanswered questions"
"There should be an alert for unanswered questions"
Affinity Mapping
Affinity Mapping
Affinity Mapping
I analyzed usability test findings using thematic analysis, organizing participant feedback into codes and grouping them into themes. The resulting thematic map revealed interrelated patterns, offering a comprehensive understanding of the platform's user experience.
I analyzed usability test findings using thematic analysis, organizing participant feedback into codes and grouping them into themes. The resulting thematic map revealed interrelated patterns, offering a comprehensive understanding of the platform's user experience.
I analyzed usability test findings using thematic analysis, organizing participant feedback into codes and grouping them into themes. The resulting thematic map revealed interrelated patterns, offering a comprehensive understanding of the platform's user experience.
Usability Test Findings
Usability Test Findings
Usability Test Findings
The results from the usability tests provided invaluable information about the platform’s usability, strong points and areas for improvement. Various important themes emerged from their accounts that provide insights into timer visibility, alert mechanisms, timer format preferences, terminology, usability issues and others.
The results from the usability tests provided invaluable information about the platform’s usability, strong points and areas for improvement. Various important themes emerged from their accounts that provide insights into timer visibility, alert mechanisms, timer format preferences, terminology, usability issues and others.
The results from the usability tests provided invaluable information about the platform’s usability, strong points and areas for improvement. Various important themes emerged from their accounts that provide insights into timer visibility, alert mechanisms, timer format preferences, terminology, usability issues and others.
Timer Visibility and Findability
Timer Visibility and Findability
Timer Visibility and Findability
Difficulty Locating Timer
Difficulty Locating Timer
Difficulty Locating Timer
Some participants experienced difficulty in locating the timer, mentioning that the timer's visibility and findability were inadequate.
Some participants experienced difficulty in locating the timer, mentioning that the timer's visibility and findability were inadequate.
Some participants experienced difficulty in locating the timer, mentioning that the timer's visibility and findability were inadequate.
Timer Disappearance
Timer Disappearance
Timer Disappearance
One participant expressed frustration over the fact that clicking the menu icon to expand the menu resulted in the timer becoming invisible.
One participant expressed frustration over the fact that clicking the menu icon to expand the menu resulted in the timer becoming invisible.
One participant expressed frustration over the fact that clicking the menu icon to expand the menu resulted in the timer becoming invisible.
Disruptive and Non-Informative Alerts
Disruptive and Non-Informative Alerts
Disruptive and Non-Informative Alerts
Intrusive Alerts
Intrusive Alerts
Intrusive Alerts
A participant expressed frustration about the screen lock due caused by alert messages during active timer sessions, stating it leads to unnecessary time loss.
A participant expressed frustration about the screen lock due caused by alert messages during active timer sessions, stating it leads to unnecessary time loss.
A participant expressed frustration about the screen lock due caused by alert messages during active timer sessions, stating it leads to unnecessary time loss.
No Alert for Unanswered Questions
No Alert for Unanswered Questions
No Alert for Unanswered Questions
A participant suggested that having an alert indicating that certain questions have not been submitted (marked) yet would be beneficial.
A participant suggested that having an alert indicating that certain questions have not been submitted (marked) yet would be beneficial.
A participant suggested that having an alert indicating that certain questions have not been submitted (marked) yet would be beneficial.
Unclear and Generic UX Writing
Unclear and Generic UX Writing
Unclear and Generic UX Writing
Lack of Clarity in UX Terminology
Lack of Clarity in UX Terminology
Lack of Clarity in UX Terminology
One student stated that they found the alert messages to be ambiguous as they could not tell the difference between “Timed Session Finish” and “Timed Session End”. Another student found the term "End Session" confusing and recommended changing it to "End Exam" for clarity.
One student stated that they found the alert messages to be ambiguous as they could not tell the difference between “Timed Session Finish” and “Timed Session End”. Another student found the term "End Session" confusing and recommended changing it to "End Exam" for clarity.
One student stated that they found the alert messages to be ambiguous as they could not tell the difference between “Timed Session Finish” and “Timed Session End”. Another student found the term "End Session" confusing and recommended changing it to "End Exam" for clarity.
Lengthy Alert Messages
Lengthy Alert Messages
Lengthy Alert Messages
Several participants expressed concerns regarding the verbosity of alert messages stating that they are distracting and time-consuming to read.
Several participants expressed concerns regarding the verbosity of alert messages stating that they are distracting and time-consuming to read.
Several participants expressed concerns regarding the verbosity of alert messages stating that they are distracting and time-consuming to read.
Custom Warning Preferences
Custom Warning Preferences
Custom Warning Preferences
Two students mentioned they preferred receiving a 5-minute warning, while another student stated a preference for a 15-minute warning.
Two students mentioned they preferred receiving a 5-minute warning, while another student stated a preference for a 15-minute warning.
Two students mentioned they preferred receiving a 5-minute warning, while another student stated a preference for a 15-minute warning.
Proposed Design Improvements
Proposed Design Improvements
Proposed Design Improvements
Timer Customisation
Timer Customisation
Timer Customisation
Enables users to set up their timer according to their individual preferences, such as Timer Display Settings, Alerts and Screen Settings
Enables users to set up their timer according to their individual preferences, such as Timer Display Settings, Alerts and Screen Settings
Enables users to set up their timer according to their individual preferences, such as Timer Display Settings, Alerts and Screen Settings
Mental Preparation Countdown
Mental Preparation Countdown
Mental Preparation Countdown
A 5-second countdown before initiating an exam allowing students to mentally prepare instead of being thrown into the assessment on clicking a link
A 5-second countdown before initiating an exam allowing students to mentally prepare instead of being thrown into the assessment on clicking a link
A 5-second countdown before initiating an exam allowing students to mentally prepare instead of being thrown into the assessment on clicking a link
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
5
4
3
2
1
0
Colour-coded Question Status Indicators
Colour-coded Question Status Indicators
Colour-coded Question Status Indicators
Provides an at-a-glance information regarding the progress of each question.
Green (Submitted), Blue (Attempted but not submitted), Orange (Modified), Grey (Not attempted)
Provides an at-a-glance information regarding the progress of each question.
Green (Submitted), Blue (Attempted but not submitted), Orange (Modified), Grey (Not attempted)
Provides an at-a-glance information regarding the progress of each question.
Green (Submitted), Blue (Attempted but not submitted), Orange (Modified), Grey (Not attempted)
Concise, Non-Intrusive Alerts
Concise, Non-Intrusive Alerts
Concise, Non-Intrusive Alerts
Alerts strategically placed on the left side, enabling uninterrupted work. Concise and timed alerts for minimal disruption
Alerts strategically placed on the left side, enabling uninterrupted work. Concise and timed alerts for minimal disruption
Alerts strategically placed on the left side, enabling uninterrupted work. Concise and timed alerts for minimal disruption
Other UI Changes
Other UI Changes
Other UI Changes
Timer is separated from the "Tutoring" and "End Session" and positioned in the top centre
"Mark" Button Renamed and repositioned below the code editor
"End Session" repositioned in the bottom right corner of the screen and changed to red
Inclusion of Dark Mode
Timer is separated from the "Tutoring" and "End Session" and positioned in the top centre
"Mark" Button Renamed and repositioned below the code editor
"End Session" repositioned in the bottom right corner of the screen and changed to red
Inclusion of Dark Mode
Timer is separated from the "Tutoring" and "End Session" and positioned in the top centre
"Mark" Button Renamed and repositioned below the code editor
"End Session" repositioned in the bottom right corner of the screen and changed to red
Inclusion of Dark Mode
