My Role: I was one of four UX Design students who worked equally on this project.
The Client: Mt. Cleverest, run by Bernie and James, who conceived and built the Beta version of the web tool.
Project Timeline: 17 days
Target Device: Desktop website
Process Structure: Research, Synthesis, Design, Iteration, Delivery
What is Mt. Cleverest?
Ed-tech tool powered by AI
Selected to enter the IBM Watson AI Prize Competition
Goal is to be an "open-sourced textbook" comprised of teacher-added content and quizzes
What It Does
Scans online articles and generates editable quiz questions
Collects questions created and edited by teachers related to specific online articles
Problem Overview: Mt. Cleverest needs to gain new users to make their vision of an "open source textbook" possible. Users came to the site and didn't understand how to create a quiz by bringing in a new resource, didn't understand the effect of adding questions to the overall system, and didn't a way to access students' quiz results on the website.
Goals: Develop an on-boarding strategy, create separate paths for users (students and teachers), create a section for accessing and organizing resources and quiz results.
Solution Summary: Redesigned Welcome page describing the primary current value of the site (quiz creation), redesigned Home page leading the user to bring in their own resources and understand and access resources/quizzes brought in by other teachers, a teacher "dashboard" for access to quiz assignments and their connected resource as well as the results of student performance on quizzes, created a delightful way to answer user's questions about the quiz creation process.
Meeting with Stakeholders
Teacher Interviews & Usability Testing
1. Meeting with Stakeholders
We began the project by exploring Mt. Cleverest Beta by creating and taking quizzes. We formed questions about the project for the stakeholders. We met with them, and discussed their goals and visions for their product and how learned more about how the AI works.
2. Teacher Interviews & Usability Testing
Interviewed 11 teachers
Performed usability tests with 6 participants
Ages: Early 20s- Late 60s
Median age: 30
3. Competitive/Comparative Feature Analysis
The teachers we interviewed mentioned ed tech tools they currently use. We analyzed these tools focusing on features that were most relevant to the problems we were solving.
Usability Testing Insights
1. Affinity Mapping
2. Affinity Mapping Insights
The affinity map helped us notice trends and draw these overall insights from the interviews. We found teachers..
Use supplementary resources beyond what is provided by their schools
Mentioned outdated textbooks as a specific pain point
Many turn to online resources, such as Newsela, Quizlet, Khan Academy, Kahoot, Desmos and Nearpod, which help teachers create engaging assessments, provide content, and easily grade and track scores
Tend to jump between multiple tools throughout the school year
Currently or would like to share resources with other teachers
Often struggle to find time and the best methods to approach students who learn at different paces than the rest of the class
After hearing about teachers helping their students hit benchmarks, we created Mr. Mark Benchman, who is a synthesis of the trends and insights we found from our research.
4. Usability Test Insights
We tested the current site with 6 users. The image below demonstrates a few of the key insights we gathered for redesigning the logged in Homepage of Mt. Cleverest.
Internal & External Design Studio
1. Design studio
We did internal design studio as a team on features such as the home page and the quiz creation page.
We then did design studio with our stakeholders, to involve them in the design process and make sure we were heading in a direction with the designs that they agreed with. Doing this design studio with them helped us to know where to focus for prototype designs, which was the onboarding.
2. Whiteboard Sketches
After design studios, we worked at the whiteboard to plan a unified design that met the needs of the users.
Testing & Iteration
We conducted two rounds of usability testing. We discussed the insights from the testing and made changes to the design to improve the usability.
4 Test participants in round 1
2 Test participants in round 2
Key Mid-Fi Pages with usability insights
key high-fi wireframes after usability testing
Delivery & Outcome
Presentation to Stakeholders
Research and Specification Documentation
1. Design Outcome
In the end we created a product that combined the current capabilities of Mt. Cleverest and what the users in the initial round of usability tests liked about the product with a strategy for on-boarding new users a set-up flow for teachers, a modified quiz creation flow, and a teacher dashboard where they could access past quizzes.
2. Presentation to Stakeholders
Photo from presentation
3. Research and Specification Documentation
The Research Documentation included the following:
User Interview notes
Research Synthesis deliverables
Key Insights from
A Usability report
The Specification Document included the following
Summary of Research
copy: what and where?
The biggest challenge of this project was copy. We found that users had many questions about the AI and how the quiz creation process worked such as "What happens to the question I created? Can other people see it?" We needed a way to answer these questions while still keeping the design simple and uncluttered. Our solution was to answer the questions as the actions were taken.
Community for Early Adopters
Another challenge was communicating the community aspect of the product. While essential to the eventual end goal of the product, the early adopters of Mt. Cleverest would not experience the "source agnostic" textbook version of the product (imagine Facebook before you had friends to fill your newsfeed). We had to find a way to emphasize the value of the quiz creation process before it reached its ideal state, while providing copy that would encourage creating this community.