User Journeys and Case Analysis

What is each person's path through our designed tool?

Our 5D Assessment team wanted to understand teacher experience in virtual learning on zoom, but zoom is not set up to record multiple breakout rooms and orgnaize the data for easily understanding later. Video data can be immensely costly in terms of human effort and time, so I knew we had to structure this massive amount of unstructured data. If we didn't structure it, we would never be able to reconstitute the evidence we needed to make a case about teacher learning and journey analysis.

Structure from Chaos


I constructed a database from scratch for locating teacher videos in corpus of 300+ zoom-recorded segments. This involved building a dynamic library "data lake" for unstructured videos using xlookup, multiple spreadsheets, and inventive Box integration. Throughout, I took immense care to manage personally identifiable information and to guide my team of 12 researchers through the effort.

Intensive structured analysis and organization of video data.

Persona 1: Allison

An Experienced Teacher in a School with many Science Teachers

Allison hears about our project from a colleague who is connect to @NGSSChat online each Thursday evening She fills out a questionnaire to join the project and receives an email response She gathers a few pieces of paperwork and attends an informed consent meeting Her principal agrees to sign her up.

She gathers data through Spring 2022. She attends our class in Fall 2023. 

Key pain points for Allison:
She is less engaged in session 1-3

Attends small groups with others in her same content area.

Able to lead and learn from her colleagues

She submits final data in Winter 2023.  She shares what she's learned with her colleagues in her rural school and state.

Persona 2: Demi

A Less Experienced Teacher & Lone Teacher in his High School

Demetri sees the ad to recruit teachers in an email sent from the state newsletter. He fills out a questionnaire to join the project and receives an email response.  He gathers a few pieces of paperwork and attends an informed consent meeting on the student bus home from a coaching commitment. His principal doesn't really understand the commitment in science and is reluctant to support video recording since many are hesitant. The principal has never had a research team in their building before. He gathers data through Spring 2022. He attends our class in Fall 2023.

Key Pain Points for Demetri

He submits final data in Winter 2023 and shares in interviews that this was very helpful for individual students that he had designed for.  He cares about how the application of this course will help less-engaged students see themselves in science.

Outcomes

60   rural teachers supported 

40  "5D" assessments designed

4     coaches trained

3     National conference acceptances

2     published courses

1     peer-reviewed publication

4    databases built from scratch

Next Steps

We continue to analyze these data to determine the paths that different users took. Our initial hunches are that teacher profiles can be determined by understanding the curriculum they are currently using, the types of things they value in assessment, and the vision they have for science education. Each of these factors likely support their journey.

We plan to identify:

This project is supported by the National Science Foundation. All views are my own adn do not reflect those of the NSF.