...
The process to create interactive videos should be smooth and seamless. For V1, users cannot upload interactive videos, but can only use existing videos to enhance them with question sets for interactivity
Srl. No. | User Action | Expected Result |
|---|---|---|
1 | User navigates to creation interface | An option to create interactive videos is available for the user |
2 | User creates interactive video | User is able to select one video from available videos. With the video available, user can select timestamps to add question sets. |
3 | User publishes interactive video for review | The interactive video can be reviewed in the same way as other new content on Sunbird |
4 | Video is reviewed and published | The interactive video is immediately available on content pages for consumption |
Interactive Video Consumption
This scenario describes the MVP for a user playing an interactive video. The expectation here is that users can find and consume interactive videos similar to any other sort of content on Sunbird.
Srl. No. | User Action | Expected Result |
|---|---|---|
1 | User navigates to available content |
|
2 | User clicks on interactive video |
|
3 | Question set shows up on interactive video | User can answer, skip, or re-attempt questions in the question set depending on the properties of the question. Feedback is provided to the user on their performance |
4 | User finishes interactive video | Feedback is provided to the user on their score |
Creator Dashboard
I believe we should also have a section on “Creator Dashboard” where creator can see metrics for their interactive videos, generate insights about what to improve.
Srl. No. | User Action | Expected Result |
|---|---|---|
1 | User navigates to their Dashboard | Relevant metrics are available for interactive videos created by them including (but not limited to): engagement with questions, number of video watchers, scores, etc. |
Exception Scenarios
Wireframes
...
The main metric to track here will be engagement with the interactive video. Some of the metrics we can use for this purpose are listed below
Srl. No. | Metric | Purpose of Metric |
|---|---|---|
1 | Video watch duration | To know what percentage of the video is watched by a user, and on aggregate what percentage of users have watched different portions of the video |
2 | Number of questions answered |
|
3 | Score | On an aggregate level, this will help us understand users' performance, and also the level of the questions in the video. |
4 | % of content that is interactive | |
5 | Ratings of Interactive vs Non Interactive Videos | |
6 | Completion Rate of Interactive vs Non Interactive Videos |
The goal will be to understand which interactive videos are working better, which are not doing so well, and in general, understand what makes for a good interactive video. For example:
...
A blue marker will be visible on the progress bar of the player at the timestamp where the question set (if they have added more than one question) is added
User can also drag and move the marker on the progress bar to change the timestamp of the question/question set (if they have added more than one question)
If the user adds two separate question sets at the same time stamps, it will be considered as one question set at the backend
On clicking the question on the right side of the player, a preview of the question will be visible to the user
User can delete a question/entire grouped question set by clicking on the red icon on the right side of the question banner. To delete a specific question in a question set, user will have to click on edit (yellow icon) and then go on to de-select the required question through the dialog box pop-up
User can submit the interactive video for review once they have added all desired questions
When the question set editor opens - the existing filters of Board, Chapter, Grade, Subject etc. should be pre-filled using the video meta-data
When the user clicks on <Add a new question> → the system auto-decides the category (can be any of the existing categories or a new category by the name of Interactive Learning)
...
Scope for 4.4
Creator Interface
Overview
For 4.3, we are targeting to enable the creation interface for interactive videos with the capability to create new questions at the time of the new video upload flow. For 4.4 we propose to enable the capability to add questions from the existing Sunbird question library. This will allow any creator to leverage the power of an open source question content library and turn their passive videos into an interactive lesson.
Detailed Work Flow
...
On uploading video content on the Sunbird platform, the user will get an option to add questions to the video
...
On clicking <Add a new question>, the browse question dialog box will pop up from where the user can select a question/multiple questions from the existing questions created
...
The question will be added at the same timestamp where the user had clicked on the <Add a new question> button. They can edit the timestamp in the bottom left corner of the dialog box
...
Users can browse through the available questions to add to the video. By default system will show questions relevant to the context of Interactive video (video metadata). Users will also have the option to use multiple filters:
Board
Class
Subject
Question Type (MCQ/Subjective)
Chapter
All Questions / My Questions
...
Once a user clicks on a question - they will see a preview of the question on the right side of the dialog box
...
To add a question, users will have to click on the green <Add> icon on the right side of the question list
...
User can add a single question or multiple questions. If a user chooses to add multiple questions, the questions will clubbed into a question set by the system (and given a default name like custom_qs_1). Number of questions added will displayed in the bottom right, below the question box
...
Creator Interface Updates - 5th Oct’21
Question Set Category
Question Sets created inside the Interactive Video flow to not be discoverable
Questions used inside Question Sets within Interactive Videos to be public/discoverable for reuse
Question Reuse flow inside the Interactive Video Creation flow to be developed in later sprints but data classification (questions to be tagged as questions meant for Interactive Video) to be structured in a way that supports reuse flow
Every question to have an additional category which is equal to category of the parent question set
Updated Review and Publish Flows
Currently when reviewer approves, the platform publishes the interactive video content in the following manner:
It first calls an API to publish all the question sets present
It call another API to publish the video
Now, there is need for one more ECAR to package both these things together. Not packaging them together may lead to failure of individual question sets or the video in which case the final product being published will have components missing.
Once this change happens, the mobile app and portal will need to be enhanced to understand this packaged structure
Question Set Player Configuration
Question Set player within the interactive video flow to be configured in a manner that reduces number of steps for user
Question Set Details Screen
Name - Set default from backend as Question Set 1/2/3/n and remove field
Description - Remove or feed default description
Instructions - Remove
Type - Set default from backend as the new question set type created
Additional Category -
BMCS - Basis meta data of video uploaded
Topics - Remove
Audience - Keep
Max Time, Warning Time - Remove Fields
Author Details - Keep inputs as default from backend and remove field
Creator Dashboard
Jira Link: https://project-sunbird.atlassian.net/browse/SB-26824
For sprint 4.4 we propose building the Creator Dashboard for Interactive Videos. This will help close the feedback loop for any creator using interactive videos for their teaching. It might also help us gain insights into the learning gains that can be achieved from an interactive video vs a passive video.
User Journey:
User(Contributor) logs on to the Sunbird Vidyadaan platform
User clicks on <My Projects> on the Nav Bar
User sees basic stats that are available as part of the existing Sunbird data product (Views, Avg Rating)
Against interactive videos, user sees option to check detailed analytics by clicking the button <Analytics> (This button is only enabled against interactive video content type and not any other content type)
...
When user clicks the <Analytics> button, the Interactive Video Creator Dashboard opens in a separate window.
Below are some mockups inspired by the Plio Dashboard design which we can choose to integrate:
...
6 metrics that we track and display:
Completion Rate - % of viewers that answered all questions
Accuracy - Total Correct Ans / (Total Correct + Total Wrong Ans)
Retention at one minute (we can choose to skip this)
Avg. Questions Answered
Viewers
Average Watch Time
Clicking the <Download Report> button leads to downloading of a zip file which contains the dump of all interactions (scrubbing behaviour like - play, pause, fast forward, question events - answering, skipping, etc, and score related data) for each session for each user. [This is something we can pick up in later sprints basis effort estimate and feasibility]
For the above to be possible it is also necessary as a part of the dev process to first ensure proper telemetry and requisite event recording during the viewer consumption journey.
Offline Support for Interactive Videos
Creator Interface - Reuse Question
Overview
For 4.3, we are targeting to enable the creation interface for interactive videos with the capability to create new questions at the time of the new video upload flow. For future releases, we propose to enable the capability to add questions from the existing Sunbird question library. This will allow any creator to leverage the power of an open source question content library and turn their passive videos into an interactive lesson. (Not picked for 4.4)
Detailed Work Flow
On uploading video content on the Sunbird platform, the user will get an option to add questions to the video
On clicking <Add a new question>, the browse question dialog box will pop up from where the user can select a question/multiple questions from the existing questions created
The question will be added at the same timestamp where the user had clicked on the <Add a new question> button. They can edit the timestamp in the bottom left corner of the dialog box
Users can browse through the available questions to add to the video. By default system will show questions relevant to the context of Interactive video (video metadata). Users will also have the option to use multiple filters:
Board
Class
Subject
Question Type (MCQ/Subjective)
Chapter
All Questions / My Questions
Once a user clicks on a question - they will see a preview of the question on the right side of the dialog box
To add a question, users will have to click on the green <Add> icon on the right side of the question list
The user will also be given the option to configure the question set (only visible when user adds more than one question)
The user can now choose to <Add Question Set> (which will keep the configuration of the question set as default, more details below), or <Configure Question Set>
If the user chooses to configuretheir question set, a new dialog box will open. The user have the option to:Arrange the questions on the question set - they can drag and change positions of their questions in the box on the left side of the dialog box. Default arrangement will be the order in which the user added the questions
Show Feedback - Configurable - This will show/not show the scorecard at the end of the question set. Default will be to show feedback
Shuffle Questions - Configurable - This will randomize the arrangement of the questions, and will render the arrangement on the left side box (we can grey it out). Default would be to not shuffle.
Show X out of total questions - Input - this option will only get active if the user select to shuffle the questions (otherwise it will mean the same X questions getting chosen every time to be displayed). Default would be for this to be disabled given default for Shuffle Questions is to not shuffle
User can now either go back to the previous dialog box or click on <Add Question Set>
Once the user clicks <Add Question Set>, the added questions will appear on the right side of the player with the timestamp as a grouped question set. From here, user can edit the question set (if they have added more than one questions) or add more questions (if they have added only one question at that timestamp)
A blue marker will be visible on the progress bar of the player at the timestamp where the question set (if they have added more than one question) is added
User can also drag and move the marker on the progress bar to change the timestamp of the question/question set (if they have added more than one question)
If the user adds two separate question sets at the same time stamps, it will be considered as one question set at the backend
On clicking the question on the right side of the player, a preview of the question will be visible to the user
User can delete a question/entire grouped question set by clicking on the red icon on the right side of the question banner. To delete a specific question in a question set, user will have to click on edit (yellow icon) and then go on to de-select the required question through the dialog box pop-up
User can submit the interactive video for review once they have added all desired questions
Timestamps with questions overlayed will be bookmarked with a green marker
The viewer will have the option to skip and revise a question set
<Skip> - This will allow you to bypass the question and proceed with the video
<Revise> - This will start playing the video from the last bookmarked timestamp. In case the first question is revised, the video will start from the beginning
If the user moves the play cursor beyond the question set marker, the question will be skipped
...
On submitting the answer, the viewer will have to click on <Proceed> for continuing with the video
Dashboard
Another potential item for 4.4 could be building the Creator Dashboard. This will help close the feedback loop for any creator using interactive videos for their teaching. It might also help us gain insights into the learning gains that can be achieved from an interactive video vs a passive video.
...
Srl. No.
...
User Action
...
Expected Result
...
1
...
User navigates to their Dashboard
...
Relevant metrics are available for interactive videos created by them including (but not limited to): engagement with questions, number of video watchers, scores, etc.
Viewers
Average Watch Time
Completion Rate
Accuracy
Retention at 1 minute
Questions AnsweredUser can add a single question or multiple questions. If a user chooses to add multiple questions, the questions will clubbed into a question set by the system (and given a default name like custom_qs_1). Number of questions added will displayed in the bottom right, below the question box
The user can deselect/remove a question by clicking on the red <Remove> icon on the right side of the question list
The user will also be given the option to configure the question set (only visible when user adds more than one question)
The user can now choose to <Add Question Set> (which will keep the configuration of the question set as default, more details below), or <Configure Question Set>
If the user chooses to configuretheir question set, a new dialog box will open. The user have the option to:
Arrange the questions on the question set - they can drag and change positions of their questions in the box on the left side of the dialog box. Default arrangement will be the order in which the user added the questions
Show Feedback - Configurable - This will show/not show the scorecard at the end of the question set. Default will be to show feedback
Shuffle Questions - Configurable - This will randomize the arrangement of the questions, and will render the arrangement on the left side box (we can grey it out). Default would be to not shuffle.
Show X out of total questions - Input - this option will only get active if the user select to shuffle the questions (otherwise it will mean the same X questions getting chosen every time to be displayed). Default would be for this to be disabled given default for Shuffle Questions is to not shuffle
User can now either go back to the previous dialog box or click on <Add Question Set>
Once the user clicks <Add Question Set>, the added questions will appear on the right side of the player with the timestamp as a grouped question set. From here, user can edit the question set (if they have added more than one questions) or add more questions (if they have added only one question at that timestamp)
A blue marker will be visible on the progress bar of the player at the timestamp where the question set (if they have added more than one question) is added
User can also drag and move the marker on the progress bar to change the timestamp of the question/question set (if they have added more than one question)
If the user adds two separate question sets at the same time stamps, it will be considered as one question set at the backend
On clicking the question on the right side of the player, a preview of the question will be visible to the user
User can delete a question/entire grouped question set by clicking on the red icon on the right side of the question banner. To delete a specific question in a question set, user will have to click on edit (yellow icon) and then go on to de-select the required question through the dialog box pop-up
User can submit the interactive video for review once they have added all desired questions
Timestamps with questions overlayed will be bookmarked with a green marker
The viewer will have the option to skip and revise a question set
<Skip> - This will allow you to bypass the question and proceed with the video
<Revise> - This will start playing the video from the last bookmarked timestamp. In case the first question is revised, the video will start from the beginning
If the user moves the play cursor beyond the question set marker, the question will be skipped
...
On submitting the answer, the viewer will have to click on <Proceed> for continuing with the video