(Energised) Question Bank primarily deals with Question and Question Set objects to enable a variety of use-cases centred around different types of questions & question sets. Know more about Question & Question set here: Question Definition and Question Set Definition
This would cater to a variety of use-cases, such as
Use Case | Use Case Type | Persona | Mode of consumption | Quick summary of the Use Case | |
---|---|---|---|---|---|
Practice | Learn | Learner, Instructor, Administrator | ETB, Independent | Practicing and learning for myself (ETB Practice) | Practice worksheets linked to curriculum ETBs for students and teachers |
Instructor | Course | Practice during a course (Course Worksheet) | |||
Help Learn | Instructor | Independent, ETB (Offline) | Conducting practice offline (Teaching material) | ||
Test | Learn | Learner, Instructor, Administrator | Practice for an examination-style test (Mock Test) | ||
Learner, Instructor, Administrator | Offline Mock Test (Printed) | ||||
Help Learn | Administering test offline | ||||
Official test for a textbook (non proctored, actual test) | |||||
Official test for a training (End of course assessment) | |||||
Quiz | Learn | Fun quiz anytime anywhere anyone | |||
Quiz competition to win a challenge | |||||
Survey | Survey |
MVP of EQB Platform & Solution
MVP would focus on enabling Survey, Test, Assessment, Quiz, and Practice capabilities for conducting Pre & Post Training Survey, Pre-Test for a Training, Baseline and End-line Survey & Assessment for Training, Self-Reflection Survey, and more..
https://project-sunbird.atlassian.net/browse/SB-20202
Platform MVP
Categories for Questions & Question Sets
Question Object Type:
Attributes: Evaluation Mode, Contains PII (i.e. skip indexing user responses in druid), visibility
Interaction types: Single select, Multi select, Short answer, Long answer, & Non-interactive Reference
QuML mimetype
Question Set Object Type:
Attributes: Trackable, Date based release criteria, Instructions, Summary type, Contains PII, Visibility, Shuffle, Show feedback, Timer, Number of attempts, Navigation mode, Completion criteria, Requires submit,
Nested Question Sets, Publish workflow
Linking Credentials (based on completion & score)
Add question sets to Collection with release criteria (start & end dates) for Question sets within the collection
Support for QuML questions only
Credentials:
Issue credentials
Depositing the credential in cert-registry & user-registry**
Fetch credentials
Data migration of existing QuML Questions & Question sets
Consumption MVP
Ability to discover various categories of Question sets on all consumption channels
Ability to play questions and question sets
Support configurations in the question set, such as trackable, start & end date, requires submit, summary display, capture PII
Enable playing of question sets as part of collection
Allow access to assessment as per dates configured
Ability to view credential received for a question set
Daily metric dashboard for admins
Completion report download for admins (on-demand)
Creation MVP
Ability to create Survey, Test, and Assessment on DIKSHA
Ability to create question set containing questions of various type, such as MCQ, MMCQ / MSQ, FTB, and Long FTB
Ability to search and reuse questions
Ability to add instructions and information to question set
Ability to configure question sets before publishing
Ability to link credentials to question set - independently and in context to a collection
Ability to review question sets on DIKSHA
Add question sets to collection
Specify start & end date for assessments within a collection
Note:
Interactive ECML content containing questions will continue to play as-is
Questions created in interactive ECML editor cannot be reused for Survey, Test, and Assessment
Data reports MVP
Daily usage metrics for all question sets: Plays, Completions, Location based aggregates,
Completion report (only for trackable question sets). Dimensions: location, collection id and within a time range.
User report: For a question set, question level score for each user.
Question report: To understand performance of all participants for a question. For a question set, compute
Total & Avg Time Spent, Total Attempts, Total Correct / Incorrect / Skipped Attempts for each question.
Data exhaust for questions without evaluation & questions containing PII
Enable admin to view and download report on DIKSHA
We currently have..
Collection (Course) score report: Collection containing content of type (CourseAssess) - based on a flag - it generates report
Each user in a batch, for a content → score (best of attempts, explicit submit)
Quiz daily metrics
Total sessions, devices, time spent
Participant info, at least a question answered
Quiz Winner reports
https://docs.google.com/document/d/1NAT7ReireW6BWWW252MDulqAfHhswuKkLn5sZpPt-Ww/edit
All quiz (object_id) events - viewed on mobile / portal, play, edit
Played
Participant info
Questions
Valid attempts - no of q / time
Dedup for did, take last / first attempt
Summary exhaust
Data dump exhaust (telemetry exhaust)
PII data sharing →
Rest of the data exhaust →
ETB
LO reports
IRT
Learner proficiency (session or device)
Survey (Manage)
Criteria based report
Session based report
Question and Question Set capabilities mapped to different use-cases
Capability | Survey | Test | Assessment |
Question types | MCQ, MSQ, FTB (S/L), DD | MCQ, MSQ, FTB (S/L) | MCQ, MSQ, FTB (S/L) |
Shuffle | No | Yes/No | No |
Feedback | No | Yes | No |
Evaluation & Scoring | No | Yes | Yes |
Start & End date | No | No | Yes |
Attempts | Unlimited | Unlimited | Controlled |
Contain PII | Yes, likely to | No | No |
Explicit Submit | No | No | Yes |
Summary | Duration & No of Qs | Detailed | Score & Duration |
Trackable | Yes/No | Yes/No | Yes |
Credentials | No | Yes/No | Yes |
Completion criteria | Optional | Optional | Mandatory |
Reports | Participant’s responses | Question level report | Question & User level report |
Visibility |
|
|
|
Practice Resource Creation, Consumption, Data, and Manage Workflows
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
As a user, given I have found any of the question set content, when I open / play the content, then I should be able to play it with the relevant consumption behaviour appropriate for that content. For example, when I play a quiz, then the quiz plays with a timer (if provided by creator).
Question set player should be able to play question set
smooth and fast
containing terms & condition, questions and information
configured to show feedback, shuffle questions, and show x/y questions
that capture user info (PII)
with mandatory and optional questions
that require explicit submit
that display different types of summary as configured by creator
that support different evaluation modes (system, none)
generate relevant telemetry
and allow playing the next / previous content in the collection from the end page
0 Comments