(Energised) Question Bank primarily deals with Question and Question Set objects to enable a variety of use-cases centred around different types of questions & question sets. Know more about Question & Question set here: Question Definition and Question Set Definition
This would cater to a variety of use-cases, such as
...
Use Case
...
Use Case Type
...
Persona
...
Mode of consumption
...
Quick summary of the Use Case
...
Practice
...
Learn
...
Learner, Instructor, Administrator
...
ETB, Independent
...
Practicing and learning for myself (ETB Practice)
As a student, I want to practice and learn by practicing for the chapters in my textbook
...
Practice worksheets linked to curriculum ETBs for students and teachers
...
Instructor
...
Course
...
Practice during a course (Course Worksheet)
As a teacher, I want to practice topics covered in the training
...
Help Learn
...
Instructor
...
Independent, ETB (Offline)
...
Conducting practice offline (Teaching material)
As a teacher, I want to provide practice to students for a chapters in the textbook
...
Test
...
Learn
...
Learner, Instructor, Administrator
...
Practice for an examination-style test (Mock Test)
As a student, I want to practice for an examination (Chapter by chapter & Mock test for a subject)
...
Learner, Instructor, Administrator
...
Offline Mock Test (Printed)
As a student, I want to practice for an examination as if I was writing it in an actual exam
...
Help Learn
...
Administering test offline
As a teacher, I want to conduct practice for an examination with my students
...
Official test for a textbook (non proctored, actual test)
As a teacher, I want to conduct an assessment to understand how well students have grasped it
...
Official test for a training (End of course assessment)
As a teacher, I want to conduct an assessment to understand how well trainees have mastered a topic
...
Quiz
...
Learn
...
Fun quiz anytime anywhere anyone
As a learner, I want to play a fun quiz on my favourite topic or on a topic I am very curious about
...
Quiz competition to win a challenge
I want to participate in a quiz to stand a chance to win and compete against others
...
Survey
...
Survey
Survey before & after a course training. Share your information, or information about something or your experience, feedback.
Transactional data capture. Registration form.
MVP of EQB Platform & Solution
MVP would focus on enabling Survey, Test, Assessment, Quiz, and Practice capabilities for conducting Pre & Post Training Survey, Pre-Test for a Training, Baseline and End-line Survey & Assessment for Training, Self-Reflection Survey, and more..(Energised) Question Bank primarily deals with Question and Question Set objects to enable a variety of use-cases centred around different types of questions & question sets. Know more about Question & Question set here: Question Definition and Question Set Definition
This would cater to a variety of use-cases, such as
Use Case | Use Case Type | Persona | Mode of consumption | Quick summary of the Use Case | |
|---|---|---|---|---|---|
Practice | Learn | Learner, Instructor, Administrator | ETB, Independent | Practicing and learning for myself (ETB Practice) | Practice worksheets linked to curriculum ETBs for students and teachers |
Instructor | Course | Practice during a course (Course Worksheet) | |||
Help Learn | Instructor | Independent, ETB (Offline) | Conducting practice offline (Teaching material) | ||
Test | Learn | Learner, Instructor, Administrator | Practice for an examination-style test (Mock Test) | ||
Learner, Instructor, Administrator | Offline Mock Test (Printed) | ||||
Help Learn | Administering test offline | ||||
Official test for a textbook (non proctored, actual test) | |||||
Official test for a training (End of course assessment) | |||||
Quiz | Learn | Fun quiz anytime anywhere anyone | |||
Quiz competition to win a challenge | |||||
Survey | Survey |
MVP of EQB Platform & Solution
MVP would focus on enabling Survey, Test, Assessment, Quiz, and Practice capabilities for conducting Pre & Post Training Survey, Pre-Test for a Training, Baseline and End-line Survey & Assessment for Training, Self-Reflection Survey, and more..
...
Platform MVP
Categories for Questions & Question Sets
Question Object Type:
Attributes: Evaluation Mode, Contains PII (i.e. skip indexing user responses in druid), visibility
Interaction types: Single select, Multi select, Short answer, Long answer, & Non-interactive Reference
QuML mimetype
Question Set Object Type:
Attributes: Trackable, Date based release criteria, Instructions, Summary type, Contains PII, Visibility, Shuffle, Show feedback, Timer, Number of attempts, Navigation mode, Completion criteria, Requires submit,
Nested Question Sets, Publish workflow
Linking Credentials (based on completion & score)
Add question sets to Collection with release criteria (start & end dates) for Question sets within the collection
Support for QuML questions only
Credentials:
Issue credentials
Depositing the credential in cert-registry & user-registry**
Fetch credentials
Data migration of existing QuML Questions & Question sets
Consumption MVP
Ability to discover various categories of Question sets on all consumption channels
Ability to play questions and question sets
Support configurations in the question set, such as trackable, start & end date, requires submit, summary display, capture PII
Enable playing of question sets as part of collection
Allow access to assessment as per dates configured
Ability to view credential received for a question set
Daily metric dashboard for admins
Completion report download for admins (on-demand)
Creation MVP
Ability to create Survey, Test, and Assessment on DIKSHA
Ability to create question set containing questions of various type, such as MCQ, MMCQ / MSQ, FTB, and Long FTB
Ability to search and reuse questions
Ability to add instructions and information to question set
Ability to configure question sets before publishing
Ability to link credentials to question set - independently and in context to a collection
Ability to review question sets on DIKSHA
Add question sets to collection
Specify start & end date for assessments within a collection
Note:
Interactive ECML content containing questions will continue to play as-is
Questions created in interactive ECML editor cannot be reused for Survey, Test, and Assessment
Data reports MVP
Daily usage metrics for all question sets: Plays, Completions, Location based aggregates,
Completion report (only for trackable question sets). Dimensions: location, collection id and within a time range.
User report: For a question set, question level score for each user.
Question report: To understand performance of all participants for a question. For a question set, compute
Total & Avg Time Spent, Total Attempts, Total Correct / Incorrect / Skipped Attempts for each question.
Data exhaust for questions without evaluation & questions containing PII
Enable admin to view and download report on DIKSHA
We currently have..
Collection (Course) score report: Collection containing content of type (CourseAssess) - based on a flag - it generates report
Each user in a batch, for a content → score (best of attempts, explicit submit)
Quiz daily metrics
Total sessions, devices, time spent
Participant info, at least a question answered
Quiz Winner reports
https://docs.google.com/document/d/1NAT7ReireW6BWWW252MDulqAfHhswuKkLn5sZpPt-Ww/edit
All quiz (object_id) events - viewed on mobile / portal, play, edit
Played
Participant info
Questions
Valid attempts - no of q / time
Dedup for did, take last / first attempt
Summary exhaust
Data dump exhaust (telemetry exhaust)
PII data sharing →
Rest of the data exhaust →
ETB
LO reports
IRT
Learner proficiency (session or device)
Survey (Manage)
Criteria based report
Session based report
Question and Question Set capabilities mapped to different use-cases
Capability | Survey | Test | Assessment |
Question types | MCQ, MSQ, FTB (S/L), DD | MCQ, MSQ, FTB (S/L) | MCQ, MSQ, FTB (S/L) |
Shuffle | No | Yes/No | No |
Feedback | No | Yes | No |
Evaluation & Scoring | No | Yes | Yes |
Start & End date | No | No | Yes |
Attempts | Unlimited | Unlimited | Controlled |
Contain PII | Yes, likely to | No | No |
Explicit Submit | No | No | Yes |
Summary | Duration & No of Qs | Detailed | Score & Duration |
Trackable | Yes/No | Yes/No | Yes |
Credentials | No | Yes/No | Yes |
Completion criteria | Optional | Optional | Mandatory |
Reports | Participant’s responses | Question level report | Question & User level report |
Visibility |
|
|
|
...
Practice Resource Creation, Consumption, Data, and Manage Workflows
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
https://project-sunbird.atlassian.net/browse/SB-20204
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
As a user, given I have found any of the question set content, when I open / play the content, then I should be able to play it with the relevant consumption behaviour appropriate for that content. For example, when I play a quiz, then the quiz plays with a timer (if provided by creator).
Question set player should be able to play question set
smooth and fast
containing terms & condition, questions and information
configured to show feedback, shuffle questions, and show x/y questions
that capture user info (PII)
with mandatory and optional questions
that require explicit submit
that display different types of summary as configured by creator
that support different evaluation modes (system, none)
generate relevant telemetry
and allow playing the next / previous content in the collection from the end page
As a creator, I want to create Survey, Test, Assessment, Quiz, and Practice resource
https://project-sunbird.atlassian.net/browse/SB-20209
As a creator,
→ I want to create a question set to provide practice content for the chapter or topic
→ When I open a textbook in a sourcing project, I should be able to contribute Practice Resource
→ When I am creating a Practice Resource, I should be able to:
Create multiple choice questions
Create fill in the blank questions
Create reference questions (VSA, SA, LA or 2 mark, 4 mark, etc)
Copy (duplicate) a question with all its attributes
Provide details for the question such as: Learning Outcome, Learning Level,
→ When I am creating a question set, I should be able to
Save Question Set
Submit Question Set
Preview Question Set (from beginning)
Add Instruction or Information about the Practice Resource
View review comments (for the question set and for any of the questions)
→ When creating any question, I should be able to
Select question type / template
Preview question
Save question (same as Save Question Set)
View review comment
→ When creating MCQ, I should be able to
Select layout of MCQ (out of 4 available layouts)
Change layout anytime
→ When I am done creating questions, I should be able to configure following for the question set
Shuffle On / Off (default Off)
Show how many questions out of total questions created (default - show all)
Show / Hide Feedback (default Show)
Weightage for each question in the question set (default equal weightage of 1 mark each)
Should we disable shuffle when weightage is provided?
Provide details for the Question Set such as:
Name
Author
Attributions
Question set would inherit / derive these values from the textbook:
Board, Medium, Class, Subject,
Topic (optional)
License
Question set would inherit / derive these values from the category configuration:
Category (Practice Resource)
Audience (“Student”, editable)
Icon
→ When I am configuring Question Set, I should be able to preview it with configured behaviour
Support configurations in the question set such as
https://project-sunbird.atlassian.net/browse/SB-20205
Trackable: requires login for the question set when played individually
Credentials: issue certificate as configured in the question set (individually or as part of a collection)
Start & end date: for the question set as configured by creator either individually or as part of a collection
As part of a collection, it inherits these attributes from collection
As a creator, I want to create Multiple Choice Questions (MCQ & MSQ) for a Question Set
https://project-sunbird.atlassian.net/browse/SB-
...
Platform MVP
Categories for Questions & Question Sets
Question Object Type:
Attributes: Evaluation Mode, Contains PII (i.e. skip indexing user responses in druid), visibility
Interaction types: Single select, Multi select, Short answer, Long answer, & Non-interactive Reference
QuML mimetype
Question Set Object Type:
Attributes: Trackable, Date based release criteria, Instructions, Summary type, Contains PII, Visibility, Shuffle, Show feedback, Timer, Number of attempts, Navigation mode, Completion criteria, Requires submit,
Nested Question Sets, Publish workflow
Linking Credentials (based on completion & score)
Add question sets to Collection with release criteria (start & end dates) for Question sets within the collection
Support for QuML questions only
Credentials:
Issue credentials
Depositing the credential in cert-registry & user-registry**
Fetch credentials
Data migration of existing QuML Questions & Question sets
Consumption MVP
Ability to discover various categories of Question sets on all consumption channels
Ability to play questions and question sets
Support configurations in the question set, such as trackable, start & end date, requires submit, summary display, capture PII
Enable playing of question sets as part of collection
Allow access to assessment as per dates configured
Ability to view credential received for a question set
Daily metric dashboard for admins
Completion report download for admins (on-demand)
Creation MVP
Ability to create Survey, Test, and Assessment on DIKSHA
Ability to create question set containing questions of various type, such as MCQ, MMCQ / MSQ, FTB, and Long FTB
Ability to search and reuse questions
Ability to add instructions and information to question set
Ability to configure question sets before publishing
Ability to link credentials to question set - independently and in context to a collection
Ability to review question sets on DIKSHA
Add question sets to collection
Specify start & end date for assessments within a collection
Note:
Interactive ECML content containing questions will continue to play as-is
Questions created in interactive ECML editor cannot be reused for Survey, Test, and Assessment
Data reports MVP
Daily usage metrics for all question sets: Plays, Completions, Location based aggregates,
Completion report (only for trackable question sets). Dimensions: location, collection id and within a time range.
User report: For a question set, question level score for each user.
Question report: To understand performance of all participants for a question. For a question set, compute
Total & Avg Time Spent, Total Attempts, Total Correct / Incorrect / Skipped Attempts for each question.
Data exhaust for questions without evaluation & questions containing PII
Enable admin to view and download report on DIKSHA
We currently have..
Collection (Course) score report: Collection containing content of type (CourseAssess) - based on a flag - it generates report
Each user in a batch, for a content → score (best of attempts, explicit submit)
Quiz daily metrics
Total sessions, devices, time spent
Participant info, at least a question answered
Quiz Winner reports
https://docs.google.com/document/d/1NAT7ReireW6BWWW252MDulqAfHhswuKkLn5sZpPt-Ww/edit
All quiz (object_id) events - viewed on mobile / portal, play, edit
Played
Participant info
Questions
Valid attempts - no of q / time
Dedup for did, take last / first attempt
Summary exhaust
Data dump exhaust (telemetry exhaust)
PII data sharing →
Rest of the data exhaust →
ETB
LO reports
IRT
Learner proficiency (session or device)
Survey (Manage)
Criteria based report
Session based report
Question and Question Set capabilities mapped to different use-cases
Capability | Survey | Test | Assessment |
Question types | MCQ, MSQ, FTB (S/L), DD | MCQ, MSQ, FTB (S/L) | MCQ, MSQ, FTB (S/L) |
Shuffle | No | Yes/No | No |
Feedback | No | Yes | No |
Evaluation & Scoring | No | Yes | Yes |
Start & End date | No | No | Yes |
Attempts | Unlimited | Unlimited | Controlled |
Contain PII | Yes, likely to | No | No |
Explicit Submit | No | No | Yes |
Summary | Duration & No of Qs | Detailed | Score & Duration |
Trackable | Yes/No | Yes/No | Yes |
Credentials | No | Yes/No | Yes |
Completion criteria | Optional | Optional | Mandatory |
Reports | Participant’s responses | Question level report | Question & User level report |
Visibility |
|
|
|
Practice Resource Creation, Consumption, Data, and Manage Workflows
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
https://project-sunbird.atlassian.net/browse/SB-20204
As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)
As a user, given I have found any of the question set content, when I open / play the content, then I should be able to play it with the relevant consumption behaviour appropriate for that content. For example, when I play a quiz, then the quiz plays with a timer (if provided by creator).
Question set player should be able to play question set
smooth and fast
containing terms & condition, questions and information
configured to show feedback, shuffle questions, and show x/y questions
that capture user info (PII)
with mandatory and optional questions
that require explicit submit
that display different types of summary as configured by creator
that support different evaluation modes (system, none)
generate relevant telemetry
and allow playing the next / previous content in the collection from the end page
As a creator, I want to create Survey, Test, Assessment, Quiz, and Practice resource
https://project-sunbird.atlassian.net/browse/SB-20209
As a creator,
→ I want to create a question set to provide practice content for the chapter or topic
→ When I open a textbook in a sourcing project, I should be able to contribute Practice Resource
→ When I am creating a Practice Resource, I should be able to:
Create multiple choice questions
Create fill in the blank questions
Create reference questions (VSA, SA, LA or 2 mark, 4 mark, etc)
Copy (duplicate) a question with all its attributes
Provide details for the question such as: Learning Outcome, Learning Level,
→ When I am creating a question set, I should be able to
Save Question Set
Submit Question Set
Preview Question Set (from beginning)
Add Instruction or Information about the Practice Resource
View review comments (for the question set and for any of the questions)
→ When creating any question, I should be able to
Select question type / template
Preview question
Save question (same as Save Question Set)
View review comment
→ When creating MCQ, I should be able to
Select layout of MCQ (out of 4 available layouts)
Change layout anytime
→ When I am done creating questions, I should be able to configure following for the question set
Shuffle On / Off (default Off)
Show how many questions out of total questions created (default - show all)
Show / Hide Feedback (default Show)
Weightage for each question in the question set (default equal weightage of 1 mark each)
Should we disable shuffle when weightage is provided?
Provide details for the Question Set such as:
Name
Author
Attributions
Question set would inherit / derive these values from the textbook:
Board, Medium, Class, Subject,
Topic (optional)
License
Question set would inherit / derive these values from the category configuration:
Category (Practice Resource)
Audience (“Student”, editable)
Icon
→ When I am configuring Question Set, I should be able to preview it with configured behaviour
Support configurations in the question set such as
https://project-sunbird.atlassian.net/browse/SB-20205
Trackable: requires login for the question set when played individually
Credentials: issue certificate as configured in the question set (individually or as part of a collection)
Start & end date: for the question set as configured by creator either individually or as part of a collection
As part of a collection, it inherits these attributes from collection
As a creator, I want to create Multiple Choice Questions (MCQ & MSQ) for a Question Set
https://project-sunbird.atlassian.net/browse/SB-20210
As a creator, I want to create Multiple Choice Questions for a Question Set
MCQ with single or multiple correct answers (partial scoring)
Supported configurations (for the question)
As a teacher, I want to create Multiple Choice Questions with one or more correct answers to provide practice questions aligned with textbook chapters to students.
As a creator,
→ When I am creating a (Practice) Question Set
I select what to add to the question set - Instructions, MCQ, FTB, Reference questions
If there are more than one template / layout options, they are all shown upfront grouped by type of block (question type)
User can change the layout within a question type at any time (e.g. changing from MCQ to FTB should be restricted)
I can navigate to any block in the question set using the table of content (on left)
I can re-arrange blocks in the ToC
New blocks such as 'Section' can be possible in future. Each Section would have Instruction and Settings.
I can copy-paste from other sources such as MS Word, PowerPoint, Internet, Google Docs, etc
Any supported characters or piece of pasted information should be pasted as image if possible or else stripped off so that question does not contain any invalid data
A relevant toast message should be shown to the creator to check preview before saving
I can change layout for MCQs or other question types at any time
I can preview in portrait and landscape orientation (or in other words computer and phone mode)
I can mark one or many options correct
When I have marked more than one option correct, the scoring mode is set to ‘Partial’ scoring. So I will get marks for any of the correct options I select
I can select to award marks only when ALL correct options are selected. Partial scoring mode is disabled.
I can add Solution for each question
Solution can be a video or a note / paragraph (text with images)
I can add Hint(s) for each question
Hints can be configured to be available upfront or after first.. nth attempt
I see various layout templates to choose from. We decided to keep only two layouts - MCQ, Multimedia MCQ,
Layout templates:
With question and options in vertical scroll single-column layout.
Question text can be of any length (say, max 1000)
Limit text font size from 14 to 48
Text can be styled as Bold, Italics, Superscript, Subscript
Text can be aligned left, centre, right or justified
Language of the text can be selected from supported Indian languages
Text can contain bulleted or numbered list with only first level of indent (not multi-level)
Question text (body) can contain a table
with upto 10 x 10 cells
Header column and row
and more features as supported by the editor library being used
Question text (body) can contain formulae, equations, and expression (Math & Scientific text)
Support most frequently used equations
Support special characters & symbols
Support Equations formats
Support advanced equation or expression
Question image can be small (25%) / medium (50%) / large (100%). Image can be added anywhere in the question body
Options can be
Large (100%): list (vertically stacked),
Small (25%): horizontal (cards), [Should the user choose number of columns or is it always 4?]
Medium (50%): grid layout [This would divide the option area into two columns]
Options may contain images
Option images can be small / medium / large if using Large options (list vertically stacked)
Option images are small in case of Small options (horizontal small size).
Option images can be small / medium in case of Medium options (grid layout)
Notes:
We will not provide more than 2 MCQ layout options
We are not providing two column (side-by-side) question layout as that would involve multiple scroll interactions on the screen which could confuse the user.
As a creator, I want to create Fill in The Blank (short & long) for a Question Set
https://project-sunbird.atlassian.net/browse/SB-20211
Short & Long FTB
With or Without Word / Character Limit
With input validation
As a creator, I want to create Single or Multi-select dropdown questions
https://project-sunbird.atlassian.net/browse/SB-20212
Max limit of options
"Other" option
As a creator, I want to add information or instructions to a question set
https://project-sunbird.atlassian.net/browse/SB-20214
Instruction title
Instruction (rich text with images)20210
As a creator, I want to create Multiple Choice Questions for a Question Set
MCQ with single or multiple correct answers (partial scoring)
Supported configurations (for the question)
As a teacher, I want to create Multiple Choice Questions with one or more correct answers to provide practice questions aligned with textbook chapters to students.
As a creator,
→ When I am creating a (Practice) Question Set
I select what to add to the question set - Instructions, MCQ, FTB, Reference questions
If there are more than one template / layout options, they are all shown upfront grouped by type of block (question type)
User can change the layout within a question type at any time (e.g. changing from MCQ to FTB should be restricted)
I can navigate to any block in the question set using the table of content (on left)
I can re-arrange blocks in the ToC
New blocks such as 'Section' can be possible in future. Each Section would have Instruction and Settings.
I can copy-paste from other sources such as MS Word, PowerPoint, Internet, Google Docs, etc
Any supported characters or piece of pasted information should be pasted as image if possible or else stripped off so that question does not contain any invalid data
A relevant toast message should be shown to the creator to check preview before saving
I can change layout for MCQs or other question types at any time
I can preview in portrait and landscape orientation (or in other words computer and phone mode)
I can mark one or many options correct
When I have marked more than one option correct, the scoring mode is set to ‘Partial’ scoring. So I will get marks for any of the correct options I select
I can select to award marks only when ALL correct options are selected. Partial scoring mode is disabled.
I can add Solution for each question
Solution can be a video or a note / paragraph (text with images)
I can add Hint(s) for each question
Hints can be configured to be available upfront or after first.. nth attempt
I see various layout templates to choose from. We decided to keep only two layouts - MCQ, Multimedia MCQ,
Layout templates:
With question and options in vertical scroll single-column layout.
Question text can be of any length (say, max 1000)
Limit text font size from 14 to 48
Text can be styled as Bold, Italics, Superscript, Subscript
Text can be aligned left, centre, right or justified
Language of the text can be selected from supported Indian languages
Text can contain bulleted or numbered list with only first level of indent (not multi-level)
Question text (body) can contain a table
with upto 10 x 10 cells
Header column and row
and more features as supported by the editor library being used
Question text (body) can contain formulae, equations, and expression (Math & Scientific text)
Support most frequently used equations
Support special characters & symbols
Support Equations formats
Support advanced equation or expression
Question image can be small (25%) / medium (50%) / large (100%). Image can be added anywhere in the question body
Options can be
Large (100%): list (vertically stacked),
Small (25%): horizontal (cards), [Should the user choose number of columns or is it always 4?]
Medium (50%): grid layout [This would divide the option area into two columns]
Options may contain images
Option images can be small / medium / large if using Large options (list vertically stacked)
Option images are small in case of Small options (horizontal small size).
Option images can be small / medium in case of Medium options (grid layout)
Notes:
We will not provide more than 2 MCQ layout options
We are not providing two column (side-by-side) question layout as that would involve multiple scroll interactions on the screen which could confuse the user.
As a creator, I want to create Fill in The Blank (short & long) for a Question Set
https://project-sunbird.atlassian.net/browse/SB-20211
Short & Long FTB
With or Without Word / Character Limit
With input validation
As a creator, I want to create Single or Multi-select dropdown questions
https://project-sunbird.atlassian.net/browse/SB-20212
Max limit of options
"Other" option
As a creator, I want to add information or instructions to a question set
https://project-sunbird.atlassian.net/browse/SB-20214
Instruction title
Instruction (rich text with images)
...
Creator selects ‘Create New’
Creator select appropriate category from ‘Create New’ list of categories
On selecting ‘Practice Resource’, default configuration for Practice Resource category will be applied to ease creation process
Shuffle: Off, editable
Number of questions to show: All, editable
Weightage: Equal (1 Mark), editable. If weightage is applied, Number of questions should be ‘All’. Should we display marks to players in case of weighted question sets?
Max marks: Total marks, view-only
Name of the question set is required, will be blank by default. User can enter any alpha-numeric character in all supported languages. Special characters are not allowed except for “?”, “-”, …
Creator can add
Instruction / Introduction / Information
Multiple Choice Question
Fill In the Blank
Reference Question
Questions or Information block are created as draft.
Visibility for Questions (of any type) is set as public
Information / Instruction / Introduction / Section block is set to ‘parent’ visibility
All changes are auto-saved. User can Undo / Redo changes (upto 10?)
Live or quick preview available for each question to verify the look & feel of the question
Creator can
Reorder questions or blocks within a question set
Copy or duplicate a question or information block
Delete questions from a question set. (In future, when we enable question reuse, user can remove question added from library)
Preview question
Change layout for MCQ options during preview
Change image size for Question or (all) Options during preview
Navigate questions (by scrolling or by selecting from question list on the left pane)
Preview Question set
Configure question set behaviour
Submit Question Set
View Review comments at Question or Question Set level
Pagination
Creator can group questions to be shown on a particular page. A page scrolls vertically. Page looks best in portrait mode. Should we have default orientation of question set?
Can be used to show more than one question on a page. Default - one question at a time.
Section
This works more as a header to demarcate parts in a question set - similar to Information block with only Title?
This works best in portrait mode, vertical scrolling mode
Question set layout and navigation
All question on a page - Portrait mode, Vertical scroll. Can be in landscape mode as well.
One question at a time - Previous / Next buttons to navigate (or Question map / Progress bar). Can be in portrait or landscape mode.
Information block can
be called as ‘Introduction’ or ‘Instruction’ or ‘Section’ or anything else creator wishes to name it as. Default name will be “Introduction”.
This is not to be confused with ‘Description’. We are not using Description.
have audio attached with it
Any block - Information or Question can have audio attached to it
Any question can have
Audio for the question. Audio can be set to autoplay.
Marks. Default: 1. Creator can provide different marks to indicate weightage of the questions
Solution
Solution can be rich text (with images) or audio. In future, Videos could be added to Rich text.
Solution is always available after attempting a scored question or on-demand in case of non-scored questions
Hints
Hints at question level after an incorrect attempt or on-demand
Multiple hints with configurable access (always available on-demand, or on Nth incorrect attempt)
Hints can be plain text upto 160 characters
Tips
Tips help a user in understanding question or option further. Specially in responding to a survey
These appear inline - not on-demand
Can we merge tips and hints? Have a custom experience depending on the category of use-case?
Question Set information. Each question set could be tagged with
Name
Board, Medium, Class, Subject (derived from collection / context if possible)
Topic(s)
Author
Credits / Attributions
License
Description? Thumbnail Icon?
Max Time / Time Limit
Total Questions
Total Marks
Certificate
Certificate based criteria such as completion or questions attempted or score obtained.
Registration upfront might not be required. It could be ‘Login to unlock your certificate’ as a post-facto prompt
Question information. Each question should / could be tagged with
Board, Medium, Class, Subject (derived from question set / context if possible)
Learning Outcome
Multiple Choice Question
[Provide the minimal simple MCQ creation experience. Make it easy to create visually appealing questions.]
What if we keep MCQ creation UX as-is and only change the QuML + Question Set API integration?Question is a rich-text block which supports images, equations & formulae, formatting, styling,
Font style: Bold, Italics, Superscript, Subscript
Font size: 12 to 48 (configurable range)
Font family: List of language specific fonts for supported Indian languages
Math & Scientific text: as-is
Add Image: Upload, Search All Images, My Images
Bulleted & Numbered list
Font & Font Background Colour
Text Alignment (Left, Centre, Right, Justify)
Insert Table
Special Character
Undo, Redo
Disable these: To-do list, Indent +/-, Block quote, Add Video, Format as Heading, Link, Page Break
Math and Scientific text
Gets inserted wherever user’s cursor is
Should be able to continue typing text before or after the inserted LaTeX / KaTeX block
Line height will need to managed when this block is inserted
User can delete this using backspace or delete button
Selecting the block and pressing enter will place the cursor after the block. Pressing enter again will create new line
Images
Images can be aligned Left, Centre, Right
Image size can be Small, Medium, Large
Options can
Layout as horizontal ↔ (◾◾◾◾┉ ), vertical ↕ (↕) , and grid (⠛). Change layout during preview.
Image size (applicable to all options)
be minimum 2 and maximum 8 or 10
have same capabilities as question body
Options can change creation layout based on option layout selected (visual arrangement similar to player view)
Options need to be marked as correct. At least one. How would the player know that multiple correct options are possible? Should we show check-boxes in player?
Evaluation logic
ANY of the correct answer (Partial scoring)
ALL of the correct answer (Non-partial scoring)
Preset layouts
Simple MCQ (Text, Vertical options), Multimedia MCQ (Grid options, With images)
Placeholder image put inside options to guide creator. On clicking placeholder image, Add Image from Library opens up.
Change preset anytime during creation or during preview
Fill In the Blanks
Type a sentence, select a word or phrase, and make it a blank
Can have multiple blanks
Each blank can have more than one correct response. __ is the Silicon Valley of India. (Bengaluru, Bangalore)
Multiple blanks can be (read more Fill in The Blank - Multiples and Variations - Nov, 2018 )
Sequential. Independent. Complete the prime number sequence 3, 5, _, 11, _, 17
Unordered list of answers, unique
One group, variations, unique
Multiple groups, variations, unique
Linked responses with 2 or more blanks
Evaluation logic
Ignore blanks
Case insensitive
Ignore special characters?
Printable by downloading as PDF
FTB are printed with empty blanks - numbered to map to answers
Answers are printed with sequence numbers
Copy-pasting from MS Word, Excel, PowerPoint or anywhere on internet
Allow text with styling format
Paste equations as (embedded) images
Paste image as embedded. Do not use local file storage path for image
Paste table as HTML
…
...
Question Set -
ECML → QuML
Content generalisation: Object type, Category,
Feature parity Configurations: Shuffle, Show Feedback, Weightage, MaxQuestions
New Configurations: Timer (Quiz), Summary (Course Assessment),
New attributes: Visibility, .. (can be derived from category, or from Form API / editor config)
Integration of Question set player (QuML) for preview - player mode
Question -
MCQ -
MCQ creation as-is (no change)
MCQ Creation minimal changes
Introduce new layouts: Options - V, H, G | Select option layout: V, H, G
Question body contains image: S (default), M, L. Align left (default), centre, right.
Image should not pixelate. Large should not extend the image - it should show original image size.
Option contains image: Preset image size & alignment
V - Small, left
H - Large, centre
G - Medium, left
Change layout during editing and preview
Zooming of images - on player
Creation UX - Switch between edit and preview - more intuitive
Separation of Question level metadata & Question Set level metadata
Q level - LO, Marks (Weightage)
Lifecycle -
Visibility - derive from parent