(Energised) Question Bank primarily deals with Question and Question Set objects to enable a variety of use-cases centred around different types of questions & question sets. Know more about Question & Question set here: Question Definition and Question Set Definition

This would cater to a variety of use-cases, such as

MVP of EQB Platform & Solution

MVP would focus on enabling Survey, Test, Assessment, Quiz, and Practice capabilities for conducting Pre & Post Training Survey, Pre-Test for a Training, Baseline and End-line Survey & Assessment for Training, Self-Reflection Survey, and more..

Platform MVP

Categories for Questions & Question Sets

Question Object Type:

• Attributes: Evaluation Mode, Contains PII (i.e. skip indexing user responses in druid), visibility

• Interaction types: Single select, Multi select, Short answer, Long answer, & Non-interactive Reference

• QuML mimetype 

Question Set Object Type:

• Attributes: Trackable, Date based release criteria, Instructions, Summary type, Contains PII, Visibility, Shuffle, Show feedback, Timer, Number of attempts, Navigation mode, Completion criteria, Requires submit, 

• Nested Question Sets, Publish workflow

• Linking Credentials (based on completion & score)

• Add question sets to Collection with release criteria (start & end dates) for Question sets within the collection

• Support for QuML questions only

Credentials:

• Issue credentials

• Depositing the credential in cert-registry & user-registry**

• Fetch credentials

Data migration of existing QuML Questions & Question sets

Consumption MVP

• Ability to discover various categories of Question sets on all consumption channels

• Ability to play questions and question sets

• Support configurations in the question set, such as trackable, start & end date, requires submit, summary display, capture PII

• Enable playing of question sets as part of collection

• Allow access to assessment as per dates configured

• Ability to view credential received for a question set

• Daily metric dashboard for admins

• Completion report download for admins (on-demand)

Creation MVP

• Ability to create Survey, Test, and Assessment on DIKSHA

• Ability to create question set containing questions of various type, such as MCQ, MMCQ / MSQ, FTB, and Long FTB

• Ability to search and reuse questions

• Ability to add instructions and information to question set

• Ability to configure question sets before publishing

• Ability to link credentials to question set - independently and in context to a collection

• Ability to review question sets on DIKSHA

• Add question sets to collection

• Specify start & end date for assessments within a collection

Note:

• Interactive ECML content containing questions will continue to play as-is

• Questions created in interactive ECML editor cannot be reused for Survey, Test, and Assessment

Data reports MVP

Daily usage metrics for all question sets: Plays, Completions, Location based aggregates, 

Completion report (only for trackable question sets). Dimensions: location, collection id and within a time range.

User report: For a question set, question level score for each user. 

Question report: To understand performance of all participants for a question. For a question set, compute 

Total & Avg Time Spent, Total Attempts, Total Correct / Incorrect / Skipped Attempts for each question.

Data exhaust for questions without evaluation & questions containing PII

Enable admin to view and download report on DIKSHA

We currently have..

• Collection (Course) score report: Collection containing content of type (CourseAssess) - based on a flag - it generates report

  • Each user in a batch, for a content → score (best of attempts, explicit submit)

• Quiz daily metrics

  • Total sessions, devices, time spent

  • Participant info, at least a question answered

• Quiz Winner reports

  • https://docs.google.com/document/d/1NAT7ReireW6BWWW252MDulqAfHhswuKkLn5sZpPt-Ww/edit

  • All quiz (object_id) events - viewed on mobile / portal, play, edit

    • Played

      • Participant info

        • Questions

          • Valid attempts - no of q / time

          • Dedup for did, take last / first attempt

• Summary exhaust

• Data dump exhaust (telemetry exhaust)

  • PII data sharing →

  • Rest of the data exhaust →

• ETB

  • LO reports

  • IRT

  • Learner proficiency (session or device)

• Survey (Manage)

  • Criteria based report

  • Session based report

Question and Question Set capabilities mapped to different use-cases

Practice Resource Creation, Consumption, Data, and Manage Workflows

As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)

https://project-sunbird.atlassian.net/browse/SB-20204

As a user, I should be able to play Survey, Practice Test / Test, Assessment / Exam, Practice Resource, Quiz and other Question Set categories on all consumption channels (app & portal)

As a user, given I have found any of the question set content, when I open / play the content, then I should be able to play it with the relevant consumption behaviour appropriate for that content. For example, when I play a quiz, then the quiz plays with a timer (if provided by creator).

Question set player should be able to play question set

• smooth and fast

• containing terms & condition, questions and information

• configured to show feedback, shuffle questions, and show x/y questions

• that capture user info (PII)

• with mandatory and optional questions

• that require explicit submit

• that display different types of summary as configured by creator

• that support different evaluation modes (system, none)

• generate relevant telemetry

• and allow playing the next / previous content in the collection from the end page

As a creator, I want to create Survey, Test, Assessment, Quiz, and Practice resource

https://project-sunbird.atlassian.net/browse/SB-20209

As a creator,

→ I want to create a question set to provide practice content for the chapter or topic

→ When I open a textbook in a sourcing project, I should be able to contribute Practice Resource

→ When I am creating a Practice Resource, I should be able to:

• Create multiple choice questions

• Create fill in the blank questions

• Create reference questions (VSA, SA, LA or 2 mark, 4 mark, etc)

• Copy (duplicate) a question with all its attributes

• Provide details for the question such as: Learning Outcome, Learning Level,

→ When I am creating a question set, I should be able to

• Save Question Set

• Submit Question Set

• Preview Question Set (from beginning)

• Add Instruction or Information about the Practice Resource

• View review comments (for the question set and for any of the questions)

→ When creating any question, I should be able to

• Select question type / template

• Preview question

• Save question (same as Save Question Set)

• View review comment

→ When creating MCQ, I should be able to

• Select layout of MCQ (out of 4 available layouts)

• Change layout anytime

→ When I am done creating questions, I should be able to configure following for the question set

• Shuffle On / Off (default Off)

• Show how many questions out of total questions created (default - show all)

• Show / Hide Feedback (default Show)

• Weightage for each question in the question set (default equal weightage of 1 mark each)

  • Should we disable shuffle when weightage is provided?

• Provide details for the Question Set such as:

  • Name

  • Author

  • Attributions

• Question set would inherit / derive these values from the textbook:

  • Board, Medium, Class, Subject,

  • Topic (optional)

  • License

• Question set would inherit / derive these values from the category configuration:

  • Category (Practice Resource)

  • Audience (“Student”, editable)

  • Icon

→ When I am configuring Question Set, I should be able to preview it with configured behaviour

As a creator, I want to create Multiple Choice Questions (MCQ & MSQ) for a Question Set

https://project-sunbird.atlassian.net/browse/SB-20210

As a creator, I want to create Multiple Choice Questions for a Question Set

MCQ with single or multiple correct answers (partial scoring)

Supported configurations (for the question)

As a teacher, I want to create Multiple Choice Questions with one or more correct answers to provide practice questions aligned with textbook chapters to students.

As a creator,

→ When I am creating a (Practice) Question Set

• I select what to add to the question set - Instructions, MCQ, FTB, Reference questions

  • If there are more than one template / layout options, they are all shown upfront grouped by type of block (question type)

  • User can change the layout within a question type at any time (e.g. changing from MCQ to FTB should be restricted)

• I can navigate to any block in the question set using the table of content (on left)

  • I can re-arrange blocks in the ToC

  • New blocks such as 'Section' can be possible in future. Each Section would have Instruction and Settings.

• I can copy-paste from other sources such as MS Word, PowerPoint, Internet, Google Docs, etc

  • Any supported characters or piece of pasted information should be pasted as image if possible or else stripped off so that question does not contain any invalid data

  • A relevant toast message should be shown to the creator to check preview before saving

• I can change layout for MCQs or other question types at any time

• I can preview in portrait and landscape orientation (or in other words computer and phone mode)

• I can mark one or many options correct

  • When I have marked more than one option correct, the scoring mode is set to ‘Partial’ scoring. So I will get marks for any of the correct options I select

  • I can select to award marks only when ALL correct options are selected. Partial scoring mode is disabled.

• I can add Solution for each question

  • Solution can be a video or a note / paragraph (text with images)

• I can add Hint(s) for each question

  • Hints can be configured to be available upfront or after first.. nth attempt

I see various layout templates to choose from. We decided to keep only two layouts - MCQ, Multimedia MCQ,

Layout templates:

1. With question and options in vertical scroll single-column layout.

   1. Question text can be of any length (say, max 1000)

      1. Limit text font size from 14 to 48

      2. Text can be styled as Bold, Italics, Superscript, Subscript

      3. Text can be aligned left, centre, right or justified

      4. Language of the text can be selected from supported Indian languages

      5. Text can contain bulleted or numbered list with only first level of indent (not multi-level)

   2. Question text (body) can contain a table

      1. with upto 10 x 10 cells

      2. Header column and row

      3. and more features as supported by the editor library being used

   3. Question text (body) can contain formulae, equations, and expression (Math & Scientific text)

      1. Support most frequently used equations

      2. Support special characters & symbols

      3. Support Equations formats

      4. Support advanced equation or expression

   4. Question image can be small (25%) / medium (50%) / large (100%). Image can be added anywhere in the question body

   5. Options can be

      1. Large (100%): list (vertically stacked),

      2. Small (25%): horizontal (cards), [Should the user choose number of columns or is it always 4?]

      3. Medium (50%): grid layout [This would divide the option area into two columns]

   6. Options may contain images

      1. Option images can be small / medium / large if using Large options (list vertically stacked)

      2. Option images are small in case of Small options (horizontal small size).

      3. Option images can be small / medium in case of Medium options (grid layout)

Notes:

• We will not provide more than 2 MCQ layout options

• We are not providing two column (side-by-side) question layout as that would involve multiple scroll interactions on the screen which could confuse the user.

As a creator, I want to create Fill in The Blank (short & long) for a Question Set

https://project-sunbird.atlassian.net/browse/SB-20211

Short & Long FTB
With or Without Word / Character Limit
With input validation

As a creator, I want to create Single or Multi-select dropdown questions

https://project-sunbird.atlassian.net/browse/SB-20212

Max limit of options
"Other" option

As a creator, I want to add information or instructions to a question set

https://project-sunbird.atlassian.net/browse/SB-20214

Instruction title
Instruction (rich text with images)