Versions Compared

Old Version 16

changes.mady.by.user Surendrasingh Sucharia

Saved on

compared with

New Version Current

changes.mady.by.user Surendrasingh Sucharia

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

(Energised) (Energised) Question Bank primarily deals with Question and Question Set objects to enable a variety of use-cases centred around different types of questions & question sets. Know more about Question & Question set here: Question Definition and Question Set Definition

...

  1. Creator selects ‘Create New’

  2. Creator select appropriate category from ‘Create New’ list of categories

  3. On selecting ‘Practice Resource’, default configuration for Practice Resource category will be applied to ease creation process

    1. Shuffle: Off, editable

    2. Number of questions to show: All, editable

    3. Weightage: Equal (1 Mark), editable. If weightage is applied, Number of questions should be ‘All’. Should we display marks to players in case of weighted question sets?

    4. Max marks: Total marks, view-only

  4. Other configurations supported for the question set

    1. Scoring mode

    2. Timer

    3. Start and End date

    4. Certificate

    5. Certificate criteria

    6. Requires login + measure progress & performance

    7. Requires explicit submit + measure performance

    8. Completion criteria

    9. Question numbering - Q1, Q1.1, Q1.1.1 OR Q1, Q1.a, Q1.a.i,

  5. Name of the question set is required, will be blank by default. User can enter any alpha-numeric character in all supported languages. Special characters are not allowed except for “?”, “-”, …

  6. Creator can add

    1. Instruction / Introduction / Information

    2. Multiple Choice Question

    3. Fill In the Blank

    4. Reference Question

    5. Dropdown Questions (Single or Multi-select)

    6. File upload Questions

  7. Questions or Information block are created as draft.

    1. Visibility for Questions (of any type) is set as public

    2. Information / Instruction / Introduction / Section block is set to ‘parent’ visibility

  8. All changes are auto-saved. User can Undo / Redo changes (upto 10?)

  9. Live or quick preview available for each question to verify the look & feel of the question

  10. Creator can

    1. Reorder questions or blocks within a question set

    2. Copy or duplicate a question or information block

    3. Delete questions from a question set. (In future, when we enable question reuse, user can remove question added from library)

    4. Preview question

      1. Change layout for MCQ options during preview

      2. Change image size for Question or (all) Options during preview

    5. Navigate questions (by scrolling or by selecting from question list on the left pane)

    6. Preview Question set

    7. Configure question set behaviour

    8. Submit Question Set

    9. View Review comments at Question or Question Set level

  11. Pagination

    1. Creator can group questions to be shown on a particular page. A page scrolls vertically. Page looks best in portrait mode. Should we have default orientation of question set?

    2. Can be used to show more than one question on a page. Default - one question at a time.

    3. Questions having multi-part might prefer to show on one page or multiple pages

  12. Section

    1. This works more as a header to demarcate parts in a question set - similar to Information block with only Title?

    2. This works best in portrait mode, vertical scrolling mode

    3. Does section work similar to a nested question set?

    4. Nested question sets have their own configuration - they inherit parent attributes as much as possible

  13. Question set layout and navigation

    1. All question on a page - Portrait mode, Vertical scroll. Can be in landscape mode as well.

    2. One question at a time - Previous / Next buttons to navigate (or Question map / Progress bar). Can be in portrait or landscape mode.

  14. Information block can

    1. be called as ‘Introduction’ or ‘Instruction’ or ‘Section’ or anything else creator wishes to name it as. Default name will be “Introduction”.

    2. This is not to be confused with ‘Description’. We are not using Description.

    3. have audio attached with it

  15. Any block - Information or Question can have audio attached to it

  16. Any question can have

    1. Audio for the question. Audio can be set to autoplay.

    2. Marks. Default: 1. Creator can provide different marks to indicate weightage of the questions

    3. Solution

      1. Solution can be rich text (with images) or audio. In future, Videos could be added to Rich text.

      2. Solution is always available after attempting a scored question or on-demand in case of non-scored questions

    4. Hints

      1. Hints at question level after an incorrect attempt or on-demand

      2. Multiple hints with configurable access (always available on-demand, or on Nth incorrect attempt)

      3. Hints can be plain text upto 160 characters

    5. Tips

      1. Tips help a user in understanding question or option further. Specially in responding to a survey

      2. These appear inline - not on-demand

      3. Can we merge tips and hints? Have a custom experience depending on the category of use-case?

  17. Question Set information. Each question set could be tagged with

    1. Name

    2. Board, Medium, Class, Subject (derived from collection / context if possible)

    3. Topic(s)

    4. Author

    5. Credits / Attributions

    6. License

    7. Description? Thumbnail Icon?

    8. Max Time / Time Limit

    9. Total Questions

    10. Total Marks

  18. Certificate

    1. Certificate based criteria such as completion or questions attempted or score obtained.

    2. Registration upfront might not be required. It could be ‘Login to unlock your certificate’ as a post-facto prompt

  19. Question information. Each question should / could be tagged with

    1. Board, Medium, Class, Subject (derived from question set / context if possible)

    2. Learning Outcome

  20. Multiple Choice Question
    [Provide the minimal simple MCQ creation experience. Make it easy to create visually appealing questions.]
    What if we keep MCQ creation UX as-is and only change the QuML + Question Set API integration?

    1. Question is a rich-text block which supports images, equations & formulae, formatting, styling,

      1. Font style: Bold, Italics, Superscript, Subscript

      2. Font size: 12 to 48 (configurable range)

      3. Font family: List of language specific fonts for supported Indian languages

      4. Math & Scientific text: as-is

      5. Add Image: Upload, Search All Images, My Images

      6. Bulleted & Numbered list

      7. Font & Font Background Colour

      8. Text Alignment (Left, Centre, Right, Justify)

      9. Insert Table

      10. Special Character

      11. Undo, Redo

      12. Disable these: To-do list, Indent +/-, Block quote, Add Video, Format as Heading, Link, Page Break

    2. Math and Scientific text

      1. Gets inserted wherever user’s cursor is

      2. Should be able to continue typing text before or after the inserted LaTeX / KaTeX block

      3. Line height will need to managed when this block is inserted

      4. User can delete this using backspace or delete button

      5. Selecting the block and pressing enter will place the cursor after the block. Pressing enter again will create new line

    3. Images

      1. Images can be aligned Left, Centre, Right

      2. Image size can be Small, Medium, Large

    4. Options can

      1. Layout as horizontal ↔ (◾◾◾◾┉ ), vertical ↕ (↕) , and grid (⠛). Change layout during preview.

      2. Image size (applicable to all options)

      3. be minimum 2 and maximum 8 or 10

      4. have same capabilities as question body

    5. Options can change creation layout based on option layout selected (visual arrangement similar to player view)

    6. Options need to be marked as correct. At least one. How would the player know that multiple correct options are possible? Should we show check-boxes in player?

    7. Evaluation logic

      1. ANY of the correct answer (Partial scoring)

      2. ALL of the correct answer (Non-partial scoring)

    8. Preset layouts

      1. Simple MCQ (Text, Vertical options), Multimedia MCQ (Grid options, With images)

      2. Placeholder image put inside options to guide creator. On clicking placeholder image, Add Image from Library opens up.

      3. Change preset anytime during creation or during preview

  21. Fill In the Blanks

    1. Type a sentence, select a word or phrase, and make it a blank

    2. Can have multiple blanks

    3. Each blank can have more than one correct response. __ is the Silicon Valley of India. (Bengaluru, Bangalore)

    4. Multiple blanks can be (read more Fill in The Blank - Multiples and Variations - Nov, 2018 )

      1. Sequential. Independent. Complete the prime number sequence 3, 5, _, 11, _, 17

      2. Unordered list of answers, unique

      3. One group, variations, unique

      4. Multiple groups, variations, unique

      5. Linked responses with 2 or more blanks

    5. Evaluation logic

      1. Ignore blanks

      2. Case insensitive

      3. Ignore special characters?

    6. Printable by downloading as PDF

      1. FTB are printed with empty blanks - numbered to map to answers

      2. Answers are printed with sequence numbers

  22. Copy-pasting from MS Word, Excel, PowerPoint or anywhere on internet

    1. Allow text with styling format

    2. Paste equations as (embedded) images

    3. Paste image as embedded. Do not use local file storage path for image

    4. Paste table as HTML

    5. …

...

Survey would contain Sections (Question Set Unit) and Questions will only be present in Sections (not in root Question Set)

Multiple Choice Question - single & multi choice

Scoring & Correct options: There could be score for each option or even no score for any of the options. So In a Survey, I want to add Section. To the sections, I want to add Questions of type MCQ, FTB, MTF, File Upload, Slider, etc. I also want to add a specific category of Question set a Section level.

Multiple Choice Question - single & multi choice

Scoring & Correct options: There could be score for each option or even no score for any of the options. So there could be no correct answers. Marking an answer correct is essentially same as setting 1 mark for that option.

...

Single or Multi-Choice: When there are no correct options (all options having 0 marks) - user should select interaction type as single/multi. If marks are mentioned for one or more options - make it automatically as single/multi-choice.

Fill in The Blank

For each blank When question has no correct answer but it still has specific interactions.type. For example, select one or more of your favourite ice-cream? Vanilla, Chocolate, Strawberry, Blackcurrant.

Fill in The Blank

For each blank there can be one or more possible correct responses. User will be awarded marks when they enter any of the possible acceptable responses.

...

There is an additional scenarios where different responses to a blank can be graded differently. For example, ____ is capital of India. If New Delhi, give full marks. If Delhi, give half mark.

Scoring logic

Basic: Marks per response. For example - Different marks for each option in MCQ, Different Imagine a question which has dropdown, text input, and number input. Number input should validate user’s input & open number-entry-keyboard by default.

When question does not have any correct response but it still has interactions.type. For example, what’s your age? (should be number, no specific correct answer)

Scoring logic

Basic: Marks per response. For example - Different marks for each option in MCQ, Different marks for each blank.

Simple logic:

...

Show questions from a section on the same page. Progress and Status indicator behave accordingly for Question Sets containing Sections.

...

January 2021 - Question Set and Question Roadmap

Status
colourYellow
titledraft

https://project-sunbird.atlassian.net/browse/SB-22719

Creation workflow should support:

  1. Viewing all my questions, question sets

  2. Creation workflow for Question sets and Questions (independently)

Key Creation capabilities:

  1. Configure question set settings required for a specific Question Set category. This includes list of behavioural settings, their default values and if they are mandatory.

  2. Support Question Set configurations such as Shuffle, Show x/y, Show/Hide feedback,

  3. Support MCQ (single select) and Reference (non-interactive, Subjective) questions

  4. Support Question Set configurations such as Timer with Warning time, Show/Hide Submit confirmation, Max attempts

  5. Support creation of various question categories such as MCQ (with multiple correct), FTB, MTF, Subjective questions, Sequencing, Ordering,

  6. Quick preview of each question with ability to view in mobile as well as desktop mode

  7. Entering details (metadata) and configuring behaviour of each individual question

  8. Ability to create a (child) question set within a question set, and configure behaviour such as Shuffle, Show x/y, etc for each child question set

  9. Add questions from library

  10. For questions added from library, allow editing question behaviour after adding to the question set

  11. Preview of the whole question set before submitting for review

https://project-sunbird.atlassian.net/browse/SB-20202

Based on the vision Project inQuiry (QuML specification), we will develop a minimum viable product for Question bank Digital Infrastructure which enables a variety of use-cases such as practice, quiz, survey, practice test, assessment, and more. These will enable Learn, Help Learn, and Manage Learn interactions.

Question Set Creation should support existing use-cases (listed below) enhancing the Ease of creation, Ability to extend & configure, and Self-serviceability.

  1. Practice in context to ‘Learn’,

  2. Quiz in context to ‘Learn’,

  3. Course Assessment in content to ‘Help Learn’, and

Ability to enable use-cases such as Survey, Observation, Institutional Assessment (rubric-driven) and Exam Papers through ecosystem engagement.

At a high-level the plan is to enable,
→ Practice in

Status
colourYellow
title3.7
,
→ Course Assessment in
Status
colourBlue
title3.8
,
→ Quiz in
Status
colourPurple
title3.9 (future)

...

Info

This section lists out key functional capabilities for various use-cases enabling us to roll-out first version at scale using the generalized capabilities of Question Bank Digital Infrastructure.

Key creation capabilities for Practice [Learn] (V1):

  1. Question categories such as MCQ (with multiple correct), FTB, MTF, Sequencing, Ordering, and Subjective questions

  2. Configuration such as Shuffle, Show x out of y, Show/Hide feedback

...

Key capabilities for Course Assessment [Help Learn] (V1):

  1. Question categories such as MCQ (with multiple correct), FTB, ..

  2. Configuration such as Shuffle, Show x out of y, Hide feedback

  3. Additional configuration such as Timer, Submit confirmation, Max attempts

  4. Ability to add Sections and configure behaviour such as Shuffle, Show x/y, etc for each section

...

Key capabilities for Quiz [Learn] (V1):

  1. Question categories such as MCQ (with multiple correct), FTB, MTF

  2. Configuration such as Shuffle, Show x out of y, Hide feedback

  3. Additional configuration such as Timer, Submit confirmation, Max attempts

  4. Ability to add Sections and configure behaviour such as Shuffle, Show x/y, etc for each section

Key capabilities for Quiz [Learn] (V2):

  1. Ability to attach a certificate to the Question Set and configure certification criteria

  2. Ability to set Start and End Date for a question set

  3. Ability to turn on/off if login is required (Trackable Enable/Disable)

...

Player supported configurations

  1. showTimer, timeLimit 2. Total number of questions / Max Questions 3. NavigationMode - Linear/ non-linear 4. allowSkip - true/false 5. setType - [“materialised”, “dynamic”] 6. showHints - 7. SummaryType - 8. showFeedback - 9. requiresSubmit - 10. shuffle - 11. showSolutions -