Introduction

The current platform capability enables creators to create practice questions, add them into courses and enable users to learn and practice. There has been an increasing number of asks from states to enable them to judge competency levels of teachers after completing an unit or all units in the course so that they can reward the teachers who have met the criteria set by the state.

To address these problems, in the next couple of releases, we are proposing changes to the platform to provide an opportunity for the course creators & stakeholders to a) gauze the content quality and b) validate teacher's learning.

At a high level, the objective of this work stream is to integrate assessments as a key TPD course component thereby enabling:

• course creators to design courses which include evaluation of learners’ understanding
• course creators to configure course assessments per their pedagogical needs 
• users to consume the course assessments per the defined configurations
• course mentors to view learners’ assessment performance and provide interventions

Creation of course assessments - User Story 1 Overview

As a content creator, I should be able to create and publish question sets within a course which are consumed as self-assessments by users enrolled in courses.

Prerequisites:

1. Should have creation rights
2. A separate instance for courses by tenant will be created in the program portal
3. Course ToC is created in the platform 

Workflow:  

Creation of self-assessments

Step1: Course assessments will be created and published on the programs portal:

1. Login with content creator credentials in the program portal
2. Click on the course card
3. Click on the respective course unit within the course ToC
4. Click on MCQ (Remove other types of questions, only MCQ is enabled)
5. Contribute questions

Step2: Question review on the program portal:

1. Login with reviewer credentials in the program portal
2. Click on the course card
3. Review and publish the questions

Step3: Setting of content type

1. Content type of the Question sets published in 'Step2' will be 'Assessment'. This will be done via an API.

Step4: Course publish will be from platform

1. All published questions will show up under the respective unit
2. Review and publish the course (this will follow the existing courses workflow in the platform) 

as practice question set:

1. Creator to include a instruction slide manually
2. Creator to include the summary plugin the last slide

Step2: Tag the practice question sets as content type 'Self Assess'

1. Backend script is run to change the content type to 'Self Assess'

Step3: Course creator adds the assessment to course ToC page

1. New type called 'Self Assessment' will be displayed when the creator clicks on 'Add Resource'

Editing the published self-assessments

Editing the questions will follow the same process as creation

Re-usability of published self-assessments

As a content creator, I would like to re-use assessment created by other creators in the course (???)current process

Note:

1. Content type ‘Assessment’ ‘Self Assess’ should not be discoverable under resources/library for content consumers

Designs

Existing program portal will be customized per the above workflow

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

JIRA Ticket ID

Creation of Self Assessment from Workspace - User Story 2 Overview

As a content creator, I should be able to apply configuration to the question sets created by me to drive the consumption experience of these assessments.

Designs

JIRA Ticket ID

Context

Currently an Assessment is created as a two step process and most of the activities are done in the back end. A content is created with type as "Resource" which is reviewed and published and later the content type is changed to "Self-Assess” and made available to the user. Instead, the whole creation and publishing process should happen from the portal, without back end team's support 

As a Content creator, I should be able to create and publish a Course-Assessment, So that it can be used in a Course for consumption

Acceptance criteria

Pre-conditions

1. Logged in user has access to create content

Workflow to enable 'Self Assess' in the workspace

1. The option to create 'Self Assess' content type questions is not enabled by default to all tenants.
2. This content type has to be enabled on request basis
3. This option will be enabled by the implementation team 

Main Workflow

Verify that

1. User is able to see an option ("Course Assessment") in the work space to create "Self - Assess" content

2. Self Assess creation process is similar to the resource creation process (Refer UI design)

3. The Summary plug in automatically gets created. This should be displayed for the user in preview, review mode and also after it gets published. There is no need for the creator to manually add it in the third slide during creation
4. The below gets displayed in the preview mode
   1. Instructions (if it exists)
   2. Questions
   3. Summary details
   4. Score details
5. The "Self - Assess" content goes through the existing Save, Review, Preview and Publish workflows - Draft, All my content, Submitted for Review, Published, Up for Review. Note: The existing table/card structure display (as applicable) will be retained for these views with the content type name shown as "Course Assessment"
6. The "Self-Assess" content can be updated and re-published similar to Resources
7. The "Self-Assess" content is not available under Library/Resources for content consumers

Exceptional workflow

The older Self Assess content will retain the existing behavior

Flow diagram

Image Added

UI Design

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Edit details page for Assessment is not included in the invision link. Hence calling this out separately

Image Added

Ability for the Content creator to search & add Self-Assess content during course creation - User Story 3 Overview

JIRA Ticket ID

Context

As a Content Creator, I should be able to search for a Course Assessment during course creation, So that the same can be linked/added to a Course

Acceptance criteria

Pre-conditions

a) Logged in user has access to create content

b) Course Assessments are published

c) User clicks "Add resource"

Main Workflow
Verify that

1. The user is able to search a “Self-Assess” content with the Assessment do-id or Assessment title

2. The user is able to select the “Self-Assess” content and add to a Course 

Flow diagram

Image AddedUI Design

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Make Course Assessment creation completely self serviceable - User story 4 Overview

JIRA Ticket ID

Context:
This is in continuation to SB-14833-15838. Course Assessments currently support only MCQ template. This should be extended to the remaining templates as well - Match the following, Fill in the blanks, Reordering words, Arrange in sequence. 

As a Content creator, I want to be able to select and use multiple templates (in addition to MCQ), So that Course Assessment gets more user friendly and interesting for consumption

Pre-conditions

1. Logged in user has access to create content

2. Logged in user has clicked "Question set" icon to create Course Assessment

Acceptance criteria

When creating new Questions/selecting questions from the existing list:

Image Added

When editing Question set:

Image Added

Verify that:

1. When selecting questions from the existing list,
   1. User is able to select any type of Question/s from the list (Multiple Choice Questions, Match the following, Fill in the blanks, Reordering words, Arrange in sequence) and add to the Question set
2. When creating new Question/s,
   1. User is able to select any of the five templates (Multiple Choice Questions, Match the following, Fill in the blanks, Reordering words, Arrange in sequence) and create Question/s
3. Before Adding the Questions to the Course Assessment,
   1. "Shuffle Questions" option is disabled by default. However the user can choose to enable, if required
   2. "Show Immediate Feedback" is disabled by default, However the user can choose to enable, if required
   3. "Display" option should be disabled/removed
4. Note: The created Course Assessment (content type "Self-Assess") should be available in All my content, Draft, Submitted for Review, Up for Review, Published sections as it exists today. There are no changes to the current behavior
5. The above (Sl.no:1-3) criteria holds good even while editing the Assessment
6. Every question with a right or wrong answer is considered as "attempted". Anything left blank or answered and later removed/left blank is considered as "skipped"

Refer the below screen shots for reference. 

When selecting Question/s from the existing list:

Image Added

When creating a new Question:

Image Added

Localization Requirements

Telemetry Requirements

Non-Functional Requirements

Impact on other Products/Solutions

Impact on Existing Users/Data 

Key Metrics