Introduction

The current platform capability enables creators to create practice questions, add them into courses and enable users to learn and practice. There has been an increasing number of asks from states to enable them to judge competency levels of teachers after completing an unit or all units in the course so that they can reward the teachers who have met the criteria set by the state.

To address these problems, in the next couple of releases, we are proposing changes to the platform to provide an opportunity for the course creators & stakeholders to a) gauze the content quality and b) validate teacher's learning.

At a high level, the objective of this work stream is to integrate assessments as a key TPD course component thereby enabling:

• course creators to design courses which include evaluation of learners’ understanding
• course creators to configure course assessments per their pedagogical needs 
• users to consume the course assessments per the defined configurations
• course mentors to view learners’ assessment performance and provide interventions

Creation of course assessments - User Story 1 Overview

As a content creator, I should be able to create and publish question sets within a course which are consumed as self-assessments by users enrolled in courses.

Prerequisites:

1. Should have creation rights

Workflow:  

Creation of self-assessments

Step1: Course assessments will be created and published as practice question set:

1. Creator to include a instruction slide manually
2. Creator to include the summary plug in plugin the last slide

Step2: Tag the practice question sets as content type 'Self Assess'

1. Backend script is run to change the content type to 'Self Assess'

Step3: Course creator adds the assessment to course ToC page

1. New type called 'Self Assessment' will be displayed when the creator clicks on 'Add Resource'

Editing the published self-assessments

Editing the questions will follow the current process

Note:

1. Content type ‘Self Assess’ should not be discoverable under resources/library for content consumers

Designs

Existing program portal will be customized per the above workflow

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

JIRA Ticket ID

Creation of Self Assessment from Workspace - User Story 2 Overview

JIRA Ticket ID

Context

Currently an Assessment is created as a two step process and most of the activities are done in the back end. A content is created with type as "Resource" which is reviewed and published and later the content type is changed to "Self-Assess” and made available to the user. Instead, the whole creation and publishing process should happen from the portal portal, without back end team's support 

As a Content creator, I should be able to create and publish a SelfCourse-Assessment, So that it can be used in a Course for consumption

Acceptance criteria

Pre-conditions

1. Logged in user has access to create contentLogged in user’s tenant has Self-Assessment configured

Workflow to enable 'Self Assess' in the workspace

1. The option to create 'Self Assess' content type questions is not enabled by default to all tenants.
2. This content type has to be enabled on request basis
3. This option will be enabled by the implementation team 

Main Workflow

Verify that

1. User is able to see an option ("Course Assessment") in the work space to create "Self - Assess" content

2. Self Assess creation process is similar to the resource creation process except for the below

   1. Add Slide, Add text, Add Shape, Add image, Add Activity options alone are available

   The created (Refer UI design)

3. The Summary plug in automatically gets created. This should be displayed for the user in preview, review mode and also after it gets published. There is no need for the creator to manually add it in the third slide during creation
4. The below gets displayed in the preview mode
   1. Instructions (if it exists)
   2. Questions
   3. Summary details
   4. Score details
5. The "Self - Assess" content goes through the existing Save, Review, Preview and Publish processThe created “Self-Assess” content is available in the “Draft”, "workflows - Draft, All my content", " Submitted for Review", Published, “Published” and " Up for Review" sections (similar to the existing behavior of Resources)The created . Note: The existing table/card structure display (as applicable) will be retained for these views with the content type name shown as "Course Assessment"
6. The "Self-Assess" content can be updated and re-published similar to Resources
7. The "Self-Assess" content is not available under Library/Resources for content consumers
8. Note: The Course Assessment through this flow will still need to be converted to content type "Self-Assess" before it could be linked to a Course

Exceptional workflow

The older Self Assess content will retain the existing behavior

Flow diagram

Image RemovedImage Added

UI DesignTo be provided

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Edit details page for Assessment is not included in the invision link. Hence calling this out separately

Image Added

Ability for the Content creator to search & add Self-Assess content during course creation - User Story 3 Overview

JIRA Ticket ID

Context

Currently Self Assessment that is created from back end cannot be discovered under resources/library for content consumers. However now that the Self Assessment can be created from Workspace, Content creator should be able search for a Self Assessment so that the same can be added to the course

As a Content Creator, I should be able to search for a Self Course Assessment during course creation, So that the same can be linked/added to a Course

Acceptance criteria

Pre-conditions

1. a) Logged in user has access to create content

b) Course
2. Logged in user's tenant has "Self-Assessment" configured 3. The content type of “Course Assessment” is changed to “Self-Assess” from back endAssessments are published

c) User clicks "Add resource"

Main Workflow
Verify that

1. The user is able to search a “Self-Assess” content from “Library” tab The user is able to search a “Self-Assess” content while adding a resource during Course creationwith the Assessment do-id or Assessment title

2. The user is able to select the “Self-Assess” content and add to a Course during creationCourse 

Flow diagram

Image Removed

Configuration of course assessments - User Story 3 OverviewT

As a content creator, I should be able to apply configuration to the question sets created by me to drive the consumption experience of these assessments.

Designs

<to be included>

Image AddedUI Design

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Make Course Assessment creation completely self serviceable - User story 4 Overview

JIRA Ticket ID

Context:
This is in continuation to SB-15838. Course Assessments currently support only MCQ template. This should be extended to the remaining templates as well - Match the following, Fill in the blanks, Reordering words, Arrange in sequence. 

As a Content creator, I want to be able to select and use multiple templates (in addition to MCQ), So that Course Assessment gets more user friendly and interesting for consumption

Pre-conditions

1. Logged in user has access to create content

2. Logged in user has clicked "Question set" icon to create Course Assessment

Acceptance criteria

When creating new Questions/selecting questions from the existing list:

Image Added

When editing Question set:

Image Added

Verify that:

1. When selecting questions from the existing list,
   1. User is able to select any type of Question/s from the list (Multiple Choice Questions, Match the following, Fill in the blanks, Reordering words, Arrange in sequence) and add to the Question set
2. When creating new Question/s,
   1. User is able to select any of the five templates (Multiple Choice Questions, Match the following, Fill in the blanks, Reordering words, Arrange in sequence) and create Question/s
3. Before Adding the Questions to the Course Assessment,
   1. "Shuffle Questions" option is disabled by default. However the user can choose to enable, if required
   2. "Show Immediate Feedback" is disabled by default, However the user can choose to enable, if required
   3. "Display" option should be disabled/removed
4. Note: The created Course Assessment (content type "Self-Assess") should be available in All my content, Draft, Submitted for Review, Up for Review, Published sections as it exists today. There are no changes to the current behavior
5. The above (Sl.no:1-3) criteria holds good even while editing the Assessment
6. Every question with a right or wrong answer is considered as "attempted". Anything left blank or answered and later removed/left blank is considered as "skipped"

Refer the below screen shots for reference. 

When selecting Question/s from the existing list:

Image Added

When creating a new Question:

Image Added

Localization Requirements

Telemetry Requirements

Non-Functional Requirements

Impact on other Products/Solutions

Impact on Existing Users/Data 

Key Metrics