Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue


Introduction

The current platform capability enables creators to create practice questions, add them into courses and enable users to learn and practice. There has been an increasing number of asks from states to enable them to judge competency levels of teachers after completing an unit or all units in the course so that they can reward the teachers who have met the criteria set by the state.

To address these problems, in the next couple of releases, we are proposing changes to the platform to provide an opportunity for the course creators & stakeholders to a) gauze the content quality and b) validate teacher's learning.

At a high level, the objective of this work stream is to integrate assessments as a key TPD course component thereby enabling:

  • course creators to design courses which include evaluation of learners’ understanding
  • course creators to configure course assessments per their pedagogical needs 
  • users to consume the course assessments per the defined configurations
  • course mentors to view learners’ assessment performance and provide interventions

Creation of course assessments - User Story 1 Overview

As a content creator, I should be able to create and publish question sets within a course which are consumed as self-assessments by users enrolled in courses.

Prerequisites:

  1. Should have creation rights

Workflow:  

Creation of self-assessments

Step1: Course assessments will be created and published as practice question set:

  1. Creator to include a instruction slide manually
  2. Creator to include the summary plugin the last slide

Step2: Tag the practice question sets as content type 'Self Assess'

  1. Backend script is run to change the content type to 'Self Assess'

Step3: Course creator adds the assessment to course ToC page

  1. New type called 'Self Assessment' will be displayed when the creator clicks on 'Add Resource'

Editing the published self-assessments

Editing the questions will follow the current process


Note:

  1. Content type ‘Self Assess’ should not be discoverable under resources/library for content consumers

Designs

Existing program portal will be customized per the above workflow

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-14832


Creation of Self Assessment from Workspace - User Story 2 Overview

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-15838

Context

Currently an Assessment is created as a two step process and most of the activities are done in the back end. A content is created with type as "Resource" which is reviewed and published and later the content type is changed to "Self-Assess” and made available to the user. Instead, the whole creation and publishing process should happen from the portal, without back end team's support 

As a Content creator, I should be able to create and publish a Course-Assessment, So that it can be used in a Course for consumption

Acceptance criteria

Pre-conditions

  1. Logged in user has access to create content

  2. Logged in user’s tenant has "Self-Assess" configured

Workflow to enable 'Self Assess' in the workspace

  1. The option to create 'Self Assess' content type questions is not enabled by default to all tenants.
  2. This content type has to be enabled on request basis
  3. This option will be enabled by the implementation team 

Main Workflow

Verify that

  1. User is able to see an option ("Course Assessment") in the work space to create "Self - Assess" content

  2. Self Assess creation process is similar to the resource creation process (Refer UI design)

  3. The Summary plug in automatically gets created. This should be displayed for the user in preview, review mode and also after it gets published. There is no need for the creator to manually add it in the third slide during creation
  4. The below gets displayed in the preview mode
    1. Instructions (if it exists)
    2. Questions
    3. Summary details
    4. Score details
  5. The "Self - Assess" content goes through the existing Save, Review, Preview and Publish workflows - Draft, All my content, Submitted for Review, Published, Up for Review. Note: The existing table/card structure display (as applicable) will be retained for these views with the content type name shown as "Course Assessment"
  6. The "Self-Assess" content can be updated and re-published similar to Resources
  7. The "Self-Assess" content is not available under Library/Resources for content consumers

Exceptional workflow

The older Self Assess content will retain the existing behavior

Flow diagram

UI Design

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Edit details page for Assessment is not included in the invision link. Hence calling this out separately

Ability for the Content creator to search & add Self-Assess content during course creation - User Story 3 Overview

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-16723

Context

As a Content Creator, I should be able to search for a Course Assessment during course creation, So that the same can be linked/added to a Course

Acceptance criteria

Pre-conditions

a) Logged in user has access to create content

b) Course Assessments are published

c) User clicks "Add resource"

Main Workflow
Verify that

  1. The user is able to search a “Self-Assess” content with the Assessment do-id or Assessment title
  2. The user is able to select the “Self-Assess” content and add to a Course 

Flow diagram

UI Design

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

Make Course Assessment creation completely self serviceable - User story 4 Overview

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-17589

Context:
This is in continuation to SB-15838. Course Assessments will need to support MCQ only and in the process of making Course Assessment creation completely self serviceable, some of the options in the current creation workflow have to be disabled/removed so that there is no manual activity at all (like state Admin is manually asked to disable "show immediate feedback") and the state can create the Course Assessment on their own, link it to course for consumption without any hassle

As a Content creator, I don't want to see options irrelevant to Assessment creation, So that the whole process becomes easy and quick

Pre-conditions

  1. Logged in user has access to create content

  2. Logged in user’s tenant has Self Assess Content type configured

  3. Logged in user has clicked "Question set" icon during Assessment creation

Acceptance criteria

Main workflow

Create workflow


Edit workflow

Verify that:

  1. When selecting Question/s from the existing list,
    1. Assessments (content type "Self Assess") alone get displayed for the user to select and add
  2. When creating new Question/s,
    1. "Multiple Choice Question" template alone gets displayed for the user to select and create question
  3. Before Adding the Questions to the Assessment,
    1. "Shuffle Questions" option is disabled by default. However the user can choose to enable, if required
    2. "Show Immediate Feedback" is disabled by default, However the user can choose to enable, if required
    3. "Display" option is not shown to the user
  4. Note: The created Assessment (content type "Self-Assess") should be available in All my content, Draft, Submitted for Review, Up for Review, Published sections as it exists today. There are no changes to the current behavior
  5. The above (Sl.no:1-3) criteria holds good while editing the Assessment

Refer the below screen shots for reference

When selecting Question/s from the existing list:

When creating new Question/s:

Localization Requirements

UI ElementDescriptionLanguage(s)/ Locales Required
Assessment (under create tab in workspace)Assessments is mapped to content type 'Self-assess'. Creators who want to include course assessments in their courses will create 'Assessments'. Hence the need to translate this to all supported languagesAll languages supported in the platform







Telemetry Requirements

Event NameDescriptionPurpose
Click on 'Create Course Worksheet (portal)

Track how many times and when (during the day) users are clicking on 'Course Worksheet' so that we can get insights into: a) the usage of this feature and b) time of usage (is it used in the morning, afternoon or late evening post school hours etc)

Track worksheets by their status (draft, live, pending review and rejected) so that we know - a) the elapsed time before creator sends the worksheet for review or the time taken to publish a worksheet

Note - this content type reuses existing 'Create Resource'. Hence the existing telemetry events should be retained as is. 

Click on 'Assessment'

Track how many times and when (during the day) users are clicking on 'Course Assessment' so that we can get insights into: a) the usage of this feature and b) time of usage (is it used in the morning, afternoon or late evening post school hours etc)

Track Assessment by their status (draft, live, pending review and rejected) so that we know - a) the elapsed time before creator sends the assessment for review or the time taken to publish a assessment

When "shuffle questions" option is turned ON during Assessment creation
Track how many Assessments are created with this option turned ON, to get insights on the usage of this feature
"Show Immediate Feedback" option is turned ON during Assessment creation
Track how many Assessments are created with this option turned ON, to get insights on the usage of this feature


Non-Functional Requirements

Performance / Responsiveness RequirementsLoad/Volume RequirementsSecurity / Privacy Requirements
A course can have, on an avg, 5 assessments with each assessment having approx. 10 questions. 


Impact on other Products/Solutions

Product/Solution ImpactedImpact Description



Impact on Existing Users/Data 

User/Data ImpactedImpact Description



Key Metrics

Srl. No.MetricPurpose of Metric