Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
outlinetrue


Introduction

The current platform capability enables creators to create practice questions, add them into courses and enable users to learn and practice. There has been an increasing number of asks from states to enable them to judge competency levels of teachers after completing an unit or all units in the course so that they can reward the teachers who have met the criteria set by the state.

To address these problems, in the next couple of releases, we are proposing changes to the platform to provide an opportunity for the course creators & stakeholders to a) gauze the content quality and b) validate teacher's learning.

At a high level, the objective of this work stream is to integrate assessments as a key TPD course component thereby enabling:

  • course creators to design courses which include evaluation of learners’ understanding
  • course creators to configure course assessments per their pedagogical needs 
  • users to consume the course assessments per the defined configurations
  • course mentors to view learners’ assessment performance and provide interventions

Creation of course assessments - User Story 1 Overview

As a content creator, I should be able to create practice questions for the courses via a new content type called 'Assessment'and publish question sets within a course which are consumed as self-assessments by users enrolled in courses.

Prerequisites:

  1. Should have creation rights
  2. A separate instance for courses by tenant will be created in the program portal
  3. Course ToC is created in the platform 


Workflow:  

Creation of self-assessments

  1. Login as content creator
  2. Click on ‘Create Assessment’ (Introduce a new content type called ‘Assessment’)
  3. Click on 'Add question set'
  4. Create questions (using the existing templates)
  5. Publish the worksheet

Note:

  1. Content type ‘Assessment’ should not be discoverable under resources/library for content consumers
  2. Content type ‘Assessment’ should be discoverable for other creators so that they can include it in a course, text book etc
  3. All the published assessments should be made visible for creator under workspace under published list. (this is as per the current flow for courses, resources etc)
  4. Assessment Metadata should have the same values as existing Create Resource but with the following change:

    • Resource Type should have only one value called 'Test'. The other values for Resource Type are irrelevant for this content type
  5. Except for the changes mentioned above, rest of the existing workflows in 'Create Resource' such as resource meta data, preview etc will remain the same. 

  6. All worksheets created and published will be referenced with tag as 'Assessment' in Published, Submitted for review, All my Content & Drafts.

Course WorkSheets 

Srl. No.User ActionExpected Result1In the workspace tab, Content creator clicks on 'Create'a new content type called 'Assessment' is displayed2Content creator clicks on 'Assessment'is taken to the editor with 'Add Slide' & 'Add question set' options enabled. Rest of the options are disabled3Content creator clicks on 'Add question set'They are navigated to the existing question set editor which is used to create questions and question sets. No changes are needed to this workflow4Content creator clicks on 'Add slide'No changes to existing workflowDesigns

Step1: Course assessments will be created and published on the programs portal:

  1. Login with content creator credentials in the program portal
  2. Click on the course card
  3. Click on the respective course unit within the course ToC
  4. Click on MCQ (Remove other types of questions, only MCQ is enabled)
  5. Contribute questions

Step2: Question review on the program portal:

  1. Login with reviewer credentials in the program portal
  2. Click on the course card
  3. Review and publish the questions

Step3: Setting of content type

  1. Content type of the Question sets published in 'Step2' will be 'Assessment'. This will be done via an API.

Step4: Course publish will be from platform

  1. All published questions will show up under the respective unit
  2. Review and publish the course (this will follow the existing courses workflow in the platform) 

Editing the published self-assessments

Editing the questions will follow the same process as creation

Re-usability of published self-assessments

As a content creator, I would like to re-use assessment created by other creators in the course (???)


Note:

  1. Content type ‘Assessment’ should not be discoverable under resources/library for content consumers

Designs

Existing program portal will be customized per the above workflow

https://projects.invisionapp.com/share/69TXKXJ54DW#/screens/384055667

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-14832

Configuration of course assessments - User Story 2 Overview

As a content creator, I should be able to apply configuration to the question sets created by me to drive the consumption experience of these assessments.


Designs

<to be included>

JIRA Ticket ID

Jira Legacy
serverSystem JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId2207a759-5bc8-39c5-9cd2-aa9ccc1f65dd
keySB-14833

Localization Requirements

UI ElementDescriptionLanguage(s)/ Locales Required
Create Course WorksheetCourse worksheet is a new content type introduced in this release. Hence the need to translate this to all supported launguagesAll languages supported in the platform







Telemetry Requirements

Event NameDescriptionPurpose
Click on 'Create Course Worksheet (portal)

Track how many times and when (during the day) users are clicking on 'Course Worksheet' so that we can get insights into: a) the usage of this feature and b) time of usage (is it used in the morning, afternoon or late evening post school hours etc)

Track worksheets by their status (draft, live, pending review and rejected) so that we know - a) the elapsed time before creator sends the worksheet for review or the time taken to publish a worksheet

Note - this content type reuses existing 'Create Resource'. Hence the existing telemetry events should be retained as is. 


Non-Functional Requirements

Performance / Responsiveness RequirementsLoad/Volume RequirementsSecurity / Privacy Requirements
A course can have, on an avg, 10 worksheets 5 assessments with each worksheet assessment having approx. 5 10 questions. 


Impact on other Products/Solutions

Product/Solution ImpactedImpact Description
Workspace - common for ETB and TPDNew content type will be made available for both ETB and TPD.Programs portal


Impact on Existing Users/Data 

User/Data ImpactedImpact Description



Key Metrics

Srl. No.MetricPurpose of Metric