DRAFT Watch out this space for more updates soon.

Program Portal for Crowdsourcing

In order to crowdsource content adopters can leverage program portal with the current set of tools. These tools allow crowdsourcing with a few salient capabilities

1. Users & Role Management: Configure this portal to allow contribution access by default to anyone who signs up

2. Textbook Driven Content Contribution: Guided contribution flow as per collection hierarchy

3. Supported Formats for Contribution: PDF, Video (MP4), and Questions

4. Report and Dashboard for Admin & Reviewer to monitor content coverage across textbooks

Program portal workflows

There are following workflows involved in crowdsourcing programs

1. Setup

2. Textbook Creation & QR Code Management

3. Contribution

4. Review & Publishing

5. Monitor

Each of these workflows are detailed below

Setup

Setup is to ensure that program portal is ready for contribution. It involves ensuring readiness of

1. Taxonomy framework: Adopter to check and ensure that taxonomy framework contains all the required fields viz. Board, Medium, Class, Subject, Concepts, Learning Objectives. Use implementation team’s services for this.

2. Textbook ToCs: Adopter should provide Textbook creation access to relevant users and ensure Textbooks are created with proper ToCs. Use Textbook editor on Sunbird for this.

3. Open for Contribution: Once relevant Textbooks are ready with ToC, they need to be opened for contribution. Use implementation team’s services for this.

4. Content type templates: As per the purpose of the program, select relevant content type templates. These will be available for contribution and eventually to the consumers

5. Role assignment: Share list of users to assigned Review, Report viewer, Textbook creator, Textbook reviewer, and other administrative roles.

6. QR codes: Once relevant Textbooks are ready with ToC, QR codes need to be generated and linked to these textbook units. Use Textbook editor on Sunbird for this.

Taxonomy framework

Taxonomy framework should contain latest up-to-date values as per curriculum and also contain required values to enable search, discovery, content organisation, and data reports. Adopter should ensure latest up-to-date taxonomy with all required fields is uploaded on Sunbird. Following taxonomy services are available (with the help on implementation team)

1. Upload taxonomy as per taxonomy specifications. Sample file is available as an example

2. Read existing taxonomy in .csv spreadsheet format for verification

Textbook ToC & QR Code

• Adopter would be required to define which all Textbooks are in the program scope.

• Those TBs should already be created in SunbirdEd instance.

• In case those are existing TBs for ETB purpose, adopter can share Textbook ID straight away however if adopter wishes to create a new TB exclusively for program purpose, it can create new ones and would further required to tag concepts.

• QR codes: Once relevant Textbooks are ready with ToC, QR codes need to be generated and linked to these textbook units. Use Textbook editor on Sunbird for this.

• Adopter need to share name and IDs of such textbook with support/implementation team.

• As per requirement such TBs shall be opened in program portal for contribution for chosen content type.

• For all the textbook units that need to be opened for contribution through programs portal, it is mandatory to link / tag them with a concept (using topic selector in textbook editor).

• Only Textbook units linked to a concept can accept contributions.

Open for Contribution

Program Portal Admin should be able to view all draft textbooks from all users in the tenant, select textbooks to be opened for contribution. Also select specific units in a textbook to be opened for contribution.

Content type templates

Content templates ease up contributor’s job by providing preset values of content metadata. Content templates will contain following information

Contribution

Contribution workflow demonstrates a contributor’s journey when contributing using crowdsourcing programs portal.

Select Textbook > Select Chapter > Select Content Type template > Upload / Create & Save > Submit for Review

Below is a workflow diagram with some sample content types

Select Textbook

Easily select textbooks to contribute to. Contributor / Reviewer will see textbooks listed in grid view and grouped by specific category (as applicable). User will also be able to filter textbooks / courses using any two of the taxonomy framework categories (e.g. Class, Subject)

Select Textbook Unit

Contributor / Reviewer will see important actionable statistics about selected chapter, see list of content contributed and take relevant action (contribute / add, edit, review). Allow contribution upto 4 levels of Textbook units.

Contributors will be able to View, Delete, and Move content from the list on this page. List of actions mapped to status of content is shown below

Content Type templates

Contributor will select from available content type templates (as configured by admin). Appropriate tool with required configuration will be launched to make contributions. Contributors will be able to Save & Submit from the contribution page.

Contribution

Contributors can create Question Sets or Upload files. Following capabilities are required for contributors

• Content contribution is open for all the public users having valid Google id.

• Once user sign in, it would be landed on a page with facility to select TB. TBs will be viewed in grid view. Contributor / Reviewer will see textbooks listed in grid view and grouped by specific category (as applicable).

• User will also be able to filter textbooks using any two of the taxonomy framework categories (e.g. Class, Subject)

• Upon selecting a textbook user will be redirected to TB detail page.

  • TB detail page would have an option to select any particular chapter or all chapter from the drop down called “Select Chapters”.

  • User will also see the following numbers:

    • Total Contribution

    • My contribution

    • Rejected

    • Under Review

  • All the chapters should have accordion to expand its nodes.

  • User should be able to contribute both at chapter and node level.

  • User should be able to contribute up to 4 levels of TB.

  • Once contributed, content should be shown under that node with status either of them:

    • Under Review

    • Published

    • Rejected

  • For every contributed content there should be following options:

    • Preview (User can preview the content In all the stages)

    • Edit (Only for content which are either in draft or rejected state)

    • Move (Only for content which are either in draft or rejected state)

    • Delete (Only for content which are either in draft or rejected state)
      

• Upon clicking “Add”, User will choose what type of content to be contributed from a platter. (Content types to be contributed, have been already defined for the program by state)

• Depending upon the content type appropriate tool with required configuration will be launched to make contributions.

• Under contribution either user can upload a content piece (video, pdf) which she already has or user may choose to create a set of questions (for test prep program) corresponding to relevant node/chapter of the textbook.

• In case of MCQs and Subjective questions, user should also have facility (“Add Solution” button) to provide solution (apart from question and options). However providing solution is optional.

• Solution can be either a “video” or “text+image” explanation, which user should be able to select from platter and should be facilitated to upload the same.

• In case of content type (apart from question set) where file is being uploaded, a progress bar should be displayed to track the completion of file upload.

• When uploading file, relevant information such as file formats, file size, and link to ‘how-to’ resize videos, ‘how-to’ create videos should be provided.

• As long as uploaded content is in draft state, means has not been submitted for review, “Change file” option should be provided.

• However “change file” option should not be provided for content which are submitted for review or published.

• On contribution page, Creator should have options to select license value from a drop down. However by default state defined license should be auto selected.

• Drop down would be populated from <SunbirdEd> License List (DLL).

• On contribution page, there should be static license text mentioned at the bottom.

“By creating content on <SunbirdEd>, you consent to publish it under the Creative Commons License Framework. Please choose the applicable creative commons license you wish to apply to your content”

• Contributors will be able to Save & Submit from the contribution page.

• Upon clicking on status, user shall be redirected to a page which would have content previewing window/ content player along with the reviewer’s comment.

Review

• Content reviewer can be nominated either at the time of program onboarding or by admin at a later stage.

• Authorised reviewer will login to program portal.

• It is assumed that reviewer would be intimated the scope which she needs to review. Accordingly she will choose TB, Node and content type.

• Reviewer would have the same TB UI experience as described for contributors. However reviewer would have the following two data points to look:

  • Total under review

  • Accepted by me

• Reviewer can approve or reject a content piece (video, pdf) by providing appropriate comment. Accordingly content shall either be published or rejected.

• Once published it would be available to be consumed.

• Upon publishing the content will be published independently as well as available to consume through the digital textbook (ETB).

• In case content is a question set (multiple questions), Reviewer would be facilitated to review each question individually.

• She can reject a particular question under a question set, can provide comment on each question separately and may go ahead to approve other questions and eventually the entire question set.

• While finally approving the question set, reviewer should be displayed a message box saying number of questions it has rejected and moving ahead with only approved once.

• Take reviewer’s confirmation by getting him clicked on “Continue” button.

• In that case published question set would have only approved questions.

• Rejected ones will be available to creator with comments.

• However creator would not be allowed to amend the rejected questions.

Program Portal V1

Use case story

A SunbirdEd adopter / tenant would like to design & implement a program to achieve certain outcomes. In order to achieve the outcomes, the SunbirdEd tenant will need to consider creation, consumption, and data requirements.

1. Teacher & Student Enablement Creation

2. Test Prep Creation & Consumption

3. Teacher Training Creation

Teacher and Student Enablement

Content Types & Book Structure

Intent was to enable teachers & students by providing access to various teaching and learning resources organised by each chapter in the textbook. Types of resources to enable students and teachers were finalised based on availability & ease of use. These content types were organised for each chapter in the textbook.

For each content type

Program user journeys

• Discover (view & access) Program

• Program Details

• Join or Leave Program

• Program Setup and Launch

• Close Program

• Program Analytics

Teacher Training Creation

Proposed workflow:

Architecture

Program Definition - Purpose and scope of the program.

• Purpose - Text

• Scope - machine understandable or free text?

• Type - Public, Sign up, invite-only

• Tenant - Root Org

• Framework -

Roles in a program -

• Program admin defines the user roles for the program.

• Maps the program roles to actions in a tool.

• Defines the default role assigned in a program

Setup Activities - Program is a collection of activities. An activity is a tool + actions + config.

• Example tools -

  • QuML Practice Set tool - create QuML questions and bundle them into practice sets against a textbook TOC.

Points to be covered

Context/Background

Business Flows

• State & System Actions - multiple phases

• Sample Use cases

  • Teacher & Student Enablement

  • Test Prep

  • TPD

• Process, Product and Content

• Creation, Consumption and Data

Architecture

• Experiment vs Program

  • Experiment - driven by us, Program - driven by state

  • Experiment - to test a feature variation, may be flaky

  • Programs are mainly used for scoping and tracking of the activities

• Core feature vs Program

  • Available to all users vs custom experience for a content type / program

  • ..

• Conceptual Model

  • Program - Types??, Definition: Scope, Activity ~ (Tool, Actions, Config)

  • Users, Teams, Roles - on boarding, setup

  • Default Programs - e.g. workspace, consumption for a content type

• High Level Design

  • Program Entity structure

  • Structure of Tools - Angular components, dynamic loading

  • Program Configuration

• Deployment Model

• Delivery Channels

  • Portal

  • Mobile App

Roadmap