Versions Compared

Old Version 1

changes.mady.by.user Jagadish Pujari

Saved on

compared with

New Version 2

changes.mady.by.user Rahul Shukla

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

So looking into telemetry Assess event resValues empty or contains data in an array based on this data will consider Question attempted or skipped.



FTBMCQMTFSequenceReorder
ASSESS Event resvalues(tick)(tick)(error)(error)(tick)


Expand
titleSkipped question

"edata": {
"item": {
"id": "do_11286000975564800011904",
"maxscore": 1,
"type": "ftb",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"1\"}"
},
{
"eval": "order"
}
],
"uri": "",
"title": "FTB: QuestionService fix____\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 1,
"pass": "No",
"score": 0,
"resvalues": [],
"duration": 26
}




Expand
titleSkipped question

"edata": {
"item": {
"id": "do_11286000940202393611903",
"maxscore": 1,
"type": "mcq",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"True\\n\"}"
},
{
"2": "{\"text\":\"False\\n\"}"
},
{
"answer": "{\"correct\":[\"1\"]}"
}
],
"uri": "",
"title": "MCQ: QuestionService fix\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 2,
"pass": "No",
"score": 0,
"resvalues": [
{}
],
"duration": 6
}



Expand
titleSkipped question

"edata": {
"item": {
"id": "do_11286000903443251211902",
"maxscore": 1,
"type": "mtf",
"exlength": 0,
"params": [
{
"lhs": "[{\"1\":\"{\\\"text\\\":\\\"A\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"B\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"C\\\\n\\\"}\"}]"
},
{
"rhs": "[{\"1\":\"{\\\"text\\\":\\\"b\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"c\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"a\\\\n\\\"}\"}]"
},
{
"answer": "{\"lhs\":[\"1\",\"2\",\"3\"],\"rhs\":[\"3\",\"1\",\"2\"]}"
}
],
"uri": "",
"title": "MTF:QuestionService fix\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 3,
"pass": "No",
"score": 0,
"resvalues": [
{
"lhs": "[{\"1\":\"{\\\"text\\\":\\\"A\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"B\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"C\\\\n\\\"}\"}]"
},
{
"rhs": "[{\"1\":\"{\\\"text\\\":\\\"b\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"c\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"a\\\\n\\\"}\"}]"
}
],
"duration": 3
}



Expand
titleSkipped question

"edata": {
"item": {
"id": "do_11286001060099686411906",
"maxscore": 1,
"type": "sequence",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"Two\"}"
},
{
"2": "{\"text\":\"One\"}"
},
{
"answer": "{\"seq\":[\"2\",\"1\"]}"
}
],
"uri": "",
"title": "Question service fix \n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 4,
"pass": "No",
"score": 0,
"resvalues": [
{
"1": "{\"text\":\"Two\"}"
},
{
"2": "{\"text\":\"One\"}"
}
],
"duration": 3
}



Expand
titleSkipped question

"edata": {
"item": {
"id": "do_11286001026143846411905",
"maxscore": 1,
"type": "reorder",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"4\"}"
},
{
"2": "{\"text\":\"8\"}"
},
{
"3": "{\"text\":\"6\"}"
},
{
"4": "{\"text\":\"5\"}"
},
{
"5": "{\"text\":\"2\"}"
},
{
"6": "{\"text\":\"7\"}"
},
{
"7": "{\"text\":\"1\"}"
},
{
"answer": "{\"seq\":[\"3\",\"7\",\"5\",\"4\",\"2\",\"6\",\"1\"]}"
}
],
"uri": "",
"title": "QuestionService fixArrange the given words in proper order to form a sentence.\n\n \n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 5,
"pass": "No",
"score": 0,
"resvalues": [],
"duration": 3
}




Expand
titleAttempted question

"edata": {
"item": {
"id": "do_11286000975564800011904",
"maxscore": 1,
"type": "ftb",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"1\"}"
},
{
"eval": "order"
}
],
"uri": "",
"title": "FTB: QuestionService fix____\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 1,
"pass": "Yes",
"score": 1,
"resvalues": [
{
"1": "{\"text\":\"1\"}"
}
],
"duration": 588
}



Expand
titleAttempted question

"edata": {
"item": {
"id": "do_11286000940202393611903",
"maxscore": 1,
"type": "mcq",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"True\\n\"}"
},
{
"2": "{\"text\":\"False\\n\"}"
},
{
"answer": "{\"correct\":[\"1\"]}"
}
],
"uri": "",
"title": "MCQ: QuestionService fix\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 2,
"pass": "Yes",
"score": 1,
"resvalues": [
{
"1": "{\"text\":\"True\\n\"}"
}
],
"duration": 293
}



Expand
titleAttempted question

"edata": {
"item": {
"id": "do_11286000903443251211902",
"maxscore": 1,
"type": "mtf",
"exlength": 0,
"params": [
{
"lhs": "[{\"1\":\"{\\\"text\\\":\\\"A\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"B\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"C\\\\n\\\"}\"}]"
},
{
"rhs": "[{\"1\":\"{\\\"text\\\":\\\"b\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"c\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"a\\\\n\\\"}\"}]"
},
{
"answer": "{\"lhs\":[\"1\",\"2\",\"3\"],\"rhs\":[\"3\",\"1\",\"2\"]}"
}
],
"uri": "",
"title": "MTF:QuestionService fix\n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 3,
"pass": "No",
"score": 0.33,
"resvalues": [
{
"lhs": "[{\"1\":\"{\\\"text\\\":\\\"A\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"B\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"C\\\\n\\\"}\"}]"
},
{
"rhs": "[{\"1\":\"{\\\"text\\\":\\\"c\\\\n\\\"}\"},{\"2\":\"{\\\"text\\\":\\\"b\\\\n\\\"}\"},{\"3\":\"{\\\"text\\\":\\\"a\\\\n\\\"}\"}]"
}
],
"duration": 63
}



Expand
titleAttempted question

"edata": {
"item": {
"id": "do_11286001060099686411906",
"maxscore": 1,
"type": "sequence",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"Two\"}"
},
{
"2": "{\"text\":\"One\"}"
},
{
"answer": "{\"seq\":[\"2\",\"1\"]}"
}
],
"uri": "",
"title": "Question service fix \n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 4,
"pass": "Yes",
"score": 1,
"resvalues": [
{
"2": "{\"text\":\"One\"}"
},
{
"1": "{\"text\":\"Two\"}"
}
],
"duration": 62
}



Expand
titleAttempted question

"edata": {
"item": {
"id": "do_11286001026143846411905",
"maxscore": 1,
"type": "reorder",
"exlength": 0,
"params": [
{
"1": "{\"text\":\"4\"}"
},
{
"2": "{\"text\":\"8\"}"
},
{
"3": "{\"text\":\"6\"}"
},
{
"4": "{\"text\":\"5\"}"
},
{
"5": "{\"text\":\"2\"}"
},
{
"6": "{\"text\":\"7\"}"
},
{
"7": "{\"text\":\"1\"}"
},
{
"answer": "{\"seq\":[\"3\",\"7\",\"5\",\"4\",\"2\",\"6\",\"1\"]}"
}
],
"uri": "",
"title": "QuestionService fixArrange the given words in proper order to form a sentence.\n\n \n",
"mmc": [],
"mc": [],
"desc": ""
},
"index": 5,
"pass": "No",
"score": 0,
"resvalues": [
{
"2": "{\"text\":\"8\"}"
},
{
"3": "{\"text\":\"6\"}"
}
],
"duration": 55
}



Solution II:

Based on Telemetry Response event. Currently, MCQ type of questions only generating a Response event.

If the response event generates so it is considered as an attempted question.



MCQFTBMTFSequenceReorder
Response event

(tick)

Expand
titleAttempted question

{
"eid": "RESPONSE",
"ets": 1571385741820,
"ver": "3.0",
"mid": "RESPONSE:c35bb556e3920e6a5b287ac699d96448",
"actor": {
"id": "874ed8a5-782e-4f6c-8f36-e0288455901e",
"type": "User"
},
"context": {
"channel": "b00bc992ef25f1a9a8d63291e20efc8d",
"pdata": {
"id": "dev.sunbird.portal",
"ver": "2.4.0",
"pid": "sunbird-portal.contenteditor.contentplayer"
},
"env": "contentplayer",
"sid": "nm-dQSSXROxfJpbONAmdXSmY_2ttSA6C",
"did": "d1b3344d6b8d8b5441c3b47842b61abd",
"cdata": [
{
"id": "f799686c9c913589cf270153edf8dbf6",
"type": "ContentSession"
}
],
"rollup": {}
},
"object": {
"id": "do_11287200486896435214",
"type": "Content",
"ver": "1.0",
"rollup": {}
},
"tags": [],
"edata": {
"target": {
"id": "org.ekstep.questionunit.mcq",
"ver": "1.3",
"type": "plugin"
},
"type": "CHOOSE",
"values": [
{
"option0": "<p>True</p>\n"
}
]
}
}


(error)(error)(error)(error)


Solution III:

In questionSet when the user selects or filled the answer, we are preserving the answers for state management. So this data will store in  evaluated result we call state data.

...

Evaluated result state object

MTQ

MCQFTBReorderSequenceMTF
Attempted(tick)(tick)(tick)(error)(error)
Skipped(tick)(tick)(tick)(error)(error)


Solution IV:

Every question units having evaluation logic and plugin knows the question attempted or not. This data we are not sending as part of Telemetry.

...