Page Comparison

Introduction

This wiki explains the design for delete user account feature. As of now there is no hard delete of user profile flow available in Sunbird. At present, we have functionality to BLOCK/UNBLOCK users.

Background & Problem Statement

Sunbird supports the mobile app for Android and iOS. As per the latest policy update of the Apple App Store and Google Play Store, mandates the user deletion from the app, if the app is having the signup from app. The specific policy mandates can be found using the following links:

• Apple App Store Policy - https://developer.apple.com/app-store/review/guidelines/#data-collection-and-storage

• Apple App Store Policy - https://developer.apple.com/support/offering-account-deletion-in-your-app

• Google Play Store Policy - https://support.google.com/googleplay/android-developer/answer/13327111?hl=en

Registered users must have access to a "Delete Account" option on both the app and the portal. This option will allow them to initiate the account deletion process themselves.

Key Design Problems

User should not able to do the following things after successful deletion of account:

• User should not be able to login by using the existing login credentials post account deletion.

• Any of the Personally Identifiable Information (PII) of the user, such as name, email, and phone number should not be available in any DB in any format (even encrypted format).

• Other than PII data should not be deleted. User transactional data and user created contents (usage, rating etc) are to be retained.

• Certificates issued to the deleted users should not be accessible, but should be verifiable. (Storing only the name of the user in Sunbird RC to display in certificate).

• External id of the SSO user should be removed.

• List the deleted user list to admin dashboard.

• Deleted user’s asset should be transferred to the other user after successful deletion.

Design

Delete User

• Send the OTP to the user’s email/phone to validate the user. (OTP templates for user account deletion verification)

• Delete login credentials and sessions from Keycloak. (async)

• Update the sunbird.user table. Set the following fields as empty: (redis data for the following fields will become empty for that user) (sync)

  • firstName

  • lastName

  • email

  • dob

  • phone

  • maskedEmail

  • maskedPhone

  • prevUsedEmail

  • prevUsedPhone

  • recoveryEmail

  • recoveryPhone

• Update the status from ACTIVE to DELETED. (sync)

• Remove the user entry from sunbird.user_lookup table. (sync)

• Remove the SSO user entry from sunbird.user_external_identity (sync)

• Update the user entry in sunbird.user_organisation (async) - May not be required.

  • isdeleted - True

  • orgleftdate - system date

• Update the user’s name in nodeBB as Deleted User to display in discussion forum.

• Insert the entry in sunbird.user_deletion_status table for each type. Note: If user has only PUBLIC role than entry for type userOwnershipTransfer will not required.

• Sync the user deletion status in user index in below format:

  Code Block
  "userDeletionStatus" : { "userLookUp": false, "userExtIdnt": true, "keycloak": false "user": true, "discussionForum": true, "userOwnershipTransfer": false }

• Insert the entry in sunbird.user_ownership_transfer table after successful deletion. Note: If user has only PUBLIC role than status will be directly marked as COMPLETED.

User deletion status table

This table is required for any audit purpose in future by anyone.

CREATE TABLE sunbird.user_deletion_status(
	userId text,
	type text,	// userLookUp, userExtIdnt, keycloak, user, discussionForum, userOwnershipTransfer
	status boolean,
	createdDate timestamp,
	upatedDate timestamp,
 	PRIMARY KEY ((userId, type))
 );

Sample curl for user delete API:

...

...

Introduction

This wiki explains the design for delete user account feature. As of now there is no hard delete of user profile flow available in Sunbird. At present, we have functionality to BLOCK/UNBLOCK users.

Background & Problem Statement

Sunbird supports the mobile app for Android and iOS. As per the latest policy update of the Apple App Store and Google Play Store, mandates the user deletion from the app, if the app is having the signup from app. The specific policy mandates can be found using the following links:

• Apple App Store Policy - https://developer.apple.com/app-store/review/guidelines/#data-collection-and-storage

• Apple App Store Policy - https://developer.apple.com/support/offering-account-deletion-in-your-app

• Google Play Store Policy - https://support.google.com/googleplay/android-developer/answer/13327111?hl=en

Registered users must have access to a "Delete Account" option on both the app and the portal. This option will allow them to initiate the account deletion process themselves.

Key Design Problems

User should not able to do the following things after successful deletion of account:

• User should not be able to login by using the existing login credentials post account deletion.

• Any of the Personally Identifiable Information (PII) of the user, such as name, email, and phone number should not be available in any DB in any format (even encrypted format).

• Other than PII data should not be deleted. User transactional data and user created contents (usage, rating etc) are to be retained.

• Certificates issued to the deleted users should not be accessible, but should be verifiable. (Storing only the name of the user in Sunbird RC to display in certificate).

• External id of the SSO user should be removed.

• List the deleted user list to admin dashboard.

• Deleted user’s asset should be transferred to the other user after successful deletion.

Design

Delete User

...

• Send the OTP to the user’s email/phone to validate the user. (OTP templates for user account deletion verification)

Sync

• Delete login credentials and sessions from Keycloak.

• Update the sunbird.user table. Set the following fields as empty: (redis data for the following fields will become empty for that user)

  • firstName

  • lastName

  • email

  • dob

  • phone

  • maskedEmail

  • maskedPhone

  • prevUsedEmail

  • prevUsedPhone

  • recoveryEmail

  • recoveryPhone

• Update the status from ACTIVE to DELETED.

• Remove the user entry from sunbird.user_lookup table.

• Remove the SSO user entry from sunbird.user_external_identity .

• Send the AUDIT telemetry event after successful/failure update/deletion of the above tables.

• Trigger the delete user kafka event {{env_name}}.delete.user

User Deletion Flink Job

• Verify the sync steps is successfully completed else perform the pending actions.

• Update the user entry in sunbird.user_organisation (async) - May not be required.

  • isdeleted - True

  • orgleftdate - system date

• Update the user’s name in nodeBB as Deleted User to display in discussion forum.

• Group - TBD

• Send the AUDIT telemetry event after successful/failure update/deletion of the above tables.

User delete API:

curl --location --request DELETE '{{host}}/api/user/v1/delete/{{userId}}' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer {{api_key}}' \
--header 'x-authenticated-user-token: {{user_token}}'

...

...

{
    "id": "api.user.delete",
    "ver": "1.0",
    "ts": "2023-08-28T13:54:45Z+05:30",
    "params": {
        "resmsgid": "a638c46e-63a5-47de-bf00-029cbe435e5e",
        "msgid": null,
        "err": null,
        "status": "successful",
        "errmsg": null
    },
    "responseCode": "OK",
    "result": {
        "response": "SUCCESS",
        "userId": "{{userId}}"
    }
}

Transfer Ownership

• List the users to whom admin wanted to transfer ownership using user ownership transfer list API (new API).

• create the new elastic search index transfer-ownership to filter the data based on different fields.

Sample curl for user ownership transfer list API:

Delete User Kafka Event

{
  "eid": "BE_JOB_REQUEST",
  "ets": 1619527882745,
  "mid": "LP.1619527882745.32dc378a-430f-49f6-83b5-bd73b767ad36",
  "actor": {
    

"

id": 

"

delete-user"

,

"

type": 

"

System"

 },
  "context": {
    "pdata": {
      "id": "org.sunbird.platform",
      "ver": "1.0"
    }
  

},

Sample Response:

"object": {
    "id": "<deleted-userId>",
    "

type": "

User"
  },
  "edata": {
    "

organisationId": "

<organisationId>"

    "

userId": "

<deleted-userId>",
    "

suggested_users": 

[
    	{
    		"

role": "

ORG_ADMIN",
    		"users": ["<orgAdminUserId>"]
   

 	},
    	{
    		"

role": 

"CONTENT_CREATOR",
    

		"users": ["

<contentCreatorUserId>"

]
    	},
   

 	{
    

		"role": "COURSE_MENTOR",
    		"

users": ["

<courseMentorUserId>"

]
    

	}
    ],
    "

action": 

"delete-user",
    "

iteration": 

1
  

Image Removed

• Transfer ownership API: This API will trigger the kafka event to transfer-ownership flink job, to precess the things asynchronously. This API will validate if “toUserId“ has all the roles of from user.

API Curl for ownership transfer

curl --location --request POST '{{host}}/api/user/v1/ownership/transfer' \
--header 'Content-Type: application/json' \
--header 'Authorization: Bearer {{api_key}}' \
--header 'x-authenticated-user-token: {{user_token}}' \
--data-raw '{
    "request":{
      "organisationId": "{{organisationId}}"
      "fromUserId": "{{FROM_UUID}}",
      "toUserId": "{{TO_UUID}}",
      "asset": []   // If array is empty then transfer all the assets fromUserId to toUserId
    }
}'

API response:

{
    "id": "api.user.ownership.transfer",
    "ver": "1.0",
    "ts": "2023-08-28T13:54:45Z+05:30",
    "params": {
        "resmsgid": "a638c46e-63a5-47de-bf00-029cbe435e5e",
        "msgid": null,
        "err": null,
        "status": "successful",
        "errmsg": null
    },
    "responseCode": "OK",
    "result": {
        "status": "Ownership transfer event is pushed successfully!"
    }
}

Flink Job

Transfer ownership:

Sample kafka event

{
  "eid": "BE_JOB_REQUEST",
  "ets": 1619527882745,
  "mid": "LP.1619527882745.32dc378a-430f-49f6-83b5-bd73b767ad36",
  "actor": {
    "id": "ownership-transfer",
    "type": "System"
  },
  "context": {
    "channel": "01309282781705830427",
    "pdata": {
      "id": "org.sunbird.platform",
      "ver": "1.0"
    },
    "env": "dev"
  },
  "object": {
    "id": "do_11329603741667328018",
    "type": "OwnershipTransfer"
  },
  "edata": {
    "organisationId": "{{organisationId}}"
    "fromUserId": "{{FROM_UUID}}",
    "toUserId": "{{TO_UUID}}",
    "asset": [],
    "action": "ownership-transfer",
    "iteration": 1
  }
}

• Update the status to PROCESSING in sunbird.user_ownership_transfer table.

• Asset

  • Fetch the list of created content/course/batch by fromUserId, using the composite search API.

  • Update the createdBy and creator using content system update API.

• Batch

  • Fetch the list of open and ongoing batches created by fromUserId from sunbird_courses.course_batch table.

  • Update the user entry in sunbird_courses.course_batch table for open and ongoing batches only.

    • createdby

  • If the user is added as a course mentors to any batch, than use the search API to find out the batches and than remove the userId from mentors column in sunbird_courses.course_batch table.

• Groups - Transfer the ownership to any other group admin if any other group admin is available else 1st assign the admin to any member and then transfer the ownership.

• Update the status to COMPLETED.

Ownership Transfer Table

CREATE TABLE sunbird.user_ownership_transfer(
    organisationId text,
	userId text,
	username text,
	roles list<text>,
	toUserId text,
	toUsername text,
	status int,
	createdDate text,
	createdBy text,
	updatedDate text,
	updatedBy text,
	summary text,
 PRIMARY KEY (organisationId, userId)
 );

• status

  • 0 - SUBMITTED

  • 1 - PROCESSING

  • 2 - COMPLETED

TBD

• Cron Job:

  • Run on specific interval to do the sanity check of deletion.

• API for other services to insert/update the data in sunbird.user_deletion_status table.

Check list:

...

Check with Cokreat regarding user PII information stored as part of program - No PII data is stored as part of program program.

...

Check in all the services, where user PII data is logged.

...

}
}

Deleted Users search curl

User search API can be used to get the more detail about user. e.g. name.

OTP Template

Hello User,

To confirm the deletion of your Sunbird Ed account, please enter the following OTP: [OTP Code].

This OTP is valid for the next [Time Limit, e.g., 5 minutes]. 

If you did not request this account deletion, please ignore this message or contact our support team immediately at [Support Email].

Thank you for using Sunbird Ed.

Best regards,
The Sunbird Ed Team

• SMS

Dear User, to confirm the deletion of your Sunbird Ed account, please enter the following OTP: [OTP Code].This OTP is valid for the next [Time Limit, e.g., 5 minutes]. If you did not request this account deletion, please ignore this message or contact our support team immediately.

Backward compatibility Approach:

As part of backward compatibility, ‘User Deletion Flink Job’ mentioned above can be deployed; ‘delete-user’ kafka topic can be created and events to the kafka topic can be inserted via scripts by passing users' information as part of the topic for completing user deletion activity.

Manage Learn -

As part of the Manage Learn use case, the user’s PII data is captured and/or used in the below-mentioned workflows -

1. A complete snapshot of a user’s profile which includes name (first and last name) as well as masked email and phone is captured under various collections in MongoDB (observations, projects, survey, and programUsers) at the start of any transaction i.e. the moment a user starts working on a survey, or project or decides to join a program. This is done to give the Program manager the details of the user as it was when he/she started working on the resource and is not affected by his/her profile change later. This means a user’s name, location, role, and sub roles which is later used for certificate generation using Sunbird RC is the same when he/she started the resource.

2. When the Program Manager requests reports via the Program Dashboard about the details of each and every user who has worked on a resource or has joined the program, the user’s email and phone along with the name is provided via a CSV using the Lern Data Product. These details are fetched in real-time at the moment of generating the on-demand report from the common and shared Redis and Cassandra storage. No change is required here since the expectation is user’s name, email phone will be deleted from the common storage and replaced with the “Deleted User” string, We will just need to test this once to confirm the entry from the reports is not removed but just the PII data is removed.

As part of the user delete flow we plan to implement the following changes in the Mangage Learn side:-

• Build a Kafka consumer in each micro-service (Survey, Projects, and ML Core) to listen to Kafka events on topic - TBD Point 4 which will do the following thing.

  • Check if any transactions are recorded for this user and if yes, remove all user name, email, and phone entries based on the userId from all collections i.e. projects, surveySubmissions, observations, observationSubmissions, and programUsers of MongoDB.

  • Update the status via API in sunbird.user_deletion_status table. Refer - TBD Point 2

• Build a Kafka consumer in each micro-service (Survey, Projects, and ML Core) to listen to Kafka events on topic - {{envName}}.tranfer.ownership.job.request which will do the following thing.

  • Check if any assets are owned by the deleted user and that the new owner has required platform roles (i.e. Program Manager or Program Designer), if yes update the owner/author in the collections i.e. programs, solutions of MongoDB.

  • Update the status via API in sunbird.user_ownership_transfer table. Refer - TBD Point 3

NOTE: None of the services should log the user PII data.

References

• [PRD] Delete Account functionality

• https://docs.google.com/presentation/d/1EoRJD8KWd0002hHtxc4PWwAVB0FQr_Z5l4PUOsvxpdQ/edit?pli=1#slide=id.p

• Apple App Store - https://developer.apple.com/support/offering-account-deletion-in-your-app

• Google Play Store - https://support.google.com/googleplay/android-developer/answer/13327111?hl=en