Problem Statement
...
| operation-mode | workflow |
|---|---|
| upload | create-upload content |
| publish | create-upload-publish content |
| link | create-upload-publish content and link it to textbook |
Design
API Specifications
Bulk Content Upload API - POST - /v1/textbook/content/bulk/upload
Request Headers
...
1. Validations
File related validations to be done are,
- Validate the format of the file
- Validate whether the file is readable
- Validate whether the file has data
Data related validations to be done are,
- Check whether the file is conforming to the bulk content upload template(The template should be configurable)
- Number of rows in file should be less than Max rows allowed(configuration)
- Duplicity check within the file. Key is Taxonomy(BGMS)+ContentName
2. Processing
- Upload the CSV file to blob storage
2. Make an entry in bulk_upload_process table
| column | data to insert | remarks |
|---|---|---|
| id | auto-generated unique id | processId |
| createdby | uploader id | |
| createdon | current timestamp | |
| data | blobstore url of CSV file | |
| failureresult | failedCount to be updated here | |
| lastupdatedon | last updated timestamp to be updated here on each update | |
| objecttype | content | |
| organisationid | tenant id | |
processendtime | endTime - current timestamp to be inserted here while moving this process to completed state | |
processstarttime | startTime - current timestamp to be inserted here while moving this process to processing state | |
retrycount | 0 | Not used |
status | queued | status - possible values - queued, processing, completed |
storagedetails | report - blobstore url of result file | |
successresult | successCount to be updated here | |
taskcount | number of records in file | totalCount |
uploadedby | uploader id | |
uploadeddate | current timestamp |
3. Make entries into bulk_upload_process_task table (One record per content)
| column | data to insert | remarks |
|---|---|---|
processid | processid | id from master table |
sequenceid | auto-generated sequence id | |
createdon | current timestamp | |
data | data in JSON format | |
failureresult | JSON data + failed message | |
iterationid | 0 | Not used |
lastupdatedon | last updated timestamp to be updated here on each update | |
status | possible values - queued, success, failed | |
successresult | JSON data + success message |
...
API Specifications
Bulk Content Upload API - POST - /v1/textbook/content/bulk/upload
Request Headers
| Content-Type | multipart/form-data |
| Authorization | Bearer {{api-key}} |
| x-authenticated-user-token | {{keycloak-token}} |
| x-channel-id | {{channel-identifier}} |
| x-framework-id | {{framework-identifier}} |
| x-hashtag-id | {{tenant-id}} |
| operation-mode | upload/publish/link |
...
Bulk Content Upload Status Check API - GET - /v1/textbook/content/bulk/upload/status/:processId
Request Headers
| Accept | application/json |
| Authorization | Bearer {{api-key}} |
| x-authenticated-user-token | {{keycloak-token}} |
Response : Success Response - OK (200) - In Queue
...
Bulk Content Upload Status List API - GET - /v1/textbook/content/bulk/upload/status/list
Request Headers
| Accept | application/json |
| Authorization | Bearer {{api-key}} |
| x-authenticated-user-token | {{keycloak-token}} |
Response : Success Response - OK (200)
...