...
Configuration File Link For Reference:
https://github.com/Sunbird-inQuiry/data-pipeline/blob/release-5.2.0_RC358d52be036712eff2e90a3842a1885d36d4473a7/kubernetes/helm_charts/datapipeline_jobs/values.j2j2#L118
questionset-republish:
| Code Block |
|---|
#Cloud Storage Config
cloud_storage_type: "{{ cloud_service_provider }}"
cloud_storage_key: "{{ cloud_public_storage_accountname }}"
cloud_storage_secret: "{{ cloud_public_storage_secret }}"
cloud_storage_endpoint: "{{ cloud_public_storage_endpoint }}"
cloud_storage_container: "{{ cloud_storage_content_bucketname }}"
cloudstorage {
metadata.replace_absolute_path={{ cloudstorage_replace_absolute_path | default('false') }}
metadata.list={{ cloudstorage_metadata_list }}
relative_path_prefix="{{ cloudstorage_relative_path_prefix }}"
read_base_path="{{ cloudstorage_base_path }}"
write_base_path={{ valid_cloudstorage_base_urls }}
} |
Configuration File Link For Reference:
https://github.com/Sunbird-inQuiry/data-pipeline/blob/release-5.2.0_RC358d52be036712eff2e90a3842a1885d36d4473a7/kubernetes/helm_charts/datapipeline_jobs/values.j2j2#L164
Deprecated variables:
sunbird_cloud_storage_type
sunbird_public_storage_account_name
sunbird_public_storage_account_key
azure_public_container
sunbird_content_azure_storage_container
...