Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
  • IMPORTANT: Take a backup of all your databases by running backup jobs located under OpsAdministration → Core / KnowledgePlatform / DataPipeline → BackupJobs OR You can use VM Disk Snapshots from your cloud provider
  • Once all the variables and Jenkins configurations are complete, you can start to build and deploy services.
  • Build all the services mentioned in the table below.
  • Ensure you provide the github_release_tag for Build jobs as per the tags mentioned in this sheet - Current Release Tags and Jenkins Jobs Reference.
  • Ensure all ArtificatUpload Jobs as successful.
  • Deploy services which are mentioned in the table below. IMPORTANT: The order of deployment for jobs in deploy directory should be same as mentioned in the below table.
  • If some build and deploy jobs are not relevant to your setup, you can skip them.
  • Ensure you provide branch_or_tag as per the data mentoined in this sheet - Current Release Tags and Jenkins Jobs Reference under Jobs which use this repository column.
  • Once all services are deployed, please perform the manaual configurations mentioned in this sheet - Manual configurations

...

Here is the list of jobs that are required to be built and deployed for your reference

Order: Top down per column

Knowledge Platform BuildKnowledge Platform DeployDataPipeline BuildDataPipeline DeployCore BuildCore Deploy

KnowledgePlatformStopNeo4jCluster
LearningCassandraDbUpdateAnalyticsCassandraAnalyticsAPICassandraPlayerPlayer

SearchDataPipelineDataProductsNeo4j
KafkaSetupKeycloakKeycloak

Yarn

StartNeo4jClusterYarn


KafkaIndexerYarnPlayerCassandraPlayerCassandra

Neo4jDefinitionUpdateKafkaSetupSecorSecorLearnerLearner

StopNeo4jClusterCassandraDbUpdateAnalyticsKafkaSetupAnalyticsAPIContentContent

Neo4jNeo4jKafkaIndexer

Neo4jDefinitionUpdate

(Run manual queries mentioned below after this job)

DataPipelineDataProductsTelemetryTelemetry
StartNeo4jClusterKnowledgePlatformLearning
CassandraDbUpdateSamzaTelemetrySchemasProxyProxy

SearchKafkaSetupYarnSamzaTelemetrySchemasYarn
OnboardAPI
Yarn

Yarn




OnboardConsumers
SyncToolNeo4jElasticSearchSyncToolOnboardConsumersCassandraDbUpdateLogging


Logging


Manual queries to be run for Neo4j:

  • Login to neo4j machine and switch to learning user
  • Go to NEO4J_HOME/bin directory
  • Run ./cypher-shell
  • Execute the below queries

match (n:domain) where n.IL_FUNC_OBJECT_TYPE in [“Content”, “ContentImage”] AND exists(n.medium) set n.medium = [n.medium];

match (n:domain) where n.IL_FUNC_OBJECT_TYPE in [“Content”, “ContentImage”] AND exists(n.subject) set n.subject = [n.subject];

match (n:domain{}) WHERE exists(n.sYS_INTERNAL_LAST_UPDATED_ON) remove n.sYS_INTERNAL_LAST_UPDATED_ON;