Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • If you want to run only Core services which will connect to Ekstep backend for other dependent services like Knowledge Platform and Data Pipeline, follow the below steps for Core module only

  • Once you complete the below steps, go to this page to get details on extra variables that need to be added for Core service only to work - Additional variables to run Core services only

Updating private repo with hosts and variables

  1. git clone https://github.com/project-sunbird/sunbird-devops

  2. cd sunbird-devops && git checkout tags/release-2.0.0 -b release-2.0.0

  3. cp -rf sunbird-devops/private_repo .

  4. cd private_repo

  5. Folder Structure for the private directory which contains ansible hosts secrets and variables.

    Code Block
    languagebash
    titleFolder Structure
    ~/Documents/projects/subird-devops/private_repo(DO-470 ✗) tree ansible
    ansible
    └── inventory
        └── dev
            ├── Core
            │   ├── common.yml
            │   ├── hosts
            │   └── secrets.yml
            ├── DataPipeline
            │   ├── common.yml
            │   ├── hosts
            │   └── secrets.yml
            └── KnowledgePlatform
                ├── common.yml
                ├── hosts
                └── secrets.yml
    
    5 directories, 9 files
    


  6. git init

  7. git add .

  8. git commit -m"Creating private files"

  9. git remote add origin <private repo url>

  10. git branch --set-upstream-to=origin/master master && git push --set-upstream origin master

  11. update the variables and push it to upstream.

Updating variables and hosts

  1. cd private_repo/ansible/inventory/dev/<module>/

  2. update hosts common.yml secrets.yml


S.NOServiceServerIP Address of the machineAnsible Group NameModule
1jenkins-master


Core
2manager
Server-1 (swarm)

swarm-manager-1,swarm-agent-for-prometheus-1
swarm-agent-for-grafana-1, swarm-agent-for-alertmanager-1,
3log-eslog-es-1
4

5keycloak
Server-2 (core-db)

keycloak-1
6cassandra-lms (core)cassandra-1
8Postgresspostgresql-master-1, postgresql-slave-1
9es-lms-1es-1
10

11cassandra-lp-dp
Server-3 (lp-db)

lp-cassandra, dp-cassandra
KnowledgePlatform
12kp-dp-es-1composite-search-cluster,es-ps
13Postgress
14neo4jlearning-neo4j-node1
15learning-1
Server-4 (lp-services)

learning1,logstash-ps
16redisredis1
17searchsearch1






18sparkServer 5 (spark)
spark
Data Pipeline
19yarn-rmServer 6 (yarn-RM)
yarn-master,yarn-ps
20yarn-slaveServer 7 (yarn-slave)
yarn-slave,yarn-ps
21



22analytics-api
Server 8 (dp-services)

analytics-api, analytics-ps,
23kafka-indexerkafka-indexer
24secorsecor, secor-ps
25InfluxDB
26




27kafka (Kp, Dp. Core)Server 9 (kafka)
processing-cluster-kafka, processing-cluster-zookeepers, kafka-ps
kafka-1
Common

...