Skip to content

Latest commit

 

History

History
157 lines (104 loc) · 5.06 KB

NOTES-FOR-NEW-SETUP.md

File metadata and controls

157 lines (104 loc) · 5.06 KB
Raw

Infrastructure Setup for a new CDP instance

TODO: create tutorial videos

Network requirements

The deployed server must have Internet connection, please set the out-bound firewall rules to these domains

https://storage.googleapis.com
https://nominatim.openstreetmap.org
http://ip-api.com
https://us1.api.mailchimp.com
https://api.brevo.com

This requirements for all server

1. Update DNS hosts for CDP Solution servers

Command to edit hosts:

sudo nano /etc/hosts

Add Local DNS for all servers

  • [the network IP of ArangoDB Server] cdpsys.database
  • [the network IP of Redis Server] cdpsys.redis
  • [the network IP of CDP Admin] cdpsys.admin
  • [the network IP of Data Observer] cdpsys.observer

Example DNS for 1 ArangoDB database server, 1 Redis cache server, 1 Admin server and 2 data observers

127.0.0.1 cdpsys.database
127.0.0.1 cdpsys.redis
127.0.0.1 cdpsys.admin
127.0.0.1 cdpsys.observer

2. Install Java 11 JVM for all

Java 11 from Amazon

wget -O- https://apt.corretto.aws/corretto.key | sudo apt-key add -
sudo add-apt-repository 'deb https://apt.corretto.aws stable main'
sudo apt-get update; sudo apt-get install -y java-11-amazon-corretto-jdk fontconfig git nano

Java 11 on Rocky / CentOS

sudo rpm --import https://yum.corretto.aws/corretto.key
sudo curl -L -o /etc/yum.repos.d/corretto.repo https://yum.corretto.aws/corretto.repo
sudo yum install -y java-11-amazon-corretto-devel git fontconfig git nano

3. Create user for SSH

sudo useradd cdpsysuser -s /bin/bash -p '*'
sudo passwd -d cdpsysuser
sudo usermod -aG sudo cdpsysuser
echo 'cdpsysuser ALL=(ALL) NOPASSWD: ALL' | sudo tee -a /etc/sudoers >/dev/null

4. Set SSH keys

sudo su cdpsysuser
sudo mkdir -p /home/cdpsysuser
cd /home/cdpsysuser
sudo chown -R cdpsysuser:cdpsysuser /home/cdpsysuser
mkdir .ssh
nano .ssh/authorized_keys

=> Set your SSH public key

This requirements for ArangoDB database

Set Linux configs to scale on high load

sudo sysctl -w "vm.max_map_count=512000"
sudo bash -c "echo madvise > /sys/kernel/mm/transparent_hugepage/enabled"
sudo bash -c "echo madvise > /sys/kernel/mm/transparent_hugepage/defrag"

ArangoDB on Ubuntu

curl -OL https://download.arangodb.com/arangodb311/DEBIAN/Release.key
sudo apt-key add - < Release.key
echo 'deb https://download.arangodb.com/arangodb311/DEBIAN/ /' | sudo tee /etc/apt/sources.list.d/arangodb.list
sudo apt-get install apt-transport-https
sudo apt-get update && sudo apt-get install arangodb3=3.11.9-1

ArangoDB on CentOS or Rocky Linux

cd /etc/yum.repos.d/
curl -OL https://download.arangodb.com/arangodb311/RPM/arangodb.repo
sudo yum --nogpgcheck install arangodb3 -y
arango-secure-installation
>  /var/log/arangodb3/arangod.log
nano /etc/arangodb3/arangod.conf
systemctl restart arangodb3.service
sudo firewall-cmd --add-port=8601/tcp --permanent
sudo firewall-cmd --reload

This requirements for HTTP Observer, Admin and Database

Install nginx on Ubuntu 22

sudo wget https://nginx.org/keys/nginx_signing.key
sudo apt-key add nginx_signing.key

sudo nano /etc/apt/sources.list
	deb https://nginx.org/packages/mainline/ubuntu/ jammy nginx
	deb-src https://nginx.org/packages/mainline/ubuntu/ jammy nginx

sudo apt-get remove nginx-common
sudo apt-get update ; sudo apt-get install nginx; sudo service nginx start

Install nginx on Rocky Linux 9

sudo dnf install nginx
sudo systemctl enable nginx
sudo systemctl start nginx
sudo firewall-cmd --permanent --add-service=http
sudo firewall-cmd --reload
systemctl status nginx

SSL for Nginx Server

SSL certbot on Ubuntu

sudo apt-get update; sudo apt-get install python-is-python3; sudo apt install certbot python3-certbot-nginx
sudo certbot --nginx

SSL certbot on Rocky Linux

sudo dnf install certbot python3-certbot-nginx
sudo certbot --nginx

Redis Caching for Admin

Ubuntu

sudo apt-get update; sudo apt -y install redis-server

CentOS or Rocky

sudo dnf -y install redis
sudo systemctl enable redis --now

Java Deployment for Admin, Observer and Data Jobs

Clone binary code for new server

# make folder to git pull 
sudo mkdir /build/
sudo mkdir -p /home/cdpsysuser/ ; sudo chown -R cdpsys:cdpsys /home/cdpsysuser/
sudo git clone https://github.com/trieu/leo-cdp-free-edition.git /build/cdp-instance
sudo chown -R cdpsys:cdpsys /build/ ; sudo chmod +x /build/cdp-instance/*.sh