FLG Monitoring Stack

Monitoring NGINX logs using FLG Stack (Fluent-bit, Loki, Grafana) with Docker and Kubernetes

Directory Structure

.
├── LICENSE
├── README.md
├── assets
│   ├── dashboard.png
│   └── flow.gif
├── docker-compose.yaml
├── fluentbit
│   ├── fluent-bit.conf
│   └── parsers.conf
├── grafana
│   ├── datasource.yml
│   └── grafana.ini
├── kubernetes
│   ├── fluentbit
│   │   ├── configmap.yaml
│   │   └── daemonset.yaml
│   ├── grafana
│   │   ├── configmap.yaml
│   │   ├── deployment.yaml
│   │   ├── pvc.yaml
│   │   └── service.yaml
│   ├── loki
│   │   ├── configmap.yaml
│   │   ├── pvc.yaml
│   │   └── service.yaml
│   │   ├── statefulset.yaml
│   ├── namespace.yaml
│   └── nginx
│       └── deployment.yaml
│       └── pvc.yaml
│       └── service.yaml
└── loki
    └── loki-config.yml

Create Docker Network and Volume

This the step to create docker network and volume. Why the network use bridge driver? because we want to use the default driver. Why the volume use local driver? because we want to store the data in local machine.

docker network create flg-network --driver bridge
docker volume create loki_data --driver local

Run NGINX with Docker Run

docker run \
    -d \
    --name nginx \
    --network flg-network \
    -v ./nginx_logs:/var/log/nginx \
    -p 8080:80 \
    nginx:1.26.0-alpine

Run Loki with Docker Run

docker run -d \
  --name loki \
  --restart always \
  -v $(pwd)/loki/loki-config.yml:/etc/loki/loki-config.yaml \
  -v loki_data:/tmp/loki \
  --network flg-stack \
  grafana/loki:k204-4901a5c \
  -config.file=/etc/loki/loki-config.yaml

Run Grafana with Docker Run

docker run -d \
    --name grafana \
    --restart always \
    -p 3000:3000 \
    -v grafana_data:/var/lib/grafana \
    -v grafana_logs:/var/log/grafana \
    -v $(pwd)/grafana/grafana.ini:/etc/grafana/grafana.ini \
    -v $(pwd)/grafana/datasource.yml:/etc/grafana/provisioning/datasources/datasource.yml \
    --network flg-stack \
    grafana/grafana:11.0.0

Run Fluent-bit with Docker Run

docker run -d \
    --name fluent_bit \
    --network flg-network \
    --restart always \
    -v $(pwd)/fluent-bit.conf:/fluent-bit/etc/fluent-bit.conf \
    -v $(pwd)/parsers.conf:/fluent-bit/parsers.conf \
    -v $(pwd)/nginx_logs:/var/log/nginx \
    fluent/fluent-bit:3.0.6 \
    fluent-bit \
    -c /fluent-bit/etc/fluent-bit.conf \
    -R /fluent-bit/parsers.conf

Run in Kubernetes

# Create Namespace
kubectl apply -f kubernetes/namespace.yaml
# NGINX
kubectl apply -f kubernetes/nginx/pvc.yaml
kubectl apply -f kubernetes/nginx/deployment.yaml
kubectl apply -f kubernetes/nginx/service.yaml
# Loki
kubectl apply -f kubernetes/loki/configmap.yaml
kubectl apply -f kubernetes/loki/pvc.yaml
kubectl apply -f kubernetes/loki/service.yaml
kubectl apply -f kubernetes/loki/statefulset.yaml
# Grafana
kubectl apply -f kubernetes/grafana/configmap.yaml
kubectl apply -f kubernetes/grafana/pvc.yaml
kubectl apply -f kubernetes/grafana/deployment.yaml
kubectl apply -f kubernetes/grafana/service.yaml
# Fluent-bit
kubectl apply -f kubernetes/fluentbit/configmap.yaml
kubectl apply -f kubernetes/fluentbit/daemonset.yaml

Access Grafana

• Open http://localhost:3000 in your browser, login use admin/admin as username/password
• Go to Explore -> label filter change to log and value nginx
• Add operations and select JSON
• You should see logs from NGINX