Skip to content

Latest commit

 

History

History

collect-stream-logs

collect-stream-logs

  1. Ingest logs from folders.
  2. Listen for syslogs on UDP port.
  3. Merge syslogs and drop-in logs and persist merged logs to Solr for historical search.
  4. Dashboard: stream real-time log events to dashboard and enable cross-filter search on historical logs data.

Note: this flow depends on nifi-websocket module, download nar and copy to $NIFI_HOME/lib

Run log generator

gradle :collect-stream-logs:log-generator:run

Flow

logs dataflow

Demo

streaming logs

Reference

  1. Collecting Logs with Apache NiFi