(stream/lib) Metric v2 (#103)

* fix requires in test_kafka script * fix rockspec again * update kafka and fix readme * typos * (stream/lib) sc_flush: new queuing system * (stream/connectors) compat patch for queue system * (stream/documentation) add doc for new params * (stream/lib): sc_flush - fix bad param name * shaping flush methods * naming + missing parameter * better useless event management with flush * avoid calling same method twice * update all apiv2 sc * add xml_escape method * add rockspec file * add doc for xml escape method * prettier markdown * fix host_status event dedup * add new output management options * better pagerduty event format * add a dumper method * add some metric stuff * metrics first tests * fixes datadog metrics bugs * fix log message sc_event * add new params doc + fix md * improve doc + more doc * simplify sc_metrics * add new standard parameters * better dumper display * new snow stream connector * improve snow sc * metric v2 splunk metrics * debug + params for datadog metrics * finishing metrics sc * forgot replacement character * "better" splunk metrics event format * revert change * add default buffer size * fix datadog metric name regex
centreon · May 10, 2022 · 164165f · 164165f
1 parent c8633ac
commit 164165f
Show file tree

Hide file tree

Showing 14 changed files with 1,242 additions and 113 deletions.
diff --git a/stream-connectors/CONTRIBUTE.md b/stream-connectors/CONTRIBUTE.md
@@ -12,7 +12,7 @@ You can work on Stream Connectors
 - Update an existing stream connector
 - [Fix issues](https://github.com/centreon/centreon-stream-connector-scripts/issues)
 
-You can improve our Lua modules 
+You can improve our Lua modules
 
 - Add a new module
   - Comment it
@@ -22,7 +22,7 @@ You can improve our Lua modules
   - Update the documentation (if it changes the input and/or output of a method)
   - Update usage examples if there are any and if they are impacted by the change
 
-### For everybody 
+### For everybody
 
 Since we are not all found of code, there are still ways to be part of this project
 
@@ -35,11 +35,11 @@ If you want to work on our LUA modules, you must follow the coding style provide
 [Coding style guidelines](https://github.com/luarocks/lua-style-guide)
 
 While it is mandatory to follow those guidelines for modules, they will not be enforced on community powered Stream Connectors scripts.
-It is however recommened to follow them as much as possible. 
+It is however recommened to follow them as much as possible.
 
 ## Documentations
 
-When creating a module you must comment your methods as follow 
+When creating a module you must comment your methods as follow
 
 ```lua
 --- This is a local function that does things
@@ -51,6 +51,6 @@ local function get_age(first_name, last_name)
 end
 ```
 
-You should comment complicated or long code blocks to help people review your code. 
+You should comment complicated or long code blocks to help people review your code.
 
 It is also required to create or update the module documentation for a more casual reading to help people use your module in their Stream Connector
diff --git a/stream-connectors/README.md b/stream-connectors/README.md
@@ -1,46 +1,45 @@
+# Centreon Stream Connectors
+
 <!-- SHIELDS -->
 [![Contributors][contributors-shield]][contributors-url]
 [![Stars][stars-shield]][stars-url]
 [![Forks][forks-shield]][forks-url]
 [![Issues][issues-shield]][issues-url]
 
-
-# Centreon Stream Connectors #
-
 Centreon stream connectors are LUA scripts that help you send your Centreon monitoring datas to your favorite tools
 
-# Stream connectors
+## Stream connectors
 
 Available scripts
 
 Here is a list of the Centreon powered scripts:
 
-| Software | Connectors | Documentations |
-| -------- | ---------- | -------------- |
-| BSM      | [BSM Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/bsm) | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-hp-bsm.html) |
+| Software      | Connectors                                                                                                                                    | Documentations                                                                                                                                                                                                                     |
+| ------------- | --------------------------------------------------------------------------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
+| BSM           | [BSM Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/bsm)                      | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-hp-bsm.html)                                                                                                                                 |
 | ElasticSearch | [ElasticSearch Stream Connectors](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/elasticsearch) | [Events Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-elastic-events.html), [Metrics Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-elastic-metrics.html) |
-| InfluxDB | [InfluxDB Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/influxdb) | WIP |
-| NDO | [NDO Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/ndo) | [Documentation](https://docs.centreon.com/current/en/integrations/stream-connectors/ndo.html) |
-| OMI | [OMI Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/omi) | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-hp-omi.html) |
-| Opsgenie | [Opsgenie Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/opsgenie) | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-opsgenie.html) |
-| PagerDuty | [PagerDuty Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/pagerduty) | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-pagerduty-events.html) |
-| Prometheus | [Prometheus Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/prometheus) | WIP |
-| ServiceNow | [ServiceNow Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/servicenow) | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-service-now-events.html) |
-| Signl4 | [Signl4 Stream Connectors](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/signl4) | [Events Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-signl4-events.html) |
-| Splunk | [Splunk Stream Connectors](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/splunk) | [Events Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-splunk-events.html), [Metrics Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-splunk-metrics.html) |
-| Warp10 | [Warp10 Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/warp10) | [Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-warp10.html) |
+| InfluxDB      | [InfluxDB Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/influxdb)            | WIP                                                                                                                                                                                                                                |
+| NDO           | [NDO Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/ndo)                      | [Documentation](https://docs.centreon.com/current/en/integrations/stream-connectors/ndo.html)                                                                                                                                      |
+| OMI           | [OMI Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/omi)                      | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-hp-omi.html)                                                                                                                                 |
+| Opsgenie      | [Opsgenie Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/opsgenie)            | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-opsgenie.html)                                                                                                                               |
+| PagerDuty     | [PagerDuty Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/pagerduty)          | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-pagerduty-events.html)                                                                                                                       |
+| Prometheus    | [Prometheus Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/prometheus)        | WIP                                                                                                                                                                                                                                |
+| ServiceNow    | [ServiceNow Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/servicenow)        | [Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-service-now-events.html)                                                                                                                     |
+| Signl4        | [Signl4 Stream Connectors](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/signl4)               | [Events Documentation](https://docs.centreon.com/current/en/integrations/event-management/sc-signl4-events.html)                                                                                                                   |
+| Splunk        | [Splunk Stream Connectors](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/splunk)               | [Events Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-splunk-events.html), [Metrics Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-splunk-metrics.html)   |
+| Warp10        | [Warp10 Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/warp10)                | [Documentation](https://docs.centreon.com/current/en/integrations/data-analytics/sc-warp10.html)                                                                                                                                   |
+| Kafka         | [Kafka stream connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/centreon-certified/kafka)                  | [Documentation](https://docs.centreon.com/docs/integrations/data-analytics/sc-kafka-events/)                                                                                                                                       |
 
 Here is a list of the Community powered scripts
 
-| Software | Connectors | Documentations | Contributors | Organizations |
-| -------- | ---------- | -------------- | ------------ | ------------- |
+| Software | Connectors                                                                                                                        | Documentations                                                                                                                  | Contributors                                              | Organizations                           |
+| -------- | --------------------------------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------- | --------------------------------------- |
 | Canopsis | [Canopsis Stream Connector](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/community-powered/canopsis) | [Documentation](https://github.com/centreon/centreon-stream-connector-scripts/tree/master/community-powered/canopsis/README.md) | [ppremont-capensis](https://github.com/ppremont-capensis) | [Capensis](https://www.capensis.fr/en/) |
 
-# Contribute
+## Contribute
 
 If you wish to help us improve this project, feel free to read the [Contribute.md](https://github.com/centreon/centreon-stream-connector-scripts/blob/master/CONTRIBUTE.md) file.
 
-
 <!-- URL AND IMAGES FOR SHIELDS -->
 [contributors-shield]: https://img.shields.io/github/contributors/centreon/centreon-stream-connector-scripts?color=%2384BD00&label=CONTRIBUTORS&style=for-the-badge
 [stars-shield]: https://img.shields.io/github/stars/centreon/centreon-stream-connector-scripts?color=%23433b02a&label=STARS&style=for-the-badge