v2.0.0

Configuration cleanup

Compatibility

Some significant changes to influx-spout's configuration file have
been made to improvement usability, clarity and consistency. These
changes break compatibility with the previous configuration file
format. Some configuration options have been renamed, some take a
different value type and one has been removed.

Here's a summary of the changes:

Old Name	New Name	Old Format	New Format
batch_max_mb	batch_max_size	integer (MB)	string, flexible units (e.g. "20MB")
nats_pending_max_mb	nats_max_pending_size	integer (MB)	string, flexible units (e.g. "1GB")
read_buffer_bytes	read_buffer_size	integer (bytes)	string, flexible units (e.g. "512K")
batch	batch_max_count	integer count	(unchanged)
listener_batch_size	Removed	-	use batch_max_size instead
batch_max_secs	batch_max_age	integer (seconds)	string, flexible units (e.g. "5m")
max_time_delta_secs	max_time_delta	integer (seconds)	string, flexible units (e.g. "30s")
write_timeout_secs	write_timeout	integer (seconds)	string, flexible units (e.g. "10s")

Listener batch aging

The listener component will now send its batch if the age of the batch
exceeds a configured limit, as set by the batch_max_age option. This
prevents batched lines from being held up if the rate of data received
by the listener drops. The default listener batch age is 5 minutes.

Hostname included in internal metrics

The metrics that each influx-spout component exposes (in Prometheus
format) now include a hostname label.

Configurable stats interval

The interval at which each influx-spout component publishes its own
metrics is now configurable using the new stats_interval
option. This was previously fixed at 3 seconds.

Configuration validation

Various errors in influx-spout's configuration are now checked
for. influx-spout will fail to start if a configuration error is
detected.

Performance improvements for internal stats

• Avoid unnecessary name lookups for index based metrics.
• Use atomic counter updates instead of mutex.
• stats package microbenchmark is now 78% faster.

Developer tooling for manual tests

• Added slow (fake) influxd tool (cmd/slowinfluxd). This is useful
  for testing how influx-spout behaves when dealing with slow
  consumers.
• Added watchmem tool for monitoring memory consumption.
• Documented how to run a manual slow consumer test.

Other

• Code structure: all binaries now live as subpackages under the cmd
  top level package.
• The writer and listener now share the same batch type instead of
  having independent but similar implementations.
• Cleaner handling for internal Prometheus labels.
• Fixed minor linter issues

---

Automated with GoReleaser
Built with go version go1.10.3 linux/amd64