Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix emit wait time #2869

Merged
merged 1 commit into from
Apr 27, 2016
Merged

fix emit wait time #2869

merged 1 commit into from
Apr 27, 2016

Conversation

b-slim
Copy link
Contributor

@b-slim b-slim commented Apr 21, 2016

Fix for #2868

@b-slim
Copy link
Contributor Author

b-slim commented Apr 21, 2016

@gianm checkout this

@b-slim b-slim added this to the 0.9.1 milestone Apr 21, 2016
@@ -24,7 +24,8 @@ All the configuration parameters for graphite emitter are under `druid.emitter.g
|`druid.emitter.graphite.flushPeriod` | Queue flushing period in milliseconds. |no|1 minute|
|`druid.emitter.graphite.maxQueueSize`| Maximum size of the queue used to buffer events. |no|`MAX_INT`|
|`druid.emitter.graphite.alertEmitters`| List of emitters where alerts will be forwarded to. |no| empty list (no forwarding)|
|`druid.emitter.graphite.emitWaitTime` | wait time in milliseconds to try to send the event otherwise emitter will throwing event. |no|1000 (1 sec)|
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO the default should be 0, it's rare that people would want to block their query threads waiting for metrics emission rather than just drop some metrics and have queries return faster.

@b-slim
Copy link
Contributor Author

b-slim commented Apr 22, 2016

@gianm fixed

@gianm
Copy link
Contributor

gianm commented Apr 22, 2016

I still think the default for offer should be 0 (drop immediately), anything else is a time bomb waiting to go off.

@gianm
Copy link
Contributor

gianm commented Apr 22, 2016

The rest generally looks good though

@b-slim
Copy link
Contributor Author

b-slim commented Apr 22, 2016

@gianm make sense, fixed

"Throwing event [%s] on the floor Graphite queue is full please increase the capacity or/and the consumer frequency",
mapper.writeValueAsString(event)
);
countLostEvents.getAndIncrement();
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this increment isn't necessary, it's happening again on the next line.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch !

@gianm
Copy link
Contributor

gianm commented Apr 22, 2016

👍 lgtm

@fjy fjy closed this Apr 22, 2016
@fjy fjy reopened this Apr 22, 2016
@fjy
Copy link
Contributor

fjy commented Apr 22, 2016

Running io.druid.query.extraction.namespace.TestKafkaExtractionCluster
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 81.083 sec <<< FAILURE! - in io.druid.query.extraction.namespace.TestKafkaExtractionCluster
testSimpleRename(io.druid.query.extraction.namespace.TestKafkaExtractionCluster) Time elapsed: 80.582 sec <<< ERROR!
com.metamx.common.ISE: renameManager took too long to start
at io.druid.query.extraction.namespace.TestKafkaExtractionCluster.setUp(TestKafkaExtractionCluster.java:272)
Running io.druid.query.extraction.namespace.KafkaExtractionNamespaceTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in io.druid.query.extraction.namespace.KafkaExtractionNamespaceTest

@fjy fjy merged commit 58510d8 into apache:master Apr 27, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants