Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sketch cache key should include size, isInputThetaSketch. #2893

Merged
merged 1 commit into from
Apr 28, 2016

Conversation

gianm
Copy link
Contributor

@gianm gianm commented Apr 28, 2016

No description provided.

@gianm gianm added the Bug label Apr 28, 2016
@gianm gianm added this to the 0.9.1 milestone Apr 28, 2016
@fjy fjy merged commit 909abd1 into apache:master Apr 28, 2016
@himanshug
Copy link
Contributor

@gianm getCacheKey() is a query time concept and not having those two fields in the cache key should be OK? It was intentional to not have those in cache key.
Did you encounter any issues there?

@gianm
Copy link
Contributor Author

gianm commented Apr 28, 2016

@himanshug wouldn't the size of the sketch affect query results? especially if this is run over a field which at query time is a string, not a sketch metric.

@himanshug
Copy link
Contributor

@gianm yeah , you are right, size would have impact on accuracy, i stand corrected. but isInputThetaSketch shouldn't change anything at query time.

@gianm
Copy link
Contributor Author

gianm commented Apr 28, 2016

I was thinking that isInputThetaSketch = false on a sketch metric should succeed, and isInputThetaSketch = true on a string column should fail, so if someone changes it from false to true that should fail (rather than pull from cache)

@gianm
Copy link
Contributor Author

gianm commented Apr 28, 2016

same for the reverse.

@himanshug
Copy link
Contributor

isInputThetaSketch is only useful while ingestion if your input data was sketches... at query time it plays no role.
at query time , users would just leave it be default.

@gianm
Copy link
Contributor Author

gianm commented Apr 28, 2016

@himanshug ah I see, you use instanceof at query time to determine the type, not isInputThetaSketch. ok, that should be removed from the cache key. will do another pr.

@gianm
Copy link
Contributor Author

gianm commented Apr 28, 2016

#2899

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants