-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Batch ingestion replace #12137
Batch ingestion replace #12137
Commits on Feb 18, 2022
-
Tombstone support for replace functionality
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 682f957 - Browse repository at this point
Copy the full SHA 682f957View commit details -
A used segment interval is the interval of a current used segment tha…
…t overlaps any of the input intervals for the spec
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 2be134d - Browse repository at this point
Copy the full SHA 2be134dView commit details -
Update compaction test to match replace behavior
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 26177b6 - Browse repository at this point
Copy the full SHA 26177b6View commit details -
Adapt ITAutoCompactionTest to work with tombstones rather than droppi…
…ng segments. Add support for tombstones in the broker.
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 3b99a81 - Browse repository at this point
Copy the full SHA 3b99a81View commit details -
Style plus simple queriableindex test
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for ac44e56 - Browse repository at this point
Copy the full SHA ac44e56View commit details -
Add segment cache loader tombstone test
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 86fd028 - Browse repository at this point
Copy the full SHA 86fd028View commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 4855929 - Browse repository at this point
Copy the full SHA 4855929View commit details -
Add a method to the LogicalSegment to test whether it has any data
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for f2e52ad - Browse repository at this point
Copy the full SHA f2e52adView commit details -
Test filter with some empty logical segments
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 84ea1a7 - Browse repository at this point
Copy the full SHA 84ea1a7View commit details -
Refactor more compaction/dropexisting tests
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for b66d8a1 - Browse repository at this point
Copy the full SHA b66d8a1View commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 4d5df0a - Browse repository at this point
Copy the full SHA 4d5df0aView commit details -
Support for all empty segments
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for b4a935a - Browse repository at this point
Copy the full SHA b4a935aView commit details -
Skip tombstones when looking-up broker's timeline. Discard changes ma…
…de to tool chest to avoid empty segments since they will no longer have empty segments after lookup because we are skipping over them.
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 6481003 - Browse repository at this point
Copy the full SHA 6481003View commit details -
Fix null ptr when segment does not have a queriable index
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 6141c18 - Browse repository at this point
Copy the full SHA 6141c18View commit details -
Add support for empty replace interval (all input data has been filte…
…red out)
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 5428675 - Browse repository at this point
Copy the full SHA 5428675View commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 3352fb6 - Browse repository at this point
Copy the full SHA 3352fb6View commit details -
Find tombstone versions from lock versions
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 173c2e1 - Browse repository at this point
Copy the full SHA 173c2e1View commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for d77a0c4 - Browse repository at this point
Copy the full SHA d77a0c4View commit details -
Interner was making this fail since the two segments were consider eq…
…ual due to their id's being equal
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 46cc72e - Browse repository at this point
Copy the full SHA 46cc72eView commit details -
Cleanup tombstone version code
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for a685cc6 - Browse repository at this point
Copy the full SHA a685cc6View commit details -
Force timeChunkLock whenever replace (i.e. dropExisting=true) is bein…
…g used
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for d0fbef9 - Browse repository at this point
Copy the full SHA d0fbef9View commit details -
Reject replace spec when input intervals are empty
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for a7ec8dc - Browse repository at this point
Copy the full SHA a7ec8dcView commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for faf2720 - Browse repository at this point
Copy the full SHA faf2720View commit details -
Agustin Gonzalez committed
Feb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 4fe9548 - Browse repository at this point
Copy the full SHA 4fe9548View commit details -
Restore test code deleted by mistake
Agustin Gonzalez committedFeb 18, 2022 Configuration menu - View commit details
-
Copy full SHA for 404072c - Browse repository at this point
Copy the full SHA 404072cView commit details
Commits on Feb 19, 2022
-
Allocate forces TIME_CHUNK locking and uses lock versions. TombstoneS…
…hardSpec added.
Agustin Gonzalez committedFeb 19, 2022 Configuration menu - View commit details
-
Copy full SHA for c6d0271 - Browse repository at this point
Copy the full SHA c6d0271View commit details
Commits on Feb 21, 2022
-
Unused imports. Dead code. Test coverage.
Agustin Gonzalez committedFeb 21, 2022 Configuration menu - View commit details
-
Copy full SHA for 617eb0b - Browse repository at this point
Copy the full SHA 617eb0bView commit details
Commits on Feb 22, 2022
-
Agustin Gonzalez committed
Feb 22, 2022 Configuration menu - View commit details
-
Copy full SHA for a977f21 - Browse repository at this point
Copy the full SHA a977f21View commit details
Commits on Feb 23, 2022
-
Prevent killer from throwing an exception for tombstones. This is the…
… killer used in the peon for killing segments.
Agustin Gonzalez committedFeb 23, 2022 Configuration menu - View commit details
-
Copy full SHA for 151d674 - Browse repository at this point
Copy the full SHA 151d674View commit details -
Fix OmniKiller + more test coverage.
Agustin Gonzalez committedFeb 23, 2022 Configuration menu - View commit details
-
Copy full SHA for 3f5d1dc - Browse repository at this point
Copy the full SHA 3f5d1dcView commit details -
Tombstones are now marked using a shard spec
Agustin Gonzalez committedFeb 23, 2022 Configuration menu - View commit details
-
Copy full SHA for c62d36b - Browse repository at this point
Copy the full SHA c62d36bView commit details
Commits on Feb 26, 2022
-
Drop a segment factory.json in the segment cache for tombstones
Agustin Gonzalez committedFeb 26, 2022 Configuration menu - View commit details
-
Copy full SHA for 0ad63a8 - Browse repository at this point
Copy the full SHA 0ad63a8View commit details
Commits on Feb 27, 2022
-
Merge branch 'master' into batch_ingestion_replace
Agustin Gonzalez committedFeb 27, 2022 Configuration menu - View commit details
-
Copy full SHA for 8680fe4 - Browse repository at this point
Copy the full SHA 8680fe4View commit details
Commits on Feb 28, 2022
-
Agustin Gonzalez committed
Feb 28, 2022 Configuration menu - View commit details
-
Copy full SHA for 55c0a38 - Browse repository at this point
Copy the full SHA 55c0a38View commit details -
Agustin Gonzalez committed
Feb 28, 2022 Configuration menu - View commit details
-
Copy full SHA for 9f7cc10 - Browse repository at this point
Copy the full SHA 9f7cc10View commit details -
Merge branch 'temp' into batch_ingestion_replace
Agustin Gonzalez committedFeb 28, 2022 Configuration menu - View commit details
-
Copy full SHA for f4c3440 - Browse repository at this point
Copy the full SHA f4c3440View commit details -
Agustin Gonzalez committed
Feb 28, 2022 Configuration menu - View commit details
-
Copy full SHA for 15f9db3 - Browse repository at this point
Copy the full SHA 15f9db3View commit details
Commits on Mar 1, 2022
-
Add TombstoneLoadSpec.class to mapper in test
Agustin Gonzalez committedMar 1, 2022 Configuration menu - View commit details
-
Copy full SHA for 1f6a80e - Browse repository at this point
Copy the full SHA 1f6a80eView commit details
Commits on Mar 5, 2022
-
Merge branch 'master' into batch_ingestion_replace
Agustin Gonzalez committedMar 5, 2022 Configuration menu - View commit details
-
Copy full SHA for db30f5f - Browse repository at this point
Copy the full SHA db30f5fView commit details -
Merge branch 'master' into batch_ingestion_replace
Agustin Gonzalez committedMar 5, 2022 Configuration menu - View commit details
-
Copy full SHA for ca1d5a2 - Browse repository at this point
Copy the full SHA ca1d5a2View commit details
Commits on Mar 8, 2022
-
Merge branch 'master' into batch_ingestion_replace
Agustin Gonzalez committedMar 8, 2022 Configuration menu - View commit details
-
Copy full SHA for 36d638c - Browse repository at this point
Copy the full SHA 36d638cView commit details -
Update core/src/main/java/org/apache/druid/segment/loading/TombstoneL…
…oadSpec.java Typo Co-authored-by: Jonathan Wei <jon-wei@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c14cdfc - Browse repository at this point
Copy the full SHA c14cdfcView commit details -
Update docs/configuration/index.md
Missing Co-authored-by: Jonathan Wei <jon-wei@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for fcd2833 - Browse repository at this point
Copy the full SHA fcd2833View commit details -
Agustin Gonzalez committed
Mar 8, 2022 Configuration menu - View commit details
-
Copy full SHA for d6a0179 - Browse repository at this point
Copy the full SHA d6a0179View commit details -
Integrated replace with an existing test since the replace part was r…
…edundant and more importantly, the test file was very close or exceeding the 10 min default "no output" CI Travis threshold.
Agustin Gonzalez committedMar 8, 2022 Configuration menu - View commit details
-
Copy full SHA for c966bdb - Browse repository at this point
Copy the full SHA c966bdbView commit details -
Range does not work with multi-dim
Agustin Gonzalez committedMar 8, 2022 Configuration menu - View commit details
-
Copy full SHA for 933a3fc - Browse repository at this point
Copy the full SHA 933a3fcView commit details