Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

KIP 714 with compression support #4721

Merged
merged 99 commits into from
Jul 8, 2024
Merged

KIP 714 with compression support #4721

merged 99 commits into from
Jul 8, 2024

Commits on Jul 25, 2023

  1. Add boilerplate for the entire flow (#4365)

    @milindl
    milindl committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    3f0eed3 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2023

  1. Added new data type UUID for topic id. Added topic id support in Meta… 

    …data Response.
    @pranavrth @milindl
    pranavrth authored and milindl committed Jul 27, 2023
    Configuration menu
    Copy the full SHA
    56fa55a View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Merge Get and Push Protocol (#4377) 

    * WIP:Push telemetry is being scheduled now.

* Push

* Compliation Fix

* Working

* Use UUID in PUSH

* Remove fprintf

* Changes

* Fix CONFIGURATION.md

* Fix size

* Update s2i bounds

---------

Co-authored-by: Milind L <miluthra@confluent.io>
    @anchitj @milindl
    anchitj and milindl committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    9546d71 View commit details
    Browse the repository at this point in the history

  2. Clang format fixes

    @anchitj
    anchitj committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    e11aa51 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2023

  1. Fix memory leaks (#4378)

    @milindl
    milindl committed Aug 2, 2023
    Configuration menu
    Copy the full SHA
    ca6a8e5 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2023

  1. Add broker selection and client termination [KIP-714] (#4382) 

    * Add broker selection and client termination

* Address review comments
    @milindl
    milindl committed Aug 7, 2023
    Configuration menu
    Copy the full SHA
    ef07a95 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2023

  1. Integrate nanopb to encode and decode metrics (#4388) 

    * Serialise metrics using nanopb

* Move nanopb and opentelemetry inside src

* Add metrics.options file

* Remove unused includes

* Style fix

* Fix formatting

* Skip copyright check

* Add nanopb and opentelemetry in windows vcxproj

* Include headers directories in CMAKE

* Use flexver with PushTelemetry

* Fix memory leaks

* Change import path

* Use rd_bool_t everywhere

* Fix librdkafka.vcxproj

* Use rd_bool_t

* PR Feedback

* Add nanopb license

* Include opentelemtry license
    @anchitj
    anchitj committed Aug 21, 2023
    Configuration menu
    Copy the full SHA
    530eb0b View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. Handle delta temporality and some code refactoring (#4410) 

    * Support for delta temporality

* Style fix

* Fix bugs

* Fix memory leaks and formatting

* Fixes

* PR Feedback
    @anchitj
    anchitj committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    5c943ba View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. Use rd_kafka_compression_t (#4419)

    @anchitj
    anchitj committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9e3cf26 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2023

  1. Add method to get requests from mock cluster

    @milindl
    milindl committed Sep 7, 2023
    Configuration menu
    Copy the full SHA
    21f7072 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. Fix to ns

    @anchitj
    anchitj committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    f1c4fc4 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Add capacity in mock broker to change PushIntervalMs

    @milindl
    milindl committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    7fdbfbe View commit details
    Browse the repository at this point in the history

  2. Fix memory leak

    @milindl
    milindl committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    e6a9d66 View commit details
    Browse the repository at this point in the history

  3. Fix jitter: should not be decimal

    @milindl
    milindl committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    e0b4f3e View commit details
    Browse the repository at this point in the history

  4. Add test for telemetry using mock broker

    @milindl
    milindl committed Sep 20, 2023
    Configuration menu
    Copy the full SHA
    d7e4b47 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2023

  1. Address comments

    @milindl
    milindl committed Sep 28, 2023
    Configuration menu
    Copy the full SHA
    a614d2c View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2023

  1. Unit tests push telemetry encode decode (#4440) 

    * Add telemetry encode and decode unit tests

* Style fix

* Improve test

* PR Feedback
    @anchitj
    anchitj committed Sep 29, 2023
    Configuration menu
    Copy the full SHA
    1216b39 View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. Initial code for metrics compression

    @anchitj
    anchitj committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    4ed6abd View commit details
    Browse the repository at this point in the history

  2. Style and some bug fixes

    @anchitj
    anchitj committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    3d66f64 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. Little refactoring

    @anchitj
    anchitj committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    88dcfc1 View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. Add max telemetry bytes (#4507) 

    * Add max telemetry bytes

* Clear telemetry_max_bytes

* PR comments
    @anchitj
    anchitj committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    81913fe View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Add other producer metrics

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    ccc1a26 View commit details
    Browse the repository at this point in the history

  2. More changes

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    b6c04ac View commit details
    Browse the repository at this point in the history

  3. Add enable.metrics.push config

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    94545fe View commit details
    Browse the repository at this point in the history

  4. Fix bugs

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    aa8a668 View commit details
    Browse the repository at this point in the history

  5. Refactor

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    8c38f8e View commit details
    Browse the repository at this point in the history

  6. Fix warnings

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    3987849 View commit details
    Browse the repository at this point in the history

  7. Fix UT

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    4d1d192 View commit details
    Browse the repository at this point in the history

  8. Nullify after free

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2f6afa2 View commit details
    Browse the repository at this point in the history

  9. Fix bugs

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    eff9351 View commit details
    Browse the repository at this point in the history

  10. Refactor

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    15fd89c View commit details
    Browse the repository at this point in the history

  11. PR Feedback

    @anchitj
    anchitj committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    d534720 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2023

  1. Upgrade vcpkg (#4531)

    @emasab @anchitj
    emasab authored and anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    7a911d9 View commit details
    Browse the repository at this point in the history

  2. Add available consumer metrics

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    40489d4 View commit details
    Browse the repository at this point in the history

  3. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    4bc1c48 View commit details
    Browse the repository at this point in the history

  4. PR Feedback

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    430745b View commit details
    Browse the repository at this point in the history

  5. labels

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    e9b2bba View commit details
    Browse the repository at this point in the history

  6. Add per broker labels

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    73d14ee View commit details
    Browse the repository at this point in the history

  7. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    4bd7946 View commit details
    Browse the repository at this point in the history

  8. Update all metrics subscribed string

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    34fca5f View commit details
    Browse the repository at this point in the history

  9. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    ebd36c8 View commit details
    Browse the repository at this point in the history

  10. PR Feedback

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    a5988d6 View commit details
    Browse the repository at this point in the history

  11. Update matching logic

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    52a6150 View commit details
    Browse the repository at this point in the history

  12. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    5a4b645 View commit details
    Browse the repository at this point in the history

  13. Add per broker labels

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    36c4f83 View commit details
    Browse the repository at this point in the history

  14. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    217ceca View commit details
    Browse the repository at this point in the history

  15. Bug fixes

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    ce9f6a1 View commit details
    Browse the repository at this point in the history

  16. Don't push terminating telemetry if metrics aren't enabled

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    5806b0f View commit details
    Browse the repository at this point in the history

  17. Match with temporality

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    7525eb4 View commit details
    Browse the repository at this point in the history

  18. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    d6cdce5 View commit details
    Browse the repository at this point in the history

  19. Add new broker errors

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    89cfa2a View commit details
    Browse the repository at this point in the history

  20. Memory leak fixes

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    8ca308b View commit details
    Browse the repository at this point in the history

  21. PR feedback

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    40edc31 View commit details
    Browse the repository at this point in the history

  22. Style fix

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    e6a88cb View commit details
    Browse the repository at this point in the history

  23. Immediate schedule getTelemetry for unknown subscription id

    @anchitj
    anchitj committed Dec 11, 2023
    Configuration menu
    Copy the full SHA
    d541a2b View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2023

  1. Rebase fix

    @anchitj
    anchitj committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    6abdf47 View commit details
    Browse the repository at this point in the history

  2. Use rd_uclock

    @anchitj
    anchitj committed Dec 12, 2023
    Configuration menu
    Copy the full SHA
    b92899b View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. Master merge

    @anchitj
    anchitj committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    ccf2ba9 View commit details
    Browse the repository at this point in the history

  2. Master merge

    @anchitj
    anchitj committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    c30a432 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. Add more mock test

    @anchitj
    anchitj committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    8d7e70b View commit details
    Browse the repository at this point in the history

  2. Master merge

    @anchitj
    anchitj committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    c815cb5 View commit details
    Browse the repository at this point in the history

  3. Style fix

    @anchitj
    anchitj committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    e516730 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Merge branch 'master' into dev_kip_714_mock_broker_integration_tests_… 

    …master_merge
    @anchitj
    anchitj committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    3cb7286 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. Merge master

    @anchitj
    anchitj committed May 10, 2024
    Configuration menu
    Copy the full SHA
    d15171b View commit details
    Browse the repository at this point in the history

  2. Merge compression

    @anchitj
    anchitj committed May 10, 2024
    Configuration menu
    Copy the full SHA
    9bf7966 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2024

  1. Merge branch 'master' into dev_kip_714_mock_broker_integration_tests_… 

    …master_merge_with_compression
    @anchitj
    anchitj committed Jun 21, 2024
    Configuration menu
    Copy the full SHA
    5c17295 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. PR feedback first phase

    @anchitj
    anchitj committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    9a0c0c2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into dev_kip_714_mock_broker_integration_tests_… 

    …master_merge_with_compression
    @anchitj
    anchitj committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    604d18f View commit details
    Browse the repository at this point in the history

  3. Minor fixes

    @anchitj
    anchitj committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    ae64b34 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Segfault fixes

    @anchitj
    anchitj committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    4f2d428 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. PR Feedback 3rd round

    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    2772552 View commit details
    Browse the repository at this point in the history

  2. Use rkb instead of rkb_selected

    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    b537675 View commit details
    Browse the repository at this point in the history

  3. Write to rbuf before returning

    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    5192995 View commit details
    Browse the repository at this point in the history

  4. Use rd_avg_rollover instead of rd_avg_current 

    Because rd_avg_current has been cleared and rolled over
    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    77fc568 View commit details
    Browse the repository at this point in the history

  5. Fix exp_max for avg counters

    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    1a04f33 View commit details
    Browse the repository at this point in the history

  6. Fix unit test

    @anchitj
    anchitj committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    4ac880c View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Reset current avg's max

    @anchitj
    anchitj committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    4566133 View commit details
    Browse the repository at this point in the history

  2. Don't use histogram in telemetry avgs

    @anchitj
    anchitj committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    e19102f View commit details
    Browse the repository at this point in the history

  3. Remove compress direct methods

    @anchitj
    anchitj committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    97589f3 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Revert "Don't use histogram in telemetry avgs" 

    This reverts commit e19102f.
    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    97b48fa View commit details
    Browse the repository at this point in the history

  2. PR Feedback 4th round

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    a5b398d View commit details
    Browse the repository at this point in the history

  3. Replace TELTERM by TERM

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    9ae5c1c View commit details
    Browse the repository at this point in the history

  4. Move first_push to telemetry.c

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    387ae01 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'master' into dev_kip_714_mock_broker_integration_tests_… 

    …master_merge_with_compression
    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    7a36b53 View commit details
    Browse the repository at this point in the history

  6. Fix unit test

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    77a75b4 View commit details
    Browse the repository at this point in the history

  7. PR feedback 5th round

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    23c3b8f View commit details
    Browse the repository at this point in the history

  8. Rename interface to decode_interface

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    69f9dcf View commit details
    Browse the repository at this point in the history

  9. PR feedback 6th round

    @anchitj
    anchitj committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    77ce834 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2024

  1. PR feedback

    @anchitj
    anchitj committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    1924e3f View commit details
    Browse the repository at this point in the history

  2. PR feedback 7th round

    @anchitj
    anchitj committed Jul 4, 2024
    Configuration menu
    Copy the full SHA
    476038a View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2024

  1. PR feedback 8th round

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    dd7d1fc View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into dev_kip_714_mock_broker_integration_tests_… 

    …master_merge_with_compression
    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    bb53d5e View commit details
    Browse the repository at this point in the history

  3. Change failure message in rd_assert

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    b78751c View commit details
    Browse the repository at this point in the history

  4. PR feedback 9th round

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    652b0ea View commit details
    Browse the repository at this point in the history

  5. Update copyright year rdkafka_conf.h

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    40b0ad8 View commit details
    Browse the repository at this point in the history

  6. Remove arg being cast as test_data

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    46e4579 View commit details
    Browse the repository at this point in the history

  7. Add changelog entry

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    0fbc703 View commit details
    Browse the repository at this point in the history

  8. Remove changes to 0009-mock_cluster.c

    @anchitj
    anchitj committed Jul 5, 2024
    Configuration menu
    Copy the full SHA
    bbd316b View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2024

  1. PR feedback 10th round

    @anchitj
    anchitj committed Jul 8, 2024
    Configuration menu
    Copy the full SHA
    4732ff6 View commit details
    Browse the repository at this point in the history