Skip to content

Commit

Permalink
fix: Clarify comment in backup consumer logic (Aiven-Open#781)
Browse files Browse the repository at this point in the history
* fix: Clarify comment in backup consumer logic

* Update api.py
  • Loading branch information
aiven-anton committed Jun 13, 2024
1 parent 38acabd commit 7a30144
Showing 1 changed file with 7 additions and 1 deletion.
8 changes: 7 additions & 1 deletion karapace/backup/api.py
Original file line number Diff line number Diff line change
Expand Up @@ -299,7 +299,13 @@ def _consume_records(
if start_offset >= end_offset:
raise EmptyPartition

end_offset -= 1 # high watermark to actual end offset
# confluent-kafka-python returns end offset + 1, i.e. the value that will
# be assigned to the next record to be produced. To get the highest offset
# already produced we need to subtract 1. Note that this has little to do
# with high watermark, which takes into account the highest record offset
# to be fully in sync across ISRs, and therefore can be an arbitrary
# number less than or equal to the LEO.
end_offset -= 1

while True:
record: Message | None = consumer.poll(timeout=poll_timeout.seconds)
Expand Down

0 comments on commit 7a30144

Please sign in to comment.