Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(deps): major version updates in /scheduler/data-flow #5639

Merged
merged 1 commit into from
May 24, 2024

Conversation

lc525
Copy link
Member

@lc525 lc525 commented May 23, 2024

  • bump kotlin language version 1.8.20 -> 1.9.21
  • bump kotlinx-coroutines-core 1.7.3 -> 1.8.1
  • bump io.grpc:grpc-* 1.63.0 -> 1.64.0

The only remaining update that we would like to make to dataflow is bumping JDK 17 -> JDK 21. However, that update is currently blocked by the requirements of kafka-streams; The confluent platform libraries that we're using (kafka-streams:7.6.1-ccs) have only been tested up to JDK 17 according to: https://docs.confluent.io/platform/current/installation/versions-interoperability.html#java

Which issue(s) this PR fixes:

  • INFRA-721 (Internal): Bump dataflow dependency versions

Special notes for your reviewer:

  • Tested in kind (pipelines smoke test). Same behaviour as before the updates.
  • The unrelated code updates just touch the code used by a test, in order to eliminate some compilation warnings

- bump kotlin language version 1.8.20 -> 1.9.21
- bump kotlinx-coroutines-core 1.7.3 -> 1.8.1
- bump io.grpc:grpc-* 1.63.0 -> 1.64.0

The only remaining update that we would like to make to dataflow is bumping
JDK 17 -> JDK 21. However, that update is currently blocked by the
requirements of kafka-streams; The confluent platform libraries that we're
using (kafka-streams:7.6.1-ccs) have only been tested up to JDK 17 according
to: https://docs.confluent.io/platform/current/installation/versions-interoperability.html#java
@lc525 lc525 added the v2 label May 23, 2024
@lc525 lc525 requested a review from sakoush as a code owner May 23, 2024 21:24
@lc525 lc525 changed the title bump(deps): major version updates in /scheduler/data-flow fix(deps): major version updates in /scheduler/data-flow May 23, 2024
Copy link
Member

@sakoush sakoush left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@@ -10,14 +10,15 @@ the Change License after the Change Date as each is defined in accordance with t
package io.seldon.dataflow

import kotlinx.coroutines.CoroutineScope
import kotlinx.coroutines.ExperimentalCoroutinesApi
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

question: curious what is this adding?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some parallel operations on Flows (i.e parallel processing of elements in a flow, like the one we want to do for pipelines) are marked as experimental, with semantics that might change. We have a test that uses some of those to see how they behave.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Functions calling those experimental operations just need to be marked with the ExperimentalCoroutinesApi decorator in order to avoid a compiler warning.

@lc525 lc525 merged commit 06fa148 into SeldonIO:v2 May 24, 2024
4 of 5 checks passed
@lc525 lc525 deleted the INFRA-721/dataflow-version-bumps branch May 24, 2024 09:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants