Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplify containerd runtime configuration for gVisor #14996

Merged
merged 3 commits into from
Jul 7, 2023

Conversation

fvoznika
Copy link
Contributor

The previous code had a copy of config.toml which is easy to get out of
sync. Instead, append the necessary configuration to the existing file
to retain the rest of the configuration.

Also changed the location where runsc is downloaded to use the latest
release instead of hardcondig to a release which gets old quickly.

Fixes google/gvisor#7877

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Sep 21, 2022
@k8s-ci-robot
Copy link
Contributor

Hi @fvoznika. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Sep 21, 2022
@minikube-bot
Copy link
Collaborator

Can one of the admins verify this patch?

@spowelljr
Copy link
Member

/ok-to-test

@fvoznika
Copy link
Contributor Author

/retest

@k8s-ci-robot
Copy link
Contributor

@fvoznika: Cannot trigger testing until a trusted user reviews the PR and leaves an /ok-to-test message.

In response to this:

/retest

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@fvoznika
Copy link
Contributor Author

There is 1 pending test, does it need to be retried?

@spowelljr
Copy link
Member

/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Sep 27, 2022
@spowelljr
Copy link
Member

k8s bot didn't seem to pickup my comment the first time

@minikube-pr-bot

This comment has been minimized.

@minikube-pr-bot

This comment has been minimized.

@spowelljr
Copy link
Member

@fvoznika gVisor test is failing with the following:

Warning FailedCreatePodSandBox 1s (x20 over 4m) kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "runsc" is configured

@spowelljr spowelljr added the do-not-merge/failing-test Indicates that a PR should not merge because it has a failing test label Sep 28, 2022
@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue or PR as fresh with /remove-lifecycle stale
  • Mark this issue or PR as rotten with /lifecycle rotten
  • Close this issue or PR with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Dec 27, 2022
@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues and PRs according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue or PR as fresh with /remove-lifecycle rotten
  • Close this issue or PR with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Jan 26, 2023
@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages PRs according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the PR is closed

You can:

  • Reopen this PR with /reopen
  • Mark this PR as fresh with /remove-lifecycle rotten
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close

@k8s-ci-robot
Copy link
Contributor

@k8s-triage-robot: Closed this PR.

In response to this:

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages PRs according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the PR is closed

You can:

  • Reopen this PR with /reopen
  • Mark this PR as fresh with /remove-lifecycle rotten
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@medyagh medyagh reopened this Jun 15, 2023
@k8s-ci-robot k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 15, 2023
@minikube-pr-bot

This comment has been minimized.

@minikube-pr-bot

This comment has been minimized.

The previous code had a copy of `config.toml` which is easy to get out of
sync. Instead, append the necessary configuration to the existing file
to retain the rest of the configuration.

Also changed the location where `runsc` is downloaded to use the latest
release instead of hardcondig to a release which gets old quickly.
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 15, 2023
@minikube-pr-bot

This comment has been minimized.

@minikube-pr-bot

This comment has been minimized.

@medyagh
Copy link
Member

medyagh commented Jun 21, 2023

@spowelljr seems to break KVM gvisor test

@spowelljr
Copy link
Member

@spowelljr seems to break KVM gvisor test

Yeah, the pod's not coming up
Warning FailedCreatePodSandBox 1s (x19 over 4m) kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "runsc" is configured

@spowelljr
Copy link
Member

I got it to work locally, needed to build a new gvisor image

@spowelljr spowelljr removed lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. do-not-merge/failing-test Indicates that a PR should not merge because it has a failing test labels Jul 6, 2023
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 14996) |
+----------------+----------+---------------------+
| minikube start | 54.1s    | 50.9s               |
| enable ingress | 28.0s    | 27.0s               |
+----------------+----------+---------------------+

Times for minikube (PR 14996) ingress: 27.2s 29.2s 25.7s 26.2s 26.7s
Times for minikube ingress: 29.2s 28.3s 28.3s 26.7s 27.8s

Times for minikube (PR 14996) start: 49.4s 51.3s 52.1s 51.9s 50.1s
Times for minikube start: 55.8s 55.7s 52.7s 53.7s 52.6s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 14996) |
+----------------+----------+---------------------+
| minikube start | 23.4s    | 22.9s               |
| enable ingress | 44.4s    | 49.2s               |
+----------------+----------+---------------------+

Times for minikube start: 24.4s 22.4s 24.7s 24.4s 21.0s
Times for minikube (PR 14996) start: 22.2s 24.0s 24.6s 22.0s 21.9s

Times for minikube ingress: 48.3s 27.9s 48.8s 48.3s 48.9s
Times for minikube (PR 14996) ingress: 49.8s 48.4s 49.4s 49.3s 48.9s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 14996) |
+----------------+----------+---------------------+
| minikube start | 20.9s    | 22.2s               |
| enable ingress | 31.1s    | 28.7s               |
+----------------+----------+---------------------+

Times for minikube ingress: 30.3s 31.4s 31.3s 32.3s 30.3s
Times for minikube (PR 14996) ingress: 31.3s 30.3s 19.4s 31.4s 31.3s

Times for minikube start: 20.8s 23.5s 19.8s 20.1s 20.2s
Times for minikube (PR 14996) start: 23.4s 21.3s 24.2s 21.0s 21.2s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Hyperkit_macOS TestImageBuild/serial/Setup (gopogh) 0.65 (chart)
QEMU_macOS TestFunctional/parallel/CpCmd (gopogh) 2.68 (chart)

To see the flake rates of all tests by environment, click here.

@spowelljr spowelljr merged commit a3934b6 into kubernetes:master Jul 7, 2023
16 of 17 checks passed
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: fvoznika, spowelljr

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 7, 2023
@fvoznika
Copy link
Contributor Author

fvoznika commented Jul 7, 2023

Thanks a lot for looking into the failures and merging it!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cannot get gVisor working on minikube
7 participants