Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add implementation for save index job #2227

Merged
merged 18 commits into from
Nov 8, 2023
Merged

Add implementation for save index job #2227

merged 18 commits into from
Nov 8, 2023

Conversation

hlts2
Copy link
Contributor

@hlts2 hlts2 commented Nov 6, 2023

Description:

I added a component to execute the saveIndex requests to agents.
This component will run as a k8s job in the future.

NOTE

This component name is index-save to match the naming of the other components (index-correction, index-creation). This may change in the future at the time of refactoring.

Related Issue:

Versions:

  • Go Version: 1.21.3
  • Docker Version: 20.10.8
  • Kubernetes Version: v1.28.2
  • NGT Version: 2.1.3

Checklist:

Special notes for your reviewer:

@vdaas-ci
Copy link
Collaborator

vdaas-ci commented Nov 6, 2023

[CHATOPS:HELP] ChatOps commands.

  • 🙆‍♀️ /approve - approve
  • 🍱 /format - format codes and add licenses
  • /gen-test - generate test codes
  • 🏷️ /label - add labels
  • 🔚 2️⃣ 🔚 /label actions/e2e-deploy - run E2E deploy & integration test

@vdaas-ci
Copy link
Collaborator

vdaas-ci commented Nov 6, 2023

[WARNING:INTCFG] Changes in interal/config may require you to change Helm charts. Please check.

Copy link

cloudflare-pages bot commented Nov 6, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: 90cea88
Status: ✅  Deploy successful!
Preview URL: https://52f66bff.vald.pages.dev
Branch Preview URL: https://feature-index-job-save.vald.pages.dev

View logs

Copy link

codecov bot commented Nov 6, 2023

Codecov Report

Attention: 274 lines in your changes are missing coverage. Please review.

Files Coverage Δ
internal/config/index_save.go 0.00% <0.00%> (ø)
pkg/index/job/save/service/options.go 5.00% <5.00%> (ø)
pkg/index/job/save/config/config.go 0.00% <0.00%> (ø)
pkg/index/job/save/service/indexer.go 35.55% <35.55%> (ø)
pkg/index/job/save/usecase/save.go 0.00% <0.00%> (ø)

... and 7 files with indirect coverage changes

📢 Thoughts on this report? Let us know!

pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
pkg/index/job/save/service/mock_test.go Outdated Show resolved Hide resolved
deepsource-autofix bot added a commit that referenced this pull request Nov 6, 2023
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
@hlts2 hlts2 changed the title Add implementation for index save job Add implementation for save index job Nov 6, 2023
hlts2 pushed a commit that referenced this pull request Nov 6, 2023
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
hlts2 and others added 8 commits November 7, 2023 09:49
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
@hlts2 hlts2 requested a review from a team November 7, 2023 00:52
@hlts2 hlts2 requested a review from vankichi November 8, 2023 03:39
ykadowak
ykadowak previously approved these changes Nov 8, 2023
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
ykadowak
ykadowak previously approved these changes Nov 8, 2023
@hlts2 hlts2 requested a review from vankichi November 8, 2023 07:05
vankichi
vankichi previously approved these changes Nov 8, 2023
Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
@hlts2 hlts2 dismissed stale reviews from vankichi and ykadowak via 90cea88 November 8, 2023 07:22
@vankichi vankichi merged commit c5cbfc9 into main Nov 8, 2023
101 of 103 checks passed
@vankichi vankichi deleted the feature/index-job/save branch November 8, 2023 07:43
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
ykadowak added a commit that referenced this pull request Nov 30, 2023
@vankichi vankichi mentioned this pull request Dec 4, 2023
kmrmt pushed a commit that referenced this pull request Dec 12, 2023
* add index save implementation

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* make gotest/gen and make format

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: sample configuration data

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* feat: add save indexing test

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* style: format code with Gofumpt and Prettier

This commit fixes the style issues introduced in 84ade79 according to the output
from Gofumpt and Prettier.

Details: #2227

* fix: deleted unnecessary code

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: update debug error message

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: option name

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: test case name

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* Update cmd/index/job/save/sample.yaml

Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com>

* Update pkg/index/job/save/config/config.go

Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com>

* fix: add comment for test case

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: fix method naming

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* feat: add mock for discoverer client and grpc client

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: struct tag for config

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

* fix: cyclic import for testing

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>

---------

Signed-off-by: hlts2 <hiroto.funakoshi.hiroto@gmail.com>
Co-authored-by: deepsource-autofix[bot] <62050782+deepsource-autofix[bot]@users.noreply.github.com>
Co-authored-by: Kiichiro YUKAWA <kyukawa315@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants