Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cherry-pick #18655 to 7.x: Remove vendor folder from the repository #19477

Merged
merged 2 commits into from
Jun 29, 2020

Conversation

kvch
Copy link
Contributor

@kvch kvch commented Jun 29, 2020

Cherry-pick of PR #18655 to 7.x branch. Original message:

What does this PR do?

This PR removes the vendor folder from the repository.

By removing the folder we become vulnerable to new dangers:

  • a package becomes unavailable
  • temporary network errors

To combat these we are adopting Artifactory and mirroring these modules to our own infra. Before we merge this PR we need to make sure we are prepared to mitigate these issues. So a working Artifactory mirror is a must-have beforehand.

We decided to merge this without Artifactory. APM team had no issues with building their binaries consistently without an own package mirror, so we are positive this decision won't have a big impact on our builds.

To update dependencies, use the standard tools provided by Golang:

$ go get github.com/elastic/go-structform@v0.3.0
$ make notice

Why is it important?

We need to remove dependencies, as we are not allowed to vendor every dependency we use.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

To update or add a dependency use the standard tools provided by Golang.
(cherry picked from commit 5426df0)
@kvch kvch requested review from a team as code owners June 29, 2020 05:44
@kvch kvch added [zube]: In Review backport Team:Services (Deprecated) Label for the former Integrations-Services team labels Jun 29, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jun 29, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jun 29, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Jun 29, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19477 updated]

  • Start Time: 2020-06-29T07:35:35.116+0000

  • Duration: 25 min 28 sec

Steps errors

Expand to view the steps failures

  • Name: Install Mage

    • Description: make mage

    • Duration: 0 min 0 sec

    • Start Time: 2020-06-29T08:00:57.555+0000

    • log

  • Name: Install Mage

    • Description: make mage

    • Duration: 0 min 0 sec

    • Start Time: 2020-06-29T08:00:57.902+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-06-29T08:00:59.566Z] Stage "Build and Test" skipped due to earlier failure(s)
[2020-06-29T08:00:59.836Z] Stage "Elastic Agent x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.837Z] Stage "Elastic Agent x-pack Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.838Z] Stage "Elastic Agent Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.838Z] Stage "Filebeat oss" skipped due to earlier failure(s)
[2020-06-29T08:00:59.839Z] Stage "Filebeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.840Z] Stage "Filebeat Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.841Z] Stage "Filebeat x-pack Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.841Z] Stage "Filebeat Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.842Z] Stage "Filebeat x-pack Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.843Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.843Z] Stage "Auditbeat oss Linux" skipped due to earlier failure(s)
[2020-06-29T08:00:59.844Z] Stage "Auditbeat crosscompile" skipped due to earlier failure(s)
[2020-06-29T08:00:59.845Z] Stage "Auditbeat oss Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.847Z] Stage "Auditbeat oss Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.848Z] Stage "Auditbeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.849Z] Stage "Auditbeat x-pack Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.851Z] Stage "Auditbeat x-pack Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.852Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.852Z] Stage "Libbeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.853Z] Stage "Metricbeat OSS Unit tests" skipped due to earlier failure(s)
[2020-06-29T08:00:59.855Z] Stage "Metricbeat OSS Integration tests" skipped due to earlier failure(s)
[2020-06-29T08:00:59.856Z] Stage "Metricbeat Python integration tests" skipped due to earlier failure(s)
[2020-06-29T08:00:59.856Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.857Z] Stage "Metricbeat crosscompile" skipped due to earlier failure(s)
[2020-06-29T08:00:59.858Z] Stage "Metricbeat Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.859Z] Stage "Metricbeat x-pack Mac OS X" skipped due to earlier failure(s)
[2020-06-29T08:00:59.860Z] Stage "Metricbeat Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.861Z] Stage "Metricbeat x-pack Windows" skipped due to earlier failure(s)
[2020-06-29T08:00:59.862Z] Stage "Packetbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.863Z] Stage "dockerlogbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.863Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.864Z] Stage "Winlogbeat Windows x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.864Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.865Z] Stage "Journalbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.866Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-29T08:00:59.866Z] Stage "Kubernetes" skipped due to earlier failure(s)
[2020-06-29T08:00:59.964Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.966Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.967Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:00:59.968Z] Stage "Packetbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.969Z] Stage "dockerlogbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.969Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.970Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.971Z] Stage "Journalbeat" skipped due to earlier failure(s)
[2020-06-29T08:00:59.972Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-29T08:01:00.569Z] Failed in branch Elastic Agent x-pack
[2020-06-29T08:01:00.570Z] Failed in branch Elastic Agent x-pack Windows
[2020-06-29T08:01:00.571Z] Failed in branch Elastic Agent Mac OS X
[2020-06-29T08:01:00.571Z] Failed in branch Filebeat oss
[2020-06-29T08:01:00.572Z] Failed in branch Filebeat x-pack
[2020-06-29T08:01:00.573Z] Failed in branch Filebeat Mac OS X
[2020-06-29T08:01:00.573Z] Failed in branch Filebeat x-pack Mac OS X
[2020-06-29T08:01:00.574Z] Failed in branch Filebeat Windows
[2020-06-29T08:01:00.574Z] Failed in branch Filebeat x-pack Windows
[2020-06-29T08:01:00.575Z] Failed in branch Auditbeat oss Linux
[2020-06-29T08:01:00.576Z] Failed in branch Auditbeat crosscompile
[2020-06-29T08:01:00.576Z] Failed in branch Auditbeat oss Mac OS X
[2020-06-29T08:01:00.577Z] Failed in branch Auditbeat oss Windows
[2020-06-29T08:01:00.577Z] Failed in branch Auditbeat x-pack
[2020-06-29T08:01:00.578Z] Failed in branch Auditbeat x-pack Mac OS X
[2020-06-29T08:01:00.579Z] Failed in branch Auditbeat x-pack Windows
[2020-06-29T08:01:00.579Z] Failed in branch Libbeat x-pack
[2020-06-29T08:01:00.580Z] Failed in branch Metricbeat OSS Unit tests
[2020-06-29T08:01:00.581Z] Failed in branch Metricbeat OSS Integration tests
[2020-06-29T08:01:00.581Z] Failed in branch Metricbeat Python integration tests
[2020-06-29T08:01:00.582Z] Failed in branch Metricbeat crosscompile
[2020-06-29T08:01:00.582Z] Failed in branch Metricbeat Mac OS X
[2020-06-29T08:01:00.583Z] Failed in branch Metricbeat x-pack Mac OS X
[2020-06-29T08:01:00.584Z] Failed in branch Metricbeat Windows
[2020-06-29T08:01:00.584Z] Failed in branch Metricbeat x-pack Windows
[2020-06-29T08:01:00.585Z] Failed in branch Winlogbeat Windows x-pack
[2020-06-29T08:01:00.585Z] Failed in branch Kubernetes
[2020-06-29T08:01:00.872Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:00.873Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:00.875Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-29T08:01:00.876Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:00.877Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:00.878Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-29T08:01:00.938Z] Failed in branch Packetbeat
[2020-06-29T08:01:00.938Z] Failed in branch dockerlogbeat
[2020-06-29T08:01:00.939Z] Failed in branch Journalbeat
[2020-06-29T08:01:01.137Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:01.138Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:01.139Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-29T08:01:01.140Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-29T08:01:01.176Z] Failed in branch Metricbeat x-pack
[2020-06-29T08:01:01.176Z] Failed in branch Winlogbeat
[2020-06-29T08:01:01.344Z] Failed in branch Heartbeat
[2020-06-29T08:01:01.344Z] Failed in branch Libbeat
[2020-06-29T08:01:01.345Z] Failed in branch Functionbeat
[2020-06-29T08:01:01.346Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-29T08:01:01.420Z] Failed in branch Generators
[2020-06-29T08:01:02.125Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19477
[2020-06-29T08:01:02.239Z] [INFO] getVaultSecret: Getting secrets
[2020-06-29T08:01:02.302Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-29T08:01:03.155Z] + chmod 755 generate-build-data.sh
[2020-06-29T08:01:03.155Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19477/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19477/runs/2 FAILURE 1527772
[2020-06-29T08:01:03.155Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19477/runs/2/steps/?limit=10000 -o steps-info.json
[2020-06-29T08:01:03.405Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19477/runs/2/tests/?status=FAILED -o tests-errors.json

Copy link
Contributor

@michalpristas michalpristas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, fix included

@kvch kvch merged commit c806e5b into elastic:7.x Jun 29, 2020
@zube zube bot removed the [zube]: Done label Oct 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport Team:Services (Deprecated) Label for the former Integrations-Services team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants