Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[package] arrow/17.0.0: Unable to install Arrow 17.0.0 with GCS enabled via conan #24996

Open
ppkowalski opened this issue Aug 21, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@ppkowalski
Copy link

ppkowalski commented Aug 21, 2024

Description

I am trying to install arrow 17 with conan 2.6.0 on Ubuntu22.04. My conanfile.py:

from conan import ConanFile

class ArrowTest(ConanFile):
    name = "arrow test"
    license = "MIT"
    description = "Arrow test"
    options = {"shared": [True, False]}
    default_options = {
        "shared": False,
        "arrow/*:acero": True,
        "arrow/*:compute": True,
        "arrow/*:dataset_modules": True,
        "arrow/*:parquet": True,
        "arrow/*:with_boost": True,
        "arrow/*:with_thrift": True,
        "arrow/*:with_flight_rpc": True,
        "arrow/*:filesystem_layer": True,
        "arrow/*:with_protobuf": True,
        "arrow/*:with_gflags": True,
        "arrow/*:with_csv": True,
        "arrow/*:with_gcs": True,
        "arrow/*:with_re2": True,
        "arrow/*:with_grpc": True,
    }

    generators = ["CMakeDeps", "CMakeToolchain"]
    exports_sources = ["CMakeLists.txt", "src/*"]
    settings = "build_type"
    build_policy = "missing"

    def requirements(self):
        self.requires("arrow/17.0.0")
        self.requires("grpc/1.54.3", override=True)
        self.requires("google-cloud-cpp/2.12.0", override=True)

The overrides are needed, because google-cloud-cpp is requested by arrow in version 1.40.1 which is not supported by conan 2.

However at some point I am getting errors (see the log messages attached)

Package and Environment Details

  • Package Name/Version: arrow/17.0.0
  • Operating System+version: Linux Ubuntu 22.04
  • Compiler+version: GCC 12
  • Docker image: nvidia/cuda:12.4.1-devel-ubuntu22.04
  • Conan version: conan 2.6.0
  • Python version: Python 3.10.12

Conan profile

[settings]
arch=x86_64
build_type=Debug
compiler=gcc
compiler.cppstd=gnu17
compiler.libcxx=libstdc++11
compiler.version=10
os=Linux

Steps to reproduce

conan install . --build=missing --output-folder=build --profile=debug

Logs

Click to expand log -- Providing CMake module for FindgRPCAlt as part of ArrowFlight CMake package -- pkg-config package for grpc++ that is used by arrow-flight for static link isn't found CMake Error at cmake_modules/ThirdpartyToolchain.cmake:310 (find_package): By not providing "Findnlohmann_json.cmake" in CMAKE_MODULE_PATH this project has asked CMake to find a package configuration file provided by "nlohmann_json", but CMake did not find one.

Could not find a package configuration file provided by "nlohmann_json"
with any of the following names:

nlohmann_jsonConfig.cmake
nlohmann_json-config.cmake

Add the installation prefix of "nlohmann_json" to CMAKE_PREFIX_PATH or set
"nlohmann_json_DIR" to a directory containing one of the above files. If
"nlohmann_json" provides a separate development package or SDK, be sure it
has been installed.
Call Stack (most recent call first):
cmake_modules/ThirdpartyToolchain.cmake:4251 (resolve_dependency)
CMakeLists.txt:544 (include)

-- Configuring incomplete, errors occurred!

arrow/17.0.0: ERROR:
Package 'e67d4e73024d64e3e32a44a09882bca88d817bbf' build failed
arrow/17.0.0: WARN: Build folder /home/ppkowalski/.conan2/p/b/arrow3de7586871a98/b/build/Debug
ERROR: arrow/17.0.0: Error in build() method, line 414
cmake.configure(build_script_folder=os.path.join(self.source_folder, "cpp"))
ConanException: Error 1 while executing

I thought about installing nlohmann-json3-dev package using apt on the system (which I prefer not to, since I'd like to install everything with conan), then it goes further, however I am getting another error:

-- Providing CMake module for FindgRPCAlt as part of ArrowFlight CMake package
-- pkg-config package for grpc++ that is used by arrow-flight for static link isn't found
-- Found nlohmann_json: /usr/lib/cmake/nlohmann_json/nlohmann_jsonConfig.cmake (found version "3.10.5")
-- Found nlohmann_json headers: /usr/include;/usr/include
CMake Error at cmake_modules/ThirdpartyToolchain.cmake:310 (find_package):
By not providing "Findgoogle_cloud_cpp_storage.cmake" in CMAKE_MODULE_PATH
this project has asked CMake to find a package configuration file provided
by "google_cloud_cpp_storage", but CMake did not find one.

Could not find a package configuration file provided by
"google_cloud_cpp_storage" with any of the following names:

google_cloud_cpp_storageConfig.cmake
google_cloud_cpp_storage-config.cmake

Add the installation prefix of "google_cloud_cpp_storage" to
CMAKE_PREFIX_PATH or set "google_cloud_cpp_storage_DIR" to a directory
containing one of the above files. If "google_cloud_cpp_storage" provides
a separate development package or SDK, be sure it has been installed.
Call Stack (most recent call first):
cmake_modules/ThirdpartyToolchain.cmake:4462 (resolve_dependency)
CMakeLists.txt:544 (include)

-- Configuring incomplete, errors occurred!

arrow/17.0.0: ERROR:
Package 'e67d4e73024d64e3e32a44a09882bca88d817bbf' build failed
arrow/17.0.0: WARN: Build folder /home/ppkowalski/.conan2/p/b/arrow191307691fc54/b/build/Debug
ERROR: arrow/17.0.0: Error in build() method, line 414
cmake.configure(build_script_folder=os.path.join(self.source_folder, "cpp"))
ConanException: Error 1 while executing


</details>
@ppkowalski ppkowalski added the bug Something isn't working label Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant