List of packages yet to adopt artifacts

[ViralBShah]

This is based on a script @pfitzseb wrote. These are packages that do not use jll packages in 1.3+, but depend on BinaryProvider. This does not include packages that use their own binary download mechanisms.

Must have group

• Blosc
• Cbc
• Clp *issue
• Cubature *issue
• Cxx
• CxxWrap *specifically libcxxwrap-julia
• DecFP *PR
• Elemental
• ECOS
• FastTransforms - Still uses BinaryProvider in Compat
• Fontconfig (PR)
• GLPK
• GSL *PR
• Ipopt
• LibCURL
• LIBLINEAR
• LIBSVM
• LightXML * PR
• MySQL *** BP only for <1.3
• NLopt
• NNlib
• PCRE2 Stdlib. Probably should be removed from General.
• PROPACK - Still uses BinaryProvider in Compat
• SQLite *** BP only for < 1.3
• StringEncodings
• SuiteSparse Stdlib. Should probably be removed from General
• Sundials *PR
• SCS
• SDPA
• SymEngine
• TextAnalysis
• Turing doesn't used BinaryProvider at all, unused dependency removed in Remove unused dependencies and imports TuringLang/Turing.jl#1182
• XGBoost *PR

Nice to have

• AMDGPUnative
• ArbNumerics
• BayesOpt
• CALCEPH
• CDDLib
• CSFML
• CUDD
• Chemfiles
• Clipper
• CodecXz
• Cuba
• Darknet
• Deldir
• Dierckx
• ERFA
• EarCut
• FIGlet
• FITSIO
• GithubMarkdown
• Gmsh
• GmshTools
• GoogleCodeSearch
• GR
• Gumbo
• H3
• HSL
• Hanabi
• Hwloc
• ITK
• InstantiateFromURL
• JSONSchema
• KaTeX
• LSL
• LazIO
• LibPQ
• LibSpatialIndex
• LibSymspg
• LibYAML
• Libtask
• Libxc
• MFrontInterface
• MakieGallery
• Mongoc
• Nemo
• Nettle *issue
• Nuklear
• OSQP
• Polymake
• RNGTest
• Remark
• RingBuffers
• SDPAFamily
• SPICE
• Sass
• Shoco
• Singular
• Snappy
• SodiumSeal
• SoftPosit
• Spot
• StringAnalysis
• TetGen
• Thrift
• Triangulate
• ViZDoom
• WCS
• WebAssembly
• XXhash
• Xsum
• YAJL
• YOLO

[ViralBShah]

This list is not perfect, and includes

1. Stdlibs that will become JLLs
2. Use JLLs on master but need a release
3. Still have BinaryProvider in project file but don't actually use it
4. Actually still depend on BinaryProvider on master
5. Depends on BinaryProvider to support Julia versions older than 1.2
6. Work in progress packages that are being prepared for artifacts

Also, some packages are more widely used than others. I have split the list into "must have" and "nice to have", but of course, I don't have a strong view on it. Happy to move things around further.

[j-fu]

Hi, Triangulate.jl is ready for it, but how to organize things to keep supporting Julia 1.0 ? Would also care about TetGen if time permits.

[ViralBShah]

Many packages have moved to 1.3+ so that they only support artifacts. I think in the spirit of moving forward, that is the right thing to do.

[ViralBShah]

@mlubin Is there an effort for moving the various solvers that JuMP users towards artifacts?

[odow]

The COIN solvers Cbc, Clp, and Ipopt have exceedingly complicated build systems (#509). I have no estimate for how much work is required to make it work. @juan-pablo-vielma managed to make the current binary builders work only after hours and hours of trial and error, and packaging everything up into one giant binary.

Is this a "would be nice to use jll's" or will the current binary builder implementations stop working on a future 1.x release?!?

GLPK is probably not too hard. I'll take a look.

[giordano]

Let's continue the discussion about Clp in #509, no need to clutter this issue

[mlubin]

@ViralBShah The answer appears to be no, there isn't currently an effort. Is BinaryBuilder being deprecated?

[giordano]

is BinaryBuilder being deprecated?

BinaryProvider, not BinaryBuilder: https://julialang.org/blog/2019/11/artifacts/

[ViralBShah]

@StefanKarpinski Bringing this list to your notice.

[SimonDanisch]

Could we try to semi automatically move some of these to Yggdrasil? E.g. look up the binarybuilder URL from the deps.jl, download the the build_tarballs.jl and add it to the correct folder?

[ViralBShah]

Could we try to semi automatically move some of these to Yggdrasil? E.g. look up the binarybuilder URL from the deps.jl, download the the build_tarballs.jl and add it to the correct folder?

I've done that process manually in many cases. Given that there's only probably about 30 more such packages, perhaps not worth implementing tooling.

[jaakkor2]

Since MathOptInterface depends on JSONSchema, I would re-classify JSONSchema from "nice to have" to "must have".

[odow]

JSONSchema doesn't actually use BinaryProvider to for binaries. It is just used to download files in a test. @fredo-dedup isn't very active on Github, but I have commit access, and was in the process of tidying up the tests: fredo-dedup/JSONSchema.jl#13. I should remove the dependency on BinaryProvider while I'm at it.

Edit: dependency removed in that PR. JSONSchema can be removed from the list above.

[ViralBShah]

Enough of the commonly used packages are done, that I feel we can close this issue.

[aviks]

Some more updates. PRs for:

LIBSVM
LIBLINEAR
NNlib
Hwloc
Gumbo
LibCURL
GoogleCodeSearch
CodecXz

[ViralBShah]

Updated that in the list above.

[aviks]

NLOpt is also done

[ViralBShah]

Filed JuliaStrings/StringEncodings.jl#36 for StringEncodings.jl. Should be straighforward to update the package.

[ViralBShah]

I believe TextAnalysis and StringAnalysis both need libstemmer.

[aviks]

Mongoc is done.

[ViralBShah]

The big missing one now is GR, which has a dependency on QT.

[ViralBShah]

GR is done now.