You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Chip: Apple M1
MacOS Sonoma, Version 14.3
Python version: 3.11
Rust Compiler installed already.
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [586 lines of output]
running bdist_wheel
running build
running build_py
creating build
creating build/lib.macosx-14.3-arm64-cpython-310
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers
copying py_src/tokenizers/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
copying py_src/tokenizers/models/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
copying py_src/tokenizers/decoders/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
copying py_src/tokenizers/normalizers/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/pre_tokenizers
...
8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblog-67209b2521d51704.rmeta --extern macro_rules_attribute=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libmacro_rules_attribute-efcdd1618729d88c.rmeta --extern onig=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libonig-55e025d9cd10ef1d.rmeta --extern paste=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libpaste-cbb23ac2fa72fb9c.dylib --extern rand=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librand-0b09f74aae2d6e40.rmeta --extern rayon=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon-30990235a038b514.rmeta --extern rayon_cond=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon_cond-2483fbb1a8df1d3e.rmeta --extern regex=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex-7fcb56abc3e47088.rmeta --extern regex_syntax=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex_syntax-66179a6cbc8e8d90.rmeta --extern reqwest=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libreqwest-beeb0f83a3b16ee5.rmeta --extern serde=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde-289f63c404915bfb.rmeta --extern serde_json=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde_json-ca3e386be1e1db16.rmeta --extern spm_precompiled=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libspm_precompiled-f9acdce561af88ff.rmeta --extern thiserror=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libthiserror-a91213e24d296260.rmeta --extern unicode_normalization_alignments=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_normalization_alignments-1aef014c0aec3a81.rmeta --extern unicode_segmentation=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_segmentation-0866dc6a2ac87bf1.rmeta --extern unicode_categories=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_categories-f44cb1f9440beb5c.rmeta -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/bzip2-sys-0c46cf013c67825b/out/lib -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/zstd-sys-9a4d4f9b48c0d595/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/esaxx-rs-9d2de4cc92300f46/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/onig_sys-433c7599de979028/outwarning: variable does not need to be mutable --> tokenizers-lib/src/models/unigram/model.rs:265:21 | 265 | let mut target_node = &mut best_path_ends_at[key_pos]; | ----^^^^^^^^^^^ | | | help: remove thismut| = note:#[warn(unused_mut)]` on by default
warning: variable does not need to be mutable
--> tokenizers-lib/src/models/unigram/model.rs:282:21
|
282 | let mut target_node = &mut best_path_ends_at[starts_at + mblen];
| ----^^^^^^^^^^^
| |
| help: remove this `mut`
warning: variable does not need to be mutable
--> tokenizers-lib/src/pre_tokenizers/byte_level.rs:200:59
|
200 | encoding.process_tokens_with_offsets_mut(|(i, (token, mut offsets))| {
| ----^^^^^^^
| |
| help: remove this `mut`
error: casting `&T` to `&mut T` is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell`
--> tokenizers-lib/src/models/bpe/trainer.rs:526:47
|
522 | let w = &words[*i] as *const _ as *mut _;
| -------------------------------- casting happend here
...
526 | let word: &mut Word = &mut (*w);
| ^^^^^^^^^
|
= note: for more information, visit <https://doc.rust-lang.org/book/ch15-05-interior-mutability.html>
= note: `#[deny(invalid_reference_casting)]` on by default
warning: `tokenizers` (lib) generated 3 warnings
error: could not compile `tokenizers` (lib) due to previous error; 3 warnings emitted
Caused by:
process didn't exit successfully: `rustc --crate-name tokenizers --edition=2018 tokenizers-lib/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="cached-path"' --cfg 'feature="clap"' --cfg 'feature="cli"' --cfg 'feature="default"' --cfg 'feature="http"' --cfg 'feature="indicatif"' --cfg 'feature="progressbar"' --cfg 'feature="reqwest"' -C metadata=02b35ef3d3a318c6 -C extra-filename=-02b35ef3d3a318c6 --out-dir /private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps -L dependency=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps --extern aho_corasick=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libaho_corasick-1f16d7cbc1e140f2.rmeta --extern cached_path=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libcached_path-4aca8b2bc71340df.rmeta --extern clap=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libclap-6026cc4aa25a0aba.rmeta --extern derive_builder=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libderive_builder-3ec426cf16b9ba1a.dylib --extern dirs=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libdirs-1da7806f8cc3f346.rmeta --extern esaxx_rs=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libesaxx_rs-5aaf1f019751a9f2.rmeta --extern indicatif=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libindicatif-75757f2d3df8bc84.rmeta --extern itertools=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libitertools-e26f459727927c7c.rmeta --extern lazy_static=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblazy_static-a035a15073af7f16.rmeta --extern log=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblog-67209b2521d51704.rmeta --extern macro_rules_attribute=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libmacro_rules_attribute-efcdd1618729d88c.rmeta --extern onig=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libonig-55e025d9cd10ef1d.rmeta --extern paste=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libpaste-cbb23ac2fa72fb9c.dylib --extern rand=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librand-0b09f74aae2d6e40.rmeta --extern rayon=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon-30990235a038b514.rmeta --extern rayon_cond=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon_cond-2483fbb1a8df1d3e.rmeta --extern regex=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex-7fcb56abc3e47088.rmeta --extern regex_syntax=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex_syntax-66179a6cbc8e8d90.rmeta --extern reqwest=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libreqwest-beeb0f83a3b16ee5.rmeta --extern serde=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde-289f63c404915bfb.rmeta --extern serde_json=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde_json-ca3e386be1e1db16.rmeta --extern spm_precompiled=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libspm_precompiled-f9acdce561af88ff.rmeta --extern thiserror=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libthiserror-a91213e24d296260.rmeta --extern unicode_normalization_alignments=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_normalization_alignments-1aef014c0aec3a81.rmeta --extern unicode_segmentation=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_segmentation-0866dc6a2ac87bf1.rmeta --extern unicode_categories=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_categories-f44cb1f9440beb5c.rmeta -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/bzip2-sys-0c46cf013c67825b/out/lib -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/zstd-sys-9a4d4f9b48c0d595/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/esaxx-rs-9d2de4cc92300f46/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/onig_sys-433c7599de979028/out` (exit status: 1)
error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib -- -C 'link-args=-undefined dynamic_lookup -Wl,-install_name,@rpath/tokenizers.cpython-310-darwin.so'` failed with code 101
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
Chip: Apple M1
MacOS Sonoma, Version 14.3
Python version: 3.11
Rust Compiler installed already.
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [586 lines of output]
running bdist_wheel
running build
running build_py
creating build
creating build/lib.macosx-14.3-arm64-cpython-310
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers
copying py_src/tokenizers/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
copying py_src/tokenizers/models/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/models
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
copying py_src/tokenizers/decoders/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/decoders
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
copying py_src/tokenizers/normalizers/init.py -> build/lib.macosx-14.3-arm64-cpython-310/tokenizers/normalizers
creating build/lib.macosx-14.3-arm64-cpython-310/tokenizers/pre_tokenizers
...
8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/liblog-67209b2521d51704.rmeta --extern macro_rules_attribute=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libmacro_rules_attribute-efcdd1618729d88c.rmeta --extern onig=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libonig-55e025d9cd10ef1d.rmeta --extern paste=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libpaste-cbb23ac2fa72fb9c.dylib --extern rand=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librand-0b09f74aae2d6e40.rmeta --extern rayon=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon-30990235a038b514.rmeta --extern rayon_cond=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/librayon_cond-2483fbb1a8df1d3e.rmeta --extern regex=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex-7fcb56abc3e47088.rmeta --extern regex_syntax=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libregex_syntax-66179a6cbc8e8d90.rmeta --extern reqwest=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libreqwest-beeb0f83a3b16ee5.rmeta --extern serde=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde-289f63c404915bfb.rmeta --extern serde_json=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libserde_json-ca3e386be1e1db16.rmeta --extern spm_precompiled=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libspm_precompiled-f9acdce561af88ff.rmeta --extern thiserror=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libthiserror-a91213e24d296260.rmeta --extern unicode_normalization_alignments=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_normalization_alignments-1aef014c0aec3a81.rmeta --extern unicode_segmentation=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_segmentation-0866dc6a2ac87bf1.rmeta --extern unicode_categories=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/deps/libunicode_categories-f44cb1f9440beb5c.rmeta -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/bzip2-sys-0c46cf013c67825b/out/lib -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/zstd-sys-9a4d4f9b48c0d595/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/esaxx-rs-9d2de4cc92300f46/out -L native=/private/var/folders/fm/gtjtp79s6zd19lfm06zv20v80000gn/T/pip-install-8rzv94n7/tokenizers_b1953320fc9f4f9c82f975191f952762/target/release/build/onig_sys-433c7599de979028/out
warning: variable does not need to be mutable --> tokenizers-lib/src/models/unigram/model.rs:265:21 | 265 | let mut target_node = &mut best_path_ends_at[key_pos]; | ----^^^^^^^^^^^ | | | help: remove this
mut| = note:
#[warn(unused_mut)]` on by defaultnote: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
@davidberenstein1957 could you guide further on this ?
The text was updated successfully, but these errors were encountered: