feat(p2p): add network explorer and community pools #3125
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
✅ Deploy Preview for localai ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
![github-advanced-security[bot]](https://github.com/avatars/in/57789?s=60&v=4){kind=small}
| ledger, err := n.Ledger() | ||
| if err != nil { | ||
| fmt.Println(err) | ||
| s.database.Delete(token) |
Check warning
Code scanning / Golang security checks by gosec
Errors unhandled. Warning
| s.Unlock() | ||
| } else { | ||
| fmt.Println("No workers found in the network, removing token", token) | ||
| s.database.Delete(token) |
Check warning
Code scanning / Golang security checks by gosec
Errors unhandled. Warning
|
ok - seems to work, I just miss a bit of UX enhancements here as currently the interface is really basic |
mudler
force-pushed
the
pool_explorer
branch
5 times, most recently
from
eddb0f5
to
bdc4547
Compare
| n, err := p2p.NewNode(token) | ||
| if err != nil { | ||
| log.Err(err).Msg("Failed to create node") | ||
| s.database.Delete(token) |
Check warning
Code scanning / Golang security checks by gosec
Errors unhandled. Warning
| err = n.Start(c) | ||
| if err != nil { | ||
| log.Err(err).Msg("Failed to start node") | ||
| s.database.Delete(token) |
Check warning
Code scanning / Golang security checks by gosec
Errors unhandled. Warning
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
… table Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
…rectly Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
if networks have no workers delete them from the database, similarly, if invalid. Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
mudler
changed the title
truecharts-admin
added a commit
to truecharts/charts
that referenced
this pull request
Aug 23, 2024
…0.0 by renovate (#25426) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-aio-cpu` -> `v2.20.0-aio-cpu` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-aio-gpu-nvidia-cuda-12` -> `v2.20.0-aio-gpu-nvidia-cuda-12` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-cublas-cuda11-ffmpeg-core` -> `v2.20.0-cublas-cuda11-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-cublas-cuda11-core` -> `v2.20.0-cublas-cuda11-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-cublas-cuda12-core` -> `v2.20.0-cublas-cuda12-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4-ffmpeg-core` -> `v2.20.0-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | minor | `v2.19.4` -> `v2.20.0` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>mudler/LocalAI (docker.io/localai/localai)</summary> ### [`v2.20.0`](https://togithub.com/mudler/LocalAI/releases/tag/v2.20.0) [Compare Source](https://togithub.com/mudler/LocalAI/compare/v2.19.4...v2.20.0)  ##### **TL;DR** - 🌍 **Explorer & Community:** Explore global community pools at [explorer.localai.io](https://explorer.localai.io) - 👀 **Demo instance available:** Test out LocalAI at [demo.localai.io](https://demo.localai.io) - 🤗 **Integration:** Hugging Face Local apps now include LocalAI - 🐛 **Bug Fixes:** Diffusers and hipblas issues resolved - 🎨 **New Feature:** FLUX-1 image generation support - 🏎️ **Strict Mode:** Stay compliant with OpenAI’s latest API changes - 💪 **Multiple P2P Clusters:** Run multiple clusters within the same network - 🧪 **Deprecation Notice:** `gpt4all.cpp` and `petals` backends deprecated *** ##### 🌍 **Explorer and Global Community Pools** Now you can share your LocalAI instance with the global community or explore available instances by visiting [explorer.localai.io](https://explorer.localai.io). This decentralized network powers our demo instance, creating a truly collaborative AI experience. <p align="center"> <img width="638" alt="Explorer Global Community Pools" src="https://github.com/user-attachments/assets/048fc0e7-58f7-4c8a-8076-874f7469e802"> </p> ##### **How It Works** Using the Explorer, you can easily share or connect to clusters. For detailed instructions on creating new clusters or connecting to existing ones, check out our [documentation](https://localai.io/features/distribute/). ##### 👀 **Demo Instance Now Available** Curious about what LocalAI can do? Dive right in with our live demo at [demo.localai.io](https://demo.localai.io)! Thanks to our generous sponsors, this instance is publicly available and configured via peer-to-peer (P2P) networks. If you'd like to connect, follow the [instructions here](https://explorer.localai.io). ##### 🤗 **Hugging Face Integration** I am excited to announce that LocalAI is now integrated within Hugging Face’s local apps! This means you can select LocalAI directly within Hugging Face to build and deploy models with the power and flexibility of our platform. Experience seamless integration with a single click! <p align="center"> <img width="303" alt="Hugging Face Integration Screenshot" src="https://github.com/user-attachments/assets/53804387-2e1d-47f4-91ab-bb2923bc5625"> <img width="638" alt="Hugging Face Integration in Action" src="https://github.com/user-attachments/assets/2a2a2498-c463-458e-96d0-33dc9cfadd60"> </p> This integration was made possible through [this PR](https://togithub.com/huggingface/huggingface.js/pull/833). ##### 🎨 **FLUX-1 Image Generation Support** **FLUX-1** lands in LocalAI! With this update, LocalAI can now generate stunning images using FLUX-1, even in federated mode. Whether you're experimenting with new designs or creating production-quality visuals, FLUX-1 has you covered. Try it out at [demo.localai.io](https://demo.localai.io) and see what LocalAI + FLUX-1 can do! <p align="center"> <img width="638" alt="FLUX-1 Image Generation Example" src="https://github.com/user-attachments/assets/02b70603-21e7-4d7e-ad81-3246c8b70161"> </p> ##### 🐛 **Diffusers and hipblas Fixes** Great news for AMD users! If you’ve encountered issues with the Diffusers backend or hipblas, those bugs have been resolved. We’ve transitioned to `uv` for managing Python dependencies, ensuring a smoother experience. For more details, check out [Issue #​1592](https://togithub.com/mudler/LocalAI/issues/1592). ##### 🏎️ **Strict Mode for API Compliance** To stay up to date with OpenAI’s latest changes, now LocalAI have support as well for **Strict Mode** ( https://openai.com/index/introducing-structured-outputs-in-the-api/ ). This new feature ensures compatibility with the most recent API updates, enforcing stricter JSON outputs using BNF grammar rules. To activate, simply set `strict: true` in your API calls, even if it’s disabled in your configuration. ##### **Key Notes:** - Setting `strict: true` enables grammar enforcement, even if disabled in your config. - If `format_type` is set to `json_schema`, BNF grammars will be automatically generated from the schema. ##### 🛑 **Disable Gallery** Need to streamline your setup? You can now disable the gallery endpoint using `LOCALAI_DISABLE_GALLERY_ENDPOINT`. For more options, check out the full list of commands with `--help`. ##### 🌞 **P2P and Federation Enhancements** Several enhancements have been made to improve your experience with P2P and federated clusters: - **Load Balancing by Default:** This feature is now enabled by default (disable it with `LOCALAI_RANDOM_WORKER` if needed). - **Target Specific Workers:** Directly target workers in federated mode using `LOCALAI_TARGET_WORKER`. ##### 💪 **Run Multiple P2P Clusters in the Same Network** You can now run multiple clusters within the same network by specifying a network ID via CLI. This allows you to logically separate clusters while using the same shared token. Just set `LOCALAI_P2P_NETWORK_ID` to a UUID that matches across instances. Please note, while this offers segmentation, it’s not fully secure—anyone with the network token can view available services within the network. ##### 🧪 **Deprecation Notice: `gpt4all.cpp` and `petals` Backends** As we continue to evolve, we are officially deprecating the `gpt4all.cpp` and `petals` backends. The newer `llama.cpp` offers a superior set of features and better performance, making it the preferred choice moving forward. From this release onward, `gpt4all` models in `ggml` format are no longer compatible. Additionally, the `petals` backend has been deprecated as well. LocalAI’s new P2P capabilities now offer a comprehensive replacement for these features. <!-- Release notes generated using configuration in .github/release.yml at master --> ##### What's Changed ##### Breaking Changes 🛠 - chore: drop gpt4all.cpp by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3106 - chore: drop petals by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3316 ##### Bug fixes 🐛 - fix(ui): do not show duplicate entries if not installed by gallery by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3107 - fix: be consistent in downloading files, check for scanner errors by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3108 - fix: ensure correct version of torch is always installed based on BUI… by [@​cryptk](https://togithub.com/cryptk) in [mudler/LocalAI#2890 - fix(python): move accelerate and GPU-specific libs to build-type by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3194 - fix(apple): disable BUILD_TYPE metal on fallback by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3199 - fix(vall-e-x): pin hipblas deps by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3201 - fix(diffusers): use nightly rocm for hipblas builds by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3202 - fix(explorer): reset counter when network is active by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3213 - fix(p2p): allocate tunnels only when needed by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3259 - fix(gallery): be consistent and disable UI routes as well by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3262 - fix(parler-tts): bump and require after build type deps by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3272 - fix: add llvm to extra images by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3321 - fix(p2p): re-use p2p host when running federated mode by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3341 - fix(ci): pin to llvmlite 0.43 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3342 - fix(p2p): avoid starting the node twice by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3349 - fix(chat): re-generated uuid, created, and text on each request by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3359 ##### Exciting New Features 🎉 - feat(guesser): add gemma2 by [@​sozercan](https://togithub.com/sozercan) in [mudler/LocalAI#3118 - feat(venv): shared env by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3195 - feat(openai): add `json_schema` format type and strict mode by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3193 - feat(p2p): allow to run multiple clusters in the same p2p network by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3128 - feat(p2p): add network explorer and community pools by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3125 - feat(explorer): relax token deletion with error threshold by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3211 - feat(diffusers): support flux models by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3129 - feat(explorer): make possible to run sync in a separate process by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3224 - feat(federated): allow to pickup a specific worker, improve loadbalancing by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3243 - feat: Initial Version of vscode DevContainer by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3217 - feat(explorer): visual improvements by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3247 - feat(gallery): lazy load images by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3246 - chore(explorer): add join instructions by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3255 - chore: allow to disable gallery endpoints, improve p2p connection handling by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3256 - chore(ux): add animated header with anime.js in p2p sections by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3271 - chore(p2p): make commands easier to copy-paste by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3273 - chore(ux): allow to create and drag dots in the animation by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3287 - feat(federation): do not allocate local services for load balancing by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3337 - feat(p2p): allow to set intervals by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3353 ##### 🧠 Models - models(gallery): add meta-llama-3.1-instruct-9.99b-brainstorm-10x-form-3 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3103 - models(gallery): add mn-12b-celeste-v1.9 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3104 - models(gallery): add shieldgemma by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3105 - models(gallery): add llama-3.1-techne-rp-8b-v1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3112 - models(gallery): add llama-spark by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3116 - models(gallery): add glitz by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3119 - models(gallery): add gemmasutra-mini by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3120 - models(gallery): add kumiho-v1-rp-uwu-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3121 - models(gallery): add humanish-roleplay-llama-3.1-8b-i1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3126 - chore(model-gallery): ⬆️ update checksum by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3167 - models(gallery): add calme-2.2-qwen2-72b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3185 - models(gallery): add calme-2.3-legalkit-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3200 - chore(model-gallery): ⬆️ update checksum by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3210 - models(gallery): add flux.1-dev and flux.1-schnell by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3215 - models(gallery): add infinity-instruct-7m-gen-llama3\_1-70b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3220 - models(gallery): add cathallama-70b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3221 - models(gallery): add edgerunner-tactical-7b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3249 - models(gallery): add hermes-3 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3252 - models(gallery): add SmolLM by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3265 - models(gallery): add mahou-1.3-llama3.1-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3266 - models(gallery): add fireball-llama-3.11-8b-v1orpo by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3267 - models(gallery): add rocinante-12b-v1.1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3268 - models(gallery): add pantheon-rp-1.6-12b-nemo by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3269 - models(gallery): add llama-3.1-storm-8b-q4\_k_m by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3270 ##### 📖 Documentation and examples - docs: ⬆️ update docs version mudler/LocalAI by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3109 - fix(docs): Refer to the OpenAI documentation to update the openai-functions docu… by [@​jermeyhu](https://togithub.com/jermeyhu) in [mudler/LocalAI#3317 - chore(docs): update p2p env var documentation by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3350 ##### 👒 Dependencies - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3110 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3115 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3117 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3123 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/autogptq by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3130 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/common/template by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3131 - chore(deps): Bump langchain from 0.2.10 to 0.2.12 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3132 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/openvoice by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3137 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/coqui by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3138 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/transformers-musicgen by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3140 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/diffusers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3141 - chore(deps): Bump llama-index from 0.10.56 to 0.10.59 in /examples/chainlit by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3143 - chore(deps): Bump docs/themes/hugo-theme-relearn from `7aec99b` to `8b14837` by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3142 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/exllama2 by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3146 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/bark by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3144 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/rerankers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3147 - chore(deps): Bump langchain from 0.2.10 to 0.2.12 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3148 - chore(deps): Bump streamlit from 1.37.0 to 1.37.1 in /examples/streamlit-bot by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3151 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/vllm by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3152 - chore(deps): Bump langchain from 0.2.11 to 0.2.12 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3155 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/transformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3161 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/vall-e-x by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3156 - chore(deps): Bump sqlalchemy from 2.0.31 to 2.0.32 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3157 - chore: ⬆️ Update ggerganov/whisper.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3164 - chore(deps): Bump openai from 1.37.0 to 1.39.0 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3134 - chore(deps): Bump openai from 1.37.0 to 1.39.0 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3149 - chore(deps): Bump openai from 1.37.1 to 1.39.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3158 - chore: ⬆️ Update ggerganov/llama.cpp by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3166 - chore(deps): Bump tqdm from 4.66.4 to 4.66.5 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3159 - chore(deps): Bump llama-index from 0.10.56 to 0.10.61 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3168 - chore: ⬆️ Update ggerganov/llama.cpp to `1e6f6554aa11fa10160a5fda689e736c3c34169f` by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3189 - chore: ⬆️ Update ggerganov/llama.cpp to `15fa07a5c564d3ed7e7eb64b73272cedb27e73ec` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3197 - chore: ⬆️ Update ggerganov/whisper.cpp to `6eac06759b87b50132a01be019e9250a3ffc8969` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3203 - chore: ⬆️ Update ggerganov/llama.cpp to `3a14e00366399040a139c67dd5951177a8cb5695` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3204 - chore(deps): Bump aiohttp from 3.9.5 to 3.10.2 in /examples/langchain/langchainpy-localai-example in the pip group by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3207 - chore: ⬆️ Update ggerganov/llama.cpp to `b72942fac998672a79a1ae3c03b340f7e629980b` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3208 - chore: ⬆️ Update ggerganov/whisper.cpp to `81c999fe0a25c4ebbfef10ed8a1a96df9cfc10fd` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3209 - chore: ⬆️ Update ggerganov/llama.cpp to `6e02327e8b7837358e0406bf90a4632e18e27846` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3212 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3214 - chore: ⬆️ Update ggerganov/llama.cpp to `4134999e01f31256b15342b41c4de9e2477c4a6c` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3218 - chore(deps): Bump llama-index from 0.10.61 to 0.10.65 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3225 - chore(deps): Bump langchain-community from 0.2.9 to 0.2.11 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3230 - chore(deps): Bump attrs from 23.2.0 to 24.2.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3232 - chore(deps): Bump pyyaml from 6.0.1 to 6.0.2 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3231 - chore(deps): Bump llama-index from 0.10.59 to 0.10.65 in /examples/chainlit by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3238 - chore: ⬆️ Update ggerganov/llama.cpp to `fc4ca27b25464a11b3b86c9dbb5b6ed6065965c2` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3240 - chore(deps): Bump openai from 1.39.0 to 1.40.5 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3241 - chore: ⬆️ Update ggerganov/whisper.cpp to `22fcd5fd110ba1ff592b4e23013d870831756259` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3239 - chore(deps): Bump aiohttp from 3.10.2 to 3.10.3 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3234 - chore(deps): Bump openai from 1.39.0 to 1.40.6 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3244 - chore: ⬆️ Update ggerganov/llama.cpp to `06943a69f678fb32829ff06d9c18367b17d4b361` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3245 - chore(deps): Bump openai from 1.39.0 to 1.40.4 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3235 - chore: ⬆️ Update ggerganov/llama.cpp to `5fd89a70ead34d1a17015ddecad05aaa2490ca46` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3248 - chore(deps): bump llama.cpp, rename `llama_add_bos_token` by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3253 - chore: ⬆️ Update ggerganov/llama.cpp to `8b3befc0e2ed8fb18b903735831496b8b0c80949` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3257 - chore: ⬆️ Update ggerganov/llama.cpp to `2fb9267887d24a431892ce4dccc75c7095b0d54d` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3260 - chore: ⬆️ Update ggerganov/llama.cpp to `554b049068de24201d19dde2fa83e35389d4585d` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3263 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3275 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/openvoice by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3282 - chore(deps): Bump docs/themes/hugo-theme-relearn from `8b14837` to `82a5e98` by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3274 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/bark by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3285 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/parler-tts by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3283 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/common/template by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3291 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/sentencetransformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3292 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/vall-e-x by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3294 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/transformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3296 - chore(deps): Bump grpcio from 1.65.0 to 1.65.5 in /backend/python/exllama by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3299 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/vllm by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3301 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3304 - chore(deps): Bump numpy from 2.0.1 to 2.1.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3310 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/mamba by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3313 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/coqui by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3306 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/transformers-musicgen by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3308 - chore(deps): Bump langchain-community from 0.2.11 to 0.2.12 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3311 - chore: ⬆️ Update ggerganov/llama.cpp to `cfac111e2b3953cdb6b0126e67a2487687646971` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3315 - chore(deps): Bump openai from 1.40.4 to 1.41.1 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3319 - chore(deps): Bump openai from 1.40.6 to 1.41.1 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3320 - chore(deps): Bump llama-index from 0.10.65 to 0.10.67.post1 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3335 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3340 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3307 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3346 - chore: ⬆️ Update ggerganov/whisper.cpp to `d65786ea540a5aef21f67cacfa6f134097727780` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3344 - chore: ⬆️ Update ggerganov/llama.cpp to `2f3c1466ff46a2413b0e363a5005c46538186ee6` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3345 - chore: ⬆️ Update ggerganov/llama.cpp to `fc54ef0d1c138133a01933296d50a36a1ab64735` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3356 - chore: ⬆️ Update ggerganov/whisper.cpp to `9e3c5345cd46ea718209db53464e426c3fe7a25e` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3357 ##### Other Changes - feat(swagger): update swagger by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3196 - fix: devcontainer part 1 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3254 - fix: devcontainer pt 2 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3258 - feat: devcontainer part 3 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3318 - feat: devcontainer part 4 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3339 - feat(swagger): update swagger by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3343 - chore(anime.js): drop unused by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3351 - chore(p2p): single-node when sharing federated instance by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3354 ##### New Contributors - [@​jermeyhu](https://togithub.com/jermeyhu) made their first contribution in [mudler/LocalAI#3317 **Full Changelog**: mudler/LocalAI@v2.19.4...v2.20.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about these updates again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://togithub.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC41MS4wIiwidXBkYXRlZEluVmVyIjoiMzguNTEuMCIsInRhcmdldEJyYW5jaCI6Im1hc3RlciIsImxhYmVscyI6WyJhdXRvbWVyZ2UiLCJ1cGRhdGUvZG9ja2VyL2dlbmVyYWwvbm9uLW1ham9yIl19-->
truecharts-admin
added a commit
to truecharts/charts
that referenced
this pull request
Aug 23, 2024
…0.1 by renovate (#25443) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0-aio-cpu` -> `v2.20.1-aio-cpu` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0-aio-gpu-nvidia-cuda-11` -> `v2.20.1-aio-gpu-nvidia-cuda-11` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0-aio-gpu-nvidia-cuda-12` -> `v2.20.1-aio-gpu-nvidia-cuda-12` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0-cublas-cuda11-core` -> `v2.20.1-cublas-cuda11-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0-ffmpeg-core` -> `v2.20.1-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.20.0` -> `v2.20.1` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>mudler/LocalAI (docker.io/localai/localai)</summary> ### [`v2.20.1`](https://togithub.com/mudler/LocalAI/releases/tag/v2.20.1) [Compare Source](https://togithub.com/mudler/LocalAI/compare/v2.20.0...v2.20.1)  ##### **TL;DR** - 🌍 **Explorer & Community:** Explore global community pools at [explorer.localai.io](https://explorer.localai.io) - 👀 **Demo instance available:** Test out LocalAI at [demo.localai.io](https://demo.localai.io) - 🤗 **Integration:** Hugging Face Local apps now include LocalAI - 🐛 **Bug Fixes:** Diffusers and hipblas issues resolved - 🎨 **New Feature:** FLUX-1 image generation support - 🏎️ **Strict Mode:** Stay compliant with OpenAI’s latest API changes - 💪 **Multiple P2P Clusters:** Run multiple clusters within the same network - 🧪 **Deprecation Notice:** `gpt4all.cpp` and `petals` backends deprecated *** ##### 🌍 **Explorer and Global Community Pools** Now you can share your LocalAI instance with the global community or explore available instances by visiting [explorer.localai.io](https://explorer.localai.io). This decentralized network powers our demo instance, creating a truly collaborative AI experience. <p align="center"> <img width="638" alt="Explorer Global Community Pools" src="https://github.com/user-attachments/assets/048fc0e7-58f7-4c8a-8076-874f7469e802"> </p> ##### **How It Works** Using the Explorer, you can easily share or connect to clusters. For detailed instructions on creating new clusters or connecting to existing ones, check out our [documentation](https://localai.io/features/distribute/). ##### 👀 **Demo Instance Now Available** Curious about what LocalAI can do? Dive right in with our live demo at [demo.localai.io](https://demo.localai.io)! Thanks to our generous sponsors, this instance is publicly available and configured via peer-to-peer (P2P) networks. If you'd like to connect, follow the [instructions here](https://explorer.localai.io). ##### 🤗 **Hugging Face Integration** I am excited to announce that LocalAI is now integrated within Hugging Face’s local apps! This means you can select LocalAI directly within Hugging Face to build and deploy models with the power and flexibility of our platform. Experience seamless integration with a single click! <p align="center"> <img width="303" alt="Hugging Face Integration Screenshot" src="https://github.com/user-attachments/assets/53804387-2e1d-47f4-91ab-bb2923bc5625"> <img width="638" alt="Hugging Face Integration in Action" src="https://github.com/user-attachments/assets/2a2a2498-c463-458e-96d0-33dc9cfadd60"> </p> This integration was made possible through [this PR](https://togithub.com/huggingface/huggingface.js/pull/833). ##### 🎨 **FLUX-1 Image Generation Support** **FLUX-1** lands in LocalAI! With this update, LocalAI can now generate stunning images using FLUX-1, even in federated mode. Whether you're experimenting with new designs or creating production-quality visuals, FLUX-1 has you covered. Try it out at [demo.localai.io](https://demo.localai.io) and see what LocalAI + FLUX-1 can do! <p align="center"> <img width="638" alt="FLUX-1 Image Generation Example" src="https://github.com/user-attachments/assets/02b70603-21e7-4d7e-ad81-3246c8b70161"> </p> ##### 🐛 **Diffusers and hipblas Fixes** Great news for AMD users! If you’ve encountered issues with the Diffusers backend or hipblas, those bugs have been resolved. We’ve transitioned to `uv` for managing Python dependencies, ensuring a smoother experience. For more details, check out [Issue #​1592](https://togithub.com/mudler/LocalAI/issues/1592). ##### 🏎️ **Strict Mode for API Compliance** To stay up to date with OpenAI’s latest changes, now LocalAI have support as well for **Strict Mode** ( https://openai.com/index/introducing-structured-outputs-in-the-api/ ). This new feature ensures compatibility with the most recent API updates, enforcing stricter JSON outputs using BNF grammar rules. To activate, simply set `strict: true` in your API calls, even if it’s disabled in your configuration. ##### **Key Notes:** - Setting `strict: true` enables grammar enforcement, even if disabled in your config. - If `format_type` is set to `json_schema`, BNF grammars will be automatically generated from the schema. ##### 🛑 **Disable Gallery** Need to streamline your setup? You can now disable the gallery endpoint using `LOCALAI_DISABLE_GALLERY_ENDPOINT`. For more options, check out the full list of commands with `--help`. ##### 🌞 **P2P and Federation Enhancements** Several enhancements have been made to improve your experience with P2P and federated clusters: - **Load Balancing by Default:** This feature is now enabled by default (disable it with `LOCALAI_RANDOM_WORKER` if needed). - **Target Specific Workers:** Directly target workers in federated mode using `LOCALAI_TARGET_WORKER`. ##### 💪 **Run Multiple P2P Clusters in the Same Network** You can now run multiple clusters within the same network by specifying a network ID via CLI. This allows you to logically separate clusters while using the same shared token. Just set `LOCALAI_P2P_NETWORK_ID` to a UUID that matches across instances. Please note, while this offers segmentation, it’s not fully secure—anyone with the network token can view available services within the network. ##### 🧪 **Deprecation Notice: `gpt4all.cpp` and `petals` Backends** As we continue to evolve, we are officially deprecating the `gpt4all.cpp` and `petals` backends. The newer `llama.cpp` offers a superior set of features and better performance, making it the preferred choice moving forward. From this release onward, `gpt4all` models in `ggml` format are no longer compatible. Additionally, the `petals` backend has been deprecated as well. LocalAI’s new P2P capabilities now offer a comprehensive replacement for these features. <!-- Release notes generated using configuration in .github/release.yml at master --> ##### What's Changed ##### Breaking Changes 🛠 - chore: drop gpt4all.cpp by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3106 - chore: drop petals by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3316 ##### Bug fixes 🐛 - fix(ui): do not show duplicate entries if not installed by gallery by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3107 - fix: be consistent in downloading files, check for scanner errors by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3108 - fix: ensure correct version of torch is always installed based on BUI… by [@​cryptk](https://togithub.com/cryptk) in [mudler/LocalAI#2890 - fix(python): move accelerate and GPU-specific libs to build-type by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3194 - fix(apple): disable BUILD_TYPE metal on fallback by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3199 - fix(vall-e-x): pin hipblas deps by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3201 - fix(diffusers): use nightly rocm for hipblas builds by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3202 - fix(explorer): reset counter when network is active by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3213 - fix(p2p): allocate tunnels only when needed by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3259 - fix(gallery): be consistent and disable UI routes as well by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3262 - fix(parler-tts): bump and require after build type deps by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3272 - fix: add llvm to extra images by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3321 - fix(p2p): re-use p2p host when running federated mode by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3341 - fix(ci): pin to llvmlite 0.43 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3342 - fix(p2p): avoid starting the node twice by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3349 - fix(chat): re-generated uuid, created, and text on each request by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3359 ##### Exciting New Features 🎉 - feat(guesser): add gemma2 by [@​sozercan](https://togithub.com/sozercan) in [mudler/LocalAI#3118 - feat(venv): shared env by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3195 - feat(openai): add `json_schema` format type and strict mode by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3193 - feat(p2p): allow to run multiple clusters in the same p2p network by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3128 - feat(p2p): add network explorer and community pools by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3125 - feat(explorer): relax token deletion with error threshold by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3211 - feat(diffusers): support flux models by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3129 - feat(explorer): make possible to run sync in a separate process by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3224 - feat(federated): allow to pickup a specific worker, improve loadbalancing by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3243 - feat: Initial Version of vscode DevContainer by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3217 - feat(explorer): visual improvements by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3247 - feat(gallery): lazy load images by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3246 - chore(explorer): add join instructions by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3255 - chore: allow to disable gallery endpoints, improve p2p connection handling by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3256 - chore(ux): add animated header with anime.js in p2p sections by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3271 - chore(p2p): make commands easier to copy-paste by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3273 - chore(ux): allow to create and drag dots in the animation by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3287 - feat(federation): do not allocate local services for load balancing by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3337 - feat(p2p): allow to set intervals by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3353 ##### 🧠 Models - models(gallery): add meta-llama-3.1-instruct-9.99b-brainstorm-10x-form-3 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3103 - models(gallery): add mn-12b-celeste-v1.9 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3104 - models(gallery): add shieldgemma by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3105 - models(gallery): add llama-3.1-techne-rp-8b-v1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3112 - models(gallery): add llama-spark by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3116 - models(gallery): add glitz by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3119 - models(gallery): add gemmasutra-mini by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3120 - models(gallery): add kumiho-v1-rp-uwu-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3121 - models(gallery): add humanish-roleplay-llama-3.1-8b-i1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3126 - chore(model-gallery): ⬆️ update checksum by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3167 - models(gallery): add calme-2.2-qwen2-72b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3185 - models(gallery): add calme-2.3-legalkit-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3200 - chore(model-gallery): ⬆️ update checksum by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3210 - models(gallery): add flux.1-dev and flux.1-schnell by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3215 - models(gallery): add infinity-instruct-7m-gen-llama3\_1-70b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3220 - models(gallery): add cathallama-70b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3221 - models(gallery): add edgerunner-tactical-7b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3249 - models(gallery): add hermes-3 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3252 - models(gallery): add SmolLM by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3265 - models(gallery): add mahou-1.3-llama3.1-8b by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3266 - models(gallery): add fireball-llama-3.11-8b-v1orpo by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3267 - models(gallery): add rocinante-12b-v1.1 by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3268 - models(gallery): add pantheon-rp-1.6-12b-nemo by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3269 - models(gallery): add llama-3.1-storm-8b-q4\_k_m by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3270 ##### 📖 Documentation and examples - docs: ⬆️ update docs version mudler/LocalAI by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3109 - fix(docs): Refer to the OpenAI documentation to update the openai-functions docu… by [@​jermeyhu](https://togithub.com/jermeyhu) in [mudler/LocalAI#3317 - chore(docs): update p2p env var documentation by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3350 ##### 👒 Dependencies - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3110 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3115 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3117 - chore: ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3123 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/autogptq by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3130 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/common/template by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3131 - chore(deps): Bump langchain from 0.2.10 to 0.2.12 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3132 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/openvoice by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3137 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/coqui by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3138 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/transformers-musicgen by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3140 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/diffusers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3141 - chore(deps): Bump llama-index from 0.10.56 to 0.10.59 in /examples/chainlit by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3143 - chore(deps): Bump docs/themes/hugo-theme-relearn from `7aec99b` to `8b14837` by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3142 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/exllama2 by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3146 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/bark by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3144 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/rerankers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3147 - chore(deps): Bump langchain from 0.2.10 to 0.2.12 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3148 - chore(deps): Bump streamlit from 1.37.0 to 1.37.1 in /examples/streamlit-bot by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3151 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/vllm by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3152 - chore(deps): Bump langchain from 0.2.11 to 0.2.12 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3155 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/transformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3161 - chore(deps): Bump grpcio from 1.65.1 to 1.65.4 in /backend/python/vall-e-x by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3156 - chore(deps): Bump sqlalchemy from 2.0.31 to 2.0.32 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3157 - chore: ⬆️ Update ggerganov/whisper.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3164 - chore(deps): Bump openai from 1.37.0 to 1.39.0 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3134 - chore(deps): Bump openai from 1.37.0 to 1.39.0 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3149 - chore(deps): Bump openai from 1.37.1 to 1.39.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3158 - chore: ⬆️ Update ggerganov/llama.cpp by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3166 - chore(deps): Bump tqdm from 4.66.4 to 4.66.5 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3159 - chore(deps): Bump llama-index from 0.10.56 to 0.10.61 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3168 - chore: ⬆️ Update ggerganov/llama.cpp to `1e6f6554aa11fa10160a5fda689e736c3c34169f` by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3189 - chore: ⬆️ Update ggerganov/llama.cpp to `15fa07a5c564d3ed7e7eb64b73272cedb27e73ec` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3197 - chore: ⬆️ Update ggerganov/whisper.cpp to `6eac06759b87b50132a01be019e9250a3ffc8969` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3203 - chore: ⬆️ Update ggerganov/llama.cpp to `3a14e00366399040a139c67dd5951177a8cb5695` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3204 - chore(deps): Bump aiohttp from 3.9.5 to 3.10.2 in /examples/langchain/langchainpy-localai-example in the pip group by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3207 - chore: ⬆️ Update ggerganov/llama.cpp to `b72942fac998672a79a1ae3c03b340f7e629980b` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3208 - chore: ⬆️ Update ggerganov/whisper.cpp to `81c999fe0a25c4ebbfef10ed8a1a96df9cfc10fd` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3209 - chore: ⬆️ Update ggerganov/llama.cpp to `6e02327e8b7837358e0406bf90a4632e18e27846` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3212 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3214 - chore: ⬆️ Update ggerganov/llama.cpp to `4134999e01f31256b15342b41c4de9e2477c4a6c` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3218 - chore(deps): Bump llama-index from 0.10.61 to 0.10.65 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3225 - chore(deps): Bump langchain-community from 0.2.9 to 0.2.11 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3230 - chore(deps): Bump attrs from 23.2.0 to 24.2.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3232 - chore(deps): Bump pyyaml from 6.0.1 to 6.0.2 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3231 - chore(deps): Bump llama-index from 0.10.59 to 0.10.65 in /examples/chainlit by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3238 - chore: ⬆️ Update ggerganov/llama.cpp to `fc4ca27b25464a11b3b86c9dbb5b6ed6065965c2` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3240 - chore(deps): Bump openai from 1.39.0 to 1.40.5 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3241 - chore: ⬆️ Update ggerganov/whisper.cpp to `22fcd5fd110ba1ff592b4e23013d870831756259` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3239 - chore(deps): Bump aiohttp from 3.10.2 to 3.10.3 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3234 - chore(deps): Bump openai from 1.39.0 to 1.40.6 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3244 - chore: ⬆️ Update ggerganov/llama.cpp to `06943a69f678fb32829ff06d9c18367b17d4b361` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3245 - chore(deps): Bump openai from 1.39.0 to 1.40.4 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3235 - chore: ⬆️ Update ggerganov/llama.cpp to `5fd89a70ead34d1a17015ddecad05aaa2490ca46` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3248 - chore(deps): bump llama.cpp, rename `llama_add_bos_token` by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3253 - chore: ⬆️ Update ggerganov/llama.cpp to `8b3befc0e2ed8fb18b903735831496b8b0c80949` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3257 - chore: ⬆️ Update ggerganov/llama.cpp to `2fb9267887d24a431892ce4dccc75c7095b0d54d` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3260 - chore: ⬆️ Update ggerganov/llama.cpp to `554b049068de24201d19dde2fa83e35389d4585d` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3263 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3275 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/openvoice by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3282 - chore(deps): Bump docs/themes/hugo-theme-relearn from `8b14837` to `82a5e98` by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3274 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/bark by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3285 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/parler-tts by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3283 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/common/template by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3291 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/sentencetransformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3292 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/vall-e-x by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3294 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/transformers by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3296 - chore(deps): Bump grpcio from 1.65.0 to 1.65.5 in /backend/python/exllama by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3299 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/vllm by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3301 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3304 - chore(deps): Bump numpy from 2.0.1 to 2.1.0 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3310 - chore(deps): Bump grpcio from 1.65.1 to 1.65.5 in /backend/python/mamba by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3313 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/coqui by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3306 - chore(deps): Bump grpcio from 1.65.4 to 1.65.5 in /backend/python/transformers-musicgen by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3308 - chore(deps): Bump langchain-community from 0.2.11 to 0.2.12 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3311 - chore: ⬆️ Update ggerganov/llama.cpp to `cfac111e2b3953cdb6b0126e67a2487687646971` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3315 - chore(deps): Bump openai from 1.40.4 to 1.41.1 in /examples/functions by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3319 - chore(deps): Bump openai from 1.40.6 to 1.41.1 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3320 - chore(deps): Bump llama-index from 0.10.65 to 0.10.67.post1 in /examples/langchain-chroma by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3335 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3340 - chore(deps): Bump langchain from 0.2.12 to 0.2.14 in /examples/langchain/langchainpy-localai-example by [@​dependabot](https://togithub.com/dependabot) in [mudler/LocalAI#3307 - chore(deps): update edgevpn by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3346 - chore: ⬆️ Update ggerganov/whisper.cpp to `d65786ea540a5aef21f67cacfa6f134097727780` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3344 - chore: ⬆️ Update ggerganov/llama.cpp to `2f3c1466ff46a2413b0e363a5005c46538186ee6` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3345 - chore: ⬆️ Update ggerganov/llama.cpp to `fc54ef0d1c138133a01933296d50a36a1ab64735` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3356 - chore: ⬆️ Update ggerganov/whisper.cpp to `9e3c5345cd46ea718209db53464e426c3fe7a25e` by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3357 ##### Other Changes - feat(swagger): update swagger by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3196 - fix: devcontainer part 1 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3254 - fix: devcontainer pt 2 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3258 - feat: devcontainer part 3 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3318 - feat: devcontainer part 4 by [@​dave-gray101](https://togithub.com/dave-gray101) in [mudler/LocalAI#3339 - feat(swagger): update swagger by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#3343 - chore(anime.js): drop unused by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3351 - chore(p2p): single-node when sharing federated instance by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#3354 ##### New Contributors - [@​jermeyhu](https://togithub.com/jermeyhu) made their first contribution in [mudler/LocalAI#3317 **Full Changelog**: mudler/LocalAI@v2.19.4...v2.20.0 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about these updates again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://togithub.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzOC41MS4xIiwidXBkYXRlZEluVmVyIjoiMzguNTEuMSIsInRhcmdldEJyYW5jaCI6Im1hc3RlciIsImxhYmVscyI6WyJhdXRvbWVyZ2UiLCJ1cGRhdGUvZG9ja2VyL2dlbmVyYWwvbm9uLW1ham9yIl19-->
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR fixes #3113
It adds another arguments to the CLI that allows to spawn-up an http server that can monitor networks and determine how many clusters and workers there are in each one.
The instance is deployed at https://explorer.localai.io