v1.23.0

What's Changed

Breaking Changes 🛠

• feat: add rope settings and negative prompt, drop grammar backend by @mudler in #797

Bug fixes 🐛

• fix missing openai_api_base on langchain-chroma example by @wendyliga in #818
• fix: add rope settings during model load, fix CUDA by @mudler in #821
• fix: select function calls if 'name' is set in the request by @mudler in #827
• fix: symlink libphonemize in the container by @mudler in #831

Exciting New Features 🎉

• Added CPU information to entrypoint.sh by @finger42 in #794
• feat: cancel stream generation if client disappears by @tmm1 in #792
• fix: use bytes in gRPC proto instead of strings by @mudler in #813

👒 Dependencies

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #807
• fix(deps): update github.com/tmc/langchaingo digest to 7d5f9fd by @renovate in #768
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to c898cd0 by @renovate in #748
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 9100b2e by @renovate in #753
• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.1 by @renovate in #783
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #814
• fix(deps): update module google.golang.org/grpc to v1.57.0 by @renovate in #815
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6ba16de by @renovate in #820
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 39acbc8 by @renovate in #817

Other Changes

• fix: update gitignore and make clean by @dave-gray101 in #798
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 562d2b5 by @renovate in #766

New Contributors

• @finger42 made their first contribution in #794
• @tmm1 made their first contribution in #792
• @wendyliga made their first contribution in #818

Full Changelog: v1.22.0...v1.23.0

v1.22.0

What's Changed

Breaking Changes 🛠

• refactor: rename "llama-master" to "llama" and "llama" to "llama-grammar" by @mudler in #776

Bug fixes 🐛

• fix: move metal file to grpcs assets by @mudler in #777
• fix: make completions endpoint more close to OpenAI specification by @mudler in #790

Exciting New Features 🎉

• feat: add llama-master backend by @mudler in #752
• [build] pass build type to cmake on libtransformers.a build by @TonDar0n in #741
• feat: resolve JSONSchema refs (planners) by @mudler in #774
• feat: backends improvements by @mudler in #778
• feat(llama2): add template for chat messages by @dave-gray101 in #782

👒 Dependencies

• ⬆️ Update go-skynet/go-bert.cpp by @ci-robbot in #758
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #759
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #769
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #770
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #775
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #723
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #785

Other Changes

• example(functions): Add OpenAI functions example by @mudler in #767
• [Telegram-bot example] Fix lint for command docker-compose by @exsplashit in #787

New Contributors

• @TonDar0n made their first contribution in #741
• @exsplashit made their first contribution in #787

Full Changelog: v1.21.0...v1.22.0

v1.21.0 - LocalAI functions!

What's Changed

Bug fixes 🐛

• fix: make first stream message to send empty content by @mudler in #751

Exciting New Features 🎉

• feat: [whisper] Partial support for verbose_json format in transcribe endpoint by @ldotlopez in #721
• feat: LocalAI functions by @mudler in #726
• feat: gRPC-based backends by @mudler in #743
• feat: falcon support (7b and 40b) with ggllm.cpp by @mudler in #743

Other Changes

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #704
• fix(deps): bump go-llama.cpp by @mudler in #719
• Create FUNDING.yml by @mudler in #725
• fix(deps): update module github.com/sashabaranov/go-openai to v1.13.0 by @renovate in #667
• fix(deps): update module github.com/otiai10/openaigo to v1.5.2 by @renovate in #731
• fix(deps): update github.com/tmc/langchaingo digest to a875e6b by @renovate in #700
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to ffa57fb by @renovate in #707
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d611d10 by @renovate in #699
• Update README with sponsors section by @mudler in #732
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 3fec197 by @renovate in #706
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #705
• fix(deps): update module google.golang.org/protobuf to v1.31.0 by @renovate in #746
• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.0 by @renovate in #739
• fix(deps): update module gopkg.in/yaml.v2 to v3 by @renovate in #299
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to ffb09d7 by @renovate in #744
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in #750
• fix(deps): update github.com/mudler/go-ggllm.cpp digest to 862477d by @renovate in #745
• fix(deps): update github.com/tmc/langchaingo digest to dcf7ecd by @renovate in #736
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 by @renovate in #734
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 by @renovate in #733
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #735
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #711
• fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 by @renovate in #756
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 by @renovate in #757

New Contributors

• @ldotlopez made their first contribution in #721

Full Changelog: v1.20.1...v1.21.0

v1.20.1

What's Changed

Other Changes

• Update README.md by @mudler in #694
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #691
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #696
• fix(deps): update github.com/tmc/langchaingo digest to e510561 by @renovate in #695
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 390994e by @renovate in #653
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #697
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to 85ed71a by @renovate in #669
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 42ba448 by @renovate in #698
• fix: adapt whisper to bindings updates by @mudler in #702
• fix: split build threads from running threads by @mudler in #703

Full Changelog: v1.20.0...v1.20.1

v1.20.0

What's Changed

Bug fixes 🐛

• fix: return index and delta in stream token by @mudler in #680

Exciting New Features 🎉

• feat: add tts with go-piper by @mudler in #649
• feat: gallery repository by @mudler in #663
• fix: rename /models/list to /models/available by @mudler in #678
• feat: Add '/version' endpoint and display it in the CLI by @mudler in #679
• feat: update llama, enable NUMA by @mudler in #684

Other Changes

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #635
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in #600
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 09ae04c by @renovate in #632
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #644
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #650
• fix(deps): update module github.com/sashabaranov/go-openai to v1.11.3 by @renovate in #606
• example(slack-qa-bot): Add slack QA bot example by @mudler in #654
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #634
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #657
• fix(deps): update module github.com/otiai10/openaigo to v1.4.0 by @renovate in #666
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #668
• Update github.com/go-skynet/go-ggml-transformers.cpp digest to a459d27 by @renovate in #629
• Update github.com/tmc/langchaingo digest to 4d9d55d by @renovate in #665
• fix: add omitempty where needed by @mudler in #671
• refactor: consolidate usage of GetURI by @mudler in #674
• fix(deps): update github.com/tmc/langchaingo digest to 7ea7345 by @renovate in #675
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #672
• Update entrypoint.sh to use $THREADS for parallel compilation on start if present by @maccam912 in #673
• Docker preserve sources by @samm81 in #658
• Dockerfile: adds a warning if $TARGETARCH or $TARGETVARIANT missing by @samm81 in #686
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #681
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #682
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to f104111 by @renovate in #630
• fix: detect TARGETARCH if not present by @mudler in #688
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #690
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #692
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 5827536 by @renovate in #693
• fix(deps): update github.com/tmc/langchaingo digest to 633853b by @renovate in #689
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 8e31841 by @renovate in #685

New Contributors

• @maccam912 made their first contribution in #673

Full Changelog: v1.19.2...v1.20.0

v1.19.2

What's Changed

Other Changes

• fix(deps): update module github.com/valyala/fasthttp to v1.48.0 by @renovate in #639
• Add LowVRAM option parameter by @mudler in #642

Full Changelog: v1.19.1...v1.19.2

v1.19.1

What's Changed

Bug fixes 🐛

• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #633

Other Changes

• fix(deps): update module github.com/gofiber/fiber/v2 to v2.47.0 by @renovate in #625
• fix(deps): update module github.com/urfave/cli/v2 to v2.25.7 by @renovate in #577
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to f5a8c45 by @renovate in #609
• fix(deps): update github.com/tmc/langchaingo digest to 1b3da44 by @renovate in #583
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f76df0d by @renovate in #627
• example(k8sgpt): Add k8sgpt example by @mudler in #631
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #628

Full Changelog: v1.19.0...v1.19.1

v1.19.0

What's Changed

Bug fixes 🐛

• fix: set default batch size by @mudler in #597

Exciting New Features 🎉

• feat: extend model configuration for llama.cpp by @mudler in #536
• tests: add llama tests with openllama by @mudler in #538
• feat: display download progress when installing models by @mudler in #543
• examples(telegram): add by @mudler in #547
• feat: add typical_p to model parameters by @mudler in #598
• feat: fix CUDA images and update go-llama to use full GPU offloading by @mudler in #618

👒 Dependencies

• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #561
• deps: update gpt4all bindings, fix search path on new versions by @mudler in #592
• deps: switch back to nomic-ai/gpt4all by @mudler in #595

Other Changes

• fix(deps): update github.com/donomii/go-rwkv.cpp digest to d5f48f6 by @renovate in #526
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to bd765bb by @renovate in #518
• examples: simplify langchain-python by @mudler in #541
• fix(deps): update module github.com/sashabaranov/go-openai to v1.10.1 by @renovate in #544
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #539
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 343a6a3 by @renovate in #528
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 672fb05 by @renovate in #529
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to fb8b955 by @renovate in #533
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #546
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to a921173 by @renovate in #551
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to d2b25a4 by @renovate in #552
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to dabd6cd by @renovate in #535
• ⬆️ Update go-skynet/go-bert.cpp by @ci-robbot in #540
• fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6069103 by @renovate in #534
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #554
• fix(deps): update github.com/tmc/langchaingo digest to 06cb7b5 by @renovate in #525
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d3ba129 by @renovate in #548
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to a12ce51 by @renovate in #555
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to a9c2f47 by @renovate in #560
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #562
• example(telegram): drop mongodb by @mudler in #565
• fix: copy metal file from build by @mudler in #564
• Dockerfile: unify duplicated requirements into single step by @samm81 in #580
• ci: drop macOS dependencies by @mudler in #581
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #584
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 5f16204 by @renovate in #563
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 8953b7f by @renovate in #573
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 01b8436 by @renovate in #558
• fix(deps): update module github.com/otiai10/openaigo to v1.1.1 by @renovate in #591
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in #527
• Docker preserve sources by @samm81 in #590
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to a796025 by @renovate in #593
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to a57bca3 by @renovate in #582
• Revert "Docker preserve sources" by @mudler in #620
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 42e8049 by @renovate in #594
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 7ad833b by @renovate in #616
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to fd419ca by @renovate in #623
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #613
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #619
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 32b9223 by @renovate in #617
• fix(deps): update module github.com/otiai10/openaigo to v1.2.0 by @renovate in #624

Full Changelog: v1.18.0...v0.19.0

v1.18.0

What's Changed

Breaking Changes 🛠

• feat: Update gpt4all, support multiple implementations in runtime by @mudler in #472

Bug fixes 🐛

• fix: Bump and fix rwkv build by @mudler in #475
• fix: display help with correct default values by @sebastien-prudhomme in #481
• fix: downgrade gpt4all by @mudler in #503

Exciting New Features 🎉

• ci: build Docker image variants by @sebastien-prudhomme in #456
• feat: add LangChainGo Huggingface backend by @EvilFreelancer in #446
• feat: Enable stablediffusion by default in container images by @mudler in #474
• feat: add support for Stream: true to completionEndpoint by @samm81 in #465
• feat: Enable static builds for Linux binaries by @mudler in #487
• feat: add ffmpeg images by @mudler in #492
• fix gpt4all, add metal GPU support by @mudler in #507
• feat: support upscaled image generation with esrgan by @mudler in #509
• feat: add experimental support for falcon-7b by @mudler in #516
• feat: update llama.cpp to support k-quants by @ci-robbot in #521

👒 Dependencies

• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #419
• ⬆️ Update go-skynet/go-bert.cpp by @ci-robbot in #418
• deps: update rwkv, switch back to upstream by @mudler in #494
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #520

Other Changes

• examples: use gallery in chatbot-ui, add flowise by @mudler in #438
• examples: keep old example around by @mudler in #439
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #443
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #442
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 62b6c07 by @renovate in #441
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #422
• fix(deps): update module github.com/onsi/ginkgo/v2 to v2.9.7 by @renovate in #445
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 5f94020 by @renovate in #435
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to c43cdf5 by @renovate in #453
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 17b0655 by @renovate in #454
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to ce6f747 by @renovate in #450
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #462
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #458
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 10caf37 by @renovate in #455
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to 3f7436e by @renovate in #466
• feat: Add new test cases for LoadConfigs by @Aisuko in #447
• ⬆️ Update go-skynet/go-bert.cpp by @ci-robbot in #463
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to 3b28b09 by @renovate in #467
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #468
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to 5b9e59b by @renovate in #469
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #459
• ⬆️ Update ggerganov/whisper.cpp by @ci-robbot in #473
• fix(deps): update module github.com/urfave/cli/v2 to v2.25.5 by @renovate in #399
• fix: fix the make run target by @mudler in #476
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 031d714 by @renovate in #464
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to be9f6ad by @renovate in #477
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #479
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 23391d4 by @renovate in #478
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #482
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #483
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in #488
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 3f10005 by @renovate in #485
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to bc624f5 by @renovate in #486
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 6fb862c by @renovate in #490
• fix(deps): update github.com/go-skynet/go-bert.cpp digest to 0548994 by @renovate in #451
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to bbe195e by @renovate in #497
• fix: correctly assign ffmpeg image tag by @mudler in #499
• fix(deps): update github.com/go-skynet/bloomz.cpp digest to 1834e77 by @renovate in #414
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #501
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to b1a4256 by @renovate in #505
• fix(deps): update github.com/tmc/langchaingo digest to 4afed6d by @renovate in #508
• fix(deps): update module github.com/sashabaranov/go-openai to v1.10.0 by @renovate in #510
• ⬆️ Update go-skynet/go-llama.cpp by @ci-robbot in #512
• fix(deps): update github.com/mudler/go-stable-diffusion digest to d89260f by @renovate in #506
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to cca84ed by @renovate in #513
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to 266f13a by @renovate in #500
• fix(deps): update github.com/ggerganov/whisper.cpp/bindings/go digest to 57543c1 by @renovate in #514
• fix(deps): update github.com/donomii/go-rwkv.cpp digest to 1e18b24 by @renovate in #489
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in #511
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 37ef81d by @renovate in #523

New Contributors

• @EvilFreelancer made their first contribution in #446
• @samm81 made their first contribution in #465

Full Changelog: v1.17.1...v1.18.0

v1.17.1

What's Changed

Bug fixes 🐛

• ci: fix typo in variable name by @sebastien-prudhomme in #424
• fix: do not build from the same container by @mudler in #434

Exciting New Features 🎉

• feat: add CuBLAS support in Docker images by @sebastien-prudhomme in #403

👒 Dependencies

• fix: switch back to upstream for rwkv bindings by @mudler in #432

Other Changes

• docs: update docs/license(clarification) and point to new website by @mudler in #415
• ⬆️ Update go-skynet/bloomz.cpp by @ci-robbot in #417
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in #421
• docs: fix link by @mudler in #426
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 13ccc22 by @renovate in #427
• fix: correctly handle errors from App constructor by @mudler in #430
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4afcaf2 by @renovate in #428
• feat: Add more test-cases and remove dev container by @Aisuko in #433
• images: cleanup, drop .dev Dockerfile by @mudler in #437

Full Changelog: v1.17.0...v1.17.1