open-webui: init at 0.2.4 #316248

shivaraj-bh · 2024-05-31T20:39:09Z

Description of changes

open-webui package

mkdir -p ./{data,static}
DATA_DIR=$(pwd) STATIC_DIR=$(pwd)/static nix run github:shivaraj-bh/nixpkgs/open-webui#open-webui

open-webui service

{
  services.open-webui.enable = true;
}

open-webui service with ollama

{
  services.ollama.enable = true;
  services.open-webui = {
    enable = true;
    environment.OLLAMA_API_BASE_URL = "http://localhost:11434";
  };
}

Add a 👍 reaction to pull requests you find important.

drupol

Hi!

Thanks for submitting this!

I left some comments, could you also please pass the new files through nixfmt-rfc-style ?

nixos/modules/services/misc/open-webui.nix

pkgs/by-name/op/open-webui/package.nix

nixos/tests/all-tests.nix

TanvirOnGH · 2024-06-02T09:52:45Z

v0.2.3 is out!

pkgs/by-name/op/open-webui/package.nix

shivaraj-bh · 2024-06-03T08:20:31Z

v0.2.2 is out: https://github.com/open-webui/open-webui/releases/tag/v0.2.2

@TanvirOnGH There is a problem after 0.1.125, which I am still unsure how to tackle, see: #309567 (comment)

To be specific, they are fetching some dependencies in build-time: https://github.com/open-webui/open-webui/blob/be08dbf00d9ed894602f92955355eb2aa8374ec5/package.json#L7C13-L7C34

shivaraj-bh · 2024-06-04T03:26:14Z

v0.2.2 is out: https://github.com/open-webui/open-webui/releases/tag/v0.2.2

@TanvirOnGH There is a problem after 0.1.125, which I am still unsure how to tackle, see: #309567 (comment)

To be specific, they are fetching some dependencies in build-time: https://github.com/open-webui/open-webui/blob/be08dbf00d9ed894602f92955355eb2aa8374ec5/package.json#L7C13-L7C34

@TanvirOnGH I have disabled pyotide until we figure that out separately in a different PR: 39227d2

Now the package inits at 0.2.0

shivaraj-bh · 2024-06-04T03:39:15Z

@drupol Does it look good for a merge now? (If yes, I can squash the commits)

I have also switched over to use buildPythonApplication as suggested by @mweinelt

pkgs/by-name/op/open-webui/package.nix

drupol · 2024-06-04T07:18:23Z

@TanvirOnGH There is a problem after 0.1.125, which I am still unsure how to tackle, see: #309567 (comment)

To be specific, they are fetching some dependencies in build-time: https://github.com/open-webui/open-webui/blob/be08dbf00d9ed894602f92955355eb2aa8374ec5/package.json#L7C13-L7C34

I see that you've updated to 0.2.0, does that mean that the aforementioned issue has been dealt with? If yes, would it be possible to update to the very latest version then?

shivaraj-bh · 2024-06-04T09:50:00Z

I see that you've updated to 0.2.0, does that mean that the aforementioned issue has been dealt with?

I have disabled the feature that’s causing the issue for the time-being: 39227d2

If yes, would it be possible to update to the very latest version then?

will do

drupol

Almost there,

Upgrade to latest version and squash the relevant some commits together now so that it make sense?

drupol · 2024-06-04T10:35:25Z

Can you please squash the relevant commits together?

I think in the end there should be 2 commits, 1 for introducing the pkg open-webui and one for introducing the NixOS module.

shivaraj-bh · 2024-06-04T10:38:56Z

Can you please squash the relevant commits together?

I think in the end there should be 2 commits, 1 for introducing the pkg open-webui and one for introducing the NixOS module.

Done!

drupol · 2024-06-04T10:41:55Z

Nice!

I'm wondering if adding something similar to

nixpkgs/pkgs/servers/honk/default.nix

Line 53 in 3e1b36a

passthru.tests = {

in open-webui pkg would be a good idea. WDYT ?

drupol · 2024-06-04T13:47:15Z

Thank you @shivaraj-bh !

drupol · 2024-06-04T14:33:44Z

I quickly tested it locally and I noticed 2 things:

Running OLLAMA_API_BASE_URL="http://127.0.0.1:11434" WEBUI_AUTH="False" STATIC_DIR=/home/pol/.open-webui/static DATA_DIR=/home/pol/.open-webui/data open-webui dev is failing:

❯ OLLAMA_API_BASE_URL="http://127.0.0.1:11434" WEBUI_AUTH="False" STATIC_DIR=/home/pol/.open-webui/static DATA_DIR=/home/pol/.open-webui/data open-webui dev
INFO:     Will watch for changes in these directories: ['/home/pol']
INFO:     Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
INFO:     Started reloader process [495629] using StatReload
2024-06-04 16:30:19.057669038 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:1983 CreateInferencePybindStateModule] Init provider bridge failed.
Process SpawnProcess-1:
Traceback (most recent call last):
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
  self.run()
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/multiprocessing/process.py", line 108, in run
  self._target(*self._args, **self._kwargs)
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/_subprocess.py", line 78, in subprocess_started
  target(sockets=sockets)
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/server.py", line 65, in run
  return asyncio.run(self.serve(sockets=sockets))
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/asyncio/runners.py", line 190, in run
  return runner.run(main)
         ^^^^^^^^^^^^^^^^
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/asyncio/runners.py", line 118, in run
  return self._loop.run_until_complete(task)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
  return future.result()
         ^^^^^^^^^^^^^^^
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/server.py", line 69, in serve
  await self._serve(sockets)
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/server.py", line 76, in _serve
  config.load()
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/config.py", line 433, in load
  self.loaded_app = import_from_string(self.app)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/importer.py", line 22, in import_from_string
  raise exc from None
File "/nix/store/a3wgjxq99f6b86vdjcf5s2x4p4a37nd6-python3.11-uvicorn-0.29.0/lib/python3.11/site-packages/uvicorn/importer.py", line 19, in import_from_string
  module = importlib.import_module(module_str)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/nix/store/7hnr99nxrd2aw6lghybqdmkckq60j6l9-python3-3.11.9/lib/python3.11/importlib/__init__.py", line 126, in import_module
  return _bootstrap._gcd_import(name[level:], package, level)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1147, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 690, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 940, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/nix/store/hww5p16985hi360yg777ngf57w8jf0yf-open-webui-0.2.4/lib/python3.11/site-packages/main.py", line 23, in <module>
  from apps.ollama.main import app as ollama_app, get_all_models as get_ollama_models
File "/nix/store/hww5p16985hi360yg777ngf57w8jf0yf-open-webui-0.2.4/lib/python3.11/site-packages/apps/ollama/main.py", line 34, in <module>
  from apps.webui.models.models import Models
File "/nix/store/hww5p16985hi360yg777ngf57w8jf0yf-open-webui-0.2.4/lib/python3.11/site-packages/apps/webui/models/models.py", line 11, in <module>
  from apps.webui.internal.db import DB, JSONField
File "/nix/store/hww5p16985hi360yg777ngf57w8jf0yf-open-webui-0.2.4/lib/python3.11/site-packages/apps/webui/internal/db.py", line 6, in <module>
  from config import SRC_LOG_LEVELS, DATA_DIR, DATABASE_URL, BACKEND_DIR
File "/nix/store/hww5p16985hi360yg777ngf57w8jf0yf-open-webui-0.2.4/lib/python3.11/site-packages/config.py", line 6, in <module>
  import chromadb
File "/nix/store/kg9z9iii6rjggd4vd9yf989dj77bqr9w-python3.11-chromadb-0.5.0/lib/python3.11/site-packages/chromadb/__init__.py", line 5, in <module>
  from chromadb.auth.token_authn import TokenTransportHeader
File "/nix/store/kg9z9iii6rjggd4vd9yf989dj77bqr9w-python3.11-chromadb-0.5.0/lib/python3.11/site-packages/chromadb/auth/token_authn/__init__.py", line 20, in <module>
  from chromadb.telemetry.opentelemetry import (
File "/nix/store/kg9z9iii6rjggd4vd9yf989dj77bqr9w-python3.11-chromadb-0.5.0/lib/python3.11/site-packages/chromadb/telemetry/opentelemetry/__init__.py", line 12, in <module>
  from opentelemetry.exporter.otlp.proto.grpc.trace_exporter import OTLPSpanExporter
File "/nix/store/0bn6iv8mv822bx1rz9944wgsb6br27sy-python3.11-opentelemetry-exporter-otlp-proto-grpc-1.24.0/lib/python3.11/site-packages/opentelemetry/exporter/otlp/proto/grpc/trace_exporter/__init__.py", line 27, in <module>
  from opentelemetry.exporter.otlp.proto.grpc.exporter import (
File "/nix/store/0bn6iv8mv822bx1rz9944wgsb6br27sy-python3.11-opentelemetry-exporter-otlp-proto-grpc-1.24.0/lib/python3.11/site-packages/opentelemetry/exporter/otlp/proto/grpc/exporter.py", line 43, in <module>
  from google.rpc.error_details_pb2 import RetryInfo
ModuleNotFoundError: No module named 'google.rpc'

~~Uploading PDFs is failing at some point~~ this has been fixed using ollama instead of local rag transformer

INFO:     127.0.0.1:47186 - "GET /api/v1/chats/ HTTP/1.1" 200 OK
Batches:   0%|                                   | 0/102 [00:00<?, ?it/s]
fish: Job 1, 'OLLAMA_API_BASE_URL="http://127…' terminated by signal SIGFPE (Floating point exception)

We forgot to add an entry in the release note
I have the feeling that we should add more environment variables, like: HF_HOME, SENTENCE_TRANSFORMERS_HOME

shivaraj-bh · 2024-06-05T07:14:44Z

I have the feeling that we should add more environment variables, like: HF_HOME, SENTENCE_TRANSFORMERS_HOME

I was about to point this out as well. I just noticed the log while running the VM test.

Celibistrial · 2024-06-06T17:42:32Z

Doesn't seem to be working

   ollama = {
      enable = true;
      acceleration = "cuda";
    };
    open-webui = {
      enable = true;
      environment.OLLAMA_API_BASE_URL = "http://localhost:11434";
    };

× open-webui.service - User-friendly WebUI for LLMs
     Loaded: loaded (/etc/systemd/system/open-webui.service; enabled; preset: enabled)
     Active: failed (Result: exit-code) since Thu 2024-06-06 23:10:19 IST; 2s ago
   Duration: 6.662s
    Process: 75006 ExecStart=/nix/store/zlk9fvnb6gfa5gbl5v9ibws9jcv30sly-open-webui-0.2.4/bin/open-webui serve --host 127.0.0.1 --port 8080 (code=exited, status=1/FAILURE)
   Main PID: 75006 (code=exited, status=1/FAILURE)
         IP: 8.3K in, 2.3K out
        CPU: 4.464s

Jun 06 23:10:18 hp-pav open-webui[75006]:     os.makedirs(os.path.dirname(blob_path), exist_ok=True)
Jun 06 23:10:18 hp-pav open-webui[75006]:   File "<frozen os>", line 215, in makedirs
Jun 06 23:10:18 hp-pav open-webui[75006]:   File "<frozen os>", line 215, in makedirs
Jun 06 23:10:18 hp-pav open-webui[75006]:   File "<frozen os>", line 215, in makedirs
Jun 06 23:10:18 hp-pav open-webui[75006]:   [Previous line repeated 1 more time]
Jun 06 23:10:18 hp-pav open-webui[75006]:   File "<frozen os>", line 225, in makedirs
Jun 06 23:10:18 hp-pav open-webui[75006]: OSError: [Errno 30] Read-only file system: '/.cache'
Jun 06 23:10:19 hp-pav systemd[1]: open-webui.service: Main process exited, code=exited, status=1/FAILURE
Jun 06 23:10:19 hp-pav systemd[1]: open-webui.service: Failed with result 'exit-code'.
Jun 06 23:10:19 hp-pav systemd[1]: open-webui.service: Consumed 4.464s CPU time, received 8.3K IP traffic, sent 2.3K IP traffic.

/var/lib/open-webui/cache is not a read only directory(i can manually create files in that dir)

jayrahdevore · 2024-06-07T20:13:40Z

First off -- thank you all for the work on this! I was pleasantly surprised to see it in nixpkgs and it saves me from having to add another docker container.

I ended up running into the same issue as @Celibistrial . Per @drupol 's comment above, I got it up and running by adding a few more environment variables. I don't think these locations can be arbitrarily created and used due to service permissions, so I kept them to the runtime directory (this may not the ideal place, I was just focused on getting up and running)

HF_HOME = ".";
SENTENCE_TRANSFORMERS_HOME = ".";

drupol · 2024-06-07T21:16:44Z

I also had the issue and planning to fix the issue, here it is: #318099

shivaraj-bh · 2024-06-10T02:24:50Z

I also had the issue and planning to fix the issue, here it is: #318099

@drupol Thanks for this! I was offline for the last few days.

Anyways, I was planning to check out why open-webui dev is failing. I will raise a PR once I do.

ported from: https://github.com/shivaraj-bh/ollama-flake/blob/main/services/open-webui.nix This was also recently upstreamed to nixpkgs: NixOS/nixpkgs#316248

pkgs/by-name/op/open-webui/package.nix

shivaraj-bh · 2024-06-13T06:02:24Z

@natsukium Thanks for the review! I will address them in a different PR and cross-reference it here.

For more info, see: - Disable hatch custom hook: NixOS#316248 (comment) - why `makeWrapperArgs`?: NixOS#316248 (comment) - `pythonRelaxDepsHook` is a nativeBuildInput: NixOS#316248 (comment)

Kreyren · 2024-06-13T15:20:00Z

Please backport this to stable, i wanna use it

Thanks <3

ported from: https://github.com/shivaraj-bh/ollama-flake/blob/main/services/open-webui.nix This was also recently upstreamed to [nixpkgs](https://github.com/NixOS/nixpkgs/tree/master): NixOS/nixpkgs#316248 --------- Co-authored-by: Pol Dellaiera <pol.dellaiera@protonmail.com> Co-authored-by: Sridhar Ratnakumar <3998+srid@users.noreply.github.com>

pkgs/by-name/op/open-webui/package.nix

github-actions · 2024-08-05T06:44:37Z

Successfully created backport PR for release-24.05:

[Backport release-24.05] open-webui: init at 0.2.4 #332412

For more info, see: - Disable hatch custom hook: #316248 (comment) - why `makeWrapperArgs`?: #316248 (comment) - `pythonRelaxDepsHook` is a nativeBuildInput: #316248 (comment) (cherry picked from commit 75d7ee7)

github-actions bot added 6.topic: nixos 8.has: module (update) labels May 31, 2024

shivaraj-bh mentioned this pull request May 31, 2024

nix run not working anymore shivaraj-bh/ollama-flake#7

Open

drupol requested changes May 31, 2024

View reviewed changes

ofborg bot added 8.has: package (new) 11.by: package-maintainer 10.rebuild-darwin: 1-10 10.rebuild-darwin: 1 10.rebuild-linux: 1-10 labels May 31, 2024

drupol requested changes May 31, 2024

View reviewed changes

nixos/tests/all-tests.nix Outdated Show resolved Hide resolved

h7x4 added 8.has: module (new) 8.has: tests labels Jun 1, 2024

mweinelt reviewed Jun 2, 2024

View reviewed changes

pkgs/by-name/op/open-webui/package.nix Outdated Show resolved Hide resolved

shivaraj-bh changed the title ~~open-webui: init at 0.1.124~~ open-webui: init at 0.2.0 Jun 4, 2024

drupol requested changes Jun 4, 2024

View reviewed changes

pkgs/by-name/op/open-webui/package.nix Outdated Show resolved Hide resolved

drupol requested changes Jun 4, 2024

View reviewed changes

shivaraj-bh changed the title ~~open-webui: init at 0.2.0~~ open-webui: init at 0.2.4 Jun 4, 2024

shivaraj-bh force-pushed the open-webui branch from e71ae1d to 85f6a59 Compare June 4, 2024 10:37

shivaraj-bh added 2 commits June 4, 2024 16:46

open-webui: init at 0.2.4

1860d78

nixos/open-webui: init

f66cb82

shivaraj-bh force-pushed the open-webui branch from 85f6a59 to f66cb82 Compare June 4, 2024 11:16

drupol merged commit 6b6d4ae into NixOS:master Jun 4, 2024
23 of 25 checks passed

shivaraj-bh deleted the open-webui branch June 4, 2024 14:00

This was referenced Jun 5, 2024

nixos/{ollama,open-webui}: minor service update #317286

Merged

private-gpt: init at 0.5.0 #305586

Merged

drupol mentioned this pull request Jun 7, 2024

Unable to query PDF document from the document library, but inline in the chat open-webui/open-webui#2901

Closed

4 tasks

drupol mentioned this pull request Jun 7, 2024

nixos/open-webui: add more default variables #318099

Merged

13 tasks

malteneuss mentioned this pull request Jun 8, 2024

Add Ollama-webui package and service for Mixtral #275448

Closed

13 tasks

shivaraj-bh added a commit to juspay/services-flake that referenced this pull request Jun 11, 2024

feat(open-webui): init

399b858

ported from: https://github.com/shivaraj-bh/ollama-flake/blob/main/services/open-webui.nix This was also recently upstreamed to nixpkgs: NixOS/nixpkgs#316248

shivaraj-bh mentioned this pull request Jun 11, 2024

feat(open-webui): init juspay/services-flake#219

Merged

2 tasks

natsukium reviewed Jun 12, 2024

View reviewed changes

pkgs/by-name/op/open-webui/package.nix Show resolved Hide resolved

pkgs/by-name/op/open-webui/package.nix Show resolved Hide resolved

pkgs/by-name/op/open-webui/package.nix Show resolved Hide resolved

shivaraj-bh mentioned this pull request Jun 13, 2024

open-webui: Use makeWrapperArgs; Use env to disable hatch custom hook #319498

Merged

13 tasks

dotlambda reviewed Jul 31, 2024

View reviewed changes

pkgs/by-name/op/open-webui/package.nix Show resolved Hide resolved

shivaraj-bh added the backport release-24.05 Backport PR automatically label Aug 5, 2024

github-actions bot mentioned this pull request Aug 5, 2024

[Backport release-24.05] open-webui: init at 0.2.4 #332412

Merged

1 task

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

open-webui: init at 0.2.4 #316248

open-webui: init at 0.2.4 #316248

shivaraj-bh commented May 31, 2024 •

edited

Loading

drupol left a comment

TanvirOnGH commented Jun 2, 2024 •

edited

Loading

shivaraj-bh commented Jun 3, 2024

shivaraj-bh commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol left a comment •

edited

Loading

drupol commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol commented Jun 4, 2024

drupol commented Jun 4, 2024

drupol commented Jun 4, 2024 •

edited

Loading

shivaraj-bh commented Jun 5, 2024

Celibistrial commented Jun 6, 2024 •

edited

Loading

jayrahdevore commented Jun 7, 2024 •

edited

Loading

drupol commented Jun 7, 2024

shivaraj-bh commented Jun 10, 2024

shivaraj-bh commented Jun 13, 2024

Kreyren commented Jun 13, 2024

github-actions bot commented Aug 5, 2024

open-webui: init at 0.2.4 #316248

open-webui: init at 0.2.4 #316248

Conversation

shivaraj-bh commented May 31, 2024 • edited Loading

Description of changes

open-webui package

open-webui service

open-webui service with ollama

drupol left a comment

Choose a reason for hiding this comment

TanvirOnGH commented Jun 2, 2024 • edited Loading

shivaraj-bh commented Jun 3, 2024

shivaraj-bh commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol left a comment • edited Loading

Choose a reason for hiding this comment

drupol commented Jun 4, 2024

shivaraj-bh commented Jun 4, 2024

drupol commented Jun 4, 2024

drupol commented Jun 4, 2024

drupol commented Jun 4, 2024 • edited Loading

shivaraj-bh commented Jun 5, 2024

Celibistrial commented Jun 6, 2024 • edited Loading

jayrahdevore commented Jun 7, 2024 • edited Loading

drupol commented Jun 7, 2024

shivaraj-bh commented Jun 10, 2024

shivaraj-bh commented Jun 13, 2024

Kreyren commented Jun 13, 2024

github-actions bot commented Aug 5, 2024

shivaraj-bh commented May 31, 2024 •

edited

Loading

TanvirOnGH commented Jun 2, 2024 •

edited

Loading

drupol left a comment •

edited

Loading

drupol commented Jun 4, 2024 •

edited

Loading

Celibistrial commented Jun 6, 2024 •

edited

Loading

jayrahdevore commented Jun 7, 2024 •

edited

Loading