-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: Unable to delete the persistent directory from another program due to PermissionError #2446
Comments
Looks like the issue has been mentioned before at #1009 (comment), and #1152 |
Hey @axiangcoding, you are hitting a Windows-related problem where (not necessarily your case) a Windows admin process (e.g., MS Defender) holds the file for a little while after another process has accessed it. However, your case might be slightly different as your FastAPI can hold the file, given that your cronjob is a separate process. Before trying to run |
hi @tazarov , I have try btw, i tried |
@axiangcoding, can you trace what process keeps the lock on the file? As an alternative, have you tried running things into a docker container with a volume instead of directory mount? |
Just known that it is the fastapi process that keep the file lock. I'll try the other sugguestions later |
@axiangcoding, thanks for confirming. That means that Chroma hasn't released the file yet. |
hi @tazarov , I've tested it in k8s, mounted an azure-file to the persistent directory, both error has changed.
I also try the |
What happened?
I have two programmes, one build by fastapi, we call it
server
, and one for schedule tasks, we call itcronjob
.I'm using chromadb in
server
to create the data through chromadb sdk (wrapper by langchain-chromadb), and i have running thecronjob
to clean the persist directory.But when chromadb finishes executing normally in
server
, and then I delete the persist directory on thecronjob
, error happened.code in
server
is as follow:code in
cronjob
is as follow:This is very strange. It looks like some resources are not being released. Any idea of where should i start to debug it?
Versions
both service install the same version of chromadb
langchain-chroma = "^0.1.1"
chromadb = "^0.5.3"
Relevant log output
The text was updated successfully, but these errors were encountered: