[paperless-ngx] Update to v2.12.1 fails during migration

[indiependente]

Issue

Running update command in the paperless-ngx LXC breaks while upgrading to version v2.12.1. This makes paperless-ngx in a non-working state, hence returning a 500 from the API.

    ____                        __                                     
   / __ \____ _____  ___  _____/ /__  __________    ____  ____ __  __
  / /_/ / __ `/ __ \/ _ \/ ___/ / _ \/ ___/ ___/___/ __ \/ __ `/ |/_/
 / ____/ /_/ / /_/ /  __/ /  / /  __(__  |__  )___/ / / / /_/ />  <  
/_/    \__,_/ .___/\___/_/  /_/\___/____/____/   /_/ /_/\__, /_/|_|  
           /_/                                         /____/        
 
cat: /opt/Paperless-ngx_version.txt: No such file or directory
 ✓ Stopped all Paperless-ngx Services
 \ Updating to v2.12.1   
[ERROR] in line 83: exit code 0: while executing command /usr/bin/python3 manage.py migrate &> /dev/null

---

Logs
journalctl -xeu paperless-webserver.service:

Oct 08 11:42:45 paperless-ngx gunicorn[458]:     response = await get_response(request)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/asgiref/sync.py", line 518, in thread_handler
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     raise exc_info[1]
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/core/handlers/base.py", line 253, in _get_response_async
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     response = await wrapped_callback(
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                ^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/asgiref/sync.py", line 468, in __call__
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     ret = await asyncio.shield(exec_coro)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/asgiref/current_thread_executor.py", line 40, in run
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     result = self.fn(*self.args, **self.kwargs)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/asgiref/sync.py", line 522, in thread_handler
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return func(*args, **kwargs)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return view_func(*args, **kwargs)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/views/generic/base.py", line 104, in view
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return self.dispatch(request, *args, **kwargs)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/rest_framework/views.py", line 509, in dispatch
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     response = self.handle_exception(exc)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                ^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/rest_framework/views.py", line 469, in handle_exception
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     self.raise_uncaught_exception(exc)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     raise exc
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/rest_framework/views.py", line 506, in dispatch
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     response = handler(request, *args, **kwargs)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/opt/paperless/src/documents/views.py", line 1420, in get
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     documents_total = documents.count()
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                       ^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/models/query.py", line 608, in count
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return self.query.get_count(using=self.db)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/models/sql/query.py", line 568, in get_count
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return obj.get_aggregation(using, {"__count": Count("*")})["__count"]
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/models/sql/query.py", line 554, in get_aggregation
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     result = compiler.execute_sql(SINGLE)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/models/sql/compiler.py", line 1562, in execute_sql
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     cursor.execute(sql, params)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 67, in execute
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return self._execute_with_wrappers(
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 80, in _execute_with_wrappers
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return executor(sql, params, many, context)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 84, in _execute
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     with self.db.wrap_database_errors:
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/utils.py", line 91, in __exit__
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     raise dj_exc_value.with_traceback(traceback) from exc_value
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/django/db/backends/utils.py", line 89, in _execute
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     return self.cursor.execute(sql, params)
Oct 08 11:42:45 paperless-ngx gunicorn[458]:            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Oct 08 11:42:45 paperless-ngx gunicorn[458]:   File "/usr/local/lib/python3.11/dist-packages/psycopg/cursor.py", line 97, in execute
Oct 08 11:42:45 paperless-ngx gunicorn[458]:     raise ex.with_traceback(None)
Oct 08 11:42:45 paperless-ngx gunicorn[458]: django.db.utils.ProgrammingError: column documents_document.deleted_at does not exist
Oct 08 11:42:45 paperless-ngx gunicorn[458]: LINE 1: ...*) AS "__count" FROM "documents_document" WHERE (("documents...
Oct 08 11:42:45 paperless-ngx gunicorn[458]:                                                              ^
Oct 08 11:43:14 paperless-ngx systemd[1]: Stopping paperless-webserver.service - Paperless webserver...

---

Initial observation
There seems to be an issue with one the DB queries as reported by LINE 1: ...*) AS "__count" FROM "documents_document" WHERE (("documents....

---

Questions

1. Is the migration script provided by paperless-ngx?
2. Is there anything that can be done from our side to fix the migration script?

Thanks in advance for any help.

[tteck]

#2925

[indiependente]

Hey @tteck thanks for the link to the discussion.

After going through the thread I ran the following commands:

1. Backed up DB and converted to UTF-8 encoding as suggested in https://www.bytehero.io/posts/2024/paperless-postgres-encoding-error/
2. Running update ended up with "[ERROR] in line 83: exit code 0: while executing command /usr/bin/python3 manage.py migrate &> /dev/null" so as suggested by this comment I downloaded the update script and changed the migrate line and that made the script suceed.
3. But the webserver is still failing due to a missing column in the DB:

Oct 08 19:40:15 paperless-ngx gunicorn[919]: django.db.utils.ProgrammingError: column documents_document.deleted_at does not exist
Oct 08 19:40:15 paperless-ngx gunicorn[919]: LINE 1: ...*) AS "__count" FROM "documents_document" WHERE (("documents...

So at this point I'm probably guessing the migration didn't work.