Installation issues

[serverul]

Hi everybody.

I am trying to install the app but I receive some errors the the app doesn't function at all.

I've tried with docker version on both my proxmox server and on linode vps. I've tried lxc container and vm as well. Nothing seems to work. On the docker install everything goes well and without errors, all the containers start, only the g3w-suite one is loop restarting, resulting in the app to not function.

On the raw installation it give me an error when I try to install it with paver. Always the same error:

 ---> pavement.sync
python g3w-admin/manage.py migrate --noinput

Build failed running pavement.install: Subprocess return code: 1

Does anyone have a complete installation guide? I am sure that are some steps that are missing because the issue replicates on other computers and other networks as well.
Either on docker or raw install.

[Raruto]

Hi @serverul,

I am sure that are some steps that are missing because the issue replicates on other computers and other networks as well.

please describe all your steps in detail (ie. step by step) to make others understand what might have gone wrong.

the g3w-suite is loop restarting

You can change the restart policy to "no" (and then restart compose) to better analyze what goes wrong within that container:

https://github.com/g3w-suite/g3w-suite-docker/blob/f90ce492fcb962969c0eb1b5d21611dadd36025b/docker-compose.yml#L55

👋 Raruto

[serverul]

Ok, at this moment I am pretty sure that the installation documentation is not complete. There is at least one step missing. In either raw and docker version. I tried 3 more times with newly setup servers. Or maybe I am just stupid.
I will try with debian 12 also, but I am pretty sure that I skip at least one step.

[Raruto]

Hi @serverul,

ref: g3w-suite/g3w-suite-docker#113 (comment)

I'll reply here, please don't open separate threads.. ☺️

root_postgis_1              /bin/bash /scripts/docker- ...   Restarting

Did you inspect that container logs? 👉 https://docs.docker.com/engine/reference/commandline/logs/

Additional info: An easy way to figure out why a docker container keep restarting?

👋 Raruto

[serverul]

Yes. So now the only container that I've got not working is the certbot one. Here is the ending log:

root@webgis:~# docker logs root_certbot_1
Saving debug log to /var/log/letsencrypt/letsencrypt.log
Certbot doesn't know how to automatically configure the web server on this system. However, it can still get a certificate for you. Please run "certbot certonly" to do so. You'll need to manually configure your web server to use the resulting certificate.

I've checked the logs for the other containers that I knew I've had problems running, postgis and g3w-suite.

This is for g3w-suite and the log has more errors like this:

ModuleNotFoundError: No module named 'base.settings.local_settings'
[2023-12-01 14:31:27 +0000] [156] [INFO] Worker exiting (pid: 156)
[2023-12-01 14:31:27 +0000] [155] [ERROR] Exception in worker process
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/arbiter.py", line 589, in spawn_worker
    worker.init_process()
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/workers/base.py", line 134, in init_process
    self.load_wsgi()
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/workers/base.py", line 146, in load_wsgi
    self.wsgi = self.app.wsgi()
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/app/base.py", line 67, in wsgi
    self.callable = self.load()
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/app/wsgiapp.py", line 58, in load
    return self.load_wsgiapp()
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/app/wsgiapp.py", line 48, in load_wsgiapp
    return util.import_app(self.app_uri)
  File "/usr/local/lib/python3.10/dist-packages/gunicorn/util.py", line 359, in import_app
    mod = importlib.import_module(module)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/code/g3w-admin/base/wsgi.py", line 21, in <module>
    application = get_wsgi_application()
  File "/usr/local/lib/python3.10/dist-packages/django/core/wsgi.py", line 12, in get_wsgi_application
    django.setup(set_prefix=False)
  File "/usr/local/lib/python3.10/dist-packages/django/__init__.py", line 19, in setup
    configure_logging(settings.LOGGING_CONFIG, settings.LOGGING)
  File "/usr/local/lib/python3.10/dist-packages/django/conf/__init__.py", line 79, in __getattr__
    self._setup(name)
  File "/usr/local/lib/python3.10/dist-packages/django/conf/__init__.py", line 66, in _setup
    self._wrapped = Settings(settings_module)
  File "/usr/local/lib/python3.10/dist-packages/django/conf/__init__.py", line 157, in __init__
    mod = importlib.import_module(self.SETTINGS_MODULE)
  File "/usr/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/code/g3w-admin/base/settings/__init__.py", line 6, in <module>
    from .local_settings import *
ModuleNotFoundError: No module named 'base.settings.local_settings'
[2023-12-01 14:31:27 +0000] [155] [INFO] Worker exiting (pid: 155)
Build was already done, skipping ...
Setup started for G3W-Suite installation ...
Cleaning up some dirs before collecting statics ...
projects
/code /code
overrides
/code
Creating projects(_data) directores in /shared-volume/media/projects ...
wait-for-it: waiting 60 seconds for postgis:5432

For postgis I found the following:

...
.
.
.
.
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response
/var/run/postgresql:5432 - no response

root@webgis:~# docker-compose ps
          Name                         Command                   State                                                Ports
-------------------------------------------------------------------------------------------------------------------------------------------------------------------
root_certbot_1              certbot                          Exit 1
root_g3w-suite-consumer_1   /scripts/docker-consumer-e ...   Up
root_g3w-suite_1            /bin/sh -c /scripts/docker ...   Up               8000/tcp
root_nginx_1                /docker-entrypoint.sh ngin ...   Up               0.0.0.0:443->443/tcp,:::443->443/tcp, 80/tcp,
                                                                              0.0.0.0:8080->8080/tcp,:::8080->8080/tcp
root_postgis_1              /bin/bash /scripts/docker- ...   Up (unhealthy)   0.0.0.0:5439->5432/tcp,:::5439->5432/tcp
root_redis_1                docker-entrypoint.sh redis ...   Up               6379/tcp

The platform is still not working

[serverul]

Also I can see the certbot container if I give command docker-compose ps and I cannot see it if I enter docker ps.

root@webgis:~#docker-compose logs -f root_certbot_1
ERROR: No such service: root_certbot_1

root@webgis:~# docker-compose ps
          Name                         Command                   State                                                Ports
-------------------------------------------------------------------------------------------------------------------------------------------------------------------
root_certbot_1              certbot                          Exit 1
root_g3w-suite-consumer_1   /scripts/docker-consumer-e ...   Up
root_g3w-suite_1            /bin/sh -c /scripts/docker ...   Up               8000/tcp
root_nginx_1                /docker-entrypoint.sh ngin ...   Up               0.0.0.0:443->443/tcp,:::443->443/tcp, 80/tcp,
                                                                              0.0.0.0:8080->8080/tcp,:::8080->8080/tcp
root_postgis_1              /bin/bash /scripts/docker- ...   Up (unhealthy)   0.0.0.0:5439->5432/tcp,:::5439->5432/tcp
root_redis_1                docker-entrypoint.sh redis ...   Up               6379/tcp

root@webgis:~# docker-compose logs root_certbot_1
ERROR: No such service: root_certbot_1
root@webgis:~# docker ps
CONTAINER ID   IMAGE                    COMMAND                  CREATED         STATUS                     PORTS                                                                                      NAMES
d419d63df44e   g3wsuite/g3w-suite:dev   "/scripts/docker-con…"   8 minutes ago   Up About a minute                                                                                                     root_g3w-suite-consumer_1
124d93beb1a0   g3wsuite/g3w-suite:dev   "/bin/sh -c /scripts…"   8 minutes ago   Up About a minute          8000/tcp                                                                                   root_g3w-suite_1
e359ae014381   kartoza/postgis:15-3.3   "/bin/bash /scripts/…"   8 minutes ago   Up 8 minutes (unhealthy)   0.0.0.0:5439->5432/tcp, :::5439->5432/tcp                                                  root_postgis_1
4b178b74a271   nginx                    "/docker-entrypoint.…"   8 minutes ago   Up 8 minutes               0.0.0.0:443->443/tcp, :::443->443/tcp, 80/tcp, 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp   root_nginx_1
21a6221fb5ce   redis:latest             "docker-entrypoint.s…"   8 minutes ago   Up 8 minutes               6379/tcp                                                                                   root_redis_1
root@webgis:~#

[serverul]

Is there anyone who can assist me with this issue? I really don't see the issue and I lose a lot of time.

Thanks.

[wlorenzetti]

Hi @serverul,

Pavement commands are for raw deploy of G3W-SUITE without docker.

G3W-SUITE can be deployed by two way:

• raw way: https://g3w-suite.readthedocs.io/en/latest/install.html
• docker way: https://g3w-suite.readthedocs.io/en/latest/docker.html

Docker way is more simple that raw way.

Get a clear Ubuntu machine with docker and docker compose installed the deploy required only few steps:

1. Clone the G3W-SUITE docker repository (at this moment can you clone the v3.7.x branch):

git clone -b v3.7.x https://github.com/g3w-suite/g3w-suite-docker.git

2. Go inside the g3w-suite-docker directory and copy .env.example file in .env
3. (Optional) Open the .env file and change the following variables:

WEBGIS_PUBLIC_HOSTNAME=v37.g3wsuite.it # Change it to your domain for production environment

WEBGIS_DOCKER_SHARED_VOLUME=./shared-volume # This is the folder where are saved the permanent data, like db cluster etc.

For a clearer explanation of the variables that can be set within the .env file you can consult the relevant section of the documentation https://g3w-suite.readthedocs.io/en/latest/docker_env.html
4. (Optional) If you want for to get the g3w-suite code updated, you can make a build of the g3wsuite/g3w-suite:v3.7.x docker image:

docker build -f Dockerfile.g3wsuite.dockerfile -t g3wsuite/g3w-suite:v3.7.x --no-cache .

5. Now you can run the docker compose:

docker compose up -d

6. (Optional) Is possible deploy G3W-SUITE with a consumer docker container for run batch processes i.e. for clear the locking feature table for editing:

docker compose -f docker-compose-consumer.yml up -d

Try to follow this simple steps and you shouldn't have any problems

[serverul]

Hello @wlorenzetti and thank you for your answer. I've tried both ways - raw and docker - believing that raw will give me more freedom to customize the application, but I really like docker as well so no big issue with it. But let's stick now with the docker install as I tried it more times than raw, also now following your steps. I skipped the optional steps (I only changed the hostname in .env file) and I still get the same issues.

root@webgis:~/g3w-suite-docker# docker-compose ps
            Name                          Command                  State                          Ports
---------------------------------------------------------------------------------------------------------------------------
g3w-suite-docker-certbot-1     certbot                          Exit 1
g3w-suite-docker-g3w-suite-1   /bin/sh -c /scripts/docker ...   Restarting
g3w-suite-docker-nginx-1       /docker-entrypoint.sh ngin ...   Up             0.0.0.0:443->443/tcp,:::443->443/tcp,
                                                                               80/tcp,
                                                                               0.0.0.0:8080->8080/tcp,:::8080->8080/tcp
g3w-suite-docker-postgis-1     /bin/sh -c /docker-entrypo ...   Up (healthy)   0.0.0.0:5439->5432/tcp,:::5439->5432/tcp
g3w-suite-docker-redis-1       docker-entrypoint.sh redis ...   Up             6379/tcp

I will give it a try now also with the consumer yaml file, but I don't have any hopes.

The system is freshly deployed. It is a Ubuntu 22.04 vps. I also attached the full install logs bellow.

g3wsuite-docker-install-issues.txt

[serverul]

I have checked the vps panel to reinstall a fresh copy and I realised that all the 4GB of ram are eaten already. Maybe this can cause this issue?

CONTAINER ID   NAME                                    CPU %     MEM USAGE / LIMIT   MEM %     NET I/O          BLOCK I/O         PIDS
bc07a5d102b5   g3w-suite-docker-g3w-suite-consumer-1   0.00%     0B / 0B             0.00%     0B / 0B          0B / 0B           0
f548427b3321   g3w-suite-docker-g3w-suite-1            0.00%     0B / 0B             0.00%     0B / 0B          0B / 0B           0
51cca9196092   g3w-suite-docker-postgis-1              0.00%     40.76MiB / 4GiB     1.00%     16.6kB / 6kB     34.5MB / 1.58MB   10
9c121dcabba5   g3w-suite-docker-nginx-1                0.00%     2.387MiB / 4GiB     0.06%     35.8kB / 451kB   20.4MB / 0B       5
e32df41c81ea   g3w-suite-docker-redis-1                0.13%     1.863MiB / 4GiB     0.05%     11.2kB / 0B      7.59MB / 0B       5

[serverul]

This is what I just received the a fresh server on my proxmox test server:

root@webgis:~/g3w-suite-docker# docker compose up -d
[+] Running 56/5
 ⠋ certbot 12 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulling                                                  399.0s 
 ⠋ g3w-suite 12 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulling                                                399.0s 
 ✔ redis 7 layers [⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                                           126.9s 
 ✔ postgis 17 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled                                              127.3s 
 ⠋ nginx 6 layers [⣿⣿⣿⣿⣿⣿]      0B/0B      Pulling                                                           399.0s 
failed to register layer: unlinkat /usr/local/lib/python3.10/site-packages/pip-23.0.1.dist-info: invalid argument

I have tried on my test server as I can give it as much resources what I need instead of buying and ram upgrade for the production server. It beats me!

[serverul]

I am feeling stupid, but I didn't install the app successufuly. If anybody has any more info or can give a eye/hand to the installation i would appreciate. Thanks guys and happy holidays!

[Raruto]

Hi @serverul,
I think Walter has already answered you in detail in here.

From what I see from here it could also be a problem related to how you installed docker (or in any case some missing permissions on your host system).

In any case, I highly recommend you:

1. try it on your local computer first too (if so, also try with dev container setup too)
2. ask for support on https://forum.proxmox.com/
3. ask for help from larger communities like: https://stackoverflow.com/ or https://serverfault.com/

Otherwise, if you prefer to have dedicated assistance, try contacting the sales department at: info@gis3w.it

Have a nice year you too,
Raruto

[serverul]

Hi @Raruto ,
Thanks for your answer. I will check other communities to search an answer.
I know that Walter detailed me the installation process, but no luck. 1. I have tried 4 different hardware machines and 2 VPS providers, this is the reason that it's getting frustrating.
If I will not get a solution soon, I will contact sales dept. also.
Thanks.

[serverul]

Hi guys,

I succesfully installed the app on a linode vps with 2 CPUs and 4 Gb RAM (it won't work on 2GB) with Ubuntu 22.04 and I installed docker with the following command instead of the install script:

apt install docker.io apt install docker-compose

So I think it was a combined issue of OS image and docker installation method and also hardware.

After this I followed @wlorenzetti instructions and everything went well. I logged in, created a group but when I try to upload a project I have the following errors:

Demo content:
[Project error on layers()]-- [Layer error on datasource(buildings_2f43dc1d_6725_42d2_a09b_dd446220104a)]-- : Current datasource is dbname='/shared-volume/project_data/spatialite/building_management_demo.sqlite' table="buildings" (geom)

My Project (saved in qgis 3.10 and again with 3.32)
[Project error on layers()]-- [Layer error on datasource(Arbori_93d53e19_94e9_422e_a004_e19fd2871d82)]-- : Current datasource is /shared-volume/media/temp_uploads/Arbori.shp

I have tried to install g3wsuite with the shared-volume folder to other location instead of the root folder (i installed everything with the root user) and I changed it to /opt/./shared-volume
I checked the folder in both cases. Eg: I uploads the logos and images and also the qgs project, but not the layersf for the root install folder and for opt install folder I have some more files including the layers, but no effect.

root@localhost:~/g3w-suite-docker/shared-volume/media/temp_uploads# ls 0414957c-b2ac-4986-ab9b-8331222beeda 76978cb3-44b2-4ecf-ae19-9e10d570eac0.qgz 684531b4-24a4-472d-8c74-12b14d480afb 8df57421-9dce-425e-8ebc-7928e8bcb2a9 76978cb3-44b2-4ecf-ae19-9e10d570eac0 fda5a56c-257d-459f-8e53-134d39f96bc4

root@localhost:/opt/shared-volume/media/temp_uploads# ls 107a0e63-d05a-4c02-a433-fed835d21047 b55ab847-fd2b-440c-8356-cf29d94a71b2 12c2f60c-be27-4521-9c03-d89256d5e7ff.qgz b7660e29-2488-4017-b08f-c07180e77825.qgz Arbori_noi.gpkg c1d2f8d4-0db2-472e-9bfd-9daeacedb113 Arbori_noi.gpkg-shm c6bd38e0-ad2d-47a0-8724-6cff3b673ffe Arbori_noi.gpkg-wal SVall_-_mod.gpkg
Can you point me to the right direction? What I am doing wrong here?

You can reach the website here: http://172.105.72.207:8080

[serverul]

So, after I chmod the temp_folder, I can upload manually the layer files and the project creation is working, but it doesn't upload it automatically. The layers appear in 'Browser module' but don't show on the map. But I can upload them again from the map viewer mode and they work.

[AP2607]

I suggest you to follow this section of the guide: https://g3w-suite.readthedocs.io/en/latest/datamanagement.html#management-and-organization-of-geographic-data-and-qgis-projects