HF_PRETRAINED_MODEL not working properly

[axel7083]

Description

am not sure to perfectly understand the following

ai-lab-recipes/model_servers/llamacpp_python/src/run.sh

Lines 18 to 20 in 55610a8

	--chat_format ${CHAT_FORMAT:=llama-2} \
	${PRETRAINED_MODEL_PATH:=}
	${HF_PRETRAINED_MODEL:%=--hf_pretrained_model_name_or_path %} \

But using the command

podman run -v /home/axel7083/Documents/models/:/models:Z -e MODEL_PATH=/models/functionary-small-v2.5.Q4_0.gguf -e HF_PRETRAINED_MODEL=meetkai/functionary-small-v2.5-GGUF -e CHAT_FORMAT=functionary-v2 -p 8000:8000 -e PORT=8000 ghcr.io/containers/llamacpp_python:latest

does not provide the proper value to --hf_pretrained_model_name_or_path.

Expected

The tokenizer_config.json should be downloaded at startup

Current

With the current, it does not download it

[axel7083]

cc @Gregory-Pereira I think a \ is missing on the following line

ai-lab-recipes/model_servers/llamacpp_python/src/run.sh

Line 19 in 55610a8

${PRETRAINED_MODEL_PATH:=}

but when adding it we got the following error

./run.sh: line 12: HF_PRETRAINED_MODEL: %=--hf_pretrained_model_name_or_path %: syntax error: operand expected (error token is "%=--hf_pretrained_model_name_or_path %")