Skip to content

Commit

Permalink
chore: Add network configuration for slam-network in compose.yml
Browse files Browse the repository at this point in the history
  • Loading branch information
chandralegend committed May 9, 2024
1 parent 427e2fa commit 32e6303
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 1 deletion.
3 changes: 3 additions & 0 deletions app/src/components/auto_evaluator/llm_as_evaluator.impl.jac
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,9 @@ import:jac from ..utils, llms, check_engine_status, load_engine, run_inference;
}
if engine_loaded {
for (question_set_id, question_set) in all_questions.items() {
if os.path.exists(os.path.join("results", f"llm_as_evaluator_{question_set_id}.json")){
continue;
}
evals = [];
for question in question_set {
prompt_id = question[0];
Expand Down
12 changes: 11 additions & 1 deletion compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ services:
- 8501:8501
volumes:
- ./results:/app/results
networks:
- slam-network
engine:
build:
context: ./engine
Expand All @@ -20,14 +22,22 @@ services:
- OPENAI_API_KEY=sk-1234567890
ports:
- 8000:8000
networks:
- slam-network
ollama:
image: ollama/ollama:latest
ports:
- 11434:11434
networks:
- slam-network
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities: [gpu]
capabilities: [gpu]

networks:
slam-network:
driver: bridge

0 comments on commit 32e6303

Please sign in to comment.