Skip to content

Commit

Permalink
chore: split out dependencies that require a GPU
Browse files Browse the repository at this point in the history
  • Loading branch information
david20571015 committed Aug 12, 2024
1 parent b605d48 commit 1c221a9
Show file tree
Hide file tree
Showing 3 changed files with 1,527 additions and 1,353 deletions.
19 changes: 17 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,27 @@ This project use [poetry](https://python-poetry.org/) to manage dependencies. Pl
### Execution Only

```bash
poetry install --without dev
# Crawler and mongodb client
poetry install

# Or

# Crawler, mongodb client and chromadb client
# To store data in chromadb, you might need GPUs for execute embedding models
poetry install --with chroma
```

### Development

```bash
poetry install
# Crawler and mongodb client
poetry install --dev
poetry run pre-commit install

# Or

# Crawler, mongodb client and chromadb client
# To store data in chromadb, you might need GPUs for execute embedding models
poetry install --dev --with chroma
poetry run pre-commit install
```
Loading

0 comments on commit 1c221a9

Please sign in to comment.