Accessible, efficient data preprocessing library for pretrain and SFT datasets, including KL3M
-
Updated
Oct 5, 2024 - Rust
Accessible, efficient data preprocessing library for pretrain and SFT datasets, including KL3M
Add a description, image, and links to the alea topic page so that developers can more easily learn about it.
To associate your repository with the alea topic, visit your repo's landing page and select "manage topics."