Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

koaning/tokenwiser

Repository files navigation

tokenwiser

Bag of, not words, but tricks!

This project contains a couple of "tricks" on tokens. It's a collection of tricks for sparse data that might be trained on a stream of data too.

While exploring these tricks was super fun, I do feel like there are plenty of better alternatives than the ideas I explore here. In the end, TfIDF + LogReg can be "fine" for a bunch of tasks that don't require embeddings.

And for embeddings ... there's embetter.

So I archived this repo. Bit of a shame, because I really liked the name of this package.