By default use end-of-full-token character (</t>) instead of token boundaries (<w>, </w>) for all kinds of pre-processing for consistency #3
Labels
enhancement
New feature or request
Milestone
Currently:
To be done:
The text was updated successfully, but these errors were encountered: