Unable to follow the ThaiTokenizer document

[elcolie]

I did pip install fastai numpy dill already. And try follow the document

from pythainlp.ulmfit.utils import ThaiTokenizer
tt = ThaiTokenizer()
tt.replace_rep('คือดียยยยยย')
คือดีtkrep6ย

This the error.

In [3]: from pythainlp.ulmfit.utils import ThaiTokenizer
Requirement already satisfied: fastai in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (1.0.13)
Requirement already satisfied: thinc==6.12.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (6.12.0)
Requirement already satisfied: pandas in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (0.23.4)
Requirement already satisfied: nbconvert in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (5.4.0)
Requirement already satisfied: requests in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (2.20.0)
Requirement already satisfied: numpy>=1.12 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (1.15.3)
Requirement already satisfied: Pillow in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (5.3.0)
Requirement already satisfied: spacy==2.0.16 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (2.0.16)
Requirement already satisfied: typing in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (3.6.6)
Requirement already satisfied: matplotlib in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (3.0.0)
Requirement already satisfied: fastprogress>=0.1.10 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (0.1.10)
Requirement already satisfied: scipy in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (1.1.0)
Requirement already satisfied: ipython in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (7.0.1)
Requirement already satisfied: cymem==2.0.2 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (2.0.2)
Requirement already satisfied: torchvision-nightly in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (0.2.1)
Requirement already satisfied: traitlets in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (4.3.2)
Requirement already satisfied: regex in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (2018.1.10)
Requirement already satisfied: jupyter in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (1.0.0)
Requirement already satisfied: dataclasses in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (0.6)
Requirement already satisfied: pyyaml in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (3.13)
Requirement already satisfied: nbformat in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from fastai) (4.4.0)
Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (1.0.1)
Requirement already satisfied: plac<1.0.0,>=0.9.6 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (0.9.6)
Requirement already satisfied: dill<0.3.0,>=0.2.7 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (0.2.8.2)
Requirement already satisfied: msgpack<1.0.0,>=0.5.6 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (0.5.6)
Requirement already satisfied: wrapt<1.11.0,>=1.10.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (1.10.11)
Requirement already satisfied: preshed<3.0.0,>=2.0.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (2.0.1)
Requirement already satisfied: cytoolz<0.10,>=0.9.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (0.9.0.1)
Requirement already satisfied: tqdm<5.0.0,>=4.10.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (4.28.1)
Requirement already satisfied: six<2.0.0,>=1.10.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (1.11.0)
Requirement already satisfied: msgpack-numpy<0.4.4.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from thinc==6.12.0->fastai) (0.4.3.2)
Requirement already satisfied: pytz>=2011k in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from pandas->fastai) (2018.6)
Requirement already satisfied: python-dateutil>=2.5.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from pandas->fastai) (2.7.3)
Requirement already satisfied: jinja2 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (2.10)
Requirement already satisfied: defusedxml in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (0.5.0)
Requirement already satisfied: pygments in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (2.2.0)
Requirement already satisfied: bleach in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (3.0.2)
Requirement already satisfied: mistune>=0.8.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (0.8.4)
Requirement already satisfied: jupyter-core in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (4.4.0)
Requirement already satisfied: entrypoints>=0.2.2 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (0.2.3)
Requirement already satisfied: pandocfilters>=1.4.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (1.4.2)
Requirement already satisfied: testpath in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbconvert->fastai) (0.4.2)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from requests->fastai) (3.0.4)
Requirement already satisfied: idna<2.8,>=2.5 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from requests->fastai) (2.7)
Requirement already satisfied: urllib3<1.25,>=1.21.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from requests->fastai) (1.22)
Requirement already satisfied: certifi>=2017.4.17 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from requests->fastai) (2018.10.15)
Requirement already satisfied: ujson>=1.35 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from spacy==2.0.16->fastai) (1.35)
Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from matplotlib->fastai) (2.2.2)
Requirement already satisfied: kiwisolver>=1.0.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from matplotlib->fastai) (1.0.1)
Requirement already satisfied: cycler>=0.10 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from matplotlib->fastai) (0.10.0)
Requirement already satisfied: setuptools>=18.5 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (39.0.1)
Requirement already satisfied: pickleshare in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (0.7.5)
Requirement already satisfied: decorator in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (4.3.0)
Requirement already satisfied: backcall in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (0.1.0)
Requirement already satisfied: prompt-toolkit<2.1.0,>=2.0.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (2.0.6)
Requirement already satisfied: appnope; sys_platform == "darwin" in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (0.1.0)
Requirement already satisfied: pexpect; sys_platform != "win32" in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (4.6.0)
Requirement already satisfied: jedi>=0.10 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (0.13.1)
Requirement already satisfied: simplegeneric>0.8 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipython->fastai) (0.8.1)
Requirement already satisfied: ipython-genutils in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from traitlets->fastai) (0.2.0)
Requirement already satisfied: ipywidgets in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jupyter->fastai) (7.4.2)
Requirement already satisfied: notebook in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jupyter->fastai) (5.7.0)
Requirement already satisfied: qtconsole in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jupyter->fastai) (4.4.2)
Requirement already satisfied: ipykernel in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jupyter->fastai) (5.1.0)
Requirement already satisfied: jupyter-console in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jupyter->fastai) (6.0.0)
Requirement already satisfied: jsonschema!=2.5.0,>=2.4 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from nbformat->fastai) (2.6.0)
Requirement already satisfied: toolz>=0.8.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from cytoolz<0.10,>=0.9.0->thinc==6.12.0->fastai) (0.9.0)
Requirement already satisfied: MarkupSafe>=0.23 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jinja2->nbconvert->fastai) (1.0)
Requirement already satisfied: webencodings in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from bleach->nbconvert->fastai) (0.5.1)
Requirement already satisfied: wcwidth in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from prompt-toolkit<2.1.0,>=2.0.0->ipython->fastai) (0.1.7)
Requirement already satisfied: ptyprocess>=0.5 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from pexpect; sys_platform != "win32"->ipython->fastai) (0.6.0)
Requirement already satisfied: parso>=0.3.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from jedi>=0.10->ipython->fastai) (0.3.1)
Requirement already satisfied: widgetsnbextension~=3.4.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from ipywidgets->jupyter->fastai) (3.4.2)
Requirement already satisfied: pyzmq>=17 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (17.1.2)
Requirement already satisfied: jupyter-client>=5.2.0 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (5.2.3)
Requirement already satisfied: prometheus-client in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (0.4.2)
Requirement already satisfied: tornado>=4 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (5.1.1)
Requirement already satisfied: Send2Trash in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (1.5.0)
Requirement already satisfied: terminado>=0.8.1 in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (from notebook->jupyter->fastai) (0.8.1)
Requirement already satisfied: numpy in /Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages (1.15.3)
Error installing using 'pip install fastai numpy dill'
An exception has occurred, use %tb to see the full traceback.

SystemExit: 0

/Users/hellohbot/.pyenv/versions/3.6.6/envs/fin-playground/lib/python3.6/site-packages/IPython/core/interactiveshell.py:3273: UserWarning: To exit: use 'exit', 'quit', or Ctrl-D.
  warn("To exit: use 'exit', 'quit', or Ctrl-D.", stacklevel=1)

pip freeze

absl-py==0.6.0
appnope==0.1.0
astor==0.7.1
backcall==0.1.0
bleach==3.0.2
certifi==2018.10.15
chardet==3.0.4
Click==7.0
conllu==1.2.1
cycler==0.10.0
cymem==2.0.2
cytoolz==0.9.0.1
dataclasses==0.6
decorator==4.3.0
deepcut==0.6.1.0
defusedxml==0.5.0
dill==0.2.8.2
emoji==0.5.1
entrypoints==0.2.3
fastai==1.0.13
fastprogress==0.1.10
future==0.16.0
gast==0.2.0
grpcio==1.16.0
h5py==2.8.0
idna==2.7
ipdb==0.11
ipykernel==5.1.0
ipython==7.0.1
ipython-genutils==0.2.0
ipywidgets==7.4.2
jedi==0.13.1
Jinja2==2.10
jsonschema==2.6.0
jupyter==1.0.0
jupyter-client==5.2.3
jupyter-console==6.0.0
jupyter-core==4.4.0
kaggle==1.4.7.1
Keras==2.2.4
Keras-Applications==1.0.6
Keras-Preprocessing==1.0.5
kiwisolver==1.0.1
marisa-trie==0.7.5
Markdown==3.0.1
MarkupSafe==1.0
matplotlib==3.0.0
mistune==0.8.4
msgpack==0.5.6
msgpack-numpy==0.4.3.2
murmurhash==1.0.1
nbconvert==5.4.0
nbformat==4.4.0
nltk==3.3
notebook==5.7.0
numpy==1.15.3
pandas==0.23.4
pandocfilters==1.4.2
parso==0.3.1
pexpect==4.6.0
pickleshare==0.7.5
Pillow==5.3.0
pip-tools==3.1.0
plac==0.9.6
preshed==2.0.1
prometheus-client==0.4.2
prompt-toolkit==2.0.6
protobuf==3.6.1
ptyprocess==0.6.0
Pygments==2.2.0
pymongo==3.7.2
pyparsing==2.2.2
pythainlp==1.7.0.1
python-dateutil==2.7.3
python-slugify==1.2.6
pytz==2018.6
PyYAML==3.13
pyzmq==17.1.2
qtconsole==4.4.2
regex==2018.1.10
requests==2.20.0
scikit-learn==0.20.0
scipy==1.1.0
Send2Trash==1.5.0
simplegeneric==0.8.1
six==1.11.0
sklearn==0.0
spacy==2.0.16
tensorboard==1.11.0
tensorflow==1.11.0
termcolor==1.1.0
terminado==0.8.1
testpath==0.4.2
thinc==6.12.0
tinydb==3.11.1
toolz==0.9.0
torch==0.4.1
torchvision-nightly==0.2.1
tornado==5.1.1
tqdm==4.28.1
traitlets==4.3.2
typing==3.6.6
ujson==1.35
Unidecode==1.0.22
urllib3==1.22
wcwidth==0.1.7
webencodings==0.5.1
Werkzeug==0.14.1
widgetsnbextension==3.4.2
wordcloud==1.5.0
wrapt==1.10.11

OSX: 10.14
Python: 3.6.6

[cstorm125]

We are in the process of moving all ULMFit-related codes to fastai 1.0. You need fastai==0.7.0 for the old code to work.