Skip to content
This repository has been archived by the owner on Apr 23, 2024. It is now read-only.

Process killed? #71

Open
miguelvictor opened this issue Jul 31, 2020 · 4 comments
Open

Process killed? #71

miguelvictor opened this issue Jul 31, 2020 · 4 comments

Comments

@miguelvictor
Copy link

Any idea why this would happen?

Training parameters
  input: _training_aux
  model: vocab.bpe
  vocab_size: 24000
  n_threads: 8
  character_coverage: 1
  pad: 0
  unk: 1
  bos: 2
  eos: 3

reading file...
learning bpe...
number of unique characters in the training data: 224
number of deleted characters: 0
number of unique characters left: 224
Killed

OS: Pop!_OS 20.04 LTS
Version: 1.0.6
Input file size: 1.8G

@xbelonogov
Copy link
Contributor

How much RAM do you have?

@miguelvictor
Copy link
Author

@xbelonogov 8GB (swap is 4GB)

@miguelvictor
Copy link
Author

The problem was my RAM is not enough. I tried running it on my 16GB macbook pro and it worked fine. It used about 22.6 GB of RAM.

@xbelonogov One suggestion though, would it be possible to compute the approximate ram usage and warn users if stuff like this will happen?

@xbelonogov
Copy link
Contributor

Yes, that looks reasonable.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants