-
Notifications
You must be signed in to change notification settings - Fork 222
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Unable to run discriminator #42
Comments
+1 A Guide/more documentation on running the discriminator would be awesome! |
Hi there, I've successfully made it runnable.Script I've used is: python ./discrimination/run_discrimination.py --input_data=./generator=mega~dataset=p0.94.jsonl --do_train=True --output_dir=./tem --config_file=./lm/configs/base.json I am running in the root directory of grover, without using pretrained discriminators. Hope it can help. |
For those trying to use the pretrained models, here's some basic steps (I used the medium* model as an example).
You will also need this one (which isn't currently listed):
Note that each record has a "split" key that determines whether it is "train", "val", or "test" data. When you call the
For example:
*One final note, in the "discrimination.py" script, the model called "medium" is actually Grover-Large from the paper, and therefore uses the "lm/configs/large.json" configuration file. The development name is likely because the size corresponds to GPT-2 medium at 355M parameters. Hope this helps some people! |
Hello there!
Great job with this model!
However, I am getting an error while running a run_discrminator of 'utf-8' codec can't decode byte 0xf8 in position 1: invalid start byte' . Can you help me with that? And also I am a little confused about how to run this discriminator so can you guide me with that? Thank You.
The text was updated successfully, but these errors were encountered: