An implementation of GPT2 using the tf.estimator API. Now GPT2 training can be run with Multiple GPUs!
- Easier training and inference
- Train on multiple GPUs
- All the goodies that tf.estimator provides
- TF 2.0 compatible
Reference:
An implementation of GPT2 using the tf.estimator API. Now GPT2 training can be run with Multiple GPUs!
Reference: