Skip to content

hannahchiu/GPT2_Chinese_Demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GPT2_Chinese_Demo

Required packages

  • Crawler:
requests
lxml
bs4
tqdm
  • Training:
torch
transformers (3.5.1)
wandb
  • Web:
flask

Link

https://ckip.iis.sinica.edu.tw/service/gpt2/

Crawl

Dataset: 三國演義

Source: Wikisource

python crawler.py

Data will be saved to ./data

Train

We used first chapter as evaluation data

CUDA_VISIBLE_DEVICES=0 ./train.sh

Model will be saved to ./output

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published