Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

想了解一下怎么可以把 输入数据形式不同的两种任务 放在一起训练 #38

Open
652994331 opened this issue Mar 5, 2020 · 1 comment

Comments

@652994331
Copy link

之前一直想做bert的多任务, 单独做过Bert 的 单句多标签分类问题,也单独做过bert 的NER实体识别。按照我对这个项目的理解,是可以比如 做一次finetune 这次finetune 涉及这两种任务, 然后得到一个比较通用的finetune 模型, 这个模型在分类任务和NER上 都有一个相对可以的表现.请问我理解的对吗.

从代码中看,是 cws & NER (同形式输入的两种任务) (用| 是不同形式输入的两种任务).
想问下 我是否可以 (multilabel_classification | NER) 这样做呢。可以讲解下数据这部分应该怎么处理这种不同形式的两种任务的读入呢, 自己理解的不是很明白. 非常感谢

@JayYip
Copy link
Owner

JayYip commented Mar 12, 2020

可以的, 你只需要定义好各自两个任务的预处理函数, 具体怎么实现可以参考这里: https://github.com/JayYip/bert-multitask-learning/blob/master/notebooks/Run%20Self%20Defined%20Problem.ipynb

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants