Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unable to load any dataset #216

Closed
XiYuan68 opened this issue Jul 25, 2021 · 1 comment
Closed

unable to load any dataset #216

XiYuan68 opened this issue Jul 25, 2021 · 1 comment
Labels
question Further information is requested solved Problems which already solved

Comments

@XiYuan68
Copy link

there is no any dataset in OpenAttack.DataManager.AVAILABLE_DATAS:

['AttackAssist.ChineseWord2Vec',
 'AttackAssist.CiLin',
 'AttackAssist.CounterFit',
 'AttackAssist.DCES',
 'AttackAssist.FYH',
 'AttackAssist.GAN',
 'AttackAssist.GloVe',
 'AttackAssist.HowNet',
 'AttackAssist.HownetSubstituteDict',
 'TProcess.NLTKPerceptronPosTagger',
 'TProcess.NLTKSentTokenizer',
 'TProcess.NLTKWordNet',
 'TProcess.NLTKWordNetDelemma',
 'AttackAssist.SCPN',
 'AttackAssist.SentenceTransformer',
 'AttackAssist.SGAN',
 'AttackAssist.SIM',
 'TProcess.StanfordNER',
 'TProcess.StanfordParser',
 'test',
 'AttackAssist.TranslationModels',
 'AttackAssist.UniversalSentenceEncoder',
 'Victim.ALBERT.AG',
 'Victim.ALBERT.IMDB',
 'Victim.ALBERT.MNLI',
 'Victim.ALBERT.SNLI',
 'Victim.ALBERT.SST',
 'Victim.BERT.SST',
 'Victim.BERT.AMAZON_ZH',
 'Victim.BERT.MNLI',
 'Victim.BERT.SNLI',
 'Victim.BiLSTM.SST',
 'Victim.BiLSTM.IMDB',
 'Victim.ROBERTA.AG',
 'Victim.ROBERTA.IMDB',
 'Victim.ROBERTA.MNLI',
 'Victim.ROBERTA.SNLI',
 'Victim.ROBERTA.SST',
 'Victim.XLNET.AG',
 'Victim.XLNET.IMDB',
 'Victim.XLNET.MNLI',
 'Victim.XLNET.SNLI',
 'Victim.XLNET.SST',
 'AttackAssist.Word2Vec']

and dataset cannot be loaded manually since Dataset and DataInstance are removed

Is there any other way to load custom dataset?

@LiuYuemei111 LiuYuemei111 added the question Further information is requested label Aug 23, 2021
@a710128
Copy link
Member

a710128 commented Sep 22, 2021

After OpenAttack 2, we use thedatasets library to load datasets. Here is an example, see examples/custom_dataset.py.

@a710128 a710128 added the solved Problems which already solved label Sep 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested solved Problems which already solved
Projects
None yet
Development

No branches or pull requests

4 participants