Skip to content

Commit

Permalink
[Feature] add global retriever config (#842)
Browse files Browse the repository at this point in the history
* add global retriever config

* give zero shot overwrite example

* give zero shot overwrite example

---------

Co-authored-by: Lei Fei <SENSETIME\leifei1@cn3114002087l.domain.sensetime.com>
Co-authored-by: Leymore <zfz-960727@163.com>
  • Loading branch information
3 people authored Feb 6, 2024
1 parent dd44468 commit e257254
Showing 1 changed file with 14 additions and 0 deletions.
14 changes: 14 additions & 0 deletions configs/eval_mmlu_with_zero_retriever_overwritten.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
from mmengine.config import read_base
from opencompass.openicl.icl_retriever import ZeroRetriever
from copy import deepcopy

with read_base():
from .models.qwen.hf_qwen_7b_chat import models
from .datasets.mmlu.mmlu_gen_4d595a import mmlu_datasets # this is a dataset evaluated with 5-shot


datasets = []
for d in mmlu_datasets:
d = deepcopy(d)
d['infer_cfg']['retriever'] = dict(type=ZeroRetriever)
datasets.append(d)

0 comments on commit e257254

Please sign in to comment.