Discussions

• 1 You must be logged in to vote

  🙏

  drop_openai_simple_evals_gen_3857b0.py中处理方式无法处理 drop数据集，脚本中的drop_simple_eval 数据集哪里能找到呢？

  KADCA21 asked Aug 6, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Does the framework support evaluation of quantized models, such as AWQ models?

  watermelon-lee asked Aug 6, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  为什么启动示例执行推理的时候一直卡着，几个小时都没进度，环境是notebook t4的环境

  pzfok asked Apr 13, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Error: mkl-service + Intel(R) MKL: MKL_THREADING_LAYER=INTEL is incompatible with libgomp-a34b3233.so.1 library.这个报错是哪个地方触发的

  IcyFeather233 asked Apr 25, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙌

  我解决了torchrun环境异常情况下的No predictions found问题.

  liuwake started Jul 28, 2024 in Show and tell · Closed

  

  

  5
• 1 You must be logged in to vote

  🙏

  opencompass支持CS-Bench数据集评测吗？

  pzfok asked Jul 31, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  关于运行run.py 执行卡死的情况

  GOOD-N-LCM asked Jul 8, 2024 in Q&A · Closed · Answered

  

  

  

  

  12
• 2 You must be logged in to vote

  🙏

  关于运行run.py时无法将推理过程部署于GPU上的情况

  qizheyanger asked Jul 30, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  评测ds1000,humanevalx数据集为什么还需要另外构造一个docker环境评测，能直接集成在opencompass的项目代码里吗

  pzfok asked Jul 29, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  关于运行run.py 执行 报错 No predictions found.

  GOOD-N-LCM asked Jul 8, 2024 in Q&A · Closed · Unanswered

  

  

  

  

  2
• 2 You must be logged in to vote

  🙏

  Is it possible to use RAG such as langchain in the evaluation?

  hcs129 asked Jul 21, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How can I run RAG_LMM model in opencompass

  christyzou asked Jul 25, 2024 in Q&A · Unanswered

  

  

  0
• 0 You must be logged in to vote

  🙏

  如何加载改过模型结构之后的qwen2呢？

  BobTsang1995 asked Jul 23, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  使用案例指令评估LLaMA-7b模型在MMLU和C-Eval数据集上的性能时评测结果为空

  liujunfei678 asked Nov 14, 2023 in Q&A · Unanswered

  

  

  

  

  5
• 1 You must be logged in to vote

  🙏

  Can't run openai api eval

  kratorado asked Apr 27, 2024 in Q&A · Unanswered

  

  

  

  

  6
• 1 You must be logged in to vote

  💡

  求支持OpenBuddy

  starplatinum3 started Jul 22, 2024 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  为什么运行到一半出现oom的情况？

  AriesHaa asked Jun 20, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  apps_mini在哪里可以下载

  HqWei asked Jul 17, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  使用opencompass如何自定义数据集，并且自定义Evaluator进行评测指标计算

  pzfok asked Jul 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  prompt 版本问题？

  stephen-nju asked Jul 11, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  测试的结果都是“-”是怎么回事啊

  claire360 asked May 28, 2024 in Q&A · Unanswered

  

  

  

  

  11
• 1 You must be logged in to vote

  💬

  测评结果为空

  254038lqq started Jul 4, 2024 in View all discussions

  

  

  0
• 3 You must be logged in to vote

  🙏

  评测结果内容为空

  yingwen330 asked Sep 25, 2023 in Q&A · Closed · Answered

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  local model (mpt + lora) opencompass error

  soraka-hu asked Jun 21, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  请问大家在测评自己量化的qwen模型时，具体该如何操作。文档里“新增第三方模型”教程有点笼统，看不明白。

  AriesHaa asked Jun 21, 2024 in Q&A · Unanswered

  

  

  0