Skip to content

Commit

Permalink
Update issue templates (#235)
Browse files Browse the repository at this point in the history
* Update issue templates

* Update feature-request.md
  • Loading branch information
clefourrier committed Jul 23, 2024
1 parent 66ed7a2 commit 003f05e
Show file tree
Hide file tree
Showing 3 changed files with 56 additions and 0 deletions.
20 changes: 20 additions & 0 deletions .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,20 @@
---
name: Bug report
about: Create a report to help us improve lighteval!
title: "[BUG] "
labels: bug
assignees: ''

---

## Describe the bug
A clear and concise description of what the bug is.

## To Reproduce
Please provide all the steps needed to reproduce the behavior, or provide a minimal working example if needed. We will ignore issues missing this section.

## Expected behavior
A clear and concise description of what you expected to happen.

## Version info
Please provide your operating system, lighteval version or commit if you installed from main, and pip/conda environment if your problem concerns dependencies.
18 changes: 18 additions & 0 deletions .github/ISSUE_TEMPLATE/evaluation-task-request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
name: Evaluation/task request
about: Suggest a new evaluation you want us to add
title: "[EVAL]"
labels: new task
assignees: ''

---

## Evaluation short description
- Why is this evaluation interesting?
- How used is it in the community?

## Evaluation metadata
Provide all available
- Paper url:
- Github url:
- Dataset url:
18 changes: 18 additions & 0 deletions .github/ISSUE_TEMPLATE/feature-request.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
name: Feature request
about: Suggest an idea for this project
title: "[FT] "
labels: feature request
assignees: ''

---

## Issue encountered
Is your feature request related to a problem? Please provide a clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

## Solution/Feature
A clear and concise description of what you want to happen.

## Posssible alternatives
A clear and concise description of any alternative solutions or features you've considered.

0 comments on commit 003f05e

Please sign in to comment.