Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Independent scale for evaluating how good a given agreement is #21

Open
Rachine opened this issue Feb 24, 2021 · 0 comments
Open

Independent scale for evaluating how good a given agreement is #21

Rachine opened this issue Feb 24, 2021 · 0 comments
Labels
documentation Improvements or additions to documentation enhancement New feature or request research

Comments

@Rachine
Copy link
Collaborator

Rachine commented Feb 24, 2021 •
edited by hadware
Loading

As mentionned in the joss reviews here openjournals/joss-reviews#2989 (comment), it would be super valuable to compare, and evaluate with a perceptual scale the values of the gamma.

Basically How good is an observed gamma for a given task?

We can start in the documentation to gather all the gamma that have been measured along the tasks, annotators informations, language, modality.

In the future, we will report here the psychophysical experiment to validate more carefully the gamma.
@Rachine Rachine added documentation Improvements or additions to documentation enhancement New feature or request research labels Feb 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
documentation Improvements or additions to documentation enhancement New feature or request research
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@Rachine