Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compare mode: Agreement measures #363

Open
melandresen opened this issue Apr 12, 2021 · 0 comments
Open

Compare mode: Agreement measures #363

melandresen opened this issue Apr 12, 2021 · 0 comments

Comments

@melandresen
Copy link

For our current annotations, some additional agreement measures would be helpful. Right now, agreement is often 0, but it is usually not as bad as it looks at first sight. I am not sure about the perfect setup, but I would like to see a more generous score for cases

  1. where spans are not identical, but overlapping, and
  2. where spans are identical, but the labels differ
    (or both).

(This would be especially nice in combination with #362 )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant