Skip to content

v0.1.0

Latest
Compare
Choose a tag to compare
@AJDERS AJDERS released this 22 Feb 12:45
· 134 commits to main since this release
92d795b

[v0.1.0] - 2023-02-22

Added

  • Support for evaluation of local Hugging Face models.
  • Tests for the question_answering-task.
  • The automatic_speech_recognition-task.
  • Util functions, leaderboard_utils, for interacting with the associated REST-api which interacts with the leaderboard holding the evaluation results.
  • A new function in the evaluator module, called _send_results_to_leaderboard which sends evaluation results to the leaderboard using the util functions from leaderboard_utils, and tests for this function and leaderboard_utils.
  • The discourse-coherence-task.
  • Support for integer labels.