Official leaderboard

This page contains official results for each scenario, both in the test and the development collection. Check the evaluation page to learn how to get your results published here automatically.

Test Collection

These are the three leaderboards for the scenarios of the test collection.

Scenario 1

Team Submission F1 Precision Recall
baseline dummy 0.424 0.519 0.359
baseline random 0.116 0.124 0.108

Scenario 2

Team Submission F1 Precision Recall
baseline dummy 0.546 0.512 0.584
baseline random 0.205 0.202 0.209

Scenario 3

Team Submission F1 Precision Recall
baseline dummy 0.123 0.488 0.07
baseline random 0.014 0.014 0.014

Development Collection

These are the three leaderboards for the scenarios of the development collection.

Scenario 1

Team Submission F1 Precision Recall
baseline dummy 0.431 0.505 0.376
baseline random 0.123 0.134 0.113

Scenario 2

Team Submission F1 Precision Recall
baseline dummy 0.584 0.541 0.635
baseline random 0.249 0.249 0.25

Scenario 3

Team Submission F1 Precision Recall
baseline dummy 0.162 0.61 0.093
baseline random 0.012 0.012 0.013