Leaderboard
Leaderboards for Dev set
English - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | QUST | 0.49041 | 0.57831 |
| 2 | vera | 0.47047 | 0.65060 |
| 3 | MELODI | 0.46999 | 0.55422 |
| 4 | BIAOac | 0.45551 | 0.56627 |
| 5 | kb | 0.44176 | 0.61446 |
| 6 | IITKGPNLPAutumn2022 | 0.41287 | 0.60241 |
| 7 | Unisa | 0.40892 | 0.43373 |
| 8 | UnedMediaBiasTeam | 0.40305 | 0.44578 |
| 9 | Hitachi | 0.38143 | 0.55422 |
| 10 | sklccc | 0.37830 | 0.39759 |
| 11 | HHU | 0.36163 | 0.43373 |
| 12 | UMBCebiquity | 0.35145 | 0.40964 |
| 13 | SharoffAndLepekhin | 0.34411 | 0.36145 |
| 14 | FramingFreaks | 0.29970 | 0.36145 |
| 15 | PALISale | 0.29820 | 0.36145 |
| 16 | stce | 0.29820 | 0.36145 |
| 17 | Riga | 0.29619 | 0.42169 |
| 18 | SATLab | 0.28257 | 0.30120 |
| 19 | UM6P | 0.26966 | 0.27711 |
| 20 | NLUBot101 | 0.26598 | 0.28916 |
| 21 | Baseline | 0.25162 | 0.30120 |
| 22 | TestTeamJRCbaseline | 0.25162 | 0.30120 |
| 23 | TheSyllogist | 0.24926 | 0.25301 |
| 24 | UTBNLP | 0.23380 | 0.20482 |
| 25 | QCRITeam | 0.23316 | 0.32530 |
| 26 | Invincibles | 0.12945 | 0.24096 |
| 27 | NL4IA | 0.12945 | 0.24096 |
| 28 | APatt | 0.00000 | 0.00000 |
| 29 | BERTastic | 0.00000 | 0.00000 |
| 30 | DSHacker | 0.00000 | 0.00000 |
| 31 | Iteeeh | 0.00000 | 0.00000 |
| 32 | MJoni | 0.00000 | 0.00000 |
English - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | A0New0Baseline | 0.78481 | 0.55745 |
| 2 | vera | 0.76033 | 0.55865 |
| 3 | TheSyllogist | 0.75481 | 0.54376 |
| 4 | BERTastic | 0.75196 | 0.39790 |
| 5 | hazhooz | 0.75090 | 0.43558 |
| 6 | TeamAmpa | 0.73657 | 0.47643 |
| 7 | SSH | 0.73628 | 0.41508 |
| 8 | Ahmedhesham11399 | 0.73458 | 0.48246 |
| 9 | khaidoan25 | 0.73387 | 0.42307 |
| 10 | UAE | 0.73307 | 0.40000 |
| 11 | MarsEclipse | 0.73072 | 0.44910 |
| 12 | Dragon9966 | 0.72464 | 0.40919 |
| 13 | Iteeeh | 0.72409 | 0.39355 |
| 14 | Ahaddad | 0.71788 | 0.39509 |
| 15 | NLUBot101 | 0.70828 | 0.46240 |
| 16 | YajuSenpai114514 | 0.70293 | 0.50595 |
| 17 | Galapagos | 0.70223 | 0.45354 |
| 18 | Littletree | 0.69870 | 0.38591 |
| 19 | kb | 0.69814 | 0.32923 |
| 20 | MBZ | 0.68768 | 0.32495 |
| 21 | PALISale | 0.67012 | 0.51354 |
| 22 | stce | 0.66169 | 0.46307 |
| 23 | Riga | 0.65977 | 0.36744 |
| 24 | fliangyue | 0.65175 | 0.34619 |
| 25 | UMBCebiquity | 0.61561 | 0.25371 |
| 26 | BIAOac | 0.60545 | 0.39752 |
| 27 | Baseline | 0.60545 | 0.39752 |
| 28 | Dragon | 0.60545 | 0.39752 |
| 29 | TestTeamJRCbaseline | 0.60545 | 0.39752 |
| 30 | PolarIce | 0.60472 | 0.35960 |
| 31 | UM6P | 0.59679 | 0.36992 |
| 32 | MJoni | 0.58737 | 0.35903 |
| 33 | AMUPD | 0.57039 | 0.46158 |
| 34 | SharoffAndLepekhin | 0.46645 | 0.32028 |
English - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | NLUBot101 | 0.39737 | 0.29273 |
| 2 | APatt | 0.38523 | 0.29660 |
| 3 | PersuasionNLP4SG | 0.37790 | 0.26514 |
| 4 | Riga | 0.37105 | 0.24414 |
| 5 | DSHacker | 0.36996 | 0.28496 |
| 6 | ACS | 0.36987 | 0.20529 |
| 7 | vera | 0.36013 | 0.27897 |
| 8 | TeamAmpa | 0.35709 | 0.32733 |
| 9 | TheSyllogist | 0.33527 | 0.24139 |
| 10 | kb | 0.32898 | 0.22576 |
| 11 | Unisa | 0.29303 | 0.25960 |
| 12 | SATLab | 0.22101 | 0.27503 |
| 13 | ReDASPersuasion | 0.18889 | 0.24465 |
| 14 | BIAOac | 0.16125 | 0.21735 |
| 15 | Baseline | 0.16125 | 0.21735 |
| 16 | TestTeamJRCbaseline | 0.16125 | 0.21735 |
| 17 | NAP | 0.11393 | 0.10245 |
| 18 | SharoffAndLepekhin | 0.03248 | 0.05174 |
Italian - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | sklccc | 0.80108 | 0.84416 |
| 2 | MELODI | 0.78116 | 0.84416 |
| 3 | SharoffAndLepekhin | 0.70575 | 0.85714 |
| 4 | vera | 0.64392 | 0.74026 |
| 5 | BIAOac | 0.60556 | 0.80519 |
| 6 | HHU | 0.57081 | 0.74026 |
| 7 | UnedMediaBiasTeam | 0.52202 | 0.71429 |
| 8 | FramingFreaks | 0.49496 | 0.70130 |
| 9 | QUST | 0.49395 | 0.74026 |
| 10 | kb | 0.45101 | 0.79221 |
| 11 | Baseline | 0.44609 | 0.80519 |
| 12 | TestJRC2 | 0.44609 | 0.80519 |
| 13 | TestTeamJRCbaseline | 0.44609 | 0.80519 |
| 14 | Riga | 0.39819 | 0.79221 |
Italian - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | vera | 0.64202 | 0.56578 |
| 2 | TeamAmpa | 0.62081 | 0.51674 |
| 3 | TheSyllogist | 0.54231 | 0.42737 |
| 4 | PolarIce | 0.47843 | 0.34496 |
| 5 | SharoffAndLepekhin | 0.43644 | 0.42263 |
| 6 | BIAOac | 0.43084 | 0.33422 |
| 7 | Baseline | 0.43084 | 0.33422 |
| 8 | TestTeamJRCbaseline | 0.43084 | 0.33422 |
| 9 | Riga | 0.40166 | 0.28810 |
Italian - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.52309 | 0.26541 |
| 2 | ACS | 0.49770 | 0.20230 |
| 3 | APatt | 0.46171 | 0.17819 |
| 4 | Riga | 0.43427 | 0.08342 |
| 5 | SATLab | 0.42924 | 0.16655 |
| 6 | kb | 0.40561 | 0.05126 |
| 7 | BIAOac | 0.38918 | 0.10385 |
| 8 | Baseline | 0.38918 | 0.10385 |
| 9 | ReDASPersuasion | 0.38918 | 0.10385 |
| 10 | TestTeamJRCbaseline | 0.38918 | 0.10385 |
| 11 | vera | 0.38918 | 0.10385 |
| 12 | NLUBot101 | 0.20783 | 0.14769 |
| 13 | NAP | 0.20342 | 0.13426 |
Russian - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | BIAOac | 0.73678 | 0.85714 |
| 2 | sklccc | 0.68373 | 0.79592 |
| 3 | FramingFreaks | 0.66886 | 0.73469 |
| 4 | SharoffAndLepekhin | 0.65000 | 0.69388 |
| 5 | QUST | 0.62480 | 0.73469 |
| 6 | vera | 0.60392 | 0.69388 |
| 7 | PALISale | 0.54589 | 0.69388 |
| 8 | MELODI | 0.49524 | 0.73469 |
| 9 | UnedMediaBiasTeam | 0.46784 | 0.69388 |
| 10 | Riga | 0.45333 | 0.71429 |
| 11 | kb | 0.43897 | 0.71429 |
| 12 | HHU | 0.41270 | 0.59184 |
| 13 | Baseline | 0.34339 | 0.67347 |
| 14 | TestTeamJRCbaseline | 0.34339 | 0.67347 |
Russian - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.57286 | 0.50408 |
| 2 | vera | 0.54726 | 0.41270 |
| 3 | PolarIce | 0.50000 | 0.40674 |
| 4 | Lubov | 0.48756 | 0.35990 |
| 5 | TheSyllogist | 0.48598 | 0.38010 |
| 6 | SharoffAndLepekhin | 0.27273 | 0.26291 |
| 7 | Riga | 0.24060 | 0.15400 |
| 8 | BIAOac | 0.21583 | 0.13175 |
| 9 | Baseline | 0.21583 | 0.13175 |
| 10 | TestTeamJRCbaseline | 0.21583 | 0.13175 |
| 11 | kb | 0.03604 | 0.01504 |
Russian - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | ACS | 0.41486 | 0.18456 |
| 2 | TeamAmpa | 0.40964 | 0.21784 |
| 3 | APatt | 0.35251 | 0.06004 |
| 4 | Riga | 0.29741 | 0.04348 |
| 5 | kb | 0.26810 | 0.02047 |
| 6 | BIAOac | 0.25316 | 0.04284 |
| 7 | Baseline | 0.25316 | 0.04284 |
| 8 | ReDASPersuasion | 0.25316 | 0.04284 |
| 9 | TestTeamJRCbaseline | 0.25316 | 0.04284 |
| 10 | NAP | 0.15612 | 0.11023 |
| 11 | SharoffAndLepekhin | 0.02427 | 0.00719 |
| 12 | vera | 0.00000 | 0.00000 |
French - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | SharoffAndLepekhin | 0.82633 | 0.87037 |
| 2 | BIAOac | 0.77049 | 0.92593 |
| 3 | vera | 0.72480 | 0.79630 |
| 4 | MELODI | 0.69120 | 0.83333 |
| 5 | sklccc | 0.67507 | 0.81481 |
| 6 | QUST | 0.65606 | 0.74074 |
| 7 | kb | 0.64503 | 0.79630 |
| 8 | SATLab | 0.62921 | 0.75926 |
| 9 | FramingFreaks | 0.61050 | 0.74074 |
| 10 | Riga | 0.50914 | 0.77778 |
| 11 | UnedMediaBiasTeam | 0.49016 | 0.57407 |
| 12 | Baseline | 0.47863 | 0.74074 |
French - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.63576 | 0.56173 |
| 2 | vera | 0.58675 | 0.49975 |
| 3 | TheSyllogist | 0.58537 | 0.52205 |
| 4 | SATLab | 0.56026 | 0.47900 |
| 5 | BIAOac | 0.38053 | 0.27293 |
| 6 | Baseline | 0.38053 | 0.27293 |
| 7 | SharoffAndLepekhin | 0.34928 | 0.33580 |
| 8 | Riga | 0.23350 | 0.06347 |
| 9 | kb | 0.14208 | 0.04815 |
French - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.47527 | 0.34016 |
| 2 | ACS | 0.44370 | 0.28545 |
| 3 | APatt | 0.42101 | 0.16863 |
| 4 | kb | 0.35498 | 0.11327 |
| 5 | SATLab | 0.34139 | 0.21224 |
| 6 | BIAOac | 0.29285 | 0.13484 |
| 7 | Baseline | 0.29285 | 0.13484 |
| 8 | ReDASPersuasion | 0.29285 | 0.13484 |
| 9 | Riga | 0.28590 | 0.04982 |
| 10 | vera | 0.27917 | 0.02528 |
| 11 | NAP | 0.19797 | 0.18023 |
German - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | sklccc | 0.76651 | 0.82222 |
| 2 | HHU | 0.73333 | 0.80000 |
| 3 | SharoffAndLepekhin | 0.72637 | 0.75556 |
| 4 | BIAOac | 0.71376 | 0.75556 |
| 5 | vera | 0.71361 | 0.75556 |
| 6 | Hitachi | 0.71278 | 0.75556 |
| 7 | QUST | 0.68755 | 0.80000 |
| 8 | UnedMediaBiasTeam | 0.67641 | 0.73333 |
| 9 | FramingFreaks | 0.66341 | 0.75556 |
| 10 | SATLab | 0.65463 | 0.73333 |
| 11 | Riga | 0.64068 | 0.75556 |
| 12 | MELODI | 0.64022 | 0.75556 |
| 13 | kb | 0.55202 | 0.64444 |
| 14 | Baseline | 0.47708 | 0.66667 |
| 15 | UMBCebiquity | 0.26126 | 0.64444 |
German - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | vera | 0.63077 | 0.47844 |
| 2 | TeamAmpa | 0.63049 | 0.53826 |
| 3 | TheSyllogist | 0.56047 | 0.44994 |
| 4 | Riga | 0.52558 | 0.37219 |
| 5 | BIAOac | 0.50625 | 0.33505 |
| 6 | Baseline | 0.50625 | 0.33505 |
| 7 | SharoffAndLepekhin | 0.20598 | 0.07435 |
German - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.47046 | 0.32375 |
| 2 | ACS | 0.45038 | 0.27202 |
| 3 | APatt | 0.39959 | 0.19202 |
| 4 | kb | 0.35799 | 0.06555 |
| 5 | SATLab | 0.34161 | 0.18702 |
| 6 | Riga | 0.33740 | 0.07095 |
| 7 | BIAOac | 0.33116 | 0.10016 |
| 8 | Baseline | 0.33116 | 0.10016 |
| 9 | ReDASPersuasion | 0.33116 | 0.10016 |
| 10 | vera | 0.28112 | 0.02893 |
| 11 | NAP | 0.18454 | 0.14692 |
Polish - Subtask 1
| Rank | Team | F1 macro | F1 micro |
| 1 | BIAOac | 0.89235 | 0.92000 |
| 2 | DSHacker | 0.89235 | 0.92000 |
| 3 | SharoffAndLepekhin | 0.87215 | 0.90000 |
| 4 | vera | 0.83810 | 0.88000 |
| 5 | kb | 0.83156 | 0.88000 |
| 6 | sklccc | 0.77073 | 0.84000 |
| 7 | MELODI | 0.75806 | 0.74000 |
| 8 | QUST | 0.72183 | 0.86000 |
| 9 | UnedMediaBiasTeam | 0.71250 | 0.76000 |
| 10 | SATLab | 0.71171 | 0.82000 |
| 11 | FramingFreaks | 0.65672 | 0.84000 |
| 12 | Baseline | 0.52976 | 0.80000 |
| 13 | Riga | 0.50842 | 0.78000 |
| 14 | us | 0.38311 | 0.62000 |
Polish - Subtask 2
| Rank | Team | F1 micro | F1 macro |
| 1 | TeamAmpa | 0.67238 | 0.58642 |
| 2 | TheSyllogist | 0.64486 | 0.53303 |
| 3 | vera | 0.63071 | 0.53754 |
| 4 | BIAOac | 0.59223 | 0.47811 |
| 5 | Baseline | 0.59223 | 0.47811 |
| 6 | kb | 0.56039 | 0.30599 |
| 7 | Riga | 0.55230 | 0.41473 |
| 8 | SharoffAndLepekhin | 0.51996 | 0.49701 |
Polish - Subtask 3
| Rank | Team | F1 micro | F1 macro |
| 1 | DSHacker | 0.38860 | 0.17736 |
| 2 | TeamAmpa | 0.36584 | 0.25342 |
| 3 | ACS | 0.35756 | 0.22775 |
| 4 | APatt | 0.30470 | 0.15182 |
| 5 | kb | 0.25797 | 0.11455 |
| 6 | SATLab | 0.21204 | 0.10023 |
| 7 | Riga | 0.14679 | 0.02658 |
| 8 | BIAOac | 0.12524 | 0.05673 |
| 9 | Baseline | 0.12524 | 0.05673 |
| 10 | vera | 0.12393 | 0.02070 |
| 11 | NAP | 0.11926 | 0.09946 |
Since the Dev gold labels have been released, submissions on the dev leaderboard are no more allowed.
Contact
- twitter.com/_proppy_
- Register to the google group of the task to ask questions and interact with other participants