Leaderboard

Leaderboards on Test set

Task 1

RankTeamF1-MacroF1-Micro
1MinD0.289930.59331
2Alpha0.262180.57187
3Volta0.266210.56958
4mmm0.302550.54839
5AIMH0.244620.53903
6LeCun0.226580.51224
7WVOQ0.226710.51057
8TeamUNCC0.236340.51027
9NLyticsFKIE0.139900.49815
10TeiAS0.213910.49740
11DAJUST0.187480.49657
12YNUHPCC0.263250.49275
13CSECUDSG0.184540.48894
14TeamFPAI0.115250.40566
15NLPIITR0.125900.37917
16TriHeadAttention0.023970.18373
17Baseline0.044270.06439

Task 2

RankTeamF1PrecisionRecallF1 Appeal_to_AuthorityF1 Appeal_to_fear-prejudiceF1 Bandwagon,Reductio_ad_hitlerumF1 Black-and-White_FallacyF1 Causal_OversimplificationF1 DoubtF1 Exaggeration,MinimisationF1 Flag-WavingF1 Loaded_LanguageF1 Name_Calling,LabelingF1 RepetitionF1 SlogansF1 Thought-terminating_ClichesF1 Whataboutism,Straw_Men,Red_HerringF1 SmearsF1 Glittering Generalities
1Volta0.481660.500610.464090.363300.200000.593410.054980.414660.422900.705880.133330.705750.000000.616280.000000.000000.000001.000000.32000
2HOMADOS0.407370.412060.402780.370370.393510.870700.293030.428570.000000.520920.105260.657400.000000.602240.000000.000000.000000.000000.46154
3TeamFPAI0.397360.651980.285760.000000.000000.000000.000000.068970.234150.000000.000000.731070.000000.366180.000000.000000.000000.000000.09524
4TeamUNCC0.328970.284670.389590.046060.211800.281790.133330.411520.356880.529410.093750.551950.000000.504400.000000.000000.000000.070380.23359
5WVOQ0.267870.242650.298940.000000.116900.069430.068970.218360.298330.126980.077900.390650.000000.418720.000000.000000.000000.000000.22011
6CSECUDSG0.119830.079520.243030.000000.000000.000000.000000.000000.000000.000000.000000.114470.000000.136750.000000.000000.000000.000000.00000
7YNUHPCC0.091110.185830.060350.000000.000000.000000.000000.000000.000000.000000.000000.044900.000000.000000.000000.000000.000000.000000.00000
8TriHeadAttention0.079690.169710.052070.000000.000000.000000.000000.000000.000000.000000.000000.129660.000000.031430.000000.000000.000000.000000.00000
9Baseline0.009520.033680.005540.000000.000000.000000.000000.000000.071430.000000.000000.002530.115380.054800.250000.117650.000000.000000.00000
Scroll the table to the right to check the F1 values for each Technique.

Task 3

RankTeamF1-MacroF1-Micro
1Alpha0.273150.58109
2MinD0.243890.56623
31213Li0.228300.54860
4AIMH0.207290.53994
5Volta0.188770.52070
6CSECUDSG0.121170.51312
7aircasMM0.200210.51078
8LIIR0.188070.49835
9CAU731NLP0.083900.48085
10WVOQ0.239570.47779
11YNUHPCC0.096190.44610
12TriHeadAttention0.062280.44196
13NLyticsFKIE0.117720.42303
14LT3UGent0.263550.33148
15TeamUNCC0.123590.22359
16Baseline0.051520.07062


Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

SemEval 2021 task 6 Leaderboard

(submissions on the test set until the shared task deadline)

Task 1

RankTeamF1-MacroF1-Micro
1NUDTPDL0.974620.97612
2pdl10.974100.97024
3TeamUNCC0.987790.96850
4MinD0.511200.69434
5Alpha0.548030.68619
6CSECUDSG0.806800.66486
7Volta0.445630.66364
8LeCun0.444090.64734
9AIMH0.462040.62698
10YNUHPCC0.471880.62500
11WVOQ0.398140.60163
12DAJUST0.350240.57031
13TeiAS0.388640.55939
14NLPIITR0.344190.50909
15TeamFPAI0.317140.50575
16CAU731NLP0.200170.34444
17TriHeadAttention0.085540.20126
18pdl20.044270.06439
19yyjc20.044270.06439
20Baseline0.034370.06427

Task 2

RankTeamF1PrecisionRecallF1 Appeal_to_AuthorityF1 Appeal_to_fear-prejudiceF1 Bandwagon,Reductio_ad_hitlerumF1 Black-and-White_FallacyF1 Causal_OversimplificationF1 DoubtF1 Exaggeration,MinimisationF1 Flag-WavingF1 Loaded_LanguageF1 Name_Calling,LabelingF1 RepetitionF1 SlogansF1 Thought-terminating_ClichesF1 Whataboutism,Straw_Men,Red_HerringF1 SmearsF1 Glittering Generalities
1pdl21.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.000001.00000
2pdl10.656430.824150.545440.000000.375000.444440.000000.635230.705880.666670.659720.789230.000000.725810.000000.000000.000000.000000.64551
3Volta0.567650.618770.524330.857140.666671.000000.000000.000000.250000.909090.000000.734540.500000.634931.000001.000000.000000.500000.78571
4HOMADOS0.541220.579770.507460.400000.794291.000000.000000.000000.250000.750000.000000.690250.000000.716031.000001.000000.000000.000001.00000
5WVOQ0.478250.618430.389870.000000.000000.000000.000000.295860.000000.500000.000000.687340.000000.493251.000001.000000.000000.322170.44444
6TeamUNCC0.310240.307370.313160.000000.000001.000000.000000.200000.293120.473390.000000.571210.000000.290101.000001.000000.000000.090910.36364
7NLyticsFKIE0.268430.512630.181820.000000.285710.000000.000000.000000.000000.571430.000000.462280.000000.226761.000001.000000.000000.000000.66667
8YNUHPCC0.215380.377900.150610.000000.000001.000000.000000.000000.000000.000000.000000.062000.000000.042231.000001.000000.000000.000000.00000
9CSECUDSG0.127140.070580.640030.000000.000001.000000.000000.128970.000000.000000.000000.131060.000000.000001.000001.000000.000000.000000.00000
10TriHeadAttention0.096630.230390.061140.000000.000001.000000.000000.000000.000000.000000.000000.134580.000000.000001.000001.000000.000000.000000.00000
11Baseline0.031650.055540.022130.133330.000000.000000.000000.184290.000000.078150.000000.026380.181820.000000.000000.000000.000000.000000.00000
12MinD0.001370.033330.000700.400000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.00000
13TeamFPAI0.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.000000.00000
Scroll the table to the right to check the F1 values for each Technique.

Task 3

RankTeamF1-MacroF1-Micro
1NUDTPDL0.717560.76518
2pdl10.603220.73435
3TDrama0.468440.70349
4MinD0.447110.70145
5Volta0.403130.69277
6Alpha0.467540.69122
7AIMH0.374300.64444
8YNUHPCC0.247270.63609
9WVOQ0.377410.60494
10CSECUDSG0.350110.59563
11LIIR0.280790.59016
12CAU731NLP0.235150.58602
13TriHeadAttention0.204220.49342
14LeCun0.345170.45560
15TeamUNCC0.126700.27477
16Baseline0.032340.05300

Organisers

  • Dimiter Dimitrov, Sofia University, Bulgaria
  • Giovanni Da San Martino, University of Padova
  • Hamed Firooz, Facebook AI
  • Fabrizio Silvestri, Facebook AI
  • Preslav Nakov, Qatar Computing Research Institute, HBKU
  • Shaden Shaar, Qatar Computing Research Institute, HBKU
  • Firoj Alam, Qatar Computing Research Institute, HBKU
  • Bishr Bin Ali, King's College, London

Contact