Leaderboard

Leaderboards on Test set

Task 1

Rank	Team	F1-Macro	F1-Micro
1	MinD	0.28993	0.59331
2	Alpha	0.26218	0.57187
3	Volta	0.26621	0.56958
4	mmm	0.30255	0.54839
5	AIMH	0.24462	0.53903
6	LeCun	0.22658	0.51224
7	WVOQ	0.22671	0.51057
8	TeamUNCC	0.23634	0.51027
9	NLyticsFKIE	0.13990	0.49815
10	TeiAS	0.21391	0.49740
11	DAJUST	0.18748	0.49657
12	YNUHPCC	0.26325	0.49275
13	CSECUDSG	0.18454	0.48894
14	TeamFPAI	0.11525	0.40566
15	NLPIITR	0.12590	0.37917
16	TriHeadAttention	0.02397	0.18373
17	Baseline	0.04427	0.06439

Task 2

Rank	Team	F1	Precision	Recall	F1 Appeal_to_Authority	F1 Appeal_to_fear-prejudice	F1 Bandwagon,Reductio_ad_hitlerum	F1 Black-and-White_Fallacy	F1 Causal_Oversimplification	F1 Doubt	F1 Exaggeration,Minimisation	F1 Flag-Waving	F1 Loaded_Language	F1 Name_Calling,Labeling	F1 Repetition	F1 Slogans	F1 Thought-terminating_Cliches	F1 Whataboutism,Straw_Men,Red_Herring	F1 Smears	F1 Glittering Generalities
1	Volta	0.48166	0.50061	0.46409	0.36330	0.20000	0.59341	0.05498	0.41466	0.42290	0.70588	0.13333	0.70575	0.00000	0.61628	0.00000	0.00000	0.00000	1.00000	0.32000
2	HOMADOS	0.40737	0.41206	0.40278	0.37037	0.39351	0.87070	0.29303	0.42857	0.00000	0.52092	0.10526	0.65740	0.00000	0.60224	0.00000	0.00000	0.00000	0.00000	0.46154
3	TeamFPAI	0.39736	0.65198	0.28576	0.00000	0.00000	0.00000	0.00000	0.06897	0.23415	0.00000	0.00000	0.73107	0.00000	0.36618	0.00000	0.00000	0.00000	0.00000	0.09524
4	TeamUNCC	0.32897	0.28467	0.38959	0.04606	0.21180	0.28179	0.13333	0.41152	0.35688	0.52941	0.09375	0.55195	0.00000	0.50440	0.00000	0.00000	0.00000	0.07038	0.23359
5	WVOQ	0.26787	0.24265	0.29894	0.00000	0.11690	0.06943	0.06897	0.21836	0.29833	0.12698	0.07790	0.39065	0.00000	0.41872	0.00000	0.00000	0.00000	0.00000	0.22011
6	CSECUDSG	0.11983	0.07952	0.24303	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.11447	0.00000	0.13675	0.00000	0.00000	0.00000	0.00000	0.00000
7	YNUHPCC	0.09111	0.18583	0.06035	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.04490	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000
8	TriHeadAttention	0.07969	0.16971	0.05207	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.12966	0.00000	0.03143	0.00000	0.00000	0.00000	0.00000	0.00000
9	Baseline	0.00952	0.03368	0.00554	0.00000	0.00000	0.00000	0.00000	0.00000	0.07143	0.00000	0.00000	0.00253	0.11538	0.05480	0.25000	0.11765	0.00000	0.00000	0.00000

Scroll the table to the right to check the F1 values for each Technique.

Task 3

Rank	Team	F1-Macro	F1-Micro
1	Alpha	0.27315	0.58109
2	MinD	0.24389	0.56623
3	1213Li	0.22830	0.54860
4	AIMH	0.20729	0.53994
5	Volta	0.18877	0.52070
6	CSECUDSG	0.12117	0.51312
7	aircasMM	0.20021	0.51078
8	LIIR	0.18807	0.49835
9	CAU731NLP	0.08390	0.48085
10	WVOQ	0.23957	0.47779
11	YNUHPCC	0.09619	0.44610
12	TriHeadAttention	0.06228	0.44196
13	NLyticsFKIE	0.11772	0.42303
14	LT3UGent	0.26355	0.33148
15	TeamUNCC	0.12359	0.22359
16	Baseline	0.05152	0.07062

Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

SemEval 2021 task 6 Leaderboard

(submissions on the test set until the shared task deadline)

Task 1

Rank	Team	F1-Macro	F1-Micro
1	NUDTPDL	0.97462	0.97612
2	pdl1	0.97410	0.97024
3	TeamUNCC	0.98779	0.96850
4	MinD	0.51120	0.69434
5	Alpha	0.54803	0.68619
6	CSECUDSG	0.80680	0.66486
7	Volta	0.44563	0.66364
8	LeCun	0.44409	0.64734
9	AIMH	0.46204	0.62698
10	YNUHPCC	0.47188	0.62500
11	WVOQ	0.39814	0.60163
12	DAJUST	0.35024	0.57031
13	TeiAS	0.38864	0.55939
14	NLPIITR	0.34419	0.50909
15	TeamFPAI	0.31714	0.50575
16	CAU731NLP	0.20017	0.34444
17	TriHeadAttention	0.08554	0.20126
18	pdl2	0.04427	0.06439
19	yyjc2	0.04427	0.06439
20	Baseline	0.03437	0.06427

Task 2

Rank	Team	F1	Precision	Recall	F1 Appeal_to_Authority	F1 Appeal_to_fear-prejudice	F1 Bandwagon,Reductio_ad_hitlerum	F1 Black-and-White_Fallacy	F1 Causal_Oversimplification	F1 Doubt	F1 Exaggeration,Minimisation	F1 Flag-Waving	F1 Loaded_Language	F1 Name_Calling,Labeling	F1 Repetition	F1 Slogans	F1 Thought-terminating_Cliches	F1 Whataboutism,Straw_Men,Red_Herring	F1 Smears	F1 Glittering Generalities
1	pdl2	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000	1.00000
2	pdl1	0.65643	0.82415	0.54544	0.00000	0.37500	0.44444	0.00000	0.63523	0.70588	0.66667	0.65972	0.78923	0.00000	0.72581	0.00000	0.00000	0.00000	0.00000	0.64551
3	Volta	0.56765	0.61877	0.52433	0.85714	0.66667	1.00000	0.00000	0.00000	0.25000	0.90909	0.00000	0.73454	0.50000	0.63493	1.00000	1.00000	0.00000	0.50000	0.78571
4	HOMADOS	0.54122	0.57977	0.50746	0.40000	0.79429	1.00000	0.00000	0.00000	0.25000	0.75000	0.00000	0.69025	0.00000	0.71603	1.00000	1.00000	0.00000	0.00000	1.00000
5	WVOQ	0.47825	0.61843	0.38987	0.00000	0.00000	0.00000	0.00000	0.29586	0.00000	0.50000	0.00000	0.68734	0.00000	0.49325	1.00000	1.00000	0.00000	0.32217	0.44444
6	TeamUNCC	0.31024	0.30737	0.31316	0.00000	0.00000	1.00000	0.00000	0.20000	0.29312	0.47339	0.00000	0.57121	0.00000	0.29010	1.00000	1.00000	0.00000	0.09091	0.36364
7	NLyticsFKIE	0.26843	0.51263	0.18182	0.00000	0.28571	0.00000	0.00000	0.00000	0.00000	0.57143	0.00000	0.46228	0.00000	0.22676	1.00000	1.00000	0.00000	0.00000	0.66667
8	YNUHPCC	0.21538	0.37790	0.15061	0.00000	0.00000	1.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.06200	0.00000	0.04223	1.00000	1.00000	0.00000	0.00000	0.00000
9	CSECUDSG	0.12714	0.07058	0.64003	0.00000	0.00000	1.00000	0.00000	0.12897	0.00000	0.00000	0.00000	0.13106	0.00000	0.00000	1.00000	1.00000	0.00000	0.00000	0.00000
10	TriHeadAttention	0.09663	0.23039	0.06114	0.00000	0.00000	1.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.13458	0.00000	0.00000	1.00000	1.00000	0.00000	0.00000	0.00000
11	Baseline	0.03165	0.05554	0.02213	0.13333	0.00000	0.00000	0.00000	0.18429	0.00000	0.07815	0.00000	0.02638	0.18182	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000
12	MinD	0.00137	0.03333	0.00070	0.40000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000
13	TeamFPAI	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000	0.00000

Scroll the table to the right to check the F1 values for each Technique.

Task 3

Rank	Team	F1-Macro	F1-Micro
1	NUDTPDL	0.71756	0.76518
2	pdl1	0.60322	0.73435
3	TDrama	0.46844	0.70349
4	MinD	0.44711	0.70145
5	Volta	0.40313	0.69277
6	Alpha	0.46754	0.69122
7	AIMH	0.37430	0.64444
8	YNUHPCC	0.24727	0.63609
9	WVOQ	0.37741	0.60494
10	CSECUDSG	0.35011	0.59563
11	LIIR	0.28079	0.59016
12	CAU731NLP	0.23515	0.58602
13	TriHeadAttention	0.20422	0.49342
14	LeCun	0.34517	0.45560
15	TeamUNCC	0.12670	0.27477
16	Baseline	0.03234	0.05300

Organisers

Dimiter Dimitrov, Sofia University, Bulgaria
Giovanni Da San Martino, University of Padova
Hamed Firooz, Facebook AI
Fabrizio Silvestri, Facebook AI
Preslav Nakov, Qatar Computing Research Institute, HBKU
Shaden Shaar, Qatar Computing Research Institute, HBKU
Firoj Alam, Qatar Computing Research Institute, HBKU
Bishr Bin Ali, King's College, London

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval 2021 Task 6 "Detection of Persuasion Techniques in Texts and Images"

Leaderboard

Leaderboards on Test set

Task 1

Task 2

Task 3

SemEval 2021 task 6 Leaderboard

Task 1

Task 2

Task 3

Organisers

Contact

SemEval 2021 Task 6
"Detection of Persuasion Techniques in Texts and Images"