Leaderboard

Official SemEval 2023 task 3 Leaderboards on the Test Set

English - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.78431	0.81481
2	MLModeler5	0.61632	0.62963
3	~~vera~~ SheffieldVeraAI	0.61282	0.70370
4	HHU	0.59423	0.61111
5	DSHacker	0.59085	0.62963
6	Unisa	0.58621	0.61111
7	Hitachi	0.55288	0.59259
8	UnedMediaBiasTeam	0.52361	0.57407
9	SinaaAI	0.50641	0.66667
10	QUST	0.50613	0.62963
11	UMUTeam	0.41338	0.59259
12	UM6P	0.39351	0.51852
13	Riga	0.34902	0.53704
14	~~SharoffAndLepekhin~~ FTD	0.32887	0.46296
15	kb	0.29929	0.57407
16	Baseline	0.28802	0.61111
17	~~QCRITeam~~ QCRI	0.28112	0.59259
18	Spoke	0.26452	0.44444
19	JUSTR00	0.25657	0.37037
20	FramingFreaks	0.24806	0.59259
20	MaChAmp	0.24806	0.59259
20	ssnNlp	0.24806	0.59259
21	SATLab	0.24314	0.57407
21	~~UTBNLP~~ UTB-NLP	0.24314	0.57407
22	E8IJS	0.07477	0.09259
23	IA2022Grupa1	0.00000	0.00000
23	NLUBot101	0.00000	0.00000
23	krasavchiki	0.00000	0.00000

English - Subtask 2

Rank	Team	F1 micro	F1 macro
1	~~vera~~SheffieldVeraAI	0.57895	0.53904
2	TeamAmpa	0.56696	0.50961
3	MarsEclipse	0.56225	0.49045
4	Hitachi	0.54257	0.47158
5	~~PolarIce~~ mCPT	0.53533	0.48173
6	QUST	0.51311	0.46213
7	~~QCRITeam~~ QCRI	0.51306	0.41900
8	BERTastic	0.51232	0.44615
9	UMUTeam	0.50831	0.41521
10	ACCEPT	0.50694	0.50201
11	MaChAmp	0.50593	0.49293
12	TheSyllogist	0.48718	0.40940
13	MLModeler5	0.47692	0.42724
14	~~SharoffAndLepekhin~~ FTD	0.45340	0.36166
15	JUSTR00	0.44298	0.36309
16	Riga	0.42049	0.31287
17	SATLab	0.37762	0.31681
18	Baseline	0.34987	0.27418
19	~~UTBNLP~~ UTB-NLP	0.34112	0.30908
20	IA2022Grupa1	0.32609	0.26519
21	SinaaAI	0.26566	0.22588
22	DigDemLab	0.20741	0.17248
23	FramingFreaks	0.19632	0.14162

English - Subtask 3

Rank	Team	F1 micro	F1 macro
1	APatt	0.37562	0.12919
2	~~vera~~ SheffieldVeraAI	0.36802	0.17194
3	~~ACS~~ Appeal for attention	0.36299	0.16621
4	~~KInIT~~ KInITVeraAI	0.36157	0.13324
5	NLUBot101	0.36058	0.19722
6	~~SharoffAndLepekhin~~ FTD	0.34637	0.08765
7	TeamAmpa	0.32457	0.15768
8	~~QCRITeam~~ QCRI	0.32004	0.13251
9	DSHacker	0.32004	0.13983
10	CLAC	0.30933	0.07122
11	NL4IA	0.30761	0.14160
12	Unisa	0.29758	0.10871
13	MaChAmp	0.29476	0.14940
14	Riga	0.28045	0.06163
15	NAP	0.26294	0.08174
16	SATLab	0.25887	0.10291
17	ReDASPersuasion	0.25053	0.04476
18	UnedMediaBiasTeam	0.24070	0.07846
19	Baseline	0.19517	0.06925
20	IA2022Grupa1	0.19275	0.07204
21	SinaaAI	0.14100	0.02211
22	QUST	0.13501	0.10315
23	kb	0.06022	0.03066

Italian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Hitachi	0.76832	0.85246
2	QUST	0.76680	0.83607
3	DSHacker	0.72040	0.83607
3	~~vera~~ SheffieldVeraAI	0.72040	0.83607
4	MELODI	0.58668	0.75410
5	UnedMediaBiasTeam	0.58408	0.62295
6	UMUTeam	0.55338	0.75410
7	~~QCRITeam~~ QCRI	0.54105	0.78689
8	~~SharoffAndLepekhin~~ FTD	0.51715	0.75410
9	SinaaAI	0.50226	0.73770
10	HHU	0.45515	0.63934
11	Riga	0.43598	0.57377
12	Baseline	0.38940	0.67213
13	FramingFreaks	0.35965	0.65574
14	SATLab	0.31930	0.62295
15	JUSTR00	0.31664	0.57377
16	MaChAmp	0.26797	0.67213
17	E8IJS	0.12146	0.16393

Italian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.61728	0.54457
2	~~QCRITeam~~ QCRI	0.59906	0.47949
3	Hitachi	0.59775	0.51510
4	TeamAmpa	0.59674	0.48268
5	~~PolarIce~~ mCPT	0.58411	0.46877
6	UMUTeam	0.57627	0.44666
7	~~vera~~ SheffieldVeraAI	0.57079	0.49149
8	TheSyllogist	0.55392	0.44434
9	BERTastic	0.54500	0.46933
10	QUST	0.50228	0.46512
11	Riga	0.49861	0.32123
12	ACCEPT	0.49466	0.43921
13	Baseline	0.48564	0.37243
14	SATLab	0.47404	0.41571
15	~~SharoffAndLepekhin~~ FTD	0.45868	0.22671
16	FramingFreaks	0.45161	0.35456
17	MaChAmp	0.42435	0.40302
18	SinaaAI	0.25061	0.19964
19	DigDemLab	0.23697	0.17307

Italian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.55019	0.21436
2	NAP	0.53879	0.26609
3	~~vera~~ SheffieldVeraAI	0.52494	0.28220
4	TeamAmpa	0.52101	0.26355
5	~~SharoffAndLepekhin~~ FTD	0.51582	0.17610
6	~~QCRITeam~~ QCRI	0.51346	0.20946
7	DSHacker	0.49563	0.15267
8	ReDASPersuasion	0.44831	0.10625
9	APatt	0.44094	0.16626
10	Riga	0.43613	0.09191
11	NLUBot101	0.43506	0.16371
12	SATLab	0.43282	0.18267
13	~~ACS~~ Appeal for attention	0.43097	0.21096
14	MaChAmp	0.42154	0.16582
15	kb	0.39874	0.20056
16	Baseline	0.39719	0.12152
17	UnedMediaBiasTeam	0.31717	0.11126
18	CLAC	0.31310	0.06333
19	QUST	0.21253	0.15497
20	SinaaAI	0.20284	0.06374

Russian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Hitachi	0.75494	0.75000
2	~~vera~~ SheffieldVeraAI	0.72871	0.72222
3	~~SharoffAndLepekhin~~ FTD	0.66797	0.69444
4	UMUTeam	0.64543	0.68056
5	MELODI	0.58642	0.62500
6	~~QCRITeam~~ QCRI	0.56659	0.65278
7	DSHacker	0.55886	0.59722
8	Spoke	0.48969	0.65278
9	QUST	0.47200	0.51389
10	SinaaAI	0.44255	0.47222
11	HHU	0.42571	0.47222
12	Baseline	0.39831	0.65278
13	UnedMediaBiasTeam	0.36457	0.44444
14	Riga	0.27095	0.38889
15	MaChAmp	0.25641	0.62500
16	FramingFreaks	0.23595	0.31944
17	E8IJS	0.17460	0.30556

Russian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.44976	0.30333
2	~~vera~~ SheffieldVeraAI	0.44144	0.35587
3	~~QCRITeam~~ QCRI	0.43386	0.36428
4	TeamAmpa	0.40930	0.29380
5	~~PolarIce~~ mCPT	0.40851	0.36675
6	BERTastic	0.39269	0.26521
7	TheSyllogist	0.38494	0.28990
8	UMUTeam	0.38488	0.28836
9	Hitachi	0.37000	0.32593
10	Riga	0.31515	0.22189
11	ACCEPT	0.25370	0.24850
12	QUST	0.25000	0.21290
13	Baseline	0.22951	0.21774
14	FramingFreaks	0.21927	0.15917
15	~~SharoffAndLepekhin~~ FTD	0.19763	0.11732
16	MaChAmp	0.16058	0.15120
17	SinaaAI	0.11299	0.12777
18	DigDemLab	0.07035	0.05495

Russian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.38682	0.18879
2	TeamAmpa	0.37781	0.22740
3	~~QCRITeam~~ QCRI	0.36134	0.18247
4	NLUBot101	0.32298	0.20052
5	~~vera~~ SheffieldVeraAI	0.31841	0.20522
6	~~ACS~~ Appeal for attention	0.31152	0.17325
7	APatt	0.30602	0.11666
8	NAP	0.30546	0.19327
9	MaChAmp	0.27110	0.14842
10	DSHacker	0.25714	0.08339
11	kb	0.25289	0.11653
12	Riga	0.25158	0.06441
13	~~SharoffAndLepekhin~~ FTD	0.23464	0.05781
14	ReDASPersuasion	0.21887	0.05031
15	Baseline	0.20722	0.08598
16	CLAC	0.19285	0.05653
17	UnedMediaBiasTeam	0.18304	0.09995
18	SinaaAI	0.13869	0.05734
19	QUST	0.10048	0.08021

French - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.83547	0.88000
2	~~QCRITeam~~ QCRI	0.76744	0.80000
3	Hitachi	0.74359	0.78000
4	DSHacker	0.71045	0.72000
5	~~vera~~ SheffieldVeraAI	0.68157	0.74000
6	~~SharoffAndLepekhin~~ FTD	0.67138	0.78000
7	MELODI	0.65595	0.74000
8	SinaaAI	0.63772	0.68000
9	QUST	0.62145	0.70000
10	Baseline	0.56806	0.74000
11	UnedMediaBiasTeam	0.46536	0.48000
12	SATLab	0.44670	0.64000
13	Riga	0.35595	0.58000
14	JUSTR00	0.34683	0.66000
15	FramingFreaks	0.34074	0.66000
16	MaChAmp	0.28352	0.74000
17	E8IJS	0.08000	0.12000

French - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.55280	0.53681
2	BERTastic	0.53691	0.52016
3	~~vera~~ SheffieldVeraAI	0.53425	0.52035
4	Hitachi	0.51408	0.48832
5	TeamAmpa	0.50558	0.47890
6	TheSyllogist	0.48571	0.46156
7	~~QCRITeam~~ QCRI	0.48031	0.43048
8	UMUTeam	0.47727	0.43820
9	~~PolarIce~~ mCPT	0.46886	0.42851
10	ACCEPT	0.45553	0.44349
11	QUST	0.44670	0.43786
12	Riga	0.37615	0.28728
13	SATLab	0.37543	0.35232
14	MaChAmp	0.35873	0.35478
15	Baseline	0.32850	0.27633
16	FramingFreaks	0.32716	0.29980
17	~~SharoffAndLepekhin~~ FTD	0.25496	0.10481
18	DigDemLab	0.22047	0.19236
19	SinaaAI	0.18699	0.15675

French - Subtask 3

Rank	Team	F1 micro	F1 macro
1	NAP	0.46869	0.32171
2	TeamAmpa	0.43442	0.30544
3	~~KInIT~~ KInITVeraAI	0.43217	0.21408
4	~~vera~~ SheffieldVeraAI	0.41436	0.32424
5	~~QCRITeam~~ QCRI	0.40145	0.22582
6	NLUBot101	0.39580	0.25431
7	DSHacker	0.38771	0.20056
8	APatt	0.38414	0.19125
9	~~ACS~~ Appeal for attention	0.37417	0.20318
10	kb	0.36246	0.26628
11	MaChAmp	0.34507	0.20676
12	SATLab	0.33755	0.24115
13	Riga	0.30573	0.07785
14	ReDASPersuasion	0.30087	0.11471
15	~~SharoffAndLepekhin~~ FTD	0.29824	0.12642
16	Baseline	0.24014	0.09867
17	CLAC	0.23903	0.06575
18	UnedMediaBiasTeam	0.23590	0.12149
19	QUST	0.20905	0.16431
20	SinaaAI	0.19523	0.06316

German - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.81951	0.82000
1	~~vera~~ SheffieldVeraAI	0.81951	0.82000
2	DSHacker	0.81314	0.82000
3	SinaaAI	0.78245	0.76000
4	MELODI	0.77885	0.78000
5	Hitachi	0.77659	0.76000
6	~~SharoffAndLepekhin~~ FTD	0.71266	0.72000
7	~~QCRITeam~~ QCRI	0.66653	0.66000
8	SATLab	0.64391	0.70000
9	Baseline	0.62963	0.76000
10	QUST	0.62598	0.66000
11	HHU	0.61087	0.74000
12	FramingFreaks	0.56937	0.70000
13	Riga	0.41225	0.48000
14	UnedMediaBiasTeam	0.36203	0.42000
15	JUSTR00	0.26506	0.66000
15	MaChAmp	0.26506	0.66000
16	E8IJS	0.11765	0.18000

German - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.71119	0.66045
2	~~QCRITeam~~ QCRI	0.66019	0.60557
3	~~vera~~ SheffieldVeraAI	0.65251	0.60140
4	TeamAmpa	0.63223	0.57266
5	Hitachi	0.62913	0.56731
6	~~PolarIce~~ mCPT	0.62222	0.56438
7	QUST	0.61580	0.54507
8	UMUTeam	0.61378	0.56539
9	BERTastic	0.60331	0.56200
10	MaChAmp	0.58156	0.56358
11	SATLab	0.57198	0.51872
12	~~SharoffAndLepekhin~~ FTD	0.55479	0.29877
13	FramingFreaks	0.54516	0.49578
14	TheSyllogist	0.53670	0.46495
15	Riga	0.50856	0.37454
16	ACCEPT	0.49606	0.45971
17	Baseline	0.48707	0.41801
18	DigDemLab	0.33473	0.27949
19	SinaaAI	0.30222	0.26524

German - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.51304	0.23313
2	NAP	0.50953	0.27195
3	~~QCRITeam~~ QCRI	0.49824	0.23090
4	APatt	0.48375	0.17692
5	TeamAmpa	0.47597	0.26610
6	~~vera~~ SheffieldVeraAI	0.44726	0.23679
7	NLUBot101	0.42042	0.17879
8	~~ACS~~ Appeal for attention	0.41783	0.21802
9	DSHacker	0.40816	0.15433
10	MaChAmp	0.40497	0.17804
11	ReDASPersuasion	0.38391	0.07810
12	kb	0.37264	0.20109
13	Riga	0.37257	0.06000
14	~~SharoffAndLepekhin~~ FTD	0.36262	0.11044
15	SATLab	0.35523	0.16270
16	UnedMediaBiasTeam	0.31827	0.10617
17	Baseline	0.31667	0.08345
18	CLAC	0.24795	0.05514
19	QUST	0.15278	0.11244
20	SinaaAI	0.04208	0.03353

Polish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	~~SharoffAndLepekhin~~ FTD	0.78551	0.93617
2	Hitachi	0.77922	0.87234
3	~~vera~~ SheffieldVeraAI	0.76455	0.85106
4	MELODI	0.70855	0.85106
5	UMUTeam	0.66431	0.80851
6	SinaaAI	0.66349	0.80851
7	DSHacker	0.66125	0.80851
8	kb	0.65259	0.80851
9	SATLab	0.57081	0.82979
10	~~QCRITeam~~ QCRI	0.57071	0.82979
11	QUST	0.52778	0.59574
12	UnedMediaBiasTeam	0.50700	0.55319
13	Baseline	0.48962	0.82979
14	Riga	0.43312	0.46809
15	MaChAmp	0.28455	0.74468
16	FramingFreaks	0.28205	0.70213
17	E8IJS	0.06276	0.08511

Polish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.67314	0.63839
2	~~vera~~ SheffieldVeraAI	0.64516	0.60272
3	~~QCRITeam~~ QCRI	0.64193	0.59867
4	UMUTeam	0.64179	0.59312
5	Hitachi	0.63396	0.58396
6	SATLab	0.62018	0.56987
7	TeamAmpa	0.61386	0.55541
8	MaChAmp	0.59701	0.58239
9	~~PolarIce~~ mCPT	0.59684	0.55454
10	Baseline	0.59381	0.53199
11	QUST	0.59084	0.53312
12	~~SharoffAndLepekhin~~ FTD	0.58795	0.51617
13	BERTastic	0.58696	0.53547
14	FramingFreaks	0.55973	0.45995
15	TheSyllogist	0.55263	0.50080
16	Riga	0.54222	0.41239
17	ACCEPT	0.50980	0.49032
18	SinaaAI	0.47458	0.44563
19	DigDemLab	0.39163	0.34847

Polish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.43037	0.17929
2	NAP	0.42180	0.24577
3	DSHacker	0.38958	0.16953
4	TeamAmpa	0.38918	0.23640
5	~~QCRITeam~~ QCRI	0.37849	0.15630
6	APatt	0.36570	0.14969
7	~~vera~~ SheffieldVeraAI	0.34700	0.19102
8	~~ACS~~ Appeal for attention	0.34368	0.20072
9	~~SharoffAndLepekhin~~ FTD	0.32680	0.12161
10	NLUBot101	0.31970	0.16911
11	kb	0.31427	0.17940
12	MaChAmp	0.30746	0.17030
13	SATLab	0.30049	0.14286
14	ReDASPersuasion	0.23839	0.11162
15	UnedMediaBiasTeam	0.23652	0.10348
16	Riga	0.22774	0.03796
17	CLAC	0.19036	0.05024
18	Baseline	0.17928	0.05932
19	QUST	0.09707	0.07426
20	SinaaAI	0.06370	0.02508

Spanish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	DSHacker	0.56349	0.56667
2	QUST	0.55236	0.63333
3	~~QCRITeam~~ QCRI	0.48894	0.56667
4	~~vera~~ SheffieldVeraAI	0.44293	0.50000
5	MELODI	0.44257	0.60000
6	UMUTeam	0.43750	0.50000
7	~~SharoffAndLepekhin~~ FTD	0.40000	0.43333
8	Riga	0.38492	0.50000
9	UnedMediaBiasTeam	0.33614	0.36667
10	HHU	0.32669	0.43333
11	SinaaAI	0.32271	0.43333
12	FramingFreaks	0.31746	0.46667
13	SATLab	0.28187	0.43333
14	E8IJS	0.23457	0.30000
15	MaChAmp	0.21212	0.46667
16	Baseline	0.15385	0.30000

Spanish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	~~PolarIce~~ mCPT	0.57143	0.45491
2	UMUTeam	0.55844	0.46541
3	~~vera~~ SheffieldVeraAI	0.50829	0.43213
4	TeamAmpa	0.50575	0.38650
5	Riga	0.48889	0.42605
6	~~QCRITeam~~ QCRI	0.48780	0.38955
7	MarsEclipse	0.47706	0.40434
8	BERTastic	0.47664	0.42842
9	TheSyllogist	0.47273	0.38734
10	ACCEPT	0.38806	0.38662
11	MaChAmp	0.38519	0.26857
12	SATLab	0.38272	0.29311
13	QUST	0.37370	0.35266
14	~~SharoffAndLepekhin~~ FTD	0.26506	0.20117
15	FramingFreaks	0.21538	0.21132
16	SinaaAI	0.18065	0.16336
17	Baseline	0.12000	0.09524

Spanish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	TeamAmpa	0.38106	0.24366
2	~~KInIT~~ KInITVeraAI	0.38035	0.15464
3	NAP	0.36996	0.18065
4	~~QCRITeam~~ QCRI	0.35014	0.15668
5	~~ACS~~ Appeal for attention	0.31730	0.13934
6	NLUBot101	0.30459	0.15092
7	~~SharoffAndLepekhin~~ FTD	0.28149	0.07445
8	MaChAmp	0.27595	0.13891
9	~~vera~~ SheffieldVeraAI	0.27497	0.13042
10	CLAC	0.26667	0.04755
11	Baseline	0.24843	0.02007
12	kb	0.24490	0.14257
13	UnedMediaBiasTeam	0.22686	0.07799
14	Riga	0.19895	0.04520
15	SATLab	0.19304	0.05708
16	SinaaAI	0.17791	0.02798
17	QUST	0.12617	0.09923

Greek - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.80588	0.81250
2	UMUTeam	0.76700	0.79688
3	HHU	0.75039	0.75000
4	~~QCRITeam~~ QCRI	0.70815	0.81250
5	~~SharoffAndLepekhin~~ FTD	0.69765	0.76563
6	~~vera~~ SheffieldVeraAI	0.68681	0.73438
7	MELODI	0.63650	0.70313
8	DSHacker	0.59346	0.64063
9	UnedMediaBiasTeam	0.52128	0.56250
10	QUST	0.49159	0.60938
11	Riga	0.41176	0.57813
12	SATLab	0.25356	0.40625
13	MaChAmp	0.25243	0.60938
14	FramingFreaks	0.23403	0.34375
15	Baseline	0.17054	0.34375
16	E8IJS	0.05670	0.06250

Greek - Subtask 2

Rank	Team	F1 micro	F1 macro
1	~~vera~~ SheffieldVeraAI	0.54630	0.45390
2	TeamAmpa	0.54408	0.44372
3	UMUTeam	0.53409	0.40360
4	TheSyllogist	0.52987	0.44048
5	BERTastic	0.52584	0.44396
6	~~QCRITeam~~ QCRI	0.51852	0.39952
7	~~PolarIce~~ mCPT	0.51629	0.40953
8	MarsEclipse	0.49791	0.40163
9	QUST	0.41357	0.39198
10	FramingFreaks	0.38020	0.15432
11	Riga	0.37692	0.19532
12	ACCEPT	0.35517	0.36951
13	Baseline	0.34538	0.05741
14	MaChAmp	0.29279	0.20575
15	SinaaAI	0.14024	0.12335
16	SATLab	0.06829	0.03730

Greek - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.26733	0.12559
2	~~QCRITeam~~ QCRI	0.26481	0.12917
3	NAP	0.25803	0.16394
4	TeamAmpa	0.23835	0.17135
5	MaChAmp	0.21465	0.12929
6	~~ACS~~ Appeal for attention	0.20583	0.11851
7	~~vera~~ SheffieldVeraAI	0.17426	0.11028
8	Riga	0.16391	0.03632
9	CLAC	0.15630	0.05507
10	NLUBot101	0.15034	0.09653
11	kb	0.15021	0.12095
12	SinaaAI	0.11448	0.02880
13	UnedMediaBiasTeam	0.10566	0.02569
14	Baseline	0.08831	0.00606
15	QUST	0.05720	0.04650
16	SATLab	0.00000	0.00000

Georgian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Riga	1.00000	1.00000
2	~~vera~~ SheffieldVeraAI	0.96268	0.96552
3	~~SharoffAndLepekhin~~ FTD	0.88803	0.89655
4	~~QCRITeam~~ QCRI	0.62210	0.89655
5	DSHacker	0.59715	0.86207
6	UMUTeam	0.58201	0.86207
7	QUST	0.53656	0.68966
8	SATLab	0.51852	0.72414
9	MELODI	0.49000	0.72414
10	UnedMediaBiasTeam	0.48630	0.68966
11	SinaaAI	0.46798	0.68966
12	MaChAmp	0.39583	0.65517
13	Baseline	0.25641	0.34483
14	FramingFreaks	0.25532	0.62069
15	E8IJS	0.00000	0.00000

Georgian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	~~vera~~ SheffieldVeraAI	0.65421	0.67891
2	MarsEclipse	0.64516	0.63927
3	TheSyllogist	0.56140	0.49288
4	BERTastic	0.55172	0.40820
5	UMUTeam	0.52941	0.41064
6	~~QCRITeam~~ QCRI	0.51685	0.45724
7	TeamAmpa	0.51667	0.37879
8	Riga	0.42353	0.38095
9	~~PolarIce~~ mCPT	0.40000	0.29065
10	FramingFreaks	0.35233	0.34399
11	MaChAmp	0.31250	0.22533
12	QUST	0.31076	0.26028
13	Baseline	0.25974	0.25092
14	ACCEPT	0.22000	0.28980
15	SinaaAI	0.13333	0.20493
16	SATLab	0.05333	0.18367

Georgian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	~~KInIT~~ KInITVeraAI	0.45714	0.32758
2	~~QCRITeam~~ QCRI	0.41353	0.33924
3	NAP	0.41261	0.30615
4	TeamAmpa	0.40816	0.25854
5	Riga	0.36190	0.20869
6	MaChAmp	0.30100	0.22056
7	~~ACS~~ Appeal for attention	0.27986	0.26142
8	CLAC	0.27053	0.19930
9	NLUBot101	0.25362	0.17235
10	~~vera~~ SheffieldVeraAI	0.24911	0.29553
11	UnedMediaBiasTeam	0.18012	0.22096
12	kb	0.15017	0.09988
13	SinaaAI	0.13878	0.03959
14	Baseline	0.13793	0.14083
15	QUST	0.09088	0.11504
16	SATLab	0.07568	0.15786

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval2023 shared task on "Detecting the Category, the Framing, and the Persuasion Techniques in Online News in a Multi-lingual Setup"

Leaderboard

Official SemEval 2023 task 3 Leaderboards on the Test Set

English - Subtask 1

English - Subtask 2

English - Subtask 3

Italian - Subtask 1

Italian - Subtask 2

Italian - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

French - Subtask 1

French - Subtask 2

French - Subtask 3

German - Subtask 1

German - Subtask 2

German - Subtask 3

Polish - Subtask 1

Polish - Subtask 2

Polish - Subtask 3

Spanish - Subtask 1

Spanish - Subtask 2

Spanish - Subtask 3

Greek - Subtask 1

Greek - Subtask 2

Greek - Subtask 3

Georgian - Subtask 1

Georgian - Subtask 2

Georgian - Subtask 3

Contact