Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.78431	0.81481
2	vera	0.67187	0.74074
3	MLModeler5	0.66077	0.70370
4	LazyDevs	0.65033	0.79630
5	HHU	0.59423	0.61111
6	DSHacker	0.59085	0.62963
7	Unisa	0.58621	0.61111
8	Hitachi	0.55288	0.59259
9	UnedMediaBiasTeam	0.52361	0.57407
10	SinaaAI	0.50641	0.66667
11	QUST	0.50613	0.62963
12	Corgis	0.49091	0.61111
13	UMUTeam	0.41338	0.59259
14	UM6P	0.39351	0.51852
15	Riga	0.34902	0.53704
16	SharoffAndLepekhin	0.32887	0.46296
17	kb	0.29929	0.57407
18	Baseline	0.28802	0.61111
18	yyjc	0.28802	0.61111
19	QCRITeam	0.28112	0.59259
20	Spoke	0.26452	0.44444
21	JUSTR00	0.25657	0.37037
22	FramingFreaks	0.24806	0.59259
22	MaChAmp	0.24806	0.59259
22	ssnNlp	0.24806	0.59259
23	SATLab	0.24314	0.57407
23	UTBNLP	0.24314	0.57407
24	E8IJS	0.07477	0.09259
25	ACS	0.00000	0.00000
25	Elyas	0.00000	0.00000
25	IA2022Grupa1	0.00000	0.00000
25	NLUBot101	0.00000	0.00000
25	ReDASPersuasion	0.00000	0.00000
25	krasavchiki	0.00000	0.00000

English - Subtask 2

Rank	Team	F1 micro	F1 macro
1	ACCEPT	0.60481	0.57427
2	MarsEclipse	0.59216	0.50503
3	vera	0.58475	0.53420
4	TeamAmpa	0.56696	0.50961
5	LazyDevs	0.54664	0.46307
6	Hitachi	0.54257	0.47158
7	PolarIce	0.53533	0.48173
8	Lubov	0.52954	0.45752
9	QUST	0.51311	0.46213
10	QCRITeam	0.51306	0.41900
11	BERTastic	0.51232	0.44615
12	UMUTeam	0.50831	0.41521
13	SinaaAI	0.50627	0.40819
14	MaChAmp	0.50593	0.49293
15	TheSyllogist	0.48718	0.40940
16	MLModeler5	0.47692	0.42724
17	SharoffAndLepekhin	0.45340	0.36166
18	JUSTR00	0.44298	0.36309
19	Riga	0.42049	0.31287
20	SATLab	0.37762	0.31681
21	Baseline	0.34987	0.27418
22	UTBNLP	0.34112	0.30908
23	IA2022Grupa1	0.32609	0.26519
24	DigDemLab	0.20741	0.17248
25	FramingFreaks	0.19632	0.14162

English - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44937	0.21698
2	Elyas	0.41334	0.17051
3	oalee	0.41206	0.18622
4	RD	0.41158	0.15525
5	KInIT	0.40515	0.17044
6	DSHacker	0.39029	0.15887
7	REHonoursProject	0.38658	0.16035
8	ACS	0.38628	0.17360
9	NAP	0.38148	0.17247
10	APatt	0.37562	0.12919
11	ReDASPersuasion	0.36553	0.09843
12	QCRITeam	0.36490	0.19847
13	NLUBot101	0.36058	0.19722
14	TeamAmpa	0.35951	0.18471
15	SharoffAndLepekhin	0.34637	0.08765
16	NL4IA	0.34280	0.15206
17	SinaaAI	0.33112	0.14294
18	MarsEclipse	0.32998	0.10620
19	LazyDevs	0.31520	0.15681
20	CLAC	0.30933	0.07122
21	kb	0.30113	0.08047
22	Unisa	0.29758	0.10871
23	MaChAmp	0.29476	0.14940
24	Riga	0.28045	0.06163
25	SATLab	0.25887	0.10291
26	UnedMediaBiasTeam	0.24070	0.07846
27	Baseline	0.19517	0.06925
28	IA2022Grupa1	0.19275	0.07204
29	QUST	0.13501	0.10315

Italian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.78299	0.83607
2	Hitachi	0.76832	0.85246
3	QUST	0.76680	0.83607
4	vera	0.73711	0.81967
5	DSHacker	0.72040	0.83607
6	LazyDevs	0.61856	0.78689
7	Corgis	0.61594	0.77049
8	MELODI	0.58668	0.75410
9	UnedMediaBiasTeam	0.58408	0.62295
10	UMUTeam	0.55338	0.75410
11	QCRITeam	0.54105	0.78689
12	SharoffAndLepekhin	0.51715	0.75410
13	HHU	0.45515	0.63934
14	Riga	0.43598	0.57377
15	Baseline	0.38940	0.67213
16	FramingFreaks	0.35965	0.65574
17	SATLab	0.31930	0.62295
18	JUSTR00	0.31664	0.57377
19	MaChAmp	0.26797	0.67213
20	E8IJS	0.12146	0.16393

Italian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.61728	0.54457
2	vera	0.61678	0.52700
3	SinaaAI	0.60621	0.48381
4	QCRITeam	0.59906	0.47949
5	Hitachi	0.59775	0.51510
6	TeamAmpa	0.59674	0.48268
7	PolarIce	0.58411	0.46877
8	LazyDevs	0.57843	0.49997
9	UMUTeam	0.57627	0.44666
10	ACCEPT	0.55963	0.47628
11	TheSyllogist	0.55392	0.44434
12	BERTastic	0.54500	0.46933
13	QUST	0.50228	0.46512
14	Riga	0.49861	0.32123
15	Baseline	0.48564	0.37243
16	SATLab	0.47404	0.41571
17	SharoffAndLepekhin	0.45868	0.22671
18	FramingFreaks	0.45161	0.35456
19	MaChAmp	0.42435	0.40302
20	DigDemLab	0.23697	0.17307

Italian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.59919	0.28122
2	RD	0.58824	0.26757
3	KInIT	0.58544	0.28580
4	oalee	0.57122	0.27299
5	ReDASPersuasion	0.56486	0.17531
6	DSHacker	0.56480	0.23300
7	MarsEclipse	0.54888	0.23192
8	NAP	0.53879	0.26609
9	TeamAmpa	0.52597	0.27214
10	QCRITeam	0.51661	0.24156
11	SharoffAndLepekhin	0.51582	0.17610
12	LazyDevs	0.50129	0.27529
13	SinaaAI	0.48048	0.17531
14	ACS	0.48011	0.22103
15	APatt	0.44094	0.16626
16	Riga	0.43613	0.09191
17	NLUBot101	0.43506	0.16371
18	SATLab	0.43282	0.18267
19	MaChAmp	0.42154	0.16582
20	kb	0.39874	0.20056
21	Baseline	0.39719	0.12152
22	UnedMediaBiasTeam	0.31717	0.11126
23	CLAC	0.31310	0.06333
24	QUST	0.21253	0.15497

Russian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Hitachi	0.75494	0.75000
2	vera	0.72871	0.72222
3	MELODI	0.70577	0.69444
4	Corgis	0.68216	0.69444
5	SharoffAndLepekhin	0.66797	0.69444
6	SinaaAI	0.65539	0.69444
7	UMUTeam	0.64543	0.68056
8	LazyDevs	0.63006	0.70833
9	QCRITeam	0.56659	0.65278
10	DSHacker	0.55886	0.59722
11	Spoke	0.48969	0.65278
12	QUST	0.47200	0.51389
13	HHU	0.42571	0.47222
14	Baseline	0.39831	0.65278
15	UnedMediaBiasTeam	0.36457	0.44444
16	Riga	0.27095	0.38889
17	MaChAmp	0.25641	0.62500
18	FramingFreaks	0.23595	0.31944
19	E8IJS	0.17460	0.30556

Russian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.48148	0.35458
2	SinaaAI	0.45662	0.41115
3	MarsEclipse	0.44976	0.30333
4	LazyDevs	0.43925	0.27730
5	QCRITeam	0.43386	0.36428
6	PolarIce	0.42051	0.25792
7	Lubov	0.41706	0.35507
8	TeamAmpa	0.40930	0.29380
9	BERTastic	0.39269	0.26521
10	TheSyllogist	0.38494	0.28990
11	UMUTeam	0.38488	0.28836
12	Hitachi	0.37000	0.32593
13	ACCEPT	0.33155	0.31283
14	Riga	0.31515	0.22189
15	QUST	0.25000	0.21290
16	Baseline	0.22951	0.21774
17	FramingFreaks	0.21927	0.15917
18	SharoffAndLepekhin	0.19763	0.11732
19	MaChAmp	0.16058	0.15120
20	DigDemLab	0.07035	0.05495

Russian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.43343	0.24205
2	vera	0.42635	0.25979
3	RD	0.41816	0.21281
4	MarsEclipse	0.39550	0.22110
5	DSHacker	0.38588	0.20209
6	oalee	0.38246	0.23232
7	TeamAmpa	0.37781	0.22740
8	QCRITeam	0.36828	0.21594
9	LazyDevs	0.36068	0.21271
10	ReDASPersuasion	0.35965	0.15988
11	ACS	0.33136	0.18251
12	NAP	0.32841	0.15809
13	NLUBot101	0.32298	0.20052
14	SinaaAI	0.31738	0.16636
15	APatt	0.30602	0.11666
16	MaChAmp	0.27110	0.14842
17	kb	0.25289	0.11653
18	Riga	0.25158	0.06441
19	SharoffAndLepekhin	0.23464	0.05781
20	Baseline	0.20722	0.08598
21	CLAC	0.19285	0.05653
22	UnedMediaBiasTeam	0.18304	0.09995
23	QUST	0.10048	0.08021

French - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.83547	0.88000
2	LazyDevs	0.77165	0.82000
3	QCRITeam	0.76744	0.80000
3	SinaaAI	0.76744	0.80000
4	vera	0.76502	0.82000
5	Hitachi	0.74359	0.78000
6	MELODI	0.74242	0.78000
7	DSHacker	0.71045	0.72000
8	Corgis	0.71043	0.76000
9	SharoffAndLepekhin	0.67138	0.78000
10	QUST	0.62145	0.70000
11	Baseline	0.56806	0.74000
12	UnedMediaBiasTeam	0.46536	0.48000
13	SATLab	0.44670	0.64000
14	Riga	0.35595	0.58000
15	JUSTR00	0.34683	0.66000
16	FramingFreaks	0.34074	0.66000
17	MaChAmp	0.28352	0.74000
18	E8IJS	0.08000	0.12000

French - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.57055	0.55956
2	MarsEclipse	0.55280	0.53681
3	ACCEPT	0.53827	0.50887
4	BERTastic	0.53691	0.52016
5	Hitachi	0.51408	0.48832
6	TeamAmpa	0.50558	0.47890
7	LazyDevs	0.50370	0.46545
8	TheSyllogist	0.48571	0.46156
9	QCRITeam	0.48031	0.43048
10	UMUTeam	0.47727	0.43820
11	SinaaAI	0.47232	0.44407
12	PolarIce	0.46886	0.42851
13	QUST	0.44670	0.43786
14	Riga	0.37615	0.28728
15	SATLab	0.37543	0.35232
16	MaChAmp	0.35873	0.35478
17	Baseline	0.32850	0.27633
18	FramingFreaks	0.32716	0.29980
19	SharoffAndLepekhin	0.25496	0.10481
20	DigDemLab	0.22047	0.19236

French - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.49699	0.32169
2	vera	0.49238	0.34815
3	RD	0.48212	0.29932
4	NAP	0.46869	0.32171
5	oalee	0.46401	0.28958
6	ReDASPersuasion	0.46311	0.26952
7	DSHacker	0.46249	0.25999
8	MarsEclipse	0.43601	0.25006
9	TeamAmpa	0.43442	0.30544
10	LazyDevs	0.43241	0.30594
11	QCRITeam	0.42566	0.27344
12	NLUBot101	0.39580	0.25431
13	ACS	0.39364	0.25458
14	APatt	0.38414	0.19125
15	kb	0.36246	0.26628
16	MaChAmp	0.34507	0.20676
17	SinaaAI	0.34364	0.11509
18	SATLab	0.33755	0.24115
19	Riga	0.30573	0.07785
20	SharoffAndLepekhin	0.29824	0.12642
21	Baseline	0.24014	0.09867
22	CLAC	0.23903	0.06575
23	UnedMediaBiasTeam	0.23590	0.12149
24	QUST	0.20905	0.16431

German - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.81951	0.82000
1	vera	0.81951	0.82000
2	DSHacker	0.81314	0.82000
3	LazyDevs	0.80884	0.82000
4	SinaaAI	0.78245	0.76000
5	Hitachi	0.77659	0.76000
6	MELODI	0.76986	0.78000
7	Corgis	0.76984	0.82000
8	SharoffAndLepekhin	0.71266	0.72000
9	HHU	0.69963	0.76000
10	QCRITeam	0.66653	0.66000
11	SATLab	0.64391	0.70000
12	Baseline	0.62963	0.76000
13	QUST	0.62598	0.66000
14	FramingFreaks	0.56937	0.70000
15	Riga	0.41225	0.48000
16	UnedMediaBiasTeam	0.36203	0.42000
17	VERITAS	0.33601	0.56000
18	JUSTR00	0.26506	0.66000
18	MaChAmp	0.26506	0.66000
19	E8IJS	0.11765	0.18000

German - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.71119	0.66045
2	vera	0.66163	0.60301
3	QCRITeam	0.66019	0.60557
4	SinaaAI	0.65038	0.54047
5	TeamAmpa	0.63223	0.57266
6	Hitachi	0.62913	0.56731
7	LazyDevs	0.62813	0.56523
8	PolarIce	0.62222	0.56438
9	QUST	0.61580	0.54507
10	UMUTeam	0.61378	0.56539
11	BERTastic	0.60331	0.56200
12	MaChAmp	0.58156	0.56358
13	ACCEPT	0.57447	0.48635
14	SATLab	0.57198	0.51872
15	SharoffAndLepekhin	0.55479	0.29877
16	FramingFreaks	0.54516	0.49578
17	TheSyllogist	0.53670	0.46495
18	Riga	0.50856	0.37454
19	Baseline	0.48707	0.41801
20	DigDemLab	0.33473	0.27949

German - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.54174	0.25994
2	KInIT	0.53086	0.26292
3	MarsEclipse	0.52962	0.24197
4	DSHacker	0.52006	0.21069
5	NAP	0.50953	0.27195
6	ReDASPersuasion	0.50750	0.21182
7	QCRITeam	0.50207	0.24889
8	oalee	0.49758	0.25192
9	TeamAmpa	0.48811	0.28106
10	RD	0.48525	0.20918
11	APatt	0.48375	0.17692
12	LazyDevs	0.47381	0.28406
13	ACS	0.46133	0.24149
14	SinaaAI	0.42923	0.14506
15	NLUBot101	0.42042	0.17879
16	MaChAmp	0.40497	0.17804
17	kb	0.37264	0.20109
18	Riga	0.37257	0.06000
19	SharoffAndLepekhin	0.36262	0.11044
20	SATLab	0.35523	0.16270
21	UnedMediaBiasTeam	0.31827	0.10617
22	Baseline	0.31667	0.08345
23	CLAC	0.24795	0.05514
24	QUST	0.15278	0.11244

Polish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.79798	0.87234
2	SharoffAndLepekhin	0.78551	0.93617
3	Hitachi	0.77922	0.87234
4	vera	0.76455	0.85106
5	LazyDevs	0.74747	0.87234
6	UMUTeam	0.66431	0.80851
7	SinaaAI	0.66349	0.80851
8	DSHacker	0.66125	0.80851
9	kb	0.65259	0.80851
10	SATLab	0.57081	0.82979
11	QCRITeam	0.57071	0.82979
12	Corgis	0.53680	0.76596
13	QUST	0.52778	0.59574
14	UnedMediaBiasTeam	0.50700	0.55319
15	Baseline	0.48962	0.82979
16	Riga	0.43312	0.46809
17	MaChAmp	0.28455	0.74468
18	FramingFreaks	0.28205	0.70213
19	E8IJS	0.06276	0.08511

Polish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.67314	0.63839
2	vera	0.66045	0.59105
3	QCRITeam	0.64193	0.59867
4	UMUTeam	0.64179	0.59312
5	SinaaAI	0.64000	0.57997
6	Hitachi	0.63396	0.58396
7	SATLab	0.62018	0.56987
8	TeamAmpa	0.61386	0.55541
9	LazyDevs	0.60679	0.55153
10	MaChAmp	0.59701	0.58239
11	PolarIce	0.59684	0.55454
12	Baseline	0.59381	0.53199
13	QUST	0.59084	0.53312
14	SharoffAndLepekhin	0.58795	0.51617
15	BERTastic	0.58696	0.53547
16	ACCEPT	0.58621	0.57220
17	FramingFreaks	0.55973	0.45995
18	TheSyllogist	0.55263	0.50080
19	Riga	0.54222	0.41239
20	DigDemLab	0.39163	0.34847

Polish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44964	0.20228
2	KInIT	0.43105	0.24194
3	NAP	0.42180	0.24577
4	TeamAmpa	0.41164	0.26631
5	DSHacker	0.40753	0.15872
6	MarsEclipse	0.40604	0.17569
7	RD	0.40457	0.19810
8	oalee	0.40296	0.19265
9	ReDASPersuasion	0.39677	0.16817
10	QCRITeam	0.38687	0.17241
11	LazyDevs	0.37598	0.18026
12	ACS	0.37195	0.23262
13	APatt	0.36570	0.14969
14	SinaaAI	0.35880	0.10318
15	SharoffAndLepekhin	0.32680	0.12161
16	NLUBot101	0.31970	0.16911
17	kb	0.31427	0.17940
18	MaChAmp	0.30746	0.17030
19	SATLab	0.30049	0.14286
20	UnedMediaBiasTeam	0.23652	0.10348
21	Riga	0.22774	0.03796
22	CLAC	0.19036	0.05024
23	Baseline	0.17928	0.05932
24	QUST	0.09707	0.07426

Spanish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	vera	0.73714	0.76667
2	HHU	0.57952	0.63333
3	DSHacker	0.56349	0.56667
4	QUST	0.55236	0.63333
5	MELODI	0.54815	0.60000
6	SinaaAI	0.53192	0.56667
7	LazyDevs	0.50688	0.66667
8	QCRITeam	0.48894	0.56667
9	UMUTeam	0.43750	0.50000
10	Corgis	0.42917	0.56667
11	SharoffAndLepekhin	0.40000	0.43333
12	Riga	0.38492	0.50000
13	UnedMediaBiasTeam	0.33614	0.36667
14	FramingFreaks	0.31746	0.46667
15	SATLab	0.28187	0.43333
16	E8IJS	0.23457	0.30000
17	MaChAmp	0.21212	0.46667
18	Baseline	0.15385	0.30000

Spanish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	PolarIce	0.57143	0.45491
2	UMUTeam	0.55844	0.46541
3	vera	0.55758	0.52425
4	SinaaAI	0.55484	0.44105
5	LazyDevs	0.52121	0.40641
6	TeamAmpa	0.50575	0.38650
7	MarsEclipse	0.49032	0.43161
8	Riga	0.48889	0.42605
9	QCRITeam	0.48780	0.38955
10	BERTastic	0.47664	0.42842
11	ACCEPT	0.47368	0.41159
12	TheSyllogist	0.47273	0.38734
13	MaChAmp	0.38519	0.26857
14	SATLab	0.38272	0.29311
15	QUST	0.37370	0.35266
16	SharoffAndLepekhin	0.26506	0.20117
17	FramingFreaks	0.21538	0.21132
18	Baseline	0.12000	0.09524

Spanish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.41067	0.21627
2	KInIT	0.39869	0.20301
3	oalee	0.39620	0.16316
4	RD	0.38587	0.19101
5	TeamAmpa	0.38106	0.24366
6	DSHacker	0.37605	0.16803
7	QCRITeam	0.37191	0.17515
8	NAP	0.36996	0.18065
9	LazyDevs	0.35595	0.20097
10	ACS	0.31730	0.13934
11	NLUBot101	0.30459	0.15092
12	SinaaAI	0.30169	0.13920
13	SharoffAndLepekhin	0.28149	0.07445
14	MaChAmp	0.27595	0.13891
15	CLAC	0.26667	0.04755
16	Baseline	0.24843	0.02007
17	kb	0.24490	0.14257
18	UnedMediaBiasTeam	0.22686	0.07799
19	Riga	0.19895	0.04520
20	SATLab	0.19304	0.05708
21	QUST	0.12617	0.09923

Greek - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.82660	0.82813
2	vera	0.81673	0.84375
3	UMUTeam	0.76700	0.79688
4	Corgis	0.76667	0.78125
4	LazyDevs	0.76667	0.78125
5	HHU	0.75039	0.75000
6	MELODI	0.71042	0.79688
7	QCRITeam	0.70815	0.81250
8	SharoffAndLepekhin	0.69765	0.76563
9	DSHacker	0.59346	0.64063
10	UnedMediaBiasTeam	0.52128	0.56250
11	QUST	0.49159	0.60938
12	Riga	0.41176	0.57813
13	SATLab	0.25356	0.40625
14	MaChAmp	0.25243	0.60938
15	FramingFreaks	0.23403	0.34375
16	Baseline	0.17054	0.34375
17	E8IJS	0.05670	0.06250

Greek - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.58000	0.48659
2	MarsEclipse	0.54507	0.44404
3	TeamAmpa	0.54408	0.44372
4	SinaaAI	0.53740	0.44874
5	UMUTeam	0.53409	0.40360
6	TheSyllogist	0.52987	0.44048
7	BERTastic	0.52584	0.44396
8	QCRITeam	0.51852	0.39952
9	PolarIce	0.51629	0.40953
10	LazyDevs	0.48696	0.38401
11	ACCEPT	0.45536	0.41098
12	QUST	0.41357	0.39198
13	FramingFreaks	0.38020	0.15432
14	Riga	0.37692	0.19532
15	Baseline	0.34538	0.05741
16	MaChAmp	0.29279	0.20575
17	SATLab	0.06829	0.03730

Greek - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.28325	0.15598
2	KInIT	0.27928	0.16332
3	DSHacker	0.27827	0.13809
4	QCRITeam	0.27261	0.15614
5	NAP	0.25803	0.16394
6	LazyDevs	0.25440	0.19551
7	TeamAmpa	0.24098	0.19388
8	ACS	0.23529	0.09411
9	RD	0.23494	0.13415
10	SinaaAI	0.23422	0.06936
11	MaChAmp	0.21465	0.12929
12	oalee	0.20398	0.04842
13	Riga	0.16391	0.03632
14	CLAC	0.15630	0.05507
15	NLUBot101	0.15034	0.09653
16	kb	0.15021	0.12095
17	UnedMediaBiasTeam	0.10566	0.02569
18	Baseline	0.08831	0.00606
19	QUST	0.05720	0.04650
20	SATLab	0.00000	0.00000

Georgian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Riga	1.00000	1.00000
2	vera	0.96268	0.96552
3	Corgis	0.92677	0.93103
4	SharoffAndLepekhin	0.88803	0.89655
5	LazyDevs	0.87518	0.89655
6	SinaaAI	0.85784	0.86207
7	MELODI	0.78676	0.79310
8	QCRITeam	0.62210	0.89655
9	DSHacker	0.59715	0.86207
10	UMUTeam	0.58201	0.86207
11	QUST	0.53656	0.68966
12	SATLab	0.51852	0.72414
13	UnedMediaBiasTeam	0.48630	0.68966
14	MaChAmp	0.39583	0.65517
15	Baseline	0.25641	0.34483
16	FramingFreaks	0.25532	0.62069
17	E8IJS	0.00000	0.00000

Georgian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.65421	0.67891
2	MarsEclipse	0.64516	0.63927
3	SinaaAI	0.62963	0.51423
4	TheSyllogist	0.56140	0.49288
5	BERTastic	0.55172	0.40820
6	UMUTeam	0.52941	0.41064
7	QCRITeam	0.51685	0.45724
8	TeamAmpa	0.51667	0.37879
9	LazyDevs	0.49541	0.39488
10	Riga	0.42353	0.38095
11	PolarIce	0.40404	0.38393
12	FramingFreaks	0.35233	0.34399
13	MaChAmp	0.31250	0.22533
14	QUST	0.31076	0.26028
15	Baseline	0.25974	0.25092
16	ACCEPT	0.22581	0.27972
17	SATLab	0.05333	0.18367

Georgian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.46023	0.37995
2	vera	0.45483	0.29014
3	RD	0.44444	0.30560
4	SinaaAI	0.43243	0.22689
5	DSHacker	0.42657	0.29866
6	QCRITeam	0.42368	0.29951
7	NAP	0.41261	0.30615
8	TeamAmpa	0.40816	0.25854
9	LazyDevs	0.38434	0.28702
10	Riga	0.36190	0.20869
11	oalee	0.35032	0.23003
12	ACS	0.33544	0.24818
13	MaChAmp	0.30100	0.22056
14	CLAC	0.27053	0.19930
15	NLUBot101	0.25362	0.17235
16	UnedMediaBiasTeam	0.18012	0.22096
17	kb	0.15017	0.09988
18	Baseline	0.13793	0.14083
19	QUST	0.09088	0.11504
20	SATLab	0.07568	0.15786

Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval2023 shared task on "Detecting the Category, the Framing, and the Persuasion Techniques in Online News in a Multi-lingual Setup"

Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Italian - Subtask 1

Italian - Subtask 2

Italian - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

French - Subtask 1

French - Subtask 2

French - Subtask 3

German - Subtask 1

German - Subtask 2

German - Subtask 3

Polish - Subtask 1

Polish - Subtask 2

Polish - Subtask 3

Spanish - Subtask 1

Spanish - Subtask 2

Spanish - Subtask 3

Greek - Subtask 1

Greek - Subtask 2

Greek - Subtask 3

Georgian - Subtask 1

Georgian - Subtask 2

Georgian - Subtask 3

Contact