Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.78431	0.81481
2	LazyDevs	0.70823	0.66667
3	vera	0.67187	0.74074
4	MLModeler5	0.66077	0.70370
5	HHU	0.59423	0.61111
6	DSHacker	0.59085	0.62963
7	Unisa	0.58621	0.61111
8	Hitachi	0.55288	0.59259
9	UnedMediaBiasTeam	0.52361	0.57407
10	SinaaAI	0.50641	0.66667
11	QUST	0.50613	0.62963
12	Corgis	0.49091	0.61111
13	UMUTeam	0.41338	0.59259
14	UM6P	0.39351	0.51852
15	Riga	0.34902	0.53704
16	SharoffAndLepekhin	0.32887	0.46296
17	kb	0.29929	0.57407
18	Baseline	0.28802	0.61111
18	yyjc	0.28802	0.61111
19	QCRITeam	0.28112	0.59259
20	Spoke	0.26452	0.44444
21	JUSTR00	0.25657	0.37037
22	FramingFreaks	0.24806	0.59259
22	MaChAmp	0.24806	0.59259
22	ssnNlp	0.24806	0.59259
23	SATLab	0.24314	0.57407
23	UTBNLP	0.24314	0.57407
24	E8IJS	0.07477	0.09259
25	ACS	0.00000	0.00000
25	DB	0.00000	0.00000
25	Elyas	0.00000	0.00000
25	HunterSpeech	0.00000	0.00000
25	IA2022Grupa1	0.00000	0.00000
25	NLUBot101	0.00000	0.00000
25	ReDASPersuasion	0.00000	0.00000
25	krasavchiki	0.00000	0.00000

English - Subtask 2

Rank	Team	F1 micro	F1 macro
1	ACCEPT	0.60481	0.57427
2	MarsEclipse	0.59216	0.50503
3	vera	0.58475	0.53420
4	TeamAmpa	0.56696	0.50961
5	LazyDevs	0.54664	0.46307
6	Hitachi	0.54257	0.47158
7	PolarIce	0.53533	0.48173
8	Lubov	0.52954	0.45752
9	TAHafidz	0.52830	0.46807
10	QUST	0.51311	0.46213
11	QCRITeam	0.51306	0.41900
12	BERTastic	0.51232	0.44615
13	UMUTeam	0.50831	0.41521
14	SinaaAI	0.50627	0.40819
15	MaChAmp	0.50593	0.49293
16	Corgis	0.49652	0.41792
17	TheSyllogist	0.48718	0.40940
18	MLModeler5	0.47692	0.42724
19	SharoffAndLepekhin	0.45340	0.36166
20	JUSTR00	0.44298	0.36309
21	Riga	0.42049	0.31287
22	SATLab	0.37762	0.31681
23	Baseline	0.34987	0.27418
24	UTBNLP	0.34112	0.30908
25	IA2022Grupa1	0.32609	0.26519
26	DigDemLab	0.20741	0.17248
27	FramingFreaks	0.19632	0.14162

English - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44937	0.21698
2	Elyas	0.41334	0.17051
3	oalee	0.41206	0.18622
4	RD	0.41158	0.15525
5	KInIT	0.40515	0.17044
6	VictorVectors	0.40457	0.21626
7	DB	0.39463	0.21696
8	DSHacker	0.39029	0.15887
9	REHonoursProject	0.38658	0.16035
10	ACS	0.38628	0.17360
11	NAP	0.38148	0.17247
12	APatt	0.37562	0.12919
13	ReDASPersuasion	0.36553	0.09843
14	QCRITeam	0.36490	0.19847
15	NLUBot101	0.36058	0.19722
16	TeamAmpa	0.35951	0.18471
17	SharoffAndLepekhin	0.34637	0.08765
18	NL4IA	0.34280	0.15206
19	SinaaAI	0.33112	0.14294
20	MarsEclipse	0.32998	0.10620
21	LazyDevs	0.31520	0.15681
22	CLAC	0.30933	0.07122
23	HunterSpeech	0.30653	0.13112
24	kb	0.30113	0.08047
25	Unisa	0.29758	0.10871
26	MaChAmp	0.29476	0.14940
27	Riga	0.28045	0.06163
28	Baseline	0.27838	0.17677
29	Corgis	0.26897	0.11346
30	SATLab	0.25887	0.10291
31	newspeak	0.25000	0.13776
32	UnedMediaBiasTeam	0.24070	0.07846
33	IA2022Grupa1	0.19275	0.07204
34	QUST	0.13501	0.10315

Italian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.78299	0.83607
2	Hitachi	0.76832	0.85246
3	QUST	0.76680	0.83607
4	vera	0.73711	0.81967
5	DSHacker	0.72040	0.83607
6	LazyDevs	0.62862	0.80328
7	Corgis	0.61594	0.77049
8	MELODI	0.58668	0.75410
9	UnedMediaBiasTeam	0.58408	0.62295
10	UMUTeam	0.55338	0.75410
11	QCRITeam	0.54105	0.78689
12	SharoffAndLepekhin	0.51715	0.75410
13	HHU	0.45515	0.63934
14	Riga	0.43598	0.57377
15	Baseline	0.38940	0.67213
16	FramingFreaks	0.35965	0.65574
17	SATLab	0.31930	0.62295
18	JUSTR00	0.31664	0.57377
19	MaChAmp	0.26797	0.67213
20	E8IJS	0.12146	0.16393

Italian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.61728	0.54457
2	vera	0.61678	0.52700
3	SinaaAI	0.60621	0.48381
4	QCRITeam	0.59906	0.47949
5	Hitachi	0.59775	0.51510
6	TeamAmpa	0.59674	0.48268
7	LazyDevs	0.59000	0.48661
8	PolarIce	0.58411	0.46877
9	UMUTeam	0.57627	0.44666
10	TAHafidz	0.56327	0.48098
11	ACCEPT	0.55963	0.47628
12	TheSyllogist	0.55392	0.44434
13	BERTastic	0.54500	0.46933
14	Corgis	0.52742	0.41503
15	QUST	0.50228	0.46512
16	Riga	0.49861	0.32123
17	Baseline	0.48564	0.37243
18	SATLab	0.47404	0.41571
19	SharoffAndLepekhin	0.45868	0.22671
20	FramingFreaks	0.45161	0.35456
21	MaChAmp	0.42435	0.40302
22	DigDemLab	0.23697	0.17307

Italian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.59919	0.28122
2	RD	0.58824	0.26757
3	KInIT	0.58544	0.28580
4	oalee	0.57122	0.27299
5	VictorVectors	0.56647	0.38071
6	ReDASPersuasion	0.56486	0.17531
7	DSHacker	0.56480	0.23300
8	MarsEclipse	0.54888	0.23192
9	NAP	0.53879	0.26609
10	TeamAmpa	0.52597	0.27214
11	QCRITeam	0.51661	0.24156
12	SharoffAndLepekhin	0.51582	0.17610
13	LazyDevs	0.50129	0.27529
14	SinaaAI	0.48048	0.17531
15	ACS	0.48011	0.22103
16	Corgis	0.44232	0.16303
17	APatt	0.44094	0.16626
18	Riga	0.43613	0.09191
19	NLUBot101	0.43506	0.16371
20	SATLab	0.43282	0.18267
21	MaChAmp	0.42154	0.16582
22	kb	0.39874	0.20056
23	Baseline	0.39719	0.12152
24	UnedMediaBiasTeam	0.31717	0.11126
25	CLAC	0.31310	0.06333
26	QUST	0.21253	0.15497

Russian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Hitachi	0.75494	0.75000
2	vera	0.72871	0.72222
3	MELODI	0.70577	0.69444
4	LazyDevs	0.69841	0.76389
5	Corgis	0.68216	0.69444
6	SharoffAndLepekhin	0.66797	0.69444
7	SinaaAI	0.65539	0.69444
8	UMUTeam	0.64543	0.68056
9	QCRITeam	0.56659	0.65278
10	DSHacker	0.55886	0.59722
11	Spoke	0.48969	0.65278
12	QUST	0.47200	0.51389
13	HHU	0.42571	0.47222
14	Baseline	0.39831	0.65278
15	UnedMediaBiasTeam	0.36457	0.44444
16	Riga	0.27095	0.38889
17	MaChAmp	0.25641	0.62500
18	FramingFreaks	0.23595	0.31944
19	E8IJS	0.17460	0.30556

Russian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.48148	0.35458
2	LazyDevs	0.47222	0.30851
3	SinaaAI	0.45662	0.41115
4	MarsEclipse	0.44976	0.30333
5	QCRITeam	0.43386	0.36428
6	PolarIce	0.42051	0.25792
7	Lubov	0.41706	0.35507
8	TAHafidz	0.41176	0.30595
9	TeamAmpa	0.40930	0.29380
10	Corgis	0.39614	0.24621
11	BERTastic	0.39269	0.26521
12	TheSyllogist	0.38494	0.28990
13	UMUTeam	0.38488	0.28836
14	Hitachi	0.37000	0.32593
15	ACCEPT	0.33155	0.31283
16	Riga	0.31515	0.22189
17	QUST	0.25000	0.21290
18	Baseline	0.22951	0.21774
19	FramingFreaks	0.21927	0.15917
20	SharoffAndLepekhin	0.19763	0.11732
21	MaChAmp	0.16058	0.15120
22	DigDemLab	0.07035	0.05495

Russian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	VictorVectors	0.43346	0.30012
2	KInIT	0.43343	0.24205
3	vera	0.42635	0.25979
4	RD	0.41816	0.21281
5	MarsEclipse	0.39550	0.22110
6	DSHacker	0.38588	0.20209
7	oalee	0.38246	0.23232
8	TeamAmpa	0.37781	0.22740
9	QCRITeam	0.36828	0.21594
10	LazyDevs	0.36068	0.21271
11	ReDASPersuasion	0.35965	0.15988
12	ACS	0.33136	0.18251
13	NAP	0.32841	0.15809
14	NLUBot101	0.32298	0.20052
15	SinaaAI	0.31738	0.16636
16	APatt	0.30602	0.11666
17	MaChAmp	0.27110	0.14842
18	Corgis	0.27043	0.12057
19	kb	0.25289	0.11653
20	Riga	0.25158	0.06441
21	SharoffAndLepekhin	0.23464	0.05781
22	Baseline	0.20722	0.08598
23	CLAC	0.19285	0.05653
24	UnedMediaBiasTeam	0.18304	0.09995
25	QUST	0.10048	0.08021

French - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.83547	0.88000
2	LazyDevs	0.77165	0.82000
3	QCRITeam	0.76744	0.80000
3	SinaaAI	0.76744	0.80000
4	vera	0.76502	0.82000
5	Hitachi	0.74359	0.78000
6	MELODI	0.74242	0.78000
7	DSHacker	0.71045	0.72000
8	Corgis	0.71043	0.76000
9	SharoffAndLepekhin	0.67138	0.78000
10	QUST	0.62145	0.70000
11	Baseline	0.56806	0.74000
12	UnedMediaBiasTeam	0.46536	0.48000
13	SATLab	0.44670	0.64000
14	Riga	0.35595	0.58000
15	JUSTR00	0.34683	0.66000
16	FramingFreaks	0.34074	0.66000
17	MaChAmp	0.28352	0.74000
18	E8IJS	0.08000	0.12000

French - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.57055	0.55956
2	MarsEclipse	0.55280	0.53681
3	ACCEPT	0.53827	0.50887
4	TAHafidz	0.53722	0.52753
5	BERTastic	0.53691	0.52016
6	LazyDevs	0.52113	0.48263
7	Hitachi	0.51408	0.48832
8	TeamAmpa	0.50558	0.47890
9	Corgis	0.48689	0.45575
10	TheSyllogist	0.48571	0.46156
11	QCRITeam	0.48031	0.43048
12	UMUTeam	0.47727	0.43820
13	SinaaAI	0.47232	0.44407
14	PolarIce	0.46886	0.42851
15	QUST	0.44670	0.43786
16	Riga	0.37615	0.28728
17	SATLab	0.37543	0.35232
18	MaChAmp	0.35873	0.35478
19	Baseline	0.32850	0.27633
20	FramingFreaks	0.32716	0.29980
21	SharoffAndLepekhin	0.25496	0.10481
22	DigDemLab	0.22047	0.19236

French - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.49699	0.32169
2	vera	0.49238	0.34815
3	VictorVectors	0.49128	0.38785
4	RD	0.48212	0.29932
5	NAP	0.46869	0.32171
6	oalee	0.46401	0.28958
7	ReDASPersuasion	0.46311	0.26952
8	DSHacker	0.46249	0.25999
9	MarsEclipse	0.43601	0.25006
10	TeamAmpa	0.43442	0.30544
11	LazyDevs	0.43241	0.30594
12	QCRITeam	0.42566	0.27344
13	NLUBot101	0.39580	0.25431
14	ACS	0.39364	0.25458
15	APatt	0.38414	0.19125
16	kb	0.36246	0.26628
17	MaChAmp	0.34507	0.20676
18	SinaaAI	0.34364	0.11509
19	SATLab	0.33755	0.24115
20	Corgis	0.33534	0.13848
21	Riga	0.30573	0.07785
22	SharoffAndLepekhin	0.29824	0.12642
23	Baseline	0.24014	0.09867
24	CLAC	0.23903	0.06575
25	UnedMediaBiasTeam	0.23590	0.12149
26	QUST	0.20905	0.16431

German - Subtask 1

Rank	Team	F1 macro	F1 micro
1	LazyDevs	0.83354	0.86000
2	UMUTeam	0.81951	0.82000
2	vera	0.81951	0.82000
3	DSHacker	0.81314	0.82000
4	SinaaAI	0.78245	0.76000
5	Hitachi	0.77659	0.76000
6	MELODI	0.76986	0.78000
7	Corgis	0.76984	0.82000
8	SharoffAndLepekhin	0.71266	0.72000
9	HHU	0.69963	0.76000
10	QCRITeam	0.66653	0.66000
11	SATLab	0.64391	0.70000
12	Baseline	0.62963	0.76000
13	QUST	0.62598	0.66000
14	FramingFreaks	0.56937	0.70000
15	Riga	0.41225	0.48000
16	UnedMediaBiasTeam	0.36203	0.42000
17	VERITAS	0.33601	0.56000
18	JUSTR00	0.26506	0.66000
18	MaChAmp	0.26506	0.66000
19	E8IJS	0.11765	0.18000

German - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.71119	0.66045
2	vera	0.66163	0.60301
3	QCRITeam	0.66019	0.60557
4	SinaaAI	0.65038	0.54047
5	LazyDevs	0.64766	0.59355
6	TeamAmpa	0.63223	0.57266
7	Hitachi	0.62913	0.56731
8	PolarIce	0.62222	0.56438
9	QUST	0.61580	0.54507
10	UMUTeam	0.61378	0.56539
11	BERTastic	0.60331	0.56200
12	Corgis	0.59414	0.52013
13	TAHafidz	0.58869	0.55346
14	MaChAmp	0.58156	0.56358
15	ACCEPT	0.57447	0.48635
16	SATLab	0.57198	0.51872
17	SharoffAndLepekhin	0.55479	0.29877
18	FramingFreaks	0.54516	0.49578
19	TheSyllogist	0.53670	0.46495
20	Riga	0.50856	0.37454
21	Baseline	0.48707	0.41801
22	DigDemLab	0.33473	0.27949

German - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.54174	0.25994
2	KInIT	0.53086	0.26292
3	MarsEclipse	0.52962	0.24197
4	DSHacker	0.52006	0.21069
5	NAP	0.50953	0.27195
6	VictorVectors	0.50801	0.32933
7	ReDASPersuasion	0.50750	0.21182
8	QCRITeam	0.50207	0.24889
9	oalee	0.49758	0.25192
10	TeamAmpa	0.48811	0.28106
11	RD	0.48525	0.20918
12	APatt	0.48375	0.17692
13	LazyDevs	0.47381	0.28406
14	Corgis	0.46631	0.15917
15	ACS	0.46133	0.24149
16	SinaaAI	0.42923	0.14506
17	NLUBot101	0.42042	0.17879
18	MaChAmp	0.40497	0.17804
19	kb	0.37264	0.20109
20	Riga	0.37257	0.06000
21	SharoffAndLepekhin	0.36262	0.11044
22	SATLab	0.35523	0.16270
23	UnedMediaBiasTeam	0.31827	0.10617
24	Baseline	0.31667	0.08345
25	CLAC	0.24795	0.05514
26	QUST	0.15278	0.11244

Polish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.79798	0.87234
2	SharoffAndLepekhin	0.78551	0.93617
3	Hitachi	0.77922	0.87234
4	vera	0.76455	0.85106
5	LazyDevs	0.75282	0.85106
6	UMUTeam	0.66431	0.80851
7	SinaaAI	0.66349	0.80851
8	DSHacker	0.66125	0.80851
9	kb	0.65259	0.80851
10	SATLab	0.57081	0.82979
11	QCRITeam	0.57071	0.82979
12	Corgis	0.53680	0.76596
13	QUST	0.52778	0.59574
14	UnedMediaBiasTeam	0.50700	0.55319
15	Baseline	0.48962	0.82979
16	Riga	0.43312	0.46809
17	MaChAmp	0.28455	0.74468
18	FramingFreaks	0.28205	0.70213
19	E8IJS	0.06276	0.08511

Polish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.67314	0.63839
2	vera	0.66045	0.59105
3	QCRITeam	0.64193	0.59867
4	UMUTeam	0.64179	0.59312
5	TAHafidz	0.64177	0.60038
6	SinaaAI	0.64000	0.57997
7	Hitachi	0.63396	0.58396
8	LazyDevs	0.62664	0.56641
9	SATLab	0.62018	0.56987
10	Corgis	0.61933	0.56553
11	TeamAmpa	0.61386	0.55541
12	MaChAmp	0.59701	0.58239
13	PolarIce	0.59684	0.55454
14	Baseline	0.59381	0.53199
15	QUST	0.59084	0.53312
16	SharoffAndLepekhin	0.58795	0.51617
17	BERTastic	0.58696	0.53547
18	ACCEPT	0.58621	0.57220
19	FramingFreaks	0.55973	0.45995
20	TheSyllogist	0.55263	0.50080
21	Riga	0.54222	0.41239
22	DigDemLab	0.39163	0.34847

Polish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44964	0.20228
2	VictorVectors	0.43766	0.29285
3	KInIT	0.43105	0.24194
4	NAP	0.42180	0.24577
5	TeamAmpa	0.41164	0.26631
6	DSHacker	0.40753	0.15872
7	MarsEclipse	0.40604	0.17569
8	RD	0.40457	0.19810
9	oalee	0.40296	0.19265
10	ReDASPersuasion	0.39677	0.16817
11	QCRITeam	0.38687	0.17241
12	LazyDevs	0.37598	0.18026
13	ACS	0.37195	0.23262
14	APatt	0.36570	0.14969
15	SinaaAI	0.35880	0.10318
16	SharoffAndLepekhin	0.32680	0.12161
17	NLUBot101	0.31970	0.16911
18	kb	0.31427	0.17940
19	MaChAmp	0.30746	0.17030
20	SATLab	0.30049	0.14286
21	Corgis	0.29576	0.12149
22	UnedMediaBiasTeam	0.23652	0.10348
23	Riga	0.22774	0.03796
24	CLAC	0.19036	0.05024
25	Baseline	0.17928	0.05932
26	QUST	0.09707	0.07426

Spanish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	vera	0.73714	0.76667
2	HHU	0.57952	0.63333
3	LazyDevs	0.57037	0.60000
4	DSHacker	0.56349	0.56667
5	QUST	0.55236	0.63333
6	MELODI	0.54815	0.60000
7	SinaaAI	0.53192	0.56667
8	QCRITeam	0.48894	0.56667
9	UMUTeam	0.43750	0.50000
10	Corgis	0.42917	0.56667
11	SharoffAndLepekhin	0.40000	0.43333
12	Riga	0.38492	0.50000
13	UnedMediaBiasTeam	0.33614	0.36667
14	FramingFreaks	0.31746	0.46667
15	SATLab	0.28187	0.43333
16	E8IJS	0.23457	0.30000
17	MaChAmp	0.21212	0.46667
18	Baseline	0.15385	0.30000

Spanish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	PolarIce	0.57143	0.45491
2	UMUTeam	0.55844	0.46541
3	vera	0.55758	0.52425
4	SinaaAI	0.55484	0.44105
5	LazyDevs	0.53503	0.39573
6	TeamAmpa	0.50575	0.38650
7	MarsEclipse	0.49032	0.43161
8	Riga	0.48889	0.42605
9	QCRITeam	0.48780	0.38955
10	BERTastic	0.47664	0.42842
11	ACCEPT	0.47368	0.41159
12	TheSyllogist	0.47273	0.38734
13	Corgis	0.46341	0.35854
14	MaChAmp	0.38519	0.26857
15	SATLab	0.38272	0.29311
16	QUST	0.37370	0.35266
17	SharoffAndLepekhin	0.26506	0.20117
18	FramingFreaks	0.21538	0.21132
19	Baseline	0.12000	0.09524

Spanish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.41067	0.21627
2	VictorVectors	0.40953	0.26331
3	KInIT	0.39869	0.20301
4	oalee	0.39620	0.16316
5	RD	0.38587	0.19101
6	TeamAmpa	0.38106	0.24366
7	DSHacker	0.37605	0.16803
8	QCRITeam	0.37191	0.17515
9	NAP	0.36996	0.18065
10	LazyDevs	0.35595	0.20097
11	ACS	0.31730	0.13934
12	NLUBot101	0.30459	0.15092
13	SinaaAI	0.30169	0.13920
14	SharoffAndLepekhin	0.28149	0.07445
15	MaChAmp	0.27595	0.13891
16	CLAC	0.26667	0.04755
17	Baseline	0.24843	0.02007
18	kb	0.24490	0.14257
19	UnedMediaBiasTeam	0.22686	0.07799
20	Corgis	0.20415	0.06712
21	Riga	0.19895	0.04520
22	SATLab	0.19304	0.05708
23	QUST	0.12617	0.09923

Greek - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.82660	0.82813
2	vera	0.81673	0.84375
3	LazyDevs	0.77744	0.82813
4	UMUTeam	0.76700	0.79688
5	Corgis	0.76667	0.78125
6	HHU	0.75039	0.75000
7	MELODI	0.71042	0.79688
8	QCRITeam	0.70815	0.81250
9	SharoffAndLepekhin	0.69765	0.76563
10	DSHacker	0.59346	0.64063
11	UnedMediaBiasTeam	0.52128	0.56250
12	QUST	0.49159	0.60938
13	Riga	0.41176	0.57813
14	SATLab	0.25356	0.40625
15	MaChAmp	0.25243	0.60938
16	FramingFreaks	0.23403	0.34375
17	Baseline	0.17054	0.34375
18	E8IJS	0.05670	0.06250

Greek - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.58000	0.48659
2	LazyDevs	0.56383	0.45829
3	MarsEclipse	0.54507	0.44404
4	TeamAmpa	0.54408	0.44372
5	SinaaAI	0.53740	0.44874
6	UMUTeam	0.53409	0.40360
7	TheSyllogist	0.52987	0.44048
8	BERTastic	0.52584	0.44396
9	QCRITeam	0.51852	0.39952
10	PolarIce	0.51629	0.40953
11	Corgis	0.49330	0.36297
12	ACCEPT	0.45536	0.41098
13	QUST	0.41357	0.39198
14	FramingFreaks	0.38020	0.15432
15	Riga	0.37692	0.19532
16	Baseline	0.34538	0.05741
17	MaChAmp	0.29279	0.20575
18	SATLab	0.06829	0.03730

Greek - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.28325	0.15598
2	VictorVectors	0.28121	0.22022
3	KInIT	0.27928	0.16332
4	DSHacker	0.27827	0.13809
5	QCRITeam	0.27261	0.15614
6	NAP	0.25803	0.16394
7	LazyDevs	0.25440	0.19551
8	TeamAmpa	0.24098	0.19388
9	ACS	0.23529	0.09411
10	RD	0.23494	0.13415
11	SinaaAI	0.23422	0.06936
12	MaChAmp	0.21465	0.12929
13	Corgis	0.20460	0.09206
14	oalee	0.20398	0.04842
15	Riga	0.16391	0.03632
16	CLAC	0.15630	0.05507
17	NLUBot101	0.15034	0.09653
18	kb	0.15021	0.12095
19	UnedMediaBiasTeam	0.10566	0.02569
20	Baseline	0.08831	0.00606
21	QUST	0.05720	0.04650
22	SATLab	0.00000	0.00000

Georgian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Riga	1.00000	1.00000
2	vera	0.96268	0.96552
3	Corgis	0.92677	0.93103
4	SharoffAndLepekhin	0.88803	0.89655
5	LazyDevs	0.87518	0.89655
6	SinaaAI	0.85784	0.86207
7	MELODI	0.78676	0.79310
8	QCRITeam	0.62210	0.89655
9	DSHacker	0.59715	0.86207
10	UMUTeam	0.58201	0.86207
11	QUST	0.53656	0.68966
12	SATLab	0.51852	0.72414
13	UnedMediaBiasTeam	0.48630	0.68966
14	MaChAmp	0.39583	0.65517
15	Baseline	0.25641	0.34483
16	FramingFreaks	0.25532	0.62069
17	E8IJS	0.00000	0.00000

Georgian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.65421	0.67891
2	MarsEclipse	0.64516	0.63927
3	SinaaAI	0.62963	0.51423
4	LazyDevs	0.57627	0.39465
5	TheSyllogist	0.56140	0.49288
6	Corgis	0.55856	0.35779
7	BERTastic	0.55172	0.40820
8	UMUTeam	0.52941	0.41064
9	QCRITeam	0.51685	0.45724
10	TeamAmpa	0.51667	0.37879
11	Riga	0.42353	0.38095
12	PolarIce	0.40404	0.38393
13	FramingFreaks	0.35233	0.34399
14	MaChAmp	0.31250	0.22533
15	QUST	0.31076	0.26028
16	Baseline	0.25974	0.25092
17	ACCEPT	0.22581	0.27972
18	SATLab	0.05333	0.18367

Georgian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.46023	0.37995
2	VictorVectors	0.45652	0.32827
3	vera	0.45483	0.29014
4	RD	0.44444	0.30560
5	SinaaAI	0.43243	0.22689
6	DSHacker	0.42657	0.29866
7	QCRITeam	0.42368	0.29951
8	NAP	0.41261	0.30615
9	TeamAmpa	0.40816	0.25854
10	LazyDevs	0.38434	0.28702
11	Riga	0.36190	0.20869
12	oalee	0.35032	0.23003
13	ACS	0.33544	0.24818
14	MaChAmp	0.30100	0.22056
15	CLAC	0.27053	0.19930
16	NLUBot101	0.25362	0.17235
17	Corgis	0.24167	0.23819
18	UnedMediaBiasTeam	0.18012	0.22096
19	kb	0.15017	0.09988
20	Baseline	0.13793	0.14083
21	QUST	0.09088	0.11504
22	SATLab	0.07568	0.15786

Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval2023 shared task on "Detecting the Category, the Framing, and the Persuasion Techniques in Online News in a Multi-lingual Setup"

Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Italian - Subtask 1

Italian - Subtask 2

Italian - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

French - Subtask 1

French - Subtask 2

French - Subtask 3

German - Subtask 1

German - Subtask 2

German - Subtask 3

Polish - Subtask 1

Polish - Subtask 2

Polish - Subtask 3

Spanish - Subtask 1

Spanish - Subtask 2

Spanish - Subtask 3

Greek - Subtask 1

Greek - Subtask 2

Greek - Subtask 3

Georgian - Subtask 1

Georgian - Subtask 2

Georgian - Subtask 3

Contact