Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.78431	0.81481
2	LazyDevs	0.70823	0.66667
3	vera	0.67187	0.74074
4	MLModeler5	0.66077	0.70370
5	HHU	0.59423	0.61111
6	DSHacker	0.59085	0.62963
7	Unisa	0.58621	0.61111
8	Hitachi	0.55288	0.59259
9	UnedMediaBiasTeam	0.52361	0.57407
10	SinaaAI	0.50641	0.66667
11	QUST	0.50613	0.62963
12	Corgis	0.49091	0.61111
13	UMUTeam	0.41338	0.59259
14	UM6P	0.39351	0.51852
15	Riga	0.34902	0.53704
16	SharoffAndLepekhin	0.32887	0.46296
17	kb	0.29929	0.57407
18	Baseline	0.28802	0.61111
18	yyjc	0.28802	0.61111
19	QCRITeam	0.28112	0.59259
20	Spoke	0.26452	0.44444
21	JUSTR00	0.25657	0.37037
22	FramingFreaks	0.24806	0.59259
22	MaChAmp	0.24806	0.59259
22	ssnNlp	0.24806	0.59259
23	SATLab	0.24314	0.57407
23	UTBNLP	0.24314	0.57407
24	E8IJS	0.07477	0.09259
25	ACS	0.00000	0.00000
25	DB	0.00000	0.00000
25	Elyas	0.00000	0.00000
25	IA2022Grupa1	0.00000	0.00000
25	NLUBot101	0.00000	0.00000
25	ReDASPersuasion	0.00000	0.00000
25	krasavchiki	0.00000	0.00000

English - Subtask 2

Rank	Team	F1 micro	F1 macro
1	ACCEPT	0.60481	0.57427
2	MarsEclipse	0.59216	0.50503
3	vera	0.58475	0.53420
4	TeamAmpa	0.56696	0.50961
5	LazyDevs	0.54664	0.46307
6	Hitachi	0.54257	0.47158
7	PolarIce	0.53533	0.48173
8	Lubov	0.52954	0.45752
9	QUST	0.51311	0.46213
10	QCRITeam	0.51306	0.41900
11	BERTastic	0.51232	0.44615
12	UMUTeam	0.50831	0.41521
13	SinaaAI	0.50627	0.40819
14	MaChAmp	0.50593	0.49293
15	Corgis	0.49652	0.41792
16	TheSyllogist	0.48718	0.40940
17	MLModeler5	0.47692	0.42724
18	SharoffAndLepekhin	0.45340	0.36166
19	JUSTR00	0.44298	0.36309
20	Riga	0.42049	0.31287
21	SATLab	0.37762	0.31681
22	Baseline	0.34987	0.27418
23	UTBNLP	0.34112	0.30908
24	IA2022Grupa1	0.32609	0.26519
25	DigDemLab	0.20741	0.17248
26	FramingFreaks	0.19632	0.14162

English - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44937	0.21698
2	Elyas	0.41334	0.17051
3	oalee	0.41206	0.18622
4	RD	0.41158	0.15525
5	KInIT	0.40515	0.17044
6	DB	0.39463	0.21696
7	DSHacker	0.39029	0.15887
8	REHonoursProject	0.38658	0.16035
9	ACS	0.38628	0.17360
10	NAP	0.38148	0.17247
11	APatt	0.37562	0.12919
12	ReDASPersuasion	0.36553	0.09843
13	QCRITeam	0.36490	0.19847
14	NLUBot101	0.36058	0.19722
15	TeamAmpa	0.35951	0.18471
16	SharoffAndLepekhin	0.34637	0.08765
17	NL4IA	0.34280	0.15206
18	SinaaAI	0.33112	0.14294
19	MarsEclipse	0.32998	0.10620
20	LazyDevs	0.31520	0.15681
21	CLAC	0.30933	0.07122
22	kb	0.30113	0.08047
23	Unisa	0.29758	0.10871
24	MaChAmp	0.29476	0.14940
25	Riga	0.28045	0.06163
26	Baseline	0.27838	0.17677
27	Corgis	0.26897	0.11346
28	SATLab	0.25887	0.10291
29	UnedMediaBiasTeam	0.24070	0.07846
30	IA2022Grupa1	0.19275	0.07204
31	QUST	0.13501	0.10315

Italian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.78299	0.83607
2	Hitachi	0.76832	0.85246
3	QUST	0.76680	0.83607
4	vera	0.73711	0.81967
5	DSHacker	0.72040	0.83607
6	LazyDevs	0.62862	0.80328
7	Corgis	0.61594	0.77049
8	MELODI	0.58668	0.75410
9	UnedMediaBiasTeam	0.58408	0.62295
10	UMUTeam	0.55338	0.75410
11	QCRITeam	0.54105	0.78689
12	SharoffAndLepekhin	0.51715	0.75410
13	HHU	0.45515	0.63934
14	Riga	0.43598	0.57377
15	Baseline	0.38940	0.67213
16	FramingFreaks	0.35965	0.65574
17	SATLab	0.31930	0.62295
18	JUSTR00	0.31664	0.57377
19	MaChAmp	0.26797	0.67213
20	E8IJS	0.12146	0.16393

Italian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.61728	0.54457
2	vera	0.61678	0.52700
3	SinaaAI	0.60621	0.48381
4	QCRITeam	0.59906	0.47949
5	Hitachi	0.59775	0.51510
6	TeamAmpa	0.59674	0.48268
7	LazyDevs	0.59000	0.48661
8	PolarIce	0.58411	0.46877
9	UMUTeam	0.57627	0.44666
10	ACCEPT	0.55963	0.47628
11	TheSyllogist	0.55392	0.44434
12	BERTastic	0.54500	0.46933
13	Corgis	0.52742	0.41503
14	QUST	0.50228	0.46512
15	Riga	0.49861	0.32123
16	Baseline	0.48564	0.37243
17	SATLab	0.47404	0.41571
18	SharoffAndLepekhin	0.45868	0.22671
19	FramingFreaks	0.45161	0.35456
20	MaChAmp	0.42435	0.40302
21	DigDemLab	0.23697	0.17307

Italian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.59919	0.28122
2	RD	0.58824	0.26757
3	KInIT	0.58544	0.28580
4	oalee	0.57122	0.27299
5	ReDASPersuasion	0.56486	0.17531
6	DSHacker	0.56480	0.23300
7	MarsEclipse	0.54888	0.23192
8	NAP	0.53879	0.26609
9	TeamAmpa	0.52597	0.27214
10	QCRITeam	0.51661	0.24156
11	SharoffAndLepekhin	0.51582	0.17610
12	LazyDevs	0.50129	0.27529
13	SinaaAI	0.48048	0.17531
14	ACS	0.48011	0.22103
15	Corgis	0.44232	0.16303
16	APatt	0.44094	0.16626
17	Riga	0.43613	0.09191
18	NLUBot101	0.43506	0.16371
19	SATLab	0.43282	0.18267
20	MaChAmp	0.42154	0.16582
21	kb	0.39874	0.20056
22	Baseline	0.39719	0.12152
23	UnedMediaBiasTeam	0.31717	0.11126
24	CLAC	0.31310	0.06333
25	QUST	0.21253	0.15497

Russian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Hitachi	0.75494	0.75000
2	vera	0.72871	0.72222
3	MELODI	0.70577	0.69444
4	LazyDevs	0.69841	0.76389
5	Corgis	0.68216	0.69444
6	SharoffAndLepekhin	0.66797	0.69444
7	SinaaAI	0.65539	0.69444
8	UMUTeam	0.64543	0.68056
9	QCRITeam	0.56659	0.65278
10	DSHacker	0.55886	0.59722
11	Spoke	0.48969	0.65278
12	QUST	0.47200	0.51389
13	HHU	0.42571	0.47222
14	Baseline	0.39831	0.65278
15	UnedMediaBiasTeam	0.36457	0.44444
16	Riga	0.27095	0.38889
17	MaChAmp	0.25641	0.62500
18	FramingFreaks	0.23595	0.31944
19	E8IJS	0.17460	0.30556

Russian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.48148	0.35458
2	LazyDevs	0.47222	0.30851
3	SinaaAI	0.45662	0.41115
4	MarsEclipse	0.44976	0.30333
5	QCRITeam	0.43386	0.36428
6	PolarIce	0.42051	0.25792
7	Lubov	0.41706	0.35507
8	TeamAmpa	0.40930	0.29380
9	Corgis	0.39614	0.24621
10	BERTastic	0.39269	0.26521
11	TheSyllogist	0.38494	0.28990
12	UMUTeam	0.38488	0.28836
13	Hitachi	0.37000	0.32593
14	ACCEPT	0.33155	0.31283
15	Riga	0.31515	0.22189
16	QUST	0.25000	0.21290
17	Baseline	0.22951	0.21774
18	FramingFreaks	0.21927	0.15917
19	SharoffAndLepekhin	0.19763	0.11732
20	MaChAmp	0.16058	0.15120
21	DigDemLab	0.07035	0.05495

Russian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.43343	0.24205
2	vera	0.42635	0.25979
3	RD	0.41816	0.21281
4	MarsEclipse	0.39550	0.22110
5	DSHacker	0.38588	0.20209
6	oalee	0.38246	0.23232
7	TeamAmpa	0.37781	0.22740
8	QCRITeam	0.36828	0.21594
9	LazyDevs	0.36068	0.21271
10	ReDASPersuasion	0.35965	0.15988
11	ACS	0.33136	0.18251
12	NAP	0.32841	0.15809
13	NLUBot101	0.32298	0.20052
14	SinaaAI	0.31738	0.16636
15	APatt	0.30602	0.11666
16	MaChAmp	0.27110	0.14842
17	Corgis	0.27043	0.12057
18	kb	0.25289	0.11653
19	Riga	0.25158	0.06441
20	SharoffAndLepekhin	0.23464	0.05781
21	Baseline	0.20722	0.08598
22	CLAC	0.19285	0.05653
23	UnedMediaBiasTeam	0.18304	0.09995
24	QUST	0.10048	0.08021

French - Subtask 1

Rank	Team	F1 macro	F1 micro
1	UMUTeam	0.83547	0.88000
2	LazyDevs	0.77165	0.82000
3	QCRITeam	0.76744	0.80000
3	SinaaAI	0.76744	0.80000
4	vera	0.76502	0.82000
5	Hitachi	0.74359	0.78000
6	MELODI	0.74242	0.78000
7	DSHacker	0.71045	0.72000
8	Corgis	0.71043	0.76000
9	SharoffAndLepekhin	0.67138	0.78000
10	QUST	0.62145	0.70000
11	Baseline	0.56806	0.74000
12	UnedMediaBiasTeam	0.46536	0.48000
13	SATLab	0.44670	0.64000
14	Riga	0.35595	0.58000
15	JUSTR00	0.34683	0.66000
16	FramingFreaks	0.34074	0.66000
17	MaChAmp	0.28352	0.74000
18	E8IJS	0.08000	0.12000

French - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.57055	0.55956
2	MarsEclipse	0.55280	0.53681
3	ACCEPT	0.53827	0.50887
4	BERTastic	0.53691	0.52016
5	LazyDevs	0.52113	0.48263
6	Hitachi	0.51408	0.48832
7	TeamAmpa	0.50558	0.47890
8	Corgis	0.48689	0.45575
9	TheSyllogist	0.48571	0.46156
10	QCRITeam	0.48031	0.43048
11	UMUTeam	0.47727	0.43820
12	SinaaAI	0.47232	0.44407
13	PolarIce	0.46886	0.42851
14	QUST	0.44670	0.43786
15	Riga	0.37615	0.28728
16	SATLab	0.37543	0.35232
17	MaChAmp	0.35873	0.35478
18	Baseline	0.32850	0.27633
19	FramingFreaks	0.32716	0.29980
20	SharoffAndLepekhin	0.25496	0.10481
21	DigDemLab	0.22047	0.19236

French - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.49699	0.32169
2	vera	0.49238	0.34815
3	RD	0.48212	0.29932
4	NAP	0.46869	0.32171
5	oalee	0.46401	0.28958
6	ReDASPersuasion	0.46311	0.26952
7	DSHacker	0.46249	0.25999
8	MarsEclipse	0.43601	0.25006
9	TeamAmpa	0.43442	0.30544
10	LazyDevs	0.43241	0.30594
11	QCRITeam	0.42566	0.27344
12	NLUBot101	0.39580	0.25431
13	ACS	0.39364	0.25458
14	APatt	0.38414	0.19125
15	kb	0.36246	0.26628
16	MaChAmp	0.34507	0.20676
17	SinaaAI	0.34364	0.11509
18	SATLab	0.33755	0.24115
19	Corgis	0.33534	0.13848
20	Riga	0.30573	0.07785
21	SharoffAndLepekhin	0.29824	0.12642
22	Baseline	0.24014	0.09867
23	CLAC	0.23903	0.06575
24	UnedMediaBiasTeam	0.23590	0.12149
25	QUST	0.20905	0.16431

German - Subtask 1

Rank	Team	F1 macro	F1 micro
1	LazyDevs	0.83354	0.86000
2	UMUTeam	0.81951	0.82000
2	vera	0.81951	0.82000
3	DSHacker	0.81314	0.82000
4	SinaaAI	0.78245	0.76000
5	Hitachi	0.77659	0.76000
6	MELODI	0.76986	0.78000
7	Corgis	0.76984	0.82000
8	SharoffAndLepekhin	0.71266	0.72000
9	HHU	0.69963	0.76000
10	QCRITeam	0.66653	0.66000
11	SATLab	0.64391	0.70000
12	Baseline	0.62963	0.76000
13	QUST	0.62598	0.66000
14	FramingFreaks	0.56937	0.70000
15	Riga	0.41225	0.48000
16	UnedMediaBiasTeam	0.36203	0.42000
17	VERITAS	0.33601	0.56000
18	JUSTR00	0.26506	0.66000
18	MaChAmp	0.26506	0.66000
19	E8IJS	0.11765	0.18000

German - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.71119	0.66045
2	vera	0.66163	0.60301
3	QCRITeam	0.66019	0.60557
4	SinaaAI	0.65038	0.54047
5	LazyDevs	0.64766	0.59355
6	TeamAmpa	0.63223	0.57266
7	Hitachi	0.62913	0.56731
8	PolarIce	0.62222	0.56438
9	QUST	0.61580	0.54507
10	UMUTeam	0.61378	0.56539
11	BERTastic	0.60331	0.56200
12	Corgis	0.59414	0.52013
13	MaChAmp	0.58156	0.56358
14	ACCEPT	0.57447	0.48635
15	SATLab	0.57198	0.51872
16	SharoffAndLepekhin	0.55479	0.29877
17	FramingFreaks	0.54516	0.49578
18	TheSyllogist	0.53670	0.46495
19	Riga	0.50856	0.37454
20	Baseline	0.48707	0.41801
21	DigDemLab	0.33473	0.27949

German - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.54174	0.25994
2	KInIT	0.53086	0.26292
3	MarsEclipse	0.52962	0.24197
4	DSHacker	0.52006	0.21069
5	NAP	0.50953	0.27195
6	ReDASPersuasion	0.50750	0.21182
7	QCRITeam	0.50207	0.24889
8	oalee	0.49758	0.25192
9	TeamAmpa	0.48811	0.28106
10	RD	0.48525	0.20918
11	APatt	0.48375	0.17692
12	LazyDevs	0.47381	0.28406
13	Corgis	0.46631	0.15917
14	ACS	0.46133	0.24149
15	SinaaAI	0.42923	0.14506
16	NLUBot101	0.42042	0.17879
17	MaChAmp	0.40497	0.17804
18	kb	0.37264	0.20109
19	Riga	0.37257	0.06000
20	SharoffAndLepekhin	0.36262	0.11044
21	SATLab	0.35523	0.16270
22	UnedMediaBiasTeam	0.31827	0.10617
23	Baseline	0.31667	0.08345
24	CLAC	0.24795	0.05514
25	QUST	0.15278	0.11244

Polish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	MELODI	0.79798	0.87234
2	SharoffAndLepekhin	0.78551	0.93617
3	Hitachi	0.77922	0.87234
4	vera	0.76455	0.85106
5	LazyDevs	0.75282	0.85106
6	UMUTeam	0.66431	0.80851
7	SinaaAI	0.66349	0.80851
8	DSHacker	0.66125	0.80851
9	kb	0.65259	0.80851
10	SATLab	0.57081	0.82979
11	QCRITeam	0.57071	0.82979
12	Corgis	0.53680	0.76596
13	QUST	0.52778	0.59574
14	UnedMediaBiasTeam	0.50700	0.55319
15	Baseline	0.48962	0.82979
16	Riga	0.43312	0.46809
17	MaChAmp	0.28455	0.74468
18	FramingFreaks	0.28205	0.70213
19	E8IJS	0.06276	0.08511

Polish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	MarsEclipse	0.67314	0.63839
2	vera	0.66045	0.59105
3	QCRITeam	0.64193	0.59867
4	UMUTeam	0.64179	0.59312
5	SinaaAI	0.64000	0.57997
6	Hitachi	0.63396	0.58396
7	LazyDevs	0.62664	0.56641
8	SATLab	0.62018	0.56987
9	Corgis	0.61933	0.56553
10	TeamAmpa	0.61386	0.55541
11	MaChAmp	0.59701	0.58239
12	PolarIce	0.59684	0.55454
13	Baseline	0.59381	0.53199
14	QUST	0.59084	0.53312
15	SharoffAndLepekhin	0.58795	0.51617
16	BERTastic	0.58696	0.53547
17	ACCEPT	0.58621	0.57220
18	FramingFreaks	0.55973	0.45995
19	TheSyllogist	0.55263	0.50080
20	Riga	0.54222	0.41239
21	DigDemLab	0.39163	0.34847

Polish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.44964	0.20228
2	KInIT	0.43105	0.24194
3	NAP	0.42180	0.24577
4	TeamAmpa	0.41164	0.26631
5	DSHacker	0.40753	0.15872
6	MarsEclipse	0.40604	0.17569
7	RD	0.40457	0.19810
8	oalee	0.40296	0.19265
9	ReDASPersuasion	0.39677	0.16817
10	QCRITeam	0.38687	0.17241
11	LazyDevs	0.37598	0.18026
12	ACS	0.37195	0.23262
13	APatt	0.36570	0.14969
14	SinaaAI	0.35880	0.10318
15	SharoffAndLepekhin	0.32680	0.12161
16	NLUBot101	0.31970	0.16911
17	kb	0.31427	0.17940
18	MaChAmp	0.30746	0.17030
19	SATLab	0.30049	0.14286
20	Corgis	0.29576	0.12149
21	UnedMediaBiasTeam	0.23652	0.10348
22	Riga	0.22774	0.03796
23	CLAC	0.19036	0.05024
24	Baseline	0.17928	0.05932
25	QUST	0.09707	0.07426

Spanish - Subtask 1

Rank	Team	F1 macro	F1 micro
1	vera	0.73714	0.76667
2	HHU	0.57952	0.63333
3	LazyDevs	0.57037	0.60000
4	DSHacker	0.56349	0.56667
5	QUST	0.55236	0.63333
6	MELODI	0.54815	0.60000
7	SinaaAI	0.53192	0.56667
8	QCRITeam	0.48894	0.56667
9	UMUTeam	0.43750	0.50000
10	Corgis	0.42917	0.56667
11	SharoffAndLepekhin	0.40000	0.43333
12	Riga	0.38492	0.50000
13	UnedMediaBiasTeam	0.33614	0.36667
14	FramingFreaks	0.31746	0.46667
15	SATLab	0.28187	0.43333
16	E8IJS	0.23457	0.30000
17	MaChAmp	0.21212	0.46667
18	Baseline	0.15385	0.30000

Spanish - Subtask 2

Rank	Team	F1 micro	F1 macro
1	PolarIce	0.57143	0.45491
2	UMUTeam	0.55844	0.46541
3	vera	0.55758	0.52425
4	SinaaAI	0.55484	0.44105
5	LazyDevs	0.53503	0.39573
6	TeamAmpa	0.50575	0.38650
7	MarsEclipse	0.49032	0.43161
8	Riga	0.48889	0.42605
9	QCRITeam	0.48780	0.38955
10	BERTastic	0.47664	0.42842
11	ACCEPT	0.47368	0.41159
12	TheSyllogist	0.47273	0.38734
13	Corgis	0.46341	0.35854
14	MaChAmp	0.38519	0.26857
15	SATLab	0.38272	0.29311
16	QUST	0.37370	0.35266
17	SharoffAndLepekhin	0.26506	0.20117
18	FramingFreaks	0.21538	0.21132
19	Baseline	0.12000	0.09524

Spanish - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.41067	0.21627
2	KInIT	0.39869	0.20301
3	oalee	0.39620	0.16316
4	RD	0.38587	0.19101
5	TeamAmpa	0.38106	0.24366
6	DSHacker	0.37605	0.16803
7	QCRITeam	0.37191	0.17515
8	NAP	0.36996	0.18065
9	LazyDevs	0.35595	0.20097
10	ACS	0.31730	0.13934
11	NLUBot101	0.30459	0.15092
12	SinaaAI	0.30169	0.13920
13	SharoffAndLepekhin	0.28149	0.07445
14	MaChAmp	0.27595	0.13891
15	CLAC	0.26667	0.04755
16	Baseline	0.24843	0.02007
17	kb	0.24490	0.14257
18	UnedMediaBiasTeam	0.22686	0.07799
19	Corgis	0.20415	0.06712
20	Riga	0.19895	0.04520
21	SATLab	0.19304	0.05708
22	QUST	0.12617	0.09923

Greek - Subtask 1

Rank	Team	F1 macro	F1 micro
1	SinaaAI	0.82660	0.82813
2	vera	0.81673	0.84375
3	LazyDevs	0.77744	0.82813
4	UMUTeam	0.76700	0.79688
5	Corgis	0.76667	0.78125
6	HHU	0.75039	0.75000
7	MELODI	0.71042	0.79688
8	QCRITeam	0.70815	0.81250
9	SharoffAndLepekhin	0.69765	0.76563
10	DSHacker	0.59346	0.64063
11	UnedMediaBiasTeam	0.52128	0.56250
12	QUST	0.49159	0.60938
13	Riga	0.41176	0.57813
14	SATLab	0.25356	0.40625
15	MaChAmp	0.25243	0.60938
16	FramingFreaks	0.23403	0.34375
17	Baseline	0.17054	0.34375
18	E8IJS	0.05670	0.06250

Greek - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.58000	0.48659
2	LazyDevs	0.56383	0.45829
3	MarsEclipse	0.54507	0.44404
4	TeamAmpa	0.54408	0.44372
5	SinaaAI	0.53740	0.44874
6	UMUTeam	0.53409	0.40360
7	TheSyllogist	0.52987	0.44048
8	BERTastic	0.52584	0.44396
9	QCRITeam	0.51852	0.39952
10	PolarIce	0.51629	0.40953
11	Corgis	0.49330	0.36297
12	ACCEPT	0.45536	0.41098
13	QUST	0.41357	0.39198
14	FramingFreaks	0.38020	0.15432
15	Riga	0.37692	0.19532
16	Baseline	0.34538	0.05741
17	MaChAmp	0.29279	0.20575
18	SATLab	0.06829	0.03730

Greek - Subtask 3

Rank	Team	F1 micro	F1 macro
1	vera	0.28325	0.15598
2	KInIT	0.27928	0.16332
3	DSHacker	0.27827	0.13809
4	QCRITeam	0.27261	0.15614
5	NAP	0.25803	0.16394
6	LazyDevs	0.25440	0.19551
7	TeamAmpa	0.24098	0.19388
8	ACS	0.23529	0.09411
9	RD	0.23494	0.13415
10	SinaaAI	0.23422	0.06936
11	MaChAmp	0.21465	0.12929
12	Corgis	0.20460	0.09206
13	oalee	0.20398	0.04842
14	Riga	0.16391	0.03632
15	CLAC	0.15630	0.05507
16	NLUBot101	0.15034	0.09653
17	kb	0.15021	0.12095
18	UnedMediaBiasTeam	0.10566	0.02569
19	Baseline	0.08831	0.00606
20	QUST	0.05720	0.04650
21	SATLab	0.00000	0.00000

Georgian - Subtask 1

Rank	Team	F1 macro	F1 micro
1	Riga	1.00000	1.00000
2	vera	0.96268	0.96552
3	Corgis	0.92677	0.93103
4	SharoffAndLepekhin	0.88803	0.89655
5	LazyDevs	0.87518	0.89655
6	SinaaAI	0.85784	0.86207
7	MELODI	0.78676	0.79310
8	QCRITeam	0.62210	0.89655
9	DSHacker	0.59715	0.86207
10	UMUTeam	0.58201	0.86207
11	QUST	0.53656	0.68966
12	SATLab	0.51852	0.72414
13	UnedMediaBiasTeam	0.48630	0.68966
14	MaChAmp	0.39583	0.65517
15	Baseline	0.25641	0.34483
16	FramingFreaks	0.25532	0.62069
17	E8IJS	0.00000	0.00000

Georgian - Subtask 2

Rank	Team	F1 micro	F1 macro
1	vera	0.65421	0.67891
2	MarsEclipse	0.64516	0.63927
3	SinaaAI	0.62963	0.51423
4	LazyDevs	0.57627	0.39465
5	TheSyllogist	0.56140	0.49288
6	Corgis	0.55856	0.35779
7	BERTastic	0.55172	0.40820
8	UMUTeam	0.52941	0.41064
9	QCRITeam	0.51685	0.45724
10	TeamAmpa	0.51667	0.37879
11	Riga	0.42353	0.38095
12	PolarIce	0.40404	0.38393
13	FramingFreaks	0.35233	0.34399
14	MaChAmp	0.31250	0.22533
15	QUST	0.31076	0.26028
16	Baseline	0.25974	0.25092
17	ACCEPT	0.22581	0.27972
18	SATLab	0.05333	0.18367

Georgian - Subtask 3

Rank	Team	F1 micro	F1 macro
1	KInIT	0.46023	0.37995
2	vera	0.45483	0.29014
3	RD	0.44444	0.30560
4	SinaaAI	0.43243	0.22689
5	DSHacker	0.42657	0.29866
6	QCRITeam	0.42368	0.29951
7	NAP	0.41261	0.30615
8	TeamAmpa	0.40816	0.25854
9	LazyDevs	0.38434	0.28702
10	Riga	0.36190	0.20869
11	oalee	0.35032	0.23003
12	ACS	0.33544	0.24818
13	MaChAmp	0.30100	0.22056
14	CLAC	0.27053	0.19930
15	NLUBot101	0.25362	0.17235
16	Corgis	0.24167	0.23819
17	UnedMediaBiasTeam	0.18012	0.22096
18	kb	0.15017	0.09988
19	Baseline	0.13793	0.14083
20	QUST	0.09088	0.11504
21	SATLab	0.07568	0.15786

Note that the leaderboard is updated every 20 minutes, therefore your submission may not be listed right away.

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval2023 shared task on "Detecting the Category, the Framing, and the Persuasion Techniques in Online News in a Multi-lingual Setup"

Leaderboard

Official SemEval 2023 task 3 Test Leaderboards

SemEval 2023 task 3 Dev Leaderboards (until Jan 14 2023)

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Italian - Subtask 1

Italian - Subtask 2

Italian - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

French - Subtask 1

French - Subtask 2

French - Subtask 3

German - Subtask 1

German - Subtask 2

German - Subtask 3

Polish - Subtask 1

Polish - Subtask 2

Polish - Subtask 3

Spanish - Subtask 1

Spanish - Subtask 2

Spanish - Subtask 3

Greek - Subtask 1

Greek - Subtask 2

Greek - Subtask 3

Georgian - Subtask 1

Georgian - Subtask 2

Georgian - Subtask 3

Contact