Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.41280	0.48100	0.43020	0.45420	0.94890
2	PinganTeam	0.40430	0.49410	0.47550	0.48460	0.90210
3	slowders	0.39150	0.45530	0.40380	0.42800	0.90210
4	PATeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PAteam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnAI	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnTeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	pateam	0.38300	0.46150	0.43020	0.44530	0.88940
5	DEMON	0.37450	0.44870	0.39620	0.42080	0.91910
6	Duth3	0.37020	0.45960	0.40750	0.43200	0.94040
6	Topato	0.37020	0.46690	0.42640	0.44580	0.91490
6	gowithnlp	0.37020	0.44260	0.39250	0.41600	0.93620
7	TartanTritons	0.35740	0.11440	0.10190	0.10780	0.72340
8	Fane	0.35320	0.40850	0.36230	0.38400	0.91490
9	NlpUned	0.32770	0.37870	0.33580	0.35600	0.09790
9	QUST	0.32770	0.39040	0.36980	0.37980	0.92340
10	LATeIIMAS	0.31060	0.36710	0.32830	0.34660	0.83830
11	Fredin	0.30210	0.36000	0.33960	0.34950	0.86380
12	clujteam	0.28940	0.34470	0.30570	0.32400	0.86380
13	m1nadzuki	0.25960	0.31490	0.27920	0.29600	0.87660
14	LTG	0.25530	0.07490	0.07550	0.07520	0.58300
15	BERTastic	0.25110	0.31490	0.27920	0.29600	0.86380
15	adithjrajeev	0.25110	0.32140	0.30570	0.31330	0.86810
16	Cimba	0.22550	0.27850	0.24910	0.26290	0.83830
17	Mekky	0.21700	0.29480	0.27920	0.28680	0.80000
18	NarrativeMiners	0.21280	0.26810	0.23770	0.25200	0.68940
18	YNUzwt	0.21280	0.26380	0.23400	0.24800	0.77450
19	FromProblemImportSolve	0.20430	0.29030	0.30570	0.29780	0.77450
20	YNUHPCC	0.19150	0.20850	0.18490	0.19600	0.82550
21	NarrativeNexus	0.18300	0.20850	0.18490	0.19600	0.71910
22	Rosetta	0.17870	0.22920	0.21890	0.22390	0.60430
23	Dhananjaya	0.17450	0.22880	0.20380	0.21560	0.81280
24	Tuebingen	0.17020	0.26340	0.26040	0.26190	0.75740
25	Chrissy	0.14890	0.18720	0.16600	0.17600	0.83400
26	UMZNLP	0.14040	0.21430	0.23770	0.22540	0.70640
27	north	0.08510	0.25870	0.42260	0.32090	0.94890
28	HowardUniversityAI4PC	0.08090	0.08320	0.17740	0.11330	0.69360
29	kzeky	0.06810	0.08090	0.07170	0.07600	0.56600
30	bumblebeeTransformer	0.06380	0.13640	0.16980	0.15130	0.78300
30	eevvgg	0.06380	0.10550	0.17360	0.13120	0.78720
31	Baseline	0.03830	0.04680	0.04150	0.04400	0.28510
32	Team12	0.02130	0.07670	0.09810	0.08610	0.72340
33	cocoa	0.01700	0.08750	0.12450	0.10280	0.82550
34	SemanticaInnovators	0.01280	0.04680	0.16600	0.07300	0.25110
35	TechDacians	0.00000	1.00000	0.00000	0.00000	0.09790
35	teamninebonn	0.00000	0.03260	0.08680	0.04740	0.17870

English - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.62300	0.33700	0.50500	0.37800
2	GATENLP	0.62700	0.35200	0.46300	0.34700
3	COGNAC	0.55400	0.40000	0.42600	0.39100
4	Duth3	0.58100	0.36600	0.42300	0.35400
5	NarrativesHunter	0.50900	0.39500	0.40000	0.40200
6	23	0.49300	0.39200	0.37700	0.38400
7	iLostTheCode	0.49800	0.36300	0.37300	0.37300
8	KostasThesis2025	0.55600	0.39600	0.36200	0.37000
9	NCLteam	0.48600	0.36300	0.34500	0.36000
10	NarrativesHunter2	0.48800	0.38400	0.34400	0.36700
10	Narrlangen	0.44400	0.41100	0.34400	0.38600
11	PATeam	0.52100	0.35600	0.33900	0.29100
11	PAteam	0.52100	0.35600	0.33900	0.29100
11	PingAnAI	0.52100	0.35600	0.33900	0.29100
11	PingAnTeam	0.52100	0.35600	0.33900	0.29100
11	PinganTeam	0.52100	0.35600	0.33900	0.29100
11	pateam	0.52100	0.35600	0.33900	0.29100
12	UNEDTeam	0.46700	0.36300	0.32700	0.34600
13	YNUzwt	0.48500	0.37800	0.32100	0.33200
14	Narrengers	0.45700	0.36300	0.31800	0.31800
15	CtrlAltElite	0.47400	0.42200	0.31100	0.44600
16	hblyl	0.45700	0.38400	0.31000	0.32900
17	NotMyNarrative	0.40300	0.41400	0.29800	0.39300
18	GeorgeSnape	0.28700	0.45200	0.28700	0.45200
18	IRNLP	0.51600	0.40200	0.28700	0.45200
19	INSAntive	0.32900	0.41200	0.25900	0.38900
20	NLPPraktikumWS2025	0.44800	0.38500	0.25800	0.33700
21	NarrativeMiners	0.36900	0.42400	0.23800	0.42600
22	nlptuducd	0.33800	0.36400	0.22600	0.31700
23	ammd7	0.29400	0.35500	0.22200	0.34300
24	erkk	0.23000	0.40100	0.21100	0.39800
25	UniBonn187	0.40900	0.33000	0.20600	0.22400
26	Irapuarani	0.33500	0.20100	0.18800	0.14100
27	DUTtask10	0.31000	0.40500	0.16500	0.36800
28	LATeIIMAS	0.22200	0.33400	0.16300	0.32300
29	GrammarPolice	0.16800	0.25800	0.06300	0.12400
30	Baseline	0.03000	0.12700	0.01300	0.07000
31	AlAnood	0.00000	0.00000	0.00000	0.00000
31	NarrativeNexus	0.00000	0.00000	0.00000	0.00000
31	bbStar	0.00000	0.00000	0.00000	0.00000

English - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	GPLSICORTEX	0.76754	0.73464	0.75040
2	KyuHyunChoi	0.76686	0.73517	0.75040
3	AITeam	0.74850	0.75229	0.75004
4	TechSSN	0.75417	0.74174	0.74767
5	pateam	0.74821	0.74742	0.74754
6	PingAnAI	0.74930	0.74283	0.74568
7	WordWiz	0.75464	0.73705	0.74551
8	PingAnTeam	0.73870	0.74376	0.74084
9	PinganTeam	0.73410	0.74832	0.74076
10	Duth3	0.73277	0.74676	0.73944
11	NarrativeNexus	0.71991	0.74267	0.73085
12	NarrativeMiners	0.71139	0.74827	0.72910
13	clujteam	0.72350	0.72647	0.72464
14	PAteam	0.72371	0.72589	0.72433
15	Dhananjaya	0.70700	0.72788	0.71689
16	TartanTritons	0.72396	0.70200	0.71245
17	YNUzwt	0.69707	0.70112	0.69885
18	LATeIIMAS	0.70540	0.68674	0.69558
19	bbStar	0.66436	0.72023	0.69103
20	Synapse	0.65986	0.69175	0.67527
21	Baseline	0.65144	0.68344	0.66690
22	DUTtask10	0.00000	0.00000	0.00000
22	Mendel292A	0.00000	0.00000	0.00000
22	UMZNLP	0.00000	0.00000	0.00000
22	ftd	0.00000	0.00000	0.00000

Portuguese - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.59260	0.64950	0.62540	0.63720	0.94610
2	PingAnTeam	0.50510	0.56410	0.54490	0.55430	0.91250
3	PingAnAI	0.49490	0.55130	0.53250	0.54170	0.90570
4	PATeam	0.49160	0.55370	0.52630	0.53970	0.90570
4	PinganTeam	0.49160	0.55310	0.53250	0.54260	0.90240
4	pateam	0.49160	0.54950	0.53250	0.54090	0.90570
5	PAteam	0.48820	0.55020	0.52630	0.53800	0.90240
6	Duth3	0.45790	0.52530	0.48300	0.50320	0.85860
6	QUST	0.45790	0.50990	0.47680	0.49280	0.84510
7	Topato	0.42090	0.49530	0.48610	0.49060	0.88550
8	BERTastic	0.41750	0.47470	0.43650	0.45480	0.84510
9	LTG	0.40740	0.11420	0.11460	0.11440	0.42760
10	DEMON	0.36700	0.43240	0.39630	0.41360	0.80810
11	LATeIIMAS	0.33670	0.38720	0.35600	0.37100	0.71720
12	TartanTritons	0.33330	0.18180	0.16720	0.17420	0.50840
13	gowithnlp	0.26940	0.31650	0.29100	0.30320	0.71380
14	Cimba	0.26260	0.33000	0.30960	0.31950	0.20540
14	FromProblemImportSolve	0.26260	0.32970	0.37150	0.34930	0.65660
15	Fane	0.25590	0.30980	0.28480	0.29680	0.62960
16	Dhananjaya	0.21890	0.26320	0.24770	0.25520	0.76770
17	YNUzwt	0.17510	0.22220	0.20430	0.21290	0.49490
18	HowardUniversityAI4PC	0.13130	0.11320	0.22600	0.15080	0.51850
19	Baseline	0.04710	0.05050	0.04640	0.04840	0.36030
20	teamninebonn	0.00000	0.04040	0.11150	0.05930	0.44110

Portuguese - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.66400	0.26000	0.48000	0.25400
2	INSALyon2	0.67900	0.26300	0.43300	0.20900
3	PATeam	0.54100	0.29000	0.40900	0.26900
3	PAteam	0.54100	0.29000	0.40900	0.26900
3	PingAnAI	0.54100	0.29000	0.40900	0.26900
3	PingAnTeam	0.54100	0.29000	0.40900	0.26900
3	PinganTeam	0.54100	0.29000	0.40900	0.26900
3	pateam	0.54100	0.29000	0.40900	0.26900
4	Duth3	0.62600	0.23900	0.40700	0.20000
5	KostasThesis2025	0.53900	0.21400	0.32900	0.17100
6	iLostTheCode	0.54700	0.22800	0.31900	0.18200
7	23	0.48700	0.33800	0.31300	0.25700
8	Narrlangen	0.48000	0.33900	0.29100	0.25900
9	UNEDTeam	0.53700	0.32400	0.27000	0.26200
10	YNUzwt	0.56800	0.30100	0.26600	0.27700
11	Irapuarani	0.43500	0.19500	0.22500	0.12900
12	INSAntive	0.49100	0.27500	0.21500	0.20400
13	COGNAC	0.34200	0.36200	0.18600	0.26200
14	CtrlAltElite	0.49200	0.31600	0.14900	0.21900
15	NotMyNarrative	0.22800	0.25000	0.12400	0.11100
16	DUTtask10	0.10700	0.24100	0.02600	0.13400
17	erkk	0.05500	0.17500	0.02100	0.07700
18	Baseline	0.03700	0.14000	0.01400	0.07000

Portuguese - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnTeam	0.76861	0.74874	0.75801
2	PinganTeam	0.76097	0.75381	0.75690
3	pateam	0.76003	0.75202	0.75548
4	Duth3	0.75861	0.75253	0.75517
5	PingAnAI	0.75403	0.74702	0.75005
6	WordWiz	0.75931	0.73885	0.74857
7	PAteam	0.75365	0.73984	0.74637
8	AITeam	0.74654	0.73767	0.74158
9	bbStar	0.70991	0.72924	0.71926
10	Dhananjaya	0.70979	0.72318	0.71614
11	YNUzwt	0.68986	0.68603	0.68771
12	TartanTritons	0.69764	0.67419	0.68540
13	Baseline	0.67822	0.68297	0.68046
14	LATeIIMAS	0.68395	0.66339	0.67297
15	DUTtask10	0.00000	0.00000	0.00000

Russian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.56540	0.61750	0.59030	0.60360	0.85510
2	QUST	0.51400	0.56280	0.53300	0.54750	0.83180
3	TartanTritons	0.47200	0.16200	0.15420	0.15800	0.43930
4	BERTastic	0.46730	0.50470	0.47580	0.48980	0.78970
4	DEMON	0.46730	0.51420	0.48020	0.49660	0.81310
5	Duth3	0.45330	0.48600	0.45810	0.47170	0.79440
6	gowithnlp	0.44860	0.48130	0.45370	0.46710	0.86450
7	PATeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PAteam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PingAnAI	0.44390	0.50230	0.48900	0.49550	0.80840
7	PingAnTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PinganTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	Topato	0.44390	0.50440	0.50660	0.50550	0.78500
7	pateam	0.44390	0.49780	0.48900	0.49330	0.78040
8	LTG	0.42990	0.08620	0.08810	0.08710	0.35980
9	Cimba	0.38320	0.41670	0.39650	0.40630	0.33640
10	FromProblemImportSolve	0.35510	0.43700	0.51980	0.47480	0.75230
11	LATeIIMAS	0.31310	0.36040	0.35240	0.35630	0.64490
12	Dhananjaya	0.29440	0.32560	0.30840	0.31670	0.66360
12	YNUzwt	0.29440	0.32710	0.30840	0.31750	0.59350
13	Fane	0.24300	0.27570	0.25990	0.26760	0.60750
14	HowardUniversityAI4PC	0.12620	0.07590	0.12780	0.09520	0.42520
15	Baseline	0.05140	0.06070	0.05730	0.05900	0.34110

Russian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.70900	0.27400	0.51800	0.28200
2	Duth3	0.64700	0.30800	0.48100	0.26200
3	iLostTheCode	0.59700	0.27900	0.44000	0.25100
4	INSALyon2	0.55600	0.31400	0.43700	0.27000
5	PATeam	0.56600	0.26800	0.43400	0.24700
5	PAteam	0.56600	0.26800	0.43400	0.24700
5	PingAnAI	0.56600	0.26800	0.43400	0.24700
5	PingAnTeam	0.56600	0.26800	0.43400	0.24700
5	PinganTeam	0.56600	0.26800	0.43400	0.24700
5	pateam	0.56600	0.26800	0.43400	0.24700
6	Narrlangen	0.57400	0.37000	0.40500	0.32400
7	KostasThesis2025	0.57100	0.34400	0.40000	0.28300
8	UNEDTeam	0.51300	0.32500	0.33000	0.27000
9	INSAntive	0.55400	0.32800	0.32300	0.34200
10	UniBonn187	0.55000	0.30300	0.23100	0.17800
11	Irapuarani	0.35900	0.15000	0.19100	0.09200
12	COGNAC	0.24800	0.35500	0.18300	0.30600
13	YNUzwt	0.21300	0.35900	0.14800	0.25700
14	IRNLP	0.53700	0.35100	0.11600	0.25200
15	GrammarPolice	0.00000	0.00000	0.05000	0.21800
16	DUTtask10	0.04000	0.18500	0.03300	0.18000
17	NotMyNarrative	0.12900	0.24600	0.01900	0.12800
18	Baseline	0.06500	0.21300	0.00800	0.06400
19	AlAnood	0.00000	0.00000	0.00000	0.00000
19	LATeIIMAS	0.00000	0.00000	0.00000	0.00000

Russian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnAI	0.72469	0.71512	0.71904
2	PinganTeam	0.71787	0.72144	0.71888
3	Duth3	0.71796	0.71537	0.71634
4	PingAnTeam	0.71926	0.70627	0.71205
5	pateam	0.71232	0.71232	0.71166
6	AITeam	0.71354	0.71034	0.71136
7	PAteam	0.69984	0.71423	0.70639
8	WordWiz	0.70193	0.70730	0.70395
9	TartanTritons	0.68271	0.68155	0.68159
10	YNUzwt	0.66621	0.68632	0.67578
11	bbStar	0.63433	0.69813	0.66440
12	DUTtask10	0.65979	0.66845	0.66379
13	Dhananjaya	0.63668	0.69308	0.66324
14	Baseline	0.62206	0.66872	0.64427
15	LATeIIMAS	0.61043	0.67674	0.64161

Bulgarian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	PingAnAI	0.53230	0.54760	0.53910	0.54330	0.92740
2	PATeam	0.51610	0.53970	0.53120	0.53540	0.92740
3	DUTIR	0.50810	0.53730	0.56250	0.54960	0.94350
4	pateam	0.48390	0.51180	0.50780	0.50980	0.94350
5	PAteam	0.46770	0.49600	0.48440	0.49010	0.94350
5	PingAnTeam	0.46770	0.48820	0.48440	0.48630	0.94350
5	PinganTeam	0.46770	0.49610	0.49220	0.49410	0.94350
6	DEMON	0.45970	0.47970	0.46090	0.47010	0.88710
7	Duth3	0.45160	0.46770	0.45310	0.46030	0.92740
8	gowithnlp	0.43550	0.45970	0.44530	0.45240	0.83060
9	TartanTritons	0.41130	0.09680	0.09380	0.09520	0.55650
10	QUST	0.38710	0.39200	0.38280	0.38740	0.84680
11	BERTastic	0.35480	0.37100	0.35940	0.36510	0.87100
12	Fane	0.34680	0.36290	0.35160	0.35710	0.77420
13	LTG	0.31450	0.04930	0.05470	0.05190	0.55650
13	Topato	0.31450	0.33820	0.35940	0.34850	0.80650
14	Cimba	0.25810	0.26980	0.26560	0.26770	0.25000
15	FromProblemImportSolve	0.20970	0.28660	0.36720	0.32190	0.80650
16	Dhananjaya	0.19350	0.21090	0.21090	0.21090	0.69350
17	Fredin	0.10480	0.12410	0.13280	0.12830	0.60480
18	HowardUniversityAI4PC	0.09680	0.07920	0.14840	0.10330	0.51610
19	Baseline	0.04030	0.04030	0.03910	0.03970	0.25810
20	TechDacians	0.00000	1.00000	0.00000	0.00000	0.25000

Bulgarian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	PATeam	0.63100	0.33800	0.46000	0.33300
1	PingAnAI	0.63100	0.33800	0.46000	0.33300
1	PingAnTeam	0.63100	0.33800	0.46000	0.33300
1	PinganTeam	0.63100	0.33800	0.46000	0.33300
1	pateam	0.63100	0.33800	0.46000	0.33300
2	PAteam	0.57500	0.32900	0.44200	0.30700
3	INSALyon2	0.57500	0.35000	0.43600	0.35700
4	Duth3	0.57800	0.37400	0.41600	0.36200
4	GATENLP	0.62900	0.33200	0.41600	0.28600
5	iLostTheCode	0.55800	0.35100	0.39100	0.35200
6	UNEDTeam	0.57400	0.35300	0.36300	0.31200
7	KostasThesis2025	0.52300	0.37100	0.35700	0.34900
8	Narrlangen	0.49500	0.40100	0.35500	0.37600
9	INSAntive	0.52300	0.36600	0.32400	0.36000
10	Irapuarani	0.36600	0.17700	0.18300	0.12000
11	NotMyNarrative	0.24900	0.30600	0.14200	0.22800
12	DUTtask10	0.17200	0.34100	0.12100	0.31200
13	erkk	0.15200	0.34000	0.12000	0.31000
14	LATeIIMAS	0.17700	0.26600	0.07200	0.16900
15	Baseline	0.05600	0.19100	0.02200	0.11900
16	AlAnood	0.00000	0.00000	0.00000	0.00000

Bulgarian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.73485	0.70303	0.71818
2	PinganTeam	0.72676	0.71052	0.71815
3	pateam	0.72369	0.70837	0.71557
4	PingAnTeam	0.72954	0.70028	0.71418
5	Duth3	0.72483	0.70127	0.71265
6	PingAnAI	0.71217	0.69934	0.70527
7	PAteam	0.71405	0.69478	0.70396
8	Dhananjaya	0.67695	0.69378	0.68508
9	WordWiz	0.69034	0.67816	0.68390
10	bbStar	0.65751	0.68740	0.67198
11	TartanTritons	0.66758	0.64399	0.65531
12	Baseline	0.62739	0.64180	0.63430
13	LATeIIMAS	0.62947	0.61907	0.62406
14	DUTtask10	0.00000	0.00000	0.00000

Hindi - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	QUST	0.46840	0.59060	0.49480	0.53850	0.76900
2	TartanTritons	0.44620	0.18940	0.15970	0.17330	0.32910
3	BERTastic	0.43990	0.56560	0.47380	0.51570	0.78480
4	DEMON	0.40190	0.52530	0.43460	0.47560	0.75630
4	Duth3	0.40190	0.52530	0.43460	0.47560	0.79110
5	Topato	0.37340	0.50570	0.46340	0.48360	0.73420
6	LTG	0.36390	0.16580	0.15970	0.16270	0.37660
7	Cimba	0.35440	0.45310	0.37960	0.41310	0.47150
8	gowithnlp	0.33540	0.43990	0.36390	0.39830	0.71520
9	DUTIR	0.29430	0.37660	0.31150	0.34100	0.59810
10	Dhananjaya	0.27850	0.37660	0.31150	0.34100	0.70890
11	LATeIIMAS	0.27220	0.37110	0.40310	0.38640	0.63610
12	PATeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PAteam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PingAnAI	0.26900	0.35330	0.29320	0.32050	0.69620
12	PinganTeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	pateam	0.26900	0.35330	0.29320	0.32050	0.69620
13	FromProblemImportSolve	0.25630	0.37410	0.39270	0.38310	0.66770
13	PingAnTeam	0.25630	0.32490	0.26960	0.29470	0.67720
14	Fane	0.23420	0.31650	0.26180	0.28650	0.65510
15	HowardUniversityAI4PC	0.16770	0.11460	0.15180	0.13060	0.35440
16	Baseline	0.05700	0.07910	0.06540	0.07160	0.32280

Hindi - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.67300	0.42100	0.58100	0.44100
2	DUTtask10	0.56900	0.48400	0.53500	0.49400
3	IRNLP	0.37500	0.46700	0.51500	0.50000
4	Duth3	0.47200	0.45600	0.40600	0.44500
5	Narrlangen	0.39500	0.46400	0.38500	0.46500
6	UNEDTeam	0.44900	0.46000	0.37600	0.45600
7	erkk	0.38200	0.47900	0.37400	0.47900
8	KostasThesis2025	0.45300	0.44100	0.34100	0.45000
9	GATENLP	0.40900	0.41000	0.32100	0.37900
10	INSAntive	0.36500	0.44000	0.26500	0.41400
11	NotMyNarrative	0.31800	0.44900	0.24300	0.40800
12	PATeam	0.39200	0.39000	0.21800	0.35000
12	PAteam	0.39200	0.39000	0.21800	0.35000
12	PingAnAI	0.39200	0.39000	0.21800	0.35000
12	PingAnTeam	0.39200	0.39000	0.21800	0.35000
12	PinganTeam	0.39200	0.39000	0.21800	0.35000
12	pateam	0.39200	0.39000	0.21800	0.35000
13	iLostTheCode	0.22700	0.37800	0.17400	0.33900
14	Irapuarani	0.23400	0.12500	0.11100	0.08200
15	LATeIIMAS	0.09700	0.18500	0.02900	0.10200
16	Baseline	0.08100	0.26000	0.00000	0.00000
17	bbStar	0.00000	0.00000	0.00000	0.00000

Hindi - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.75576	0.76231	0.75845
2	pateam	0.75656	0.75959	0.75774
3	PinganTeam	0.75605	0.75613	0.75574
4	PAteam	0.75097	0.76045	0.75540
5	PingAnAI	0.74263	0.75416	0.74792
6	Duth3	0.74819	0.74536	0.74655
7	PingAnTeam	0.73661	0.74691	0.74145
8	WordWiz	0.72859	0.73914	0.73356
9	bbStar	0.71789	0.73704	0.72712
10	Dhananjaya	0.72143	0.72156	0.72125
11	TartanTritons	0.69679	0.70119	0.69873
12	Baseline	0.66802	0.67188	0.66974
13	DUTtask10	0.00000	0.00000	0.00000
13	INSALyon2	0.00000	0.00000	0.00000

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval 2025 shared task on "Multilingual Characterization and Extraction of Narratives from Online News"

Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Portuguese - Subtask 1

Portuguese - Subtask 2

Portuguese - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

Bulgarian - Subtask 1

Bulgarian - Subtask 2

Bulgarian - Subtask 3

Hindi - Subtask 1

Hindi - Subtask 2

Hindi - Subtask 3

Contact