Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.41280	0.48100	0.43020	0.45420	0.94890
2	PinganTeam	0.40430	0.49410	0.47550	0.48460	0.90210
3	slowders	0.39150	0.45530	0.40380	0.42800	0.90210
4	PATeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PAteam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnAI	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnTeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	pateam	0.38300	0.46150	0.43020	0.44530	0.88940
5	DEMON	0.37450	0.44870	0.39620	0.42080	0.91910
6	Duth3	0.37020	0.45960	0.40750	0.43200	0.94040
6	Topato	0.37020	0.46690	0.42640	0.44580	0.91490
6	gowithnlp	0.37020	0.44260	0.39250	0.41600	0.93620
7	TartanTritons	0.35740	0.11440	0.10190	0.10780	0.72340
8	Fane	0.35320	0.40850	0.36230	0.38400	0.91490
9	NlpUned	0.32770	0.37870	0.33580	0.35600	0.09790
9	QUST	0.32770	0.39040	0.36980	0.37980	0.92340
10	LATeIIMAS	0.31060	0.36710	0.32830	0.34660	0.83830
11	Fredin	0.30210	0.36000	0.33960	0.34950	0.86380
12	clujteam	0.28940	0.34470	0.30570	0.32400	0.86380
13	m1nadzuki	0.25960	0.31490	0.27920	0.29600	0.87660
14	LTG	0.25530	0.07490	0.07550	0.07520	0.58300
15	BERTastic	0.25110	0.31490	0.27920	0.29600	0.86380
15	adithjrajeev	0.25110	0.32140	0.30570	0.31330	0.86810
16	Cimba	0.22550	0.27850	0.24910	0.26290	0.83830
17	Mekky	0.21700	0.29480	0.27920	0.28680	0.80000
18	NarrativeMiners	0.21280	0.26810	0.23770	0.25200	0.68940
18	YNUzwt	0.21280	0.26380	0.23400	0.24800	0.77450
19	FromProblemImportSolve	0.20430	0.29030	0.30570	0.29780	0.77450
20	YNUHPCC	0.19150	0.20850	0.18490	0.19600	0.82550
21	NarrativeNexus	0.18300	0.20850	0.18490	0.19600	0.71910
22	Rosetta	0.17870	0.22920	0.21890	0.22390	0.60430
23	Dhananjaya	0.17450	0.22880	0.20380	0.21560	0.81280
24	Tuebingen	0.17020	0.26340	0.26040	0.26190	0.75740
25	Chrissy	0.14890	0.18720	0.16600	0.17600	0.83400
26	UMZNLP	0.14040	0.21430	0.23770	0.22540	0.70640
27	north	0.08510	0.25870	0.42260	0.32090	0.94890
28	HowardUniversityAI4PC	0.08090	0.08320	0.17740	0.11330	0.69360
29	kzeky	0.06810	0.08090	0.07170	0.07600	0.56600
30	bumblebeeTransformer	0.06380	0.13640	0.16980	0.15130	0.78300
30	eevvgg	0.06380	0.10550	0.17360	0.13120	0.78720
31	Baseline	0.03830	0.04680	0.04150	0.04400	0.28510
32	Team12	0.02130	0.07670	0.09810	0.08610	0.72340
33	cocoa	0.01700	0.08750	0.12450	0.10280	0.82550
34	SemanticaInnovators	0.01280	0.04680	0.16600	0.07300	0.25110
35	TechDacians	0.00000	1.00000	0.00000	0.00000	0.09790
35	teamninebonn	0.00000	0.03260	0.08680	0.04740	0.17870

English - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.62300	0.33700	0.50500	0.37800
2	GATENLP	0.62700	0.35200	0.46300	0.34700
3	hblyl	0.57600	0.36200	0.44000	0.34300
4	COGNAC	0.55400	0.40000	0.42600	0.39100
5	Duth3	0.58100	0.36600	0.42300	0.35400
6	NarrativesHunter	0.50900	0.39500	0.40000	0.40200
7	pinefaith	0.53800	0.38700	0.38800	0.35500
8	23	0.49300	0.39200	0.37700	0.38400
9	iLostTheCode	0.49800	0.36300	0.37300	0.37300
10	KostasThesis2025	0.55600	0.39600	0.36200	0.37000
11	NCLteam	0.48600	0.36300	0.34500	0.36000
12	NarrativesHunter2	0.48800	0.38400	0.34400	0.36700
12	Narrlangen	0.44400	0.41100	0.34400	0.38600
13	PATeam	0.52100	0.35600	0.33900	0.29100
13	PAteam	0.52100	0.35600	0.33900	0.29100
13	PingAnAI	0.52100	0.35600	0.33900	0.29100
13	PingAnTeam	0.52100	0.35600	0.33900	0.29100
13	PinganTeam	0.52100	0.35600	0.33900	0.29100
13	pateam	0.52100	0.35600	0.33900	0.29100
14	UNEDTeam	0.46700	0.36300	0.32700	0.34600
15	YNUzwt	0.48500	0.37800	0.32100	0.33200
16	Narrengers	0.45700	0.36300	0.31800	0.31800
17	CtrlAltElite	0.47400	0.42200	0.31100	0.44600
18	NotMyNarrative	0.40300	0.41400	0.29800	0.39300
19	GeorgeSnape	0.28700	0.45200	0.28700	0.45200
19	IRNLP	0.51600	0.40200	0.28700	0.45200
20	INSAntive	0.32900	0.41200	0.25900	0.38900
21	NLPPraktikumWS2025	0.44800	0.38500	0.25800	0.33700
22	NarrativeMiners	0.36900	0.42400	0.23800	0.42600
23	nlptuducd	0.33800	0.36400	0.22600	0.31700
24	ammd7	0.29400	0.35500	0.22200	0.34300
25	erkk	0.23000	0.40100	0.21100	0.39800
26	UniBonn187	0.40900	0.33000	0.20600	0.22400
27	Irapuarani	0.33500	0.20100	0.18800	0.14100
28	DUTtask10	0.31000	0.40500	0.16500	0.36800
29	LATeIIMAS	0.22200	0.33400	0.16300	0.32300
30	GrammarPolice	0.16800	0.25800	0.06300	0.12400
31	Baseline	0.03000	0.12700	0.01300	0.07000
32	AlAnood	0.00000	0.00000	0.00000	0.00000
32	NarrativeNexus	0.00000	0.00000	0.00000	0.00000
32	bbStar	0.00000	0.00000	0.00000	0.00000

English - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	GPLSICORTEX	0.76754	0.73464	0.75040
2	KyuHyunChoi	0.76686	0.73517	0.75040
3	AITeam	0.74850	0.75229	0.75004
4	TechSSN	0.75417	0.74174	0.74767
5	pateam	0.74821	0.74742	0.74754
6	PingAnAI	0.74930	0.74283	0.74568
7	WordWiz	0.75464	0.73705	0.74551
8	PingAnTeam	0.73870	0.74376	0.74084
9	PinganTeam	0.73410	0.74832	0.74076
10	Duth3	0.73277	0.74676	0.73944
11	NarrativeNexus	0.71991	0.74267	0.73085
12	NarrativeMiners	0.71139	0.74827	0.72910
13	clujteam	0.72350	0.72647	0.72464
14	PAteam	0.72371	0.72589	0.72433
15	Dhananjaya	0.70700	0.72788	0.71689
16	TartanTritons	0.72396	0.70200	0.71245
17	YNUzwt	0.69707	0.70112	0.69885
18	LATeIIMAS	0.70540	0.68674	0.69558
19	bbStar	0.66436	0.72023	0.69103
20	Synapse	0.65986	0.69175	0.67527
21	Baseline	0.65144	0.68344	0.66690
22	DUTtask10	0.00000	0.00000	0.00000
22	Mendel292A	0.00000	0.00000	0.00000
22	UMZNLP	0.00000	0.00000	0.00000
22	ftd	0.00000	0.00000	0.00000

Portuguese - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.59260	0.64950	0.62540	0.63720	0.94610
2	PingAnTeam	0.50510	0.56410	0.54490	0.55430	0.91250
3	PingAnAI	0.49490	0.55130	0.53250	0.54170	0.90570
4	PATeam	0.49160	0.55370	0.52630	0.53970	0.90570
4	PinganTeam	0.49160	0.55310	0.53250	0.54260	0.90240
4	pateam	0.49160	0.54950	0.53250	0.54090	0.90570
5	PAteam	0.48820	0.55020	0.52630	0.53800	0.90240
6	Duth3	0.45790	0.52530	0.48300	0.50320	0.85860
6	QUST	0.45790	0.50990	0.47680	0.49280	0.84510
7	Topato	0.42090	0.49530	0.48610	0.49060	0.88550
8	BERTastic	0.41750	0.47470	0.43650	0.45480	0.84510
9	LTG	0.40740	0.11420	0.11460	0.11440	0.42760
10	DEMON	0.36700	0.43240	0.39630	0.41360	0.80810
11	LATeIIMAS	0.33670	0.38720	0.35600	0.37100	0.71720
12	TartanTritons	0.33330	0.18180	0.16720	0.17420	0.50840
13	gowithnlp	0.26940	0.31650	0.29100	0.30320	0.71380
14	Cimba	0.26260	0.33000	0.30960	0.31950	0.20540
14	FromProblemImportSolve	0.26260	0.32970	0.37150	0.34930	0.65660
15	Fane	0.25590	0.30980	0.28480	0.29680	0.62960
16	Dhananjaya	0.21890	0.26320	0.24770	0.25520	0.76770
17	YNUzwt	0.17510	0.22220	0.20430	0.21290	0.49490
18	HowardUniversityAI4PC	0.13130	0.11320	0.22600	0.15080	0.51850
19	Baseline	0.04710	0.05050	0.04640	0.04840	0.36030
20	teamninebonn	0.00000	0.04040	0.11150	0.05930	0.44110

Portuguese - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.66400	0.26000	0.48000	0.25400
2	INSALyon2	0.67900	0.26300	0.43300	0.20900
3	PATeam	0.54100	0.29000	0.40900	0.26900
3	PAteam	0.54100	0.29000	0.40900	0.26900
3	PingAnAI	0.54100	0.29000	0.40900	0.26900
3	PingAnTeam	0.54100	0.29000	0.40900	0.26900
3	PinganTeam	0.54100	0.29000	0.40900	0.26900
3	pateam	0.54100	0.29000	0.40900	0.26900
4	Duth3	0.62600	0.23900	0.40700	0.20000
5	KostasThesis2025	0.53900	0.21400	0.32900	0.17100
6	hblyl	0.59000	0.30700	0.32000	0.25700
7	iLostTheCode	0.54700	0.22800	0.31900	0.18200
8	23	0.48700	0.33800	0.31300	0.25700
9	Narrlangen	0.48000	0.33900	0.29100	0.25900
10	UNEDTeam	0.53700	0.32400	0.27000	0.26200
11	YNUzwt	0.56800	0.30100	0.26600	0.27700
12	Irapuarani	0.43500	0.19500	0.22500	0.12900
13	INSAntive	0.49100	0.27500	0.21500	0.20400
14	COGNAC	0.34200	0.36200	0.18600	0.26200
15	CtrlAltElite	0.49200	0.31600	0.14900	0.21900
16	NotMyNarrative	0.22800	0.25000	0.12400	0.11100
17	DUTtask10	0.10700	0.24100	0.02600	0.13400
18	erkk	0.05500	0.17500	0.02100	0.07700
19	Baseline	0.03700	0.14000	0.01400	0.07000

Portuguese - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnTeam	0.76861	0.74874	0.75801
2	PinganTeam	0.76097	0.75381	0.75690
3	pateam	0.76003	0.75202	0.75548
4	Duth3	0.75861	0.75253	0.75517
5	PingAnAI	0.75403	0.74702	0.75005
6	WordWiz	0.75931	0.73885	0.74857
7	PAteam	0.75365	0.73984	0.74637
8	AITeam	0.74654	0.73767	0.74158
9	bbStar	0.70991	0.72924	0.71926
10	Dhananjaya	0.70979	0.72318	0.71614
11	YNUzwt	0.68986	0.68603	0.68771
12	TartanTritons	0.69764	0.67419	0.68540
13	Baseline	0.67822	0.68297	0.68046
14	LATeIIMAS	0.68395	0.66339	0.67297
15	DUTtask10	0.00000	0.00000	0.00000

Russian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.56540	0.61750	0.59030	0.60360	0.85510
2	QUST	0.51400	0.56280	0.53300	0.54750	0.83180
3	TartanTritons	0.47200	0.16200	0.15420	0.15800	0.43930
4	BERTastic	0.46730	0.50470	0.47580	0.48980	0.78970
4	DEMON	0.46730	0.51420	0.48020	0.49660	0.81310
5	Duth3	0.45330	0.48600	0.45810	0.47170	0.79440
6	gowithnlp	0.44860	0.48130	0.45370	0.46710	0.86450
7	PATeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PAteam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PingAnAI	0.44390	0.50230	0.48900	0.49550	0.80840
7	PingAnTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PinganTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	Topato	0.44390	0.50440	0.50660	0.50550	0.78500
7	pateam	0.44390	0.49780	0.48900	0.49330	0.78040
8	LTG	0.42990	0.08620	0.08810	0.08710	0.35980
9	Cimba	0.38320	0.41670	0.39650	0.40630	0.33640
10	FromProblemImportSolve	0.35510	0.43700	0.51980	0.47480	0.75230
11	LATeIIMAS	0.31310	0.36040	0.35240	0.35630	0.64490
12	Dhananjaya	0.29440	0.32560	0.30840	0.31670	0.66360
12	YNUzwt	0.29440	0.32710	0.30840	0.31750	0.59350
13	Fane	0.24300	0.27570	0.25990	0.26760	0.60750
14	HowardUniversityAI4PC	0.12620	0.07590	0.12780	0.09520	0.42520
15	Baseline	0.05140	0.06070	0.05730	0.05900	0.34110

Russian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.70900	0.27400	0.51800	0.28200
2	Duth3	0.64700	0.30800	0.48100	0.26200
3	iLostTheCode	0.59700	0.27900	0.44000	0.25100
4	INSALyon2	0.55600	0.31400	0.43700	0.27000
5	PATeam	0.56600	0.26800	0.43400	0.24700
5	PAteam	0.56600	0.26800	0.43400	0.24700
5	PingAnAI	0.56600	0.26800	0.43400	0.24700
5	PingAnTeam	0.56600	0.26800	0.43400	0.24700
5	PinganTeam	0.56600	0.26800	0.43400	0.24700
5	pateam	0.56600	0.26800	0.43400	0.24700
6	Narrlangen	0.57400	0.37000	0.40500	0.32400
7	KostasThesis2025	0.57100	0.34400	0.40000	0.28300
8	hblyl	0.50800	0.37200	0.35400	0.31900
9	UNEDTeam	0.51300	0.32500	0.33000	0.27000
10	INSAntive	0.55400	0.32800	0.32300	0.34200
11	UniBonn187	0.55000	0.30300	0.23100	0.17800
12	Irapuarani	0.35900	0.15000	0.19100	0.09200
13	COGNAC	0.24800	0.35500	0.18300	0.30600
14	YNUzwt	0.21300	0.35900	0.14800	0.25700
15	IRNLP	0.53700	0.35100	0.11600	0.25200
16	GrammarPolice	0.00000	0.00000	0.05000	0.21800
17	DUTtask10	0.04000	0.18500	0.03300	0.18000
18	NotMyNarrative	0.12900	0.24600	0.01900	0.12800
19	Baseline	0.06500	0.21300	0.00800	0.06400
20	AlAnood	0.00000	0.00000	0.00000	0.00000
20	LATeIIMAS	0.00000	0.00000	0.00000	0.00000

Russian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnAI	0.72469	0.71512	0.71904
2	PinganTeam	0.71787	0.72144	0.71888
3	Duth3	0.71796	0.71537	0.71634
4	PingAnTeam	0.71926	0.70627	0.71205
5	pateam	0.71232	0.71232	0.71166
6	AITeam	0.71354	0.71034	0.71136
7	PAteam	0.69984	0.71423	0.70639
8	WordWiz	0.70193	0.70730	0.70395
9	TartanTritons	0.68271	0.68155	0.68159
10	YNUzwt	0.66621	0.68632	0.67578
11	bbStar	0.63433	0.69813	0.66440
12	DUTtask10	0.65979	0.66845	0.66379
13	Dhananjaya	0.63668	0.69308	0.66324
14	Baseline	0.62206	0.66872	0.64427
15	LATeIIMAS	0.61043	0.67674	0.64161

Bulgarian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	PingAnAI	0.53230	0.54760	0.53910	0.54330	0.92740
2	PATeam	0.51610	0.53970	0.53120	0.53540	0.92740
3	DUTIR	0.50810	0.53730	0.56250	0.54960	0.94350
4	pateam	0.48390	0.51180	0.50780	0.50980	0.94350
5	PAteam	0.46770	0.49600	0.48440	0.49010	0.94350
5	PingAnTeam	0.46770	0.48820	0.48440	0.48630	0.94350
5	PinganTeam	0.46770	0.49610	0.49220	0.49410	0.94350
6	DEMON	0.45970	0.47970	0.46090	0.47010	0.88710
7	Duth3	0.45160	0.46770	0.45310	0.46030	0.92740
8	gowithnlp	0.43550	0.45970	0.44530	0.45240	0.83060
9	TartanTritons	0.41130	0.09680	0.09380	0.09520	0.55650
10	QUST	0.38710	0.39200	0.38280	0.38740	0.84680
11	BERTastic	0.35480	0.37100	0.35940	0.36510	0.87100
12	Fane	0.34680	0.36290	0.35160	0.35710	0.77420
13	LTG	0.31450	0.04930	0.05470	0.05190	0.55650
13	Topato	0.31450	0.33820	0.35940	0.34850	0.80650
14	Cimba	0.25810	0.26980	0.26560	0.26770	0.25000
15	FromProblemImportSolve	0.20970	0.28660	0.36720	0.32190	0.80650
16	Dhananjaya	0.19350	0.21090	0.21090	0.21090	0.69350
17	Fredin	0.10480	0.12410	0.13280	0.12830	0.60480
18	HowardUniversityAI4PC	0.09680	0.07920	0.14840	0.10330	0.51610
19	Baseline	0.04030	0.04030	0.03910	0.03970	0.25810
20	TechDacians	0.00000	1.00000	0.00000	0.00000	0.25000

Bulgarian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	PATeam	0.63100	0.33800	0.46000	0.33300
1	PingAnAI	0.63100	0.33800	0.46000	0.33300
1	PingAnTeam	0.63100	0.33800	0.46000	0.33300
1	PinganTeam	0.63100	0.33800	0.46000	0.33300
1	pateam	0.63100	0.33800	0.46000	0.33300
2	PAteam	0.57500	0.32900	0.44200	0.30700
3	INSALyon2	0.57500	0.35000	0.43600	0.35700
4	Duth3	0.57800	0.37400	0.41600	0.36200
4	GATENLP	0.62900	0.33200	0.41600	0.28600
5	iLostTheCode	0.55800	0.35100	0.39100	0.35200
6	hblyl	0.56600	0.40200	0.37100	0.38300
7	UNEDTeam	0.57400	0.35300	0.36300	0.31200
8	KostasThesis2025	0.52300	0.37100	0.35700	0.34900
9	Narrlangen	0.49500	0.40100	0.35500	0.37600
10	INSAntive	0.52300	0.36600	0.32400	0.36000
11	Irapuarani	0.36600	0.17700	0.18300	0.12000
12	NotMyNarrative	0.24900	0.30600	0.14200	0.22800
13	DUTtask10	0.17200	0.34100	0.12100	0.31200
14	erkk	0.15200	0.34000	0.12000	0.31000
15	LATeIIMAS	0.17700	0.26600	0.07200	0.16900
16	Baseline	0.05600	0.19100	0.02200	0.11900
17	AlAnood	0.00000	0.00000	0.00000	0.00000

Bulgarian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.73485	0.70303	0.71818
2	PinganTeam	0.72676	0.71052	0.71815
3	pateam	0.72369	0.70837	0.71557
4	PingAnTeam	0.72954	0.70028	0.71418
5	Duth3	0.72483	0.70127	0.71265
6	PingAnAI	0.71217	0.69934	0.70527
7	PAteam	0.71405	0.69478	0.70396
8	Dhananjaya	0.67695	0.69378	0.68508
9	WordWiz	0.69034	0.67816	0.68390
10	bbStar	0.65751	0.68740	0.67198
11	TartanTritons	0.66758	0.64399	0.65531
12	Baseline	0.62739	0.64180	0.63430
13	LATeIIMAS	0.62947	0.61907	0.62406
14	DUTtask10	0.00000	0.00000	0.00000

Hindi - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	QUST	0.46840	0.59060	0.49480	0.53850	0.76900
2	TartanTritons	0.44620	0.18940	0.15970	0.17330	0.32910
3	BERTastic	0.43990	0.56560	0.47380	0.51570	0.78480
4	DEMON	0.40190	0.52530	0.43460	0.47560	0.75630
4	Duth3	0.40190	0.52530	0.43460	0.47560	0.79110
5	Topato	0.37340	0.50570	0.46340	0.48360	0.73420
6	LTG	0.36390	0.16580	0.15970	0.16270	0.37660
7	Cimba	0.35440	0.45310	0.37960	0.41310	0.47150
8	gowithnlp	0.33540	0.43990	0.36390	0.39830	0.71520
9	DUTIR	0.29430	0.37660	0.31150	0.34100	0.59810
10	Dhananjaya	0.27850	0.37660	0.31150	0.34100	0.70890
11	LATeIIMAS	0.27220	0.37110	0.40310	0.38640	0.63610
12	PATeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PAteam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PingAnAI	0.26900	0.35330	0.29320	0.32050	0.69620
12	PinganTeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	pateam	0.26900	0.35330	0.29320	0.32050	0.69620
13	FromProblemImportSolve	0.25630	0.37410	0.39270	0.38310	0.66770
13	PingAnTeam	0.25630	0.32490	0.26960	0.29470	0.67720
14	Fane	0.23420	0.31650	0.26180	0.28650	0.65510
15	HowardUniversityAI4PC	0.16770	0.11460	0.15180	0.13060	0.35440
16	Baseline	0.05700	0.07910	0.06540	0.07160	0.32280

Hindi - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.67300	0.42100	0.58100	0.44100
2	DUTtask10	0.56900	0.48400	0.53500	0.49400
3	IRNLP	0.37500	0.46700	0.51500	0.50000
4	hblyl	0.58400	0.45400	0.48900	0.47800
5	Duth3	0.47200	0.45600	0.40600	0.44500
6	Narrlangen	0.39500	0.46400	0.38500	0.46500
7	UNEDTeam	0.44900	0.46000	0.37600	0.45600
8	erkk	0.38200	0.47900	0.37400	0.47900
9	KostasThesis2025	0.45300	0.44100	0.34100	0.45000
10	GATENLP	0.40900	0.41000	0.32100	0.37900
11	INSAntive	0.36500	0.44000	0.26500	0.41400
12	NotMyNarrative	0.31800	0.44900	0.24300	0.40800
13	PATeam	0.39200	0.39000	0.21800	0.35000
13	PAteam	0.39200	0.39000	0.21800	0.35000
13	PingAnAI	0.39200	0.39000	0.21800	0.35000
13	PingAnTeam	0.39200	0.39000	0.21800	0.35000
13	PinganTeam	0.39200	0.39000	0.21800	0.35000
13	pateam	0.39200	0.39000	0.21800	0.35000
14	iLostTheCode	0.22700	0.37800	0.17400	0.33900
15	Irapuarani	0.23400	0.12500	0.11100	0.08200
16	LATeIIMAS	0.09700	0.18500	0.02900	0.10200
17	Baseline	0.08100	0.26000	0.00000	0.00000
18	bbStar	0.00000	0.00000	0.00000	0.00000

Hindi - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.75576	0.76231	0.75845
2	pateam	0.75656	0.75959	0.75774
3	PinganTeam	0.75605	0.75613	0.75574
4	PAteam	0.75097	0.76045	0.75540
5	PingAnAI	0.74263	0.75416	0.74792
6	Duth3	0.74819	0.74536	0.74655
7	PingAnTeam	0.73661	0.74691	0.74145
8	WordWiz	0.72859	0.73914	0.73356
9	bbStar	0.71789	0.73704	0.72712
10	Dhananjaya	0.72143	0.72156	0.72125
11	TartanTritons	0.69679	0.70119	0.69873
12	Baseline	0.66802	0.67188	0.66974
13	DUTtask10	0.00000	0.00000	0.00000
13	INSALyon2	0.00000	0.00000	0.00000

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval 2025 shared task on "Multilingual Characterization and Extraction of Narratives from Online News"

Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Portuguese - Subtask 1

Portuguese - Subtask 2

Portuguese - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

Bulgarian - Subtask 1

Bulgarian - Subtask 2

Bulgarian - Subtask 3

Hindi - Subtask 1

Hindi - Subtask 2

Hindi - Subtask 3

Contact