Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.41280	0.48100	0.43020	0.45420	0.94890
2	PinganTeam	0.40430	0.49410	0.47550	0.48460	0.90210
3	slowders	0.39150	0.45530	0.40380	0.42800	0.90210
4	PATeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PAteam	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnAI	0.38300	0.46150	0.43020	0.44530	0.88940
4	PingAnTeam	0.38300	0.46150	0.43020	0.44530	0.88940
4	pateam	0.38300	0.46150	0.43020	0.44530	0.88940
5	DEMON	0.37450	0.44870	0.39620	0.42080	0.91910
6	Duth3	0.37020	0.45960	0.40750	0.43200	0.94040
6	Topato	0.37020	0.46690	0.42640	0.44580	0.91490
6	gowithnlp	0.37020	0.44260	0.39250	0.41600	0.93620
7	TartanTritons	0.35740	0.11440	0.10190	0.10780	0.72340
8	Fane	0.35320	0.40850	0.36230	0.38400	0.91490
9	NlpUned	0.32770	0.37870	0.33580	0.35600	0.09790
9	QUST	0.32770	0.39040	0.36980	0.37980	0.92340
10	LATeIIMAS	0.31060	0.36710	0.32830	0.34660	0.83830
11	Fredin	0.30210	0.36000	0.33960	0.34950	0.86380
12	clujteam	0.28940	0.34470	0.30570	0.32400	0.86380
13	m1nadzuki	0.25960	0.31490	0.27920	0.29600	0.87660
14	LTG	0.25530	0.07490	0.07550	0.07520	0.58300
15	BERTastic	0.25110	0.31490	0.27920	0.29600	0.86380
15	adithjrajeev	0.25110	0.32140	0.30570	0.31330	0.86810
16	Cimba	0.22550	0.27850	0.24910	0.26290	0.83830
17	Mekky	0.21700	0.29480	0.27920	0.28680	0.80000
18	NarrativeMiners	0.21280	0.26810	0.23770	0.25200	0.68940
18	YNUzwt	0.21280	0.26380	0.23400	0.24800	0.77450
19	FromProblemImportSolve	0.20430	0.29030	0.30570	0.29780	0.77450
20	YNUHPCC	0.19150	0.20850	0.18490	0.19600	0.82550
21	NarrativeNexus	0.18300	0.20850	0.18490	0.19600	0.71910
22	Rosetta	0.17870	0.22920	0.21890	0.22390	0.60430
23	Dhananjaya	0.17450	0.22880	0.20380	0.21560	0.81280
24	Tuebingen	0.17020	0.26340	0.26040	0.26190	0.75740
25	Chrissy	0.14890	0.18720	0.16600	0.17600	0.83400
26	UMZNLP	0.14040	0.21430	0.23770	0.22540	0.70640
27	north	0.08510	0.25870	0.42260	0.32090	0.94890
28	HowardUniversityAI4PC	0.08090	0.08320	0.17740	0.11330	0.69360
29	kzeky	0.06810	0.08090	0.07170	0.07600	0.56600
30	bumblebeeTransformer	0.06380	0.13640	0.16980	0.15130	0.78300
30	eevvgg	0.06380	0.10550	0.17360	0.13120	0.78720
31	Baseline	0.03830	0.04680	0.04150	0.04400	0.28510
32	Team12	0.02130	0.07670	0.09810	0.08610	0.72340
33	cocoa	0.01700	0.08750	0.12450	0.10280	0.82550
34	SemanticaInnovators	0.01280	0.04680	0.16600	0.07300	0.25110
35	TechDacians	0.00000	1.00000	0.00000	0.00000	0.09790
35	teamninebonn	0.00000	0.03260	0.08680	0.04740	0.17870

English - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.62300	0.33700	0.50500	0.37800
2	GATENLP	0.62700	0.35200	0.46300	0.34700
3	hblyl	0.57600	0.36200	0.44000	0.34300
4	cr00	0.53500	0.38400	0.42900	0.37300
5	COGNAC	0.55400	0.40000	0.42600	0.39100
6	Duth3	0.58100	0.36600	0.42300	0.35400
7	NarrativesHunter	0.50900	0.39500	0.40000	0.40200
8	pinefaith	0.53800	0.38700	0.38800	0.35500
9	23	0.49300	0.39200	0.37700	0.38400
10	iLostTheCode	0.49800	0.36300	0.37300	0.37300
11	KostasThesis2025	0.55600	0.39600	0.36200	0.37000
12	NCLteam	0.48600	0.36300	0.34500	0.36000
13	NarrativesHunter2	0.48800	0.38400	0.34400	0.36700
13	Narrlangen	0.44400	0.41100	0.34400	0.38600
14	PATeam	0.52100	0.35600	0.33900	0.29100
14	PAteam	0.52100	0.35600	0.33900	0.29100
14	PingAnAI	0.52100	0.35600	0.33900	0.29100
14	PingAnTeam	0.52100	0.35600	0.33900	0.29100
14	PinganTeam	0.52100	0.35600	0.33900	0.29100
14	pateam	0.52100	0.35600	0.33900	0.29100
15	UNEDTeam	0.46700	0.36300	0.32700	0.34600
16	YNUzwt	0.48500	0.37800	0.32100	0.33200
17	Narrengers	0.45700	0.36300	0.31800	0.31800
18	CtrlAltElite	0.47400	0.42200	0.31100	0.44600
19	NotMyNarrative	0.40300	0.41400	0.29800	0.39300
20	GeorgeSnape	0.28700	0.45200	0.28700	0.45200
20	IRNLP	0.51600	0.40200	0.28700	0.45200
21	INSAntive	0.32900	0.41200	0.25900	0.38900
22	NLPPraktikumWS2025	0.44800	0.38500	0.25800	0.33700
23	NarrativeMiners	0.36900	0.42400	0.23800	0.42600
24	nlptuducd	0.33800	0.36400	0.22600	0.31700
25	ammd7	0.29400	0.35500	0.22200	0.34300
26	erkk	0.23000	0.40100	0.21100	0.39800
27	UniBonn187	0.40900	0.33000	0.20600	0.22400
28	Irapuarani	0.33500	0.20100	0.18800	0.14100
29	DUTtask10	0.31000	0.40500	0.16500	0.36800
30	LATeIIMAS	0.22200	0.33400	0.16300	0.32300
31	GrammarPolice	0.16800	0.25800	0.06300	0.12400
32	Baseline	0.03000	0.12700	0.01300	0.07000
33	AlAnood	0.00000	0.00000	0.00000	0.00000
33	NarrativeNexus	0.00000	0.00000	0.00000	0.00000
33	bbStar	0.00000	0.00000	0.00000	0.00000

English - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	GPLSICORTEX	0.76754	0.73464	0.75040
2	KyuHyunChoi	0.76686	0.73517	0.75040
3	AITeam	0.74850	0.75229	0.75004
4	TechSSN	0.75417	0.74174	0.74767
5	pateam	0.74821	0.74742	0.74754
6	PingAnAI	0.74930	0.74283	0.74568
7	WordWiz	0.75464	0.73705	0.74551
8	PingAnTeam	0.73870	0.74376	0.74084
9	PinganTeam	0.73410	0.74832	0.74076
10	Duth3	0.73277	0.74676	0.73944
11	NarrativeNexus	0.71991	0.74267	0.73085
12	NarrativeMiners	0.71139	0.74827	0.72910
13	clujteam	0.72350	0.72647	0.72464
14	PAteam	0.72371	0.72589	0.72433
15	Dhananjaya	0.70700	0.72788	0.71689
16	TartanTritons	0.72396	0.70200	0.71245
17	YNUzwt	0.69707	0.70112	0.69885
18	LATeIIMAS	0.70540	0.68674	0.69558
19	bbStar	0.66436	0.72023	0.69103
20	Synapse	0.65986	0.69175	0.67527
21	Baseline	0.65144	0.68344	0.66690
22	DUTtask10	0.00000	0.00000	0.00000
22	Mendel292A	0.00000	0.00000	0.00000
22	UMZNLP	0.00000	0.00000	0.00000
22	ftd	0.00000	0.00000	0.00000
22	hblyl	0.00000	0.00000	0.00000

Portuguese - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.59260	0.64950	0.62540	0.63720	0.94610
2	PingAnTeam	0.50510	0.56410	0.54490	0.55430	0.91250
3	PingAnAI	0.49490	0.55130	0.53250	0.54170	0.90570
4	PATeam	0.49160	0.55370	0.52630	0.53970	0.90570
4	PinganTeam	0.49160	0.55310	0.53250	0.54260	0.90240
4	pateam	0.49160	0.54950	0.53250	0.54090	0.90570
5	PAteam	0.48820	0.55020	0.52630	0.53800	0.90240
6	Duth3	0.45790	0.52530	0.48300	0.50320	0.85860
6	QUST	0.45790	0.50990	0.47680	0.49280	0.84510
7	Topato	0.42090	0.49530	0.48610	0.49060	0.88550
8	BERTastic	0.41750	0.47470	0.43650	0.45480	0.84510
9	LTG	0.40740	0.11420	0.11460	0.11440	0.42760
10	DEMON	0.36700	0.43240	0.39630	0.41360	0.80810
11	LATeIIMAS	0.33670	0.38720	0.35600	0.37100	0.71720
12	TartanTritons	0.33330	0.18180	0.16720	0.17420	0.50840
13	gowithnlp	0.26940	0.31650	0.29100	0.30320	0.71380
14	Cimba	0.26260	0.33000	0.30960	0.31950	0.20540
14	FromProblemImportSolve	0.26260	0.32970	0.37150	0.34930	0.65660
15	Fane	0.25590	0.30980	0.28480	0.29680	0.62960
16	Dhananjaya	0.21890	0.26320	0.24770	0.25520	0.76770
17	YNUzwt	0.17510	0.22220	0.20430	0.21290	0.49490
18	HowardUniversityAI4PC	0.13130	0.11320	0.22600	0.15080	0.51850
19	Baseline	0.04710	0.05050	0.04640	0.04840	0.36030
20	teamninebonn	0.00000	0.04040	0.11150	0.05930	0.44110

Portuguese - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.66400	0.26000	0.48000	0.25400
2	INSALyon2	0.67900	0.26300	0.43300	0.20900
3	PATeam	0.54100	0.29000	0.40900	0.26900
3	PAteam	0.54100	0.29000	0.40900	0.26900
3	PingAnAI	0.54100	0.29000	0.40900	0.26900
3	PingAnTeam	0.54100	0.29000	0.40900	0.26900
3	PinganTeam	0.54100	0.29000	0.40900	0.26900
3	pateam	0.54100	0.29000	0.40900	0.26900
4	Duth3	0.62600	0.23900	0.40700	0.20000
5	hblyl	0.64400	0.23700	0.40100	0.23100
6	cr00	0.63300	0.27800	0.33500	0.24600
7	KostasThesis2025	0.53900	0.21400	0.32900	0.17100
8	iLostTheCode	0.54700	0.22800	0.31900	0.18200
9	23	0.48700	0.33800	0.31300	0.25700
10	Narrlangen	0.48000	0.33900	0.29100	0.25900
11	UNEDTeam	0.53700	0.32400	0.27000	0.26200
12	YNUzwt	0.56800	0.30100	0.26600	0.27700
13	Irapuarani	0.43500	0.19500	0.22500	0.12900
14	INSAntive	0.49100	0.27500	0.21500	0.20400
15	COGNAC	0.34200	0.36200	0.18600	0.26200
16	CtrlAltElite	0.49200	0.31600	0.14900	0.21900
17	NotMyNarrative	0.22800	0.25000	0.12400	0.11100
18	DUTtask10	0.10700	0.24100	0.02600	0.13400
19	erkk	0.05500	0.17500	0.02100	0.07700
20	Baseline	0.03700	0.14000	0.01400	0.07000

Portuguese - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnTeam	0.76861	0.74874	0.75801
2	PinganTeam	0.76097	0.75381	0.75690
3	pateam	0.76003	0.75202	0.75548
4	Duth3	0.75861	0.75253	0.75517
5	PingAnAI	0.75403	0.74702	0.75005
6	WordWiz	0.75931	0.73885	0.74857
7	PAteam	0.75365	0.73984	0.74637
8	AITeam	0.74654	0.73767	0.74158
9	bbStar	0.70991	0.72924	0.71926
10	Dhananjaya	0.70979	0.72318	0.71614
11	YNUzwt	0.68986	0.68603	0.68771
12	TartanTritons	0.69764	0.67419	0.68540
13	Baseline	0.67822	0.68297	0.68046
14	LATeIIMAS	0.68395	0.66339	0.67297
15	DUTtask10	0.00000	0.00000	0.00000

Russian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	DUTIR	0.56540	0.61750	0.59030	0.60360	0.85510
2	QUST	0.51400	0.56280	0.53300	0.54750	0.83180
3	TartanTritons	0.47200	0.16200	0.15420	0.15800	0.43930
4	BERTastic	0.46730	0.50470	0.47580	0.48980	0.78970
4	DEMON	0.46730	0.51420	0.48020	0.49660	0.81310
5	Duth3	0.45330	0.48600	0.45810	0.47170	0.79440
6	gowithnlp	0.44860	0.48130	0.45370	0.46710	0.86450
7	PATeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PAteam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PingAnAI	0.44390	0.50230	0.48900	0.49550	0.80840
7	PingAnTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	PinganTeam	0.44390	0.49780	0.48900	0.49330	0.78040
7	Topato	0.44390	0.50440	0.50660	0.50550	0.78500
7	pateam	0.44390	0.49780	0.48900	0.49330	0.78040
8	LTG	0.42990	0.08620	0.08810	0.08710	0.35980
9	Cimba	0.38320	0.41670	0.39650	0.40630	0.33640
10	FromProblemImportSolve	0.35510	0.43700	0.51980	0.47480	0.75230
11	LATeIIMAS	0.31310	0.36040	0.35240	0.35630	0.64490
12	Dhananjaya	0.29440	0.32560	0.30840	0.31670	0.66360
12	YNUzwt	0.29440	0.32710	0.30840	0.31750	0.59350
13	Fane	0.24300	0.27570	0.25990	0.26760	0.60750
14	HowardUniversityAI4PC	0.12620	0.07590	0.12780	0.09520	0.42520
15	Baseline	0.05140	0.06070	0.05730	0.05900	0.34110

Russian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	GATENLP	0.70900	0.27400	0.51800	0.28200
2	Duth3	0.64700	0.30800	0.48100	0.26200
3	iLostTheCode	0.59700	0.27900	0.44000	0.25100
4	INSALyon2	0.55600	0.31400	0.43700	0.27000
5	PATeam	0.56600	0.26800	0.43400	0.24700
5	PAteam	0.56600	0.26800	0.43400	0.24700
5	PingAnAI	0.56600	0.26800	0.43400	0.24700
5	PingAnTeam	0.56600	0.26800	0.43400	0.24700
5	PinganTeam	0.56600	0.26800	0.43400	0.24700
5	pateam	0.56600	0.26800	0.43400	0.24700
6	hblyl	0.61500	0.32300	0.40600	0.33800
7	Narrlangen	0.57400	0.37000	0.40500	0.32400
8	KostasThesis2025	0.57100	0.34400	0.40000	0.28300
9	cr00	0.45100	0.35700	0.33300	0.33100
10	UNEDTeam	0.51300	0.32500	0.33000	0.27000
11	INSAntive	0.55400	0.32800	0.32300	0.34200
12	UniBonn187	0.55000	0.30300	0.23100	0.17800
13	Irapuarani	0.35900	0.15000	0.19100	0.09200
14	COGNAC	0.24800	0.35500	0.18300	0.30600
15	YNUzwt	0.21300	0.35900	0.14800	0.25700
16	IRNLP	0.53700	0.35100	0.11600	0.25200
17	GrammarPolice	0.00000	0.00000	0.05000	0.21800
18	DUTtask10	0.04000	0.18500	0.03300	0.18000
19	NotMyNarrative	0.12900	0.24600	0.01900	0.12800
20	Baseline	0.06500	0.21300	0.00800	0.06400
21	AlAnood	0.00000	0.00000	0.00000	0.00000
21	LATeIIMAS	0.00000	0.00000	0.00000	0.00000

Russian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	PingAnAI	0.72469	0.71512	0.71904
2	PinganTeam	0.71787	0.72144	0.71888
3	Duth3	0.71796	0.71537	0.71634
4	PingAnTeam	0.71926	0.70627	0.71205
5	pateam	0.71232	0.71232	0.71166
6	AITeam	0.71354	0.71034	0.71136
7	PAteam	0.69984	0.71423	0.70639
8	WordWiz	0.70193	0.70730	0.70395
9	TartanTritons	0.68271	0.68155	0.68159
10	YNUzwt	0.66621	0.68632	0.67578
11	bbStar	0.63433	0.69813	0.66440
12	DUTtask10	0.65979	0.66845	0.66379
13	Dhananjaya	0.63668	0.69308	0.66324
14	Baseline	0.62206	0.66872	0.64427
15	LATeIIMAS	0.61043	0.67674	0.64161

Bulgarian - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	PingAnAI	0.53230	0.54760	0.53910	0.54330	0.92740
2	PATeam	0.51610	0.53970	0.53120	0.53540	0.92740
3	DUTIR	0.50810	0.53730	0.56250	0.54960	0.94350
4	pateam	0.48390	0.51180	0.50780	0.50980	0.94350
5	PAteam	0.46770	0.49600	0.48440	0.49010	0.94350
5	PingAnTeam	0.46770	0.48820	0.48440	0.48630	0.94350
5	PinganTeam	0.46770	0.49610	0.49220	0.49410	0.94350
6	DEMON	0.45970	0.47970	0.46090	0.47010	0.88710
7	Duth3	0.45160	0.46770	0.45310	0.46030	0.92740
8	gowithnlp	0.43550	0.45970	0.44530	0.45240	0.83060
9	TartanTritons	0.41130	0.09680	0.09380	0.09520	0.55650
10	QUST	0.38710	0.39200	0.38280	0.38740	0.84680
11	BERTastic	0.35480	0.37100	0.35940	0.36510	0.87100
12	Fane	0.34680	0.36290	0.35160	0.35710	0.77420
13	LTG	0.31450	0.04930	0.05470	0.05190	0.55650
13	Topato	0.31450	0.33820	0.35940	0.34850	0.80650
14	Cimba	0.25810	0.26980	0.26560	0.26770	0.25000
15	FromProblemImportSolve	0.20970	0.28660	0.36720	0.32190	0.80650
16	Dhananjaya	0.19350	0.21090	0.21090	0.21090	0.69350
17	Fredin	0.10480	0.12410	0.13280	0.12830	0.60480
18	HowardUniversityAI4PC	0.09680	0.07920	0.14840	0.10330	0.51610
19	Baseline	0.04030	0.04030	0.03910	0.03970	0.25810
20	TechDacians	0.00000	1.00000	0.00000	0.00000	0.25000

Bulgarian - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	PATeam	0.63100	0.33800	0.46000	0.33300
1	PingAnAI	0.63100	0.33800	0.46000	0.33300
1	PingAnTeam	0.63100	0.33800	0.46000	0.33300
1	PinganTeam	0.63100	0.33800	0.46000	0.33300
1	pateam	0.63100	0.33800	0.46000	0.33300
2	PAteam	0.57500	0.32900	0.44200	0.30700
3	INSALyon2	0.57500	0.35000	0.43600	0.35700
4	Duth3	0.57800	0.37400	0.41600	0.36200
4	GATENLP	0.62900	0.33200	0.41600	0.28600
5	cr00	0.59000	0.38100	0.41300	0.34400
6	iLostTheCode	0.55800	0.35100	0.39100	0.35200
7	hblyl	0.56600	0.40200	0.37100	0.38300
8	UNEDTeam	0.57400	0.35300	0.36300	0.31200
9	KostasThesis2025	0.52300	0.37100	0.35700	0.34900
10	Narrlangen	0.49500	0.40100	0.35500	0.37600
11	INSAntive	0.52300	0.36600	0.32400	0.36000
12	Irapuarani	0.36600	0.17700	0.18300	0.12000
13	NotMyNarrative	0.24900	0.30600	0.14200	0.22800
14	DUTtask10	0.17200	0.34100	0.12100	0.31200
15	erkk	0.15200	0.34000	0.12000	0.31000
16	LATeIIMAS	0.17700	0.26600	0.07200	0.16900
17	Baseline	0.05600	0.19100	0.02200	0.11900
18	AlAnood	0.00000	0.00000	0.00000	0.00000

Bulgarian - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.73485	0.70303	0.71818
2	PinganTeam	0.72676	0.71052	0.71815
3	pateam	0.72369	0.70837	0.71557
4	PingAnTeam	0.72954	0.70028	0.71418
5	Duth3	0.72483	0.70127	0.71265
6	PingAnAI	0.71217	0.69934	0.70527
7	PAteam	0.71405	0.69478	0.70396
8	Dhananjaya	0.67695	0.69378	0.68508
9	WordWiz	0.69034	0.67816	0.68390
10	bbStar	0.65751	0.68740	0.67198
11	TartanTritons	0.66758	0.64399	0.65531
12	Baseline	0.62739	0.64180	0.63430
13	LATeIIMAS	0.62947	0.61907	0.62406
14	DUTtask10	0.00000	0.00000	0.00000

Hindi - Subtask 1

Rank	Team	Exact Match Ratio	micro P	micro R	micro F1	Accuracy for main role
1	QUST	0.46840	0.59060	0.49480	0.53850	0.76900
2	TartanTritons	0.44620	0.18940	0.15970	0.17330	0.32910
3	BERTastic	0.43990	0.56560	0.47380	0.51570	0.78480
4	DEMON	0.40190	0.52530	0.43460	0.47560	0.75630
4	Duth3	0.40190	0.52530	0.43460	0.47560	0.79110
5	Topato	0.37340	0.50570	0.46340	0.48360	0.73420
6	LTG	0.36390	0.16580	0.15970	0.16270	0.37660
7	Cimba	0.35440	0.45310	0.37960	0.41310	0.47150
8	gowithnlp	0.33540	0.43990	0.36390	0.39830	0.71520
9	DUTIR	0.29430	0.37660	0.31150	0.34100	0.59810
10	Dhananjaya	0.27850	0.37660	0.31150	0.34100	0.70890
11	LATeIIMAS	0.27220	0.37110	0.40310	0.38640	0.63610
12	PATeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PAteam	0.26900	0.35330	0.29320	0.32050	0.69620
12	PingAnAI	0.26900	0.35330	0.29320	0.32050	0.69620
12	PinganTeam	0.26900	0.35330	0.29320	0.32050	0.69620
12	pateam	0.26900	0.35330	0.29320	0.32050	0.69620
13	FromProblemImportSolve	0.25630	0.37410	0.39270	0.38310	0.66770
13	PingAnTeam	0.25630	0.32490	0.26960	0.29470	0.67720
14	Fane	0.23420	0.31650	0.26180	0.28650	0.65510
15	HowardUniversityAI4PC	0.16770	0.11460	0.15180	0.13060	0.35440
16	Baseline	0.05700	0.07910	0.06540	0.07160	0.32280

Hindi - Subtask 2

Rank	Team	F1 macro coarse	F1 st. dev. coarse	F1 samples	F1 st. dev. samples
1	INSALyon2	0.67300	0.42100	0.58100	0.44100
2	DUTtask10	0.56900	0.48400	0.53500	0.49400
3	IRNLP	0.37500	0.46700	0.51500	0.50000
4	cr00	0.56400	0.46800	0.50700	0.48100
5	hblyl	0.58400	0.45400	0.48900	0.47800
6	Duth3	0.47200	0.45600	0.40600	0.44500
7	Narrlangen	0.39500	0.46400	0.38500	0.46500
8	UNEDTeam	0.44900	0.46000	0.37600	0.45600
9	erkk	0.38200	0.47900	0.37400	0.47900
10	KostasThesis2025	0.45300	0.44100	0.34100	0.45000
11	GATENLP	0.40900	0.41000	0.32100	0.37900
12	INSAntive	0.36500	0.44000	0.26500	0.41400
13	NotMyNarrative	0.31800	0.44900	0.24300	0.40800
14	PATeam	0.39200	0.39000	0.21800	0.35000
14	PAteam	0.39200	0.39000	0.21800	0.35000
14	PingAnAI	0.39200	0.39000	0.21800	0.35000
14	PingAnTeam	0.39200	0.39000	0.21800	0.35000
14	PinganTeam	0.39200	0.39000	0.21800	0.35000
14	pateam	0.39200	0.39000	0.21800	0.35000
15	iLostTheCode	0.22700	0.37800	0.17400	0.33900
16	Irapuarani	0.23400	0.12500	0.11100	0.08200
17	LATeIIMAS	0.09700	0.18500	0.02900	0.10200
18	Baseline	0.08100	0.26000	0.00000	0.00000
19	bbStar	0.00000	0.00000	0.00000	0.00000

Hindi - Subtask 3

Rank	Team	Precision	Recall	F1 macro
1	AITeam	0.75576	0.76231	0.75845
2	pateam	0.75656	0.75959	0.75774
3	PinganTeam	0.75605	0.75613	0.75574
4	PAteam	0.75097	0.76045	0.75540
5	PingAnAI	0.74263	0.75416	0.74792
6	Duth3	0.74819	0.74536	0.74655
7	PingAnTeam	0.73661	0.74691	0.74145
8	WordWiz	0.72859	0.73914	0.73356
9	bbStar	0.71789	0.73704	0.72712
10	Dhananjaya	0.72143	0.72156	0.72125
11	TartanTritons	0.69679	0.70119	0.69873
12	Baseline	0.66802	0.67188	0.66974
13	DUTtask10	0.00000	0.00000	0.00000
13	INSALyon2	0.00000	0.00000	0.00000

Contact

twitter.com/_proppy_
Register to the google group of the task to ask questions and interact with other participants

SemEval 2025 shared task on "Multilingual Characterization and Extraction of Narratives from Online News"

Leaderboard

Official SemEval 2025 task 10 Test Leaderboards

Post SemEval Leaderboards on the Test set (open)

English - Subtask 1

English - Subtask 2

English - Subtask 3

Portuguese - Subtask 1

Portuguese - Subtask 2

Portuguese - Subtask 3

Russian - Subtask 1

Russian - Subtask 2

Russian - Subtask 3

Bulgarian - Subtask 1

Bulgarian - Subtask 2

Bulgarian - Subtask 3

Hindi - Subtask 1

Hindi - Subtask 2

Hindi - Subtask 3

Contact