Skip to main content

Speech recognition

This leaderboard is prepared for the evaluation of automated speech recognition in Slovene. Its goal is to enable independent evaluation of language technologies tools for the Slovenian language.

The evaluation data includes the recordings and speakers which are, according to our knowledge, not present in the available speech databases for the Slovenian language. The data is structured as follows:

  • 15 recordings in total duration 3h 18min 28sec (3:18:28)
  • public speech in total duration 2:08:35sec and private speech in total duration 1:09:53
  • 9 recordings in total duration 2:03:04 from south-western part of Slovenia and 6 recordings in total duration 1:15:24 from north-eastern part of Slovenia
  • 18 male speakers and 19 female speakers
  • public speech includes topics evolution, description of a settlement, scientific slam, description of a life, culture of speech, news, books, energetics, and the private speech includes 4 monologues and 3 dialogues between two persons
  • in private speech, 10 speakers are recorded, 3 of them are up to 30 years old, 5 of them are between 30 and 49 years old and 2 of them are over 50 years old

Corpus was already pre-processed according to the rules of the RSDO project (2020-2023). Audio files are converted to 16kHz mono with durations between 0.398s and 64.065s.

NOTE: Due to large test dataset (unlabeled) it might take some time (cca. 60 seconds) before the file is downloaded. Please do not click download multiple times.

Iztok Lebar Bajec, ilb@fri.uni-lj.si

Slavko Žitnik, slavko@zitnik.si


RankTitleAuthors and Affiliations1 - WERCERWERMERWILWIPTag
1True-bar 24.05Iztok Lebar Bajec, UL-FRI; Marko Bajec, UL-FRI; Mitja Rizvič, VITASIS
0.9598
0.0143
0.0402
0.0399
0.0616
0.9384
2True-bar 23.02Iztok Lebar Bajec, UL-FRI; Marko Bajec, UL-FRI; Mitja Rizvič, VITASIS
0.9528
0.0159
0.0472
0.0468
0.0747
0.9253
3CON-ASR-1.1Matija Marolt, FRI & Vid Klopčič, FRI
0.9514
0.0171
0.0486
0.0482
0.0781
0.9219
4CON-ASR-1.0Matija Marolt, FRI & Vid Klopčič, FRI
0.9418
0.0200
0.0582
0.0577
0.0941
0.9059
5True-bar 22.12Iztok Lebar Bajec, UL-FRI; Marko Bajec, UL-FRI; Mitja Rizvič, VITASIS
0.9410
0.0191
0.0590
0.0581
0.0924
0.9076
6True-bar 22.07Iztok Lebar Bajec, UL-FRI; Marko Bajec, UL-FRI; Mitja Rizvič, VITASIS
0.9396
0.0199
0.0604
0.0594
0.0921
0.9079
7RSDO-DS2-ASR-E2E 2.0Iztok Lebar Bajec, UL-FRI; Marko Bajec, UL-FRI
0.9374
0.0187
0.0626
0.0621
0.1032
0.8968
Baseline
8Azure Slovenian STTAzure
0.8558
0.0447
0.1442
0.1424
0.2182
0.7818
9facebook/seamless-m4t-v2-largeFB; entry submitted by Aleš Žagar, FRI
0.8220
0.1059
0.1780
0.1744
0.2555
0.7445
10openai/whisper-large-v3OpenAI; entry submitted by Taja Kuzman, JSI
0.8027
0.0892
0.1973
0.1917
0.2870
0.7130