Date of Original Version

5-2014

Type

Conference Proceeding

Journal Title

Proceedings of the International Workshop on Spoken Language Technologies for Underresourced Languages (SLTU)

First Page

24

Last Page

31

Rights Management

© SPIIRAS, 2014 © Authors, 2014

Abstract or Description

As part of the MediaEval 2013 benchmark evaluation campaign, the objective of the Spoken Web Search (SWS) task was to perform Query-by-Example Spoken Term Detection (QbE-STD), using spoken queries to retrieve matching segments in a set of audio files. As in previous editions, the SWS 2013 evaluation focused on the development of technology specifically designed to perform speech search in a low-resource setting. In this paper, we first describe the main features of past SWS evaluations and then focus on the 2013 SWS task, in which a special effort was made to prepare a challenging database, including speech in 9 different languages with diverse environment and channel conditions. The main novelties of the submitted systems are reviewed and performance figures are then presented and discussed, demonstrating the feasibility of the proposed task, even under such challenging conditions. Finally, the fusion of the 10 top-performing systems is analyzed. The best fusion provides a 30% relative improvement over the best single system in the evaluation, which proves that a variety of approaches can be effectively combined to bring complementary information in the search for queries.

Share

COinS
 

Published In

Proceedings of the International Workshop on Spoken Language Technologies for Underresourced Languages (SLTU), 24-31.