Date of Original Version

5-2012

Type

Conference Proceeding

Journal Title

Proceedings of Workshop on Spoken Language Technologies for Under-Resourced Languages

Rights Management

Copyright 2012 MICA

Abstract or Description

This paper describes the integration of language identification (LID) into a multilingual automatic speech recognition (ASR) system for spoken conversations containing code-switches between Mandarin and English. We apply a multistream approach to combine at frame level the acoustic model score and the language information, where the latter is provided by an LID component. Furthermore, we advance this multistream approach by a new method called “Language Lookahead”, in which the language information of subsequent frames is used to improve accuracy. Both methods are evaluated using a set of controlled LID results with varying frame accuracies. Our results show that both approaches improve the ASR performance by at least 4% relative if the LID achieves a minimum frame accuracy of 85%.

Share

COinS
 

Published In

Proceedings of Workshop on Spoken Language Technologies for Under-Resourced Languages.