Abstract
Recent works in spoken language translation (SLT) have attempted to buildend-to-end speech-to-text translation without using source languagetranscription during learning or decoding. However, while large quantities ofparallel texts (such as Europarl, OpenSubtitles) are available for trainingmachine translation systems, there are no large (100h) and open source parallelcorpora that include speech in a source language aligned to text in a targetlanguage. This paper tries to fill this gap by augmenting an existing(monolingual) corpus: LibriSpeech. This corpus, used for automatic speechrecognition, is derived from read audiobooks from the LibriVox project, and hasbeen carefully segmented and aligned. After gathering French e-bookscorresponding to the English audio-books from LibriSpeech, we align speechsegments at the sentence level with their respective translations and obtain236h of usable parallel data. This paper presents the details of the processingas well as a manual evaluation conducted on a small subset of the corpus. Thisevaluation shows that the automatic alignments scores are reasonably correlatedwith the human judgments of the bilingual alignment quality. We believe thatthis corpus (which is made available online) is useful for replicableexperiments in direct speech translation or more general spoken languagetranslation experiments.