Appendix

Dataset Creation

In order to perform the reconstruction task, we required a large dataset of cognates and their proto-words, in both orthographic and phonetic (IPA) forms.

Despite growing interest in recent years, high-quality digital resources for the tasks of proto-word reconstruction and cognates detection are scarce. Our departure point is the dataset provided by ciobanu-dataset, which, to the best of our knowledge, is the most extensive dataset for proto-word reconstruction of a well-attested proto-language. The dataset contains 3,218 complete cognate sets in five Romance languages (Spanish, Italian, Portuguese, French, Romanian) together with their Latin etymological ancestor. Although being a valuable resource, this dataset was constructed via automatic method of cognate extraction, and a comparison with references on the development of Romance languages [LatinToRomance, HistoricalIntroduction] reveals some problems, such as false cognates, truncated forms, non-existent words and mismatch between the part of speech of the cognates and the ancestor. Another salient problem of the dataset regarded the grammatical case of Latin nouns: Romance languages derived their words from the accusative Latin case [RomanceLanguages], while in the dataset Latin words were displayed in the nominative case, an inconsistency making the reconstruction inherently more challenging.

Lastly, as neural models often requires large amounts of training data, we aimed to expand the dataset. We thus created a cleaned and extended dataset by Wiktionary scrapping, followed by manual validation and cleansing.

Wikitionary scraping

We augment the existing dataset with a freely available resource: Wiktionary. Wiktionary entries for Latin words usually contain inflection tables, and often list the descendants in Romance languages; these descendents are, by definition, cognates. We scraped all Latin entries from Wiktionary, and extracted the forms of the daughter languages (available in the “Descendants” section). This resulted in 5,598 additional comparative entries, for a total of 22,361 new individual words. Contrary to the previous dataset, the Wiktionary-derived cognates are not based on automatic alignment between translations, but rather on direct human annotation. On the other hand, the Wiktionary-based entries are often incomplete, and include cognates in only a subset of the daughter languages.

Form normalization

Using the Wiktionary-provided inflection tables, we decline the Latin nouns to the accusative case, and conjugate verbs to the infinitive form. We do this both to the Wiktionary-based entries and to the ones in the original dataset. We selected a sample of around 100 Latin words to check the accuracy of the automatic conjugation, against Gaffiot, finding them all correct. Finally, Latin words in the ciobanu-dataset dataset for which we did not find a Wiktionary entry were conjugated “manually” by consulting [Charlton, Gaffiot].

Manual verification and cleaning

After the collection of the Wikitionary dataset, we went manually through all the Latin words contained in ciobanu-dataset, checking them against Charlton, Gaffiot. Additionally, we went over the some suspicious-looking words from the daughter language and verified them against etymologicalDict to ensure their etymological relatedness with the Latin source, fixing if necessary.This sort of fix was not performed systematically, but we did fix or remove around 170 words.

Finally, we sample 300 entries from the original [ciobanu-dataset] dataset prior to cleaning and 300 words from our cleaned and unified version of the dataset, and manually verified them. We find 43 mistakes in the original dataset and only 4 in our version, indicating that, while still not perfect, it is of substantial higher quality.

IPA transcription

To obtain the phonetic transcriptions into IPA, we utilized the transcription module of the eSpeak library, which offers transcriptions for all languages in our dataset, including Latin. While a human transcription would be preferable, a manual evaluation of 200 of the resulting transcriptions by comparing them against several sources [LtOrtho, ItnOrtho, FrOrtho, SpOrtho, PtOrtho, RmOrtho] show high accuracy: all the 200 words were correct, except for minor systematic changes which we fixed globally to better suit the transcription to phonological conventions. Specifically, we deleted the vowel symbols $<$U$>$ and $<$I$>$ in Italian and Romanian, which resulted to be alien to those languages, changed the sequence $<$RR$>$ to $<$r$>$ in Spanish, and regularized the Portuguese transcriptions, which showed some phonological traits of Brazilian Portuguese.

Final dataset

The resulting dataset, used for all experiments in this work, contains 8,799 entries. The dataset was randomly splitted into train, evaluation and test sets, with 7,038 examples (80%) used for training, 703 (8%) for evaluation and 1,055 (12%) for testing.

Overall, the dataset contains 41,563 distinct words across the different languages (for a total of 83,126 words counting both the orthographic and the phonetic datasets), with 7,384 Italian words, 7,183 Spanish words, 6,806 Portuguese words, 6,505 French words and 4,886 Romanian words. As vowel lengths were found to be difficult to recover, we created the following variations of the dataset: with and without vowel length (for both the orthographic and phonetic datasets), and without a contrast (for the phonetic dataset).

Phoneme representations

[scale=0.31]clusts-ward-all.jpeg

Figure :

In this appendix, we show the hierarchical clustering created for all the languages in our dataset. As it can be noted from figure id1, the results for the different languages exhibit representations similar to those found in the French clustering: the primary division in each language is between vowels and consonants. In Portuguese, Latin, Spanish and Romanian some consonants are grouped together with vowels. These consonants are restricted to nasals, liquids or glides. The inclusion of these consonants can be explained by the peculiarity of their nature: all of them have a special phonological status, displaying similarities in their behavior to vowels. In all languages phonologically related phonemes tend to be group under the same nodes. Among the others, glides are either found together with each other (as in French, Italian and Romanian) or with their vocalic counterparts (Latin, Spanish and Portuguese), consonants differentiated only in voicing are usually paired ([S] and [Z]), front and back vowels forms clusters and allophones usually shares the same node (Italian, French, Romanian, Spanish, Portuguese).

Rules of Phonetic Change

0.8 Latin phoneme Romanian French Italian Spanish Portuguese Latin Latin - reconstruction Correct /e/ blocked syllable pep pep pep pep pep pep pIp no /o/ blocked syllable pop pup pop pop pop pop pUp no /E/ blocked syllable pjep pEp pEp pjep pEp pEp pep no /kt/ medially, before nasals - anta anta anta anta ankta antam no /aI/ pe pe pe pe pe paI pEm no /OI/ pe pe pe pe pe pOI pEm no /b/ intervocalic aa ava ava aBa ava aba awam no /e/ free syllable pe pwa pe pe pe pe pEm no /o/ free syllable po pø po po po po pUm no /I/ free syllable pe pwa pe pe pe pI pEm no /n/ before front vowels ji i i i i ni ŋidEm no /a/ before nasal p1n pan pan pan pan pan pan yes /a/ blocked syllable pap pap pap pap pap pap pap yes /i/ pi pi pi pi pi pi pi yes /u/ pu py pu pu pu pu pu yes /I/ blocked syllable pep pep pep pep pep pIp pIp yes /U/ blocked syllable pup pup pop pop pop pUp pUp yes /O/ blocked syllable pop pOp pOp pwep pOp pOp pOp yes /k/ before front vowels tSi si tSi Ti si ki ki yes /sk/ before front vowels Sti si Si Ti Si ski ski yes /kt/ medially, elsewhere apta ata atta atSa ata akta aktam yes /aU/ pau pO pO po po paU paUm yes /pl/ word initial pla pla pja La Sa pla plam yes /a/ free syllable pa pa pa pa pa pa pam yes /E/ free syllable pje pje pje pje pE pE pEm yes /w/ va va va ba va wa wam yes /b/ word initial ba ba ba ba ba ba bam yes /j/ word initial Za Za dZa xa Za ja jam yes /f/ word initial fa fa fa a fa fa fam yes /f/ elsewhere afa afa afa afa afa afa affam yes /U/ free syllable pu pø po po po pU pUpUm yes /O/ free syllable po pø pwO pwe pO pO pOdEm yes /l/ before front vowels ji ji Li xi Li li gIlUm yes

Table :

Table id1 displays the set of test phonemes used to evaluate the model’s generalizations. Each row represents a distinct rule of phonetic change, which focuses on a single phoneme. The phoneme in question is bolded, and other consonants / vowels are added to simulate the phonological environment of the rule. The added consonants / vowels were chosen because they did not affect the evolution of the examined phonemes from Latin to the Romance languages.