Abstract
Contextual influences on language exhibit substantial language-independentregularities; for example, we are more verbose in situations that require finerdistinctions. However, these regularities are sometimes obscured by semanticand syntactic differences. Using a newly-collected dataset of color referencegames in Mandarin Chinese (which we release to the public), we confirm that avariety of constructions display the same sensitivity to contextual difficultyin Chinese and English. We then show that a neural speaker agent trained onbilingual data with a simple multitask learning approach displays morehuman-like patterns of context dependence and is more pragmatically informativethan its monolingual Chinese counterpart. Moreover, this is not at the expenseof language-specific semantic understanding: the resulting speaker model learnsthe different basic color term systems of English and Chinese (with noteworthycross-lingual influences), and it can identify synonyms between the twolanguages using vector analogy operations on its output layer, despite havingno exposure to parallel data.