Abstract
We present a comparison of word-based and character-basedsequence-to-sequence models for data-to-text natural language generation, whichgenerate natural language descriptions for structured inputs. On the datasetsof two recent generation challenges, our models achieve comparable or betterautomatic evaluation results than the best challenge submissions. Subsequentdetailed statistical and human analyses shed light on the differences betweenthe two input representations and the diversity of the generated texts. In acontrolled experiment with synthetic training data generated from templates, wedemonstrate the ability of neural models to learn novel combinations of thetemplates and thereby generalize beyond the linguistic structures they weretrained on.