Abstract
Recently advancements in deep learning allowed the development of end-to-endtrained goal-oriented dialog systems. Although these systems already achievegood performance, some simplifications limit their usage in real-lifescenarios. In this work, we address two of these limitations: ignoring positionalinformation and a fixed number of possible response candidates. We propose touse positional encodings in the input to model the word order of the userutterances. Furthermore, by using a feedforward neural network, we are able togenerate the output word by word and are no longer restricted to a fixed numberof possible response candidates. Using the positional encoding, we were able toachieve better accuracies in the Dialog bAbI Tasks and using the feedforwardneural network for generating the response, we were able to save computationtime and space consumption.