Abstract
Extracting action sequences from texts in natural language is challenging,which requires commonsense inferences based on world knowledge. Although therehas been work on extracting action scripts, instructions, navigation actions,etc., they require either the set of candidate actions is provided in advance,or action descriptions are restricted in a specific form, e.g., descriptiontemplates. In this paper, we aim to extract action sequences from texts in freenatural language, i.e., without any restricted templates, provided thecandidate set of actions is unknown. We propose to extract action sequencesfrom texts based on the deep reinforcement learning framework. Specifically, weview "selecting" or "eliminating" words from texts as "actions", and textsassociated with actions as "states". We then build Q-networks to learn thepolicy of extracting actions and extract plans from the labelled texts. Weexhibit the effectiveness of our approach in several datasets with comparisonto state-of-the-art approaches, including online experiments interacting withhumans.