Abstract
Using questions in written text is an effective strategy to enhancereadability. However, what makes an active reading question good, what thelinguistic role of these questions is, and what is their impact on humanreading remains understudied. We introduce GuidingQ, a dataset of 10K in-textquestions from textbooks and scientific articles. By analyzing the dataset, wepresent a comprehensive understanding of the use, distribution, and linguisticcharacteristics of these questions. Then, we explore various approaches togenerate such questions using language models. Our results highlight theimportance of capturing inter-question relationships and the challenge ofquestion position identification in generating these questions. Finally, weconduct a human study to understand the implication of such questions onreading comprehension. We find that the generated questions are of high qualityand are almost as effective as human-written questions in terms of improvingreaders' memorization and comprehension.