Abstract
Conversational search supports multi-turn user-system interactions to solvecomplex information needs. Different from the traditional single-turn ad-hocsearch, conversational search encounters a more challenging problem ofcontext-dependent query understanding with the lengthy and long-tailconversational history context. While conversational query rewriting methodsleverage explicit rewritten queries to train a rewriting model to transform thecontext-dependent query into a stand-stone search query, this is usually donewithout considering the quality of search results. Conversational denseretrieval methods use fine-tuning to improve a pre-trained ad-hoc queryencoder, but they are limited by the conversational search data available fortraining. In this paper, we leverage both rewritten queries and relevancejudgments in the conversational search data to train a better queryrepresentation model. The key idea is to align the query representation withthose of rewritten queries and relevant documents. The proposed model -- QueryRepresentation Alignment Conversational Dense Retriever, QRACDR, is tested oneight datasets, including various settings in conversational search and ad-hocsearch. The results demonstrate the strong performance of QRACDR compared withstate-of-the-art methods, and confirm the effectiveness of representationalignment.