Abstract
Prompt engineering, as an efficient and effective way to leverage LargeLanguage Models (LLM), has drawn a lot of attention from the researchcommunity. The existing research primarily emphasizes the importance ofadapting prompts to specific tasks, rather than specific LLMs. However, a goodprompt is not solely defined by its wording, but also binds to the nature ofthe LLM in question. In this work, we first quantitatively demonstrate thatdifferent prompts should be adapted to different LLMs to enhance theircapabilities across various downstream tasks in NLP. Then we novelly propose amodel-adaptive prompt optimizer (MAPO) method that optimizes the originalprompts for each specific LLM in downstream tasks. Extensive experimentsindicate that the proposed method can effectively refine prompts for an LLM,leading to significant improvements over various downstream tasks.