Abstract
Recently, ''pre-training and fine-tuning'' has been adopted as a standardworkflow for many graph tasks since it can take general graph knowledge torelieve the lack of graph annotations from each application. However, graphtasks with node level, edge level, and graph level are far diversified, makingthe pre-training pretext often incompatible with these multiple tasks. This gapmay even cause a ''negative transfer'' to the specific application, leading topoor results. Inspired by the prompt learning in natural language processing(NLP), which has presented significant effectiveness in leveraging priorknowledge for various NLP tasks, we study the prompting topic for graphs withthe motivation of filling the gap between pre-trained models and various graphtasks. In this paper, we propose a novel multi-task prompting method for graphmodels. Specifically, we first unify the format of graph prompts and languageprompts with the prompt token, token structure, and inserting pattern. In thisway, the prompting idea from NLP can be seamlessly introduced to the grapharea. Then, to further narrow the gap between various graph tasks andstate-of-the-art pre-training strategies, we further study the task space ofvarious graph applications and reformulate downstream problems to thegraph-level task. Afterward, we introduce meta-learning to efficiently learn abetter initialization for the multi-task prompt of graphs so that our promptingframework can be more reliable and general for different tasks. We conductextensive experiments, results from which demonstrate the superiority of ourmethod.