Abstract
With the recent success of large language models (LLMs), the idea ofAI-augmented Business Process Management systems is becoming more feasible. Oneof their essential characteristics is the ability to be conversationallyactionable, allowing humans to interact with the LLM effectively to performcrucial process life cycle tasks such as process model design and redesign.However, most current research focuses on single-prompt execution andevaluation of results, rather than on continuous interaction between the userand the LLM. In this work, we aim to explore the feasibility of using LLMs toempower domain experts in the creation and redesign of process models in aniterative and effective way. The proposed conversational process model redesign(CPD) approach receives as input a process model and a redesign request by theuser in natural language. Instead of just letting the LLM make changes, the LLMis employed to (a) identify process change patterns from literature, (b)re-phrase the change request to be aligned with an expected wording for theidentified pattern (i.e., the meaning), and then to (c) apply the meaning ofthe change to the process model. This multi-step approach allows forexplainable and reproducible changes. In order to ensure the feasibility of theCPD approach, and to find out how well the patterns from literature can behandled by the LLM, we performed an extensive evaluation. The results show thatsome patterns are hard to understand by LLMs and by users. Within the scope ofthe study, we demonstrated that users need support to describe the changesclearly. Overall the evaluation shows that the LLMs can handle most changeswell according to a set of completeness and correctness criteria.