Abstract
Large Language Models (LLMs) often struggle with complex reasoning tasks dueto insufficient in-depth insights in their training data, which are typicallyabsent in publicly available documents. This paper introduces the Chain ofMethodologies (CoM), an innovative and intuitive prompting framework thatenhances structured thinking by integrating human methodological insights,enabling LLMs to tackle complex tasks with extended reasoning. CoM leveragesthe metacognitive abilities of advanced LLMs, activating systematic reasoningthrought user-defined methodologies without explicit fine-tuning. Experimentsshow that CoM surpasses competitive baselines, demonstrating the potential oftraining-free prompting methods as robust solutions for complex reasoning tasksand bridging the gap toward human-level reasoning through human-likemethodological insights.