Abstract
Leveraging multiple Large Language Models(LLMs) has proven effective foraddressing complex, high-dimensional tasks, but current approaches often relyon static, manually engineered multi-agent configurations. To overcome theseconstraints, we present the Agentic Neural Network(ANN), a framework thatconceptualizes multi-agent collaboration as a layered neural networkarchitecture. In this design, each agent operates as a node, and each layerforms a cooperative "team" focused on a specific subtask. Agentic NeuralNetwork follows a two-phase optimization strategy: (1) Forward Phase-Drawinginspiration from neural network forward passes, tasks are dynamicallydecomposed into subtasks, and cooperative agent teams with suitable aggregationmethods are constructed layer by layer. (2) Backward Phase-Mirroringbackpropagation, we refine both global and local collaboration throughiterative feedback, allowing agents to self-evolve their roles, prompts, andcoordination. This neuro-symbolic approach enables ANN to create new orspecialized agent teams post-training, delivering notable gains in accuracy andadaptability. Across four benchmark datasets, ANN surpasses leading multi-agentbaselines under the same configurations, showing consistent performanceimprovements. Our findings indicate that ANN provides a scalable, data-drivenframework for multi-agent systems, combining the collaborative capabilities ofLLMs with the efficiency and flexibility of neural network principles. We planto open-source the entire framework.