Abstract

Large language models (LLMs) have demonstrated remarkable capabilities, butthey require vast amounts of data and computational resources. In contrast,smaller models (SMs), while less powerful, can be more efficient and tailoredto specific domains. In this position paper, we argue that taking acollaborative approach, where large and small models work synergistically, canaccelerate the adaptation of LLMs to private domains and unlock new potentialin AI. We explore various strategies for model collaboration and identifypotential challenges and opportunities. Building upon this, we advocate forindustry-driven research that prioritizes multi-objective benchmarks onreal-world private datasets and applications.

 

Quick Read (beta)