Abstract
Virtual musicians have become a remarkable phenomenon in the contemporarymultimedia arts. However, most of the virtual musicians nowadays have not beenendowed with abilities to create their own behaviors, or to perform music withhuman musicians. In this paper, we firstly create a virtual violinist, who cancollaborate with a human pianist to perform chamber music automatically withoutany intervention. The system incorporates the techniques from various fields,including real-time music tracking, pose estimation, and body movementgeneration. In our system, the virtual musician's behavior is generated basedon the given music audio alone, and such a system results in a low-cost,efficient and scalable way to produce human and virtual musicians'co-performance. The proposed system has been validated in public concerts.Objective quality assessment approaches and possible ways to systematicallyimprove the system are also discussed.