idtracker.ai: Tracking all individuals in large collectives of unmarked animals

  • 2018-03-12 16:21:19
  • Francisco Romero-Ferrero, Mattia G. Bergomi, Robert Hinz, Francisco J. H. Heras, Gonzalo G. de Polavieja
  • 42

Abstract

Our understanding of collective animal behavior is limited by our ability totrack each of the individuals. We describe an algorithm and software,idtracker.ai, that extracts from video all trajectories with correct identitiesat a high accuracy for collectives of up to 100 individuals. It uses two deepnetworks, one detecting when animals touch or cross and another one for animalidentification, trained adaptively to conditions and difficulty of the video.

 

Quick Read (beta)

loading the full paper ...