Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics

  • 2023-09-21 12:34:52
  • Patricio Vera, Pedro Moya, Lisa Barraza
  • 0

Abstract

In the burgeoning field of artificial intelligence (AI), the unprecedentedprogress of large language models (LLMs) in natural language processing (NLP)offers an opportunity to revisit the entire approach of traditional metrics ofmachine intelligence, both in form and content. As the realm of machinecognitive evaluation has already reached Imitation, the next step is anefficient Language Acquisition and Understanding. Our paper proposes a paradigmshift from the established Turing Test towards an all-embracing framework thathinges on language acquisition, taking inspiration from the recent advancementsin LLMs. The present contribution is deeply tributary of the excellent workfrom various disciplines, point out the need to keep interdisciplinary bridgesopen, and delineates a more robust and sustainable approach.

 

Quick Read (beta)

loading the full paper ...