A Comparative Approach to Assessing Linguistic Creativity of Large Language Models and Humans

  • 2025-07-17 15:27:29
  • Anca Dinu, Andra-Maria Florescu, Alina Resceanu
  • 0

Abstract

The following paper introduces a general linguistic creativity test forhumans and Large Language Models (LLMs). The test consists of various tasksaimed at assessing their ability to generate new original words and phrasesbased on word formation processes (derivation and compounding) and onmetaphorical language use. We administered the test to 24 humans and to anequal number of LLMs, and we automatically evaluated their answers using OCSAItool for three criteria: Originality, Elaboration, and Flexibility. The resultsshow that LLMs not only outperformed humans in all the assessed criteria, butdid better in six out of the eight test tasks. We then computed the uniquenessof the individual answers, which showed some minor differences between humansand LLMs. Finally, we performed a short manual analysis of the dataset, whichrevealed that humans are more inclined towards E(extending)-creativity, whileLLMs favor F(ixed)-creativity.

 

Quick Read (beta)

loading the full paper ...