Exploring Creativity in Large Language Models: From GPT-2 to GPT-4 | …

Analyzing the evolution of creative processes in large language models through creativity tests

This blog was originally posted at https://blog.yenniejun.com/p/exploring-creativity-in-large-language

In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to measure the level of creative process more broadly in these models?

Human creativity has long fascinated psychologists and researchers. Starting in the 1950s, researchers created a series of tests to compare the creative performance and potential of individuals. While no single test can fully capture creativity, these tests attempted to measure and quantify different aspects of it.

In this article, I analyze the performance of GPT models from 2019 to 2023 on tests that measure two kinds of creativity: convergent (a single, correct solution…