As AI-generated text continues to evolve, distinguishing it from human-authored content has become increasingly difficult. This study examined whether non-expert readers could reliably differentiate between AI-generated poems and those written by well-known human poets. We conducted two experiments with non-expert poetry readers and found that participants performed below chance levels in identifying AI-generated poems (46.6% accuracy, χ2(1, N = 16,340) = 75.13, p < 0.0001). Notably, participants were more likely to judge AI-generated poems as human-authored than actual human-authored poems (χ2(2, N = 16,340) = 247.04, p < 0.0001). We found that AI-generated poems were rated more favorably in qualities such as rhythm and beauty, and that this contributed to their mistaken identification as human-authored. Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.
It actually makes quite a lot of sense if you think about it. Poems generally follow a structure of some sort; a certain amount of syllables per line, a certain rhyming scheme, alliterative patterns, etc. Most poems as we know them are actually rather formulaic by nature, so it seems only natural that a computer would be good at creating something according to a set of configured parameters.
And knows all the words and how they rhyme.
I don’t follow poetry, but there could be a resurgence of abstract or non pattern following poetry, just like most art has movement that move along with what is happening in the world.