That was my feeling reading the paper. I feel that LLMs are overhyped but the issue of linear vs super linear growth in metrics is a different issue and can’t be a refutation of what has traditionally been thought of as emergent properties. In other words, this is refutation by redefinition.