One of my favorite moments like this was a Reddit thread where some account was pretending to be human and arguing with people in favor of the CEO’s actions during The Purge. Then one person asked it a question about making some dangerous thing or other, and it starting replying with things like “As an AI model, I cannot explain how to do that.” and stuff. It was great.