You must log in or register to comment.
Is it able to generate text on Winnie the Pooh or how free Taiwan is without crashing though?
I did some locally hosted testing. It absolutely refused to talk about Tiananmen Square. But it was more than happy to talk about Kent State. Interesting what the model happens to think is safe and what it think is unsafe.
Supposedly their cloud hosted version will block those responses, but the local run version does not.
It’s in the article.
I was curious about the exact same thing, but it’s a 671B parameter model and I only have 3 GPUs.
They have a 3GB model that is close to 4o model