Mistral 7B v0.2 Base (released at SHACK15sf hackathon)

github.com

Mistral 7B v0.2 Base (released at SHACK15sf hackathon)

github.com

ylai to Machine Learning - Learning/Language Models@lemmy.intai.techEnglish · 8 months ago

GitHub - mistralai-sf24/hackathon

github.com

Contribute to mistralai-sf24/hackathon development by creating an account on GitHub.

GitHub: https://github.com/mistralai-sf24/hackathon
X: https://twitter.com/MistralAILabs/status/1771670765521281370

New release: Mistral 7B v0.2 Base (Raw pretrained model used to train Mistral-7B-Instruct-v0.2)
🔸 https://models.mistralcdn.com/mistral-7b-v0-2/mistral-7B-v0.2.tar
🔸 32k context window
🔸 Rope Theta = 1e6
🔸 No sliding window
🔸 How to fine-tune:

You must log in or # to comment.

Chat

Machine Learning - Learning/Language Models@lemmy.intai.tech

models@lemmy.intai.tech

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !models@lemmy.intai.tech

Discussion of models, thier use, setup and options.

Please include models used with your outputs, workflows optional.

Model Catalog

We follow Lemmy’s code of conduct.

Communities

Useful links

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
1 user / week
1 user / month
2 users / 6 months
3 local subscribers
3 subscribers
95 Posts
8 Comments
Modlog

mods:
manitcor@lemmy.intai.tech