Mixtral 8x22B
https://mistral.ai/news/mixtral-8x22b/

@dchaplot
We just released Mixtral-8x22B-v0.1 and Mixtral-8x22B-Instruct-v0.1:
- Free to use under Apache 2.0 license
- Outperforms all open models
- Native function calling
- Masters English, French, Italian, German and Spanish.
- Seq_len = 64K

https://i.imgur.com/COA0U77.png