Mistral's official instruct fine-tuned version of Mixtral 8x22B. It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include:

• strong math, coding, and reasoning
• large context length (64k)
• fluency in English, French, Italian, German, and Spanish

See benchmarks on the launch announcement here. #moe