Mistral's sparse mixture-of-experts models.
An open sparse mixture-of-experts model. Only a fraction of parameters are active per token.