December 11, 2023
Mistral AImodel
Mixtral 8x7B — Mixture of Experts goes open
Open-weight MoE model matching GPT-3.5. Shifts industry toward sparse architectures.
More context
See it on the timeline →ShareOG image
December 11, 2023
Open-weight MoE model matching GPT-3.5. Shifts industry toward sparse architectures.
More context
See it on the timeline →