Meta Releases Muse Spark Open: A Large-Scale Sparse Mixture-of-Experts Model
Meta has released the weights for Muse Spark Open, an 816-billion-parameter multimodal model designed for complex agentic tasks like software engineering. The model utilizes a sparse mixture-of-experts (MoE) architecture to activate only 42 billion parameters per token, allowing it to run on high-end consumer hardware like dual Mac Studios.
Read full article →









:max_bytes(150000):strip_icc()/24-02-WS1726201_Snack-BevStudioShoot2024_Biscoff_KEY_052.JPEG-M-2COURTESYOFDELTA-6b07a5ebf1d548258132b6f640877b35.jpg)






-oOdUn61bDRSykk4H951SoDOHzqoOe1.png)










