DBRX: NEW MOST POWERFUL Open Source LLM: MoE 132B 16E 32K 12T
Databricks reveals DBRX: After 2 months of cloud compute on 3072 H100 GPUs DBRX sets a new state-of-the-art for established open LLMs. Moreover, it provides the open community and enterprises building their own LLMs with capabilities that were previously limited to closed model APIs; according to first measurements, it surpasses GPT-3.5, and it is competitive with Gemini 1.0 Pro.
Great job https://www.youtube.com/channel/UC3q8O3Bh2Le8Rj1-Q-_UUbA
All rights with authors:
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
#databricks
#airesearch
#ai
25 Comments