IBL News | New York
Meta announced its text-only AI model Llama 3.3 70B.
Ahmad Al-Dahle, VP of generative AI at Meta, said in a post on X that Llama 3.3 70B delivers the performance of the largest Llama model, Llama 3.1 405B, at lower cost, with improvements in areas like math, general knowledge, instruction following, and app use.
Al-Dahle published a chart showing Llama 3.3 70B outperforming Google’s Gemini 1.5 Pro, OpenAI’s GPT-4o, and Amazon’s newly released Nova Pro on several industry benchmarks, including MMLU, which evaluates a model’s ability to understand language.
Llama 3.3 70B is available for download from Hugging Face and the official Llama website.
Meta’s latest move is to dominate the AI field with “open source models, which can be equally used and commercialized for various applications.
Meta AI’s CEO, Mark Zuckerberg, said the company has nearly 600 million monthly active users on Llama models.
However, training generative AI models is a costly business.
The company announced this month that it would build a $10 billion AI data center in Louisiana — the largest AI data center Meta has ever built.
Meta has procured a cluster of more than 100,000 Nvidia GPUs for model development, rivaling the resources of competition like xAI.
Introducing Llama 3.3 – a new 70B model that delivers the performance of our 405B model but is easier & more cost-efficient to run. By leveraging the latest advancements in post-training techniques including online preference optimization, this model improves core performance at… pic.twitter.com/6oQ7b3Yuzc
— Ahmad Al-Dahle (@Ahmad_Al_Dahle) December 6, 2024
