What's New with Meta's AI Assistant Llama 3.1 405B Update

Published On Thu Jul 25 2024
What's New with Meta's AI Assistant Llama 3.1 405B Update

Meta's AI Assistant Got an LLM Update. Here's What You Need to Know

Tech giant Meta recently launched the latest version of its large language model, Llama 3.1 405B. This open-source model is said to rival proprietary LLM competitors like OpenAI’s GPT-4 and Anthropic’s Claude 3.5 Sonnet. Llama powers the Meta AI assistant, which is now accessible through platforms like WhatsApp (owned by Meta) and the Meta.ai site. While Meta AI can also be used on Instagram and Facebook, it's unclear if the new model is available on those platforms yet.

Development of Llama

Meta first introduced Llama in February 2023, with CEO Mark Zuckerberg admitting that early versions of Llama were not as advanced as their competitors. Large language models, such as Llama, are key to generative AI chatbots like ChatGPT and Gemini. These models are trained on extensive datasets to understand human language and generate content that mimics human speech. In addition to Llama 3.1 405B, Meta AI's image generation tool, Imagine, now offers "Imagine me" prompts for creating personalized images.

Creating Synthetic Data Using Llama 3.1 405B | NVIDIA Technical Blog

Enhancements and Features

Llama's latest models, including 3.1 8B and 70B, boast a context window of 128,000 tokens for improved memory during conversations. The models also support enhanced reasoning capabilities, making Meta AI more adept at handling complex queries, especially in math and coding. Llama 3.1 405B, trained on over 15 trillion tokens, is ideal for creating synthetic data and facilitating model distillation.

Partnerships and Open Source Model

Meta has partnered with over 25 companies, such as Amazon and Nvidia, to offer services for developers utilizing Llama 3.1 405B. Unlike proprietary LLMs, Meta's model is open source, allowing wider accessibility. This move is akin to the success of Linux in the software industry, demonstrating that open-source models can compete with closed, proprietary alternatives. Zuckerberg believes this approach will encourage innovation and adoption of Meta AI.

Stay updated with the latest news and developments in art, design, and business by subscribing to FooBar's newsletter. Enter your email address below and agree to our Privacy Policy to receive regular updates.

Feel free to explore more content on our website or log in to your account for personalized recommendations and exclusive features.