How Meta's Llama 3 Models Are Pioneering Open Source AI

Published On Sat Jun 08 2024
How Meta's Llama 3 Models Are Pioneering Open Source AI

TechCrunch Minute: Meta's new Llama 3 models give open source AI a boost

AI models from Meta are making waves in technology circles. The two new models, part of the Facebook parent company's Llama line of artificial intelligence tools, are both open source, helping them stand apart from competing offerings from OpenAI and other well-known names.

The UK's Creative Industries Independent Standards Authority

The company's new Llama models have differently sized underlying datasets, with the Llama 3 8B model featuring eight billion parameters, and the Llama 3 70B model some 70 billion parameters. The more parameters, the more powerful the model, but not every AI task needs the largest possible dataset.

Performance and Benchmarking

The company's new models, which were trained on 24,000 GPU clusters, perform well across benchmarks that Meta put them up against, besting some rivals' models that were already in the market. What matters for those of us not competing to build and release the most capable, or largest AI models, what we care about is that they are still getting better with time. And work. And a lot of compute.

Unveiling Llama 3: A Deep Dive into Meta's AI Colossus

Open Source vs. Closed Source

While Meta takes an open source approach to AI work, its competitors often prefer more closed source work. OpenAI, despite its name and history, offers access to its models, but not their source code. There's a healthy debate in the world of AI regarding which approach is better, for both speed of development and also safety. After all, some technologists -- and some computing doomers, to be clear -- are worried that AI tech is developing too fast and could prove dangerous to democracies and more.

For now, Meta is keeping the AI fires alight, offering a new challenge to its peers and rivals to best their latest. Hit play, and let's talk about it!

Upcoming Entertainment Highlights

Netflix has just breathed new life into the world of shark movies with "Under Paris". So now's the time to look beyond Jaws and Sharknado.

The Netflix Effect: Technology and Entertainment in the 21st Century

Everyone’s favourite plasticine heroes are back on the big screen in "Wallace and Gromit: Vengeance Most Fowl".

Glen Powell stars as the famous fake assassin Gary Johnson in Richard Linklater's darkly comedic Netflix thriller.

Meta's Llama 3 AI Is Smart, But Who Is Going To Profit From It?

A new prequel from Suzanne Collins is in the works, "Sunrise on the Reaping", set to follow Haymitch Abernathy's experience in the Hunger Games.

Bad Boys: Ride or Die is the actor's first big comeback since the 2022 Oscars, where he slapped Chris Rock and became persona non grata as a result.

The Beatles are getting four individual movies courtesy of filmmaker Sam Mendes.

The Lord of the Rings star's second directorial movie "The Dead Don't Hurt" is in UK cinemas this week.

The events of D-Day have been recreated on screen many times. These are the ones we recommend watching if you want to learn more about the historic event.

The couple went to boarding school together.

The Donnie Darko star has been wearing corrective lenses since childhood.

With the promise of 4K UHD Olympic broadcasts from the BBC, now looks to be the ideal time to invest in a new telly.

The US actor confirmed the script for the upcoming film is still being written.

The open letter calls for firms to make their ‘final financial commitment’ to the creation of the Creative Industries Independent Standards Authority.

From chewing popcorn too loudly to being on your phone, bad behaviour at the cinema is starting to become more of a problem according to a recent survey.

The Quiet Place star has vented her frustrations about the film junket tradition, but are her comments fair?

Star Wars: "The Acolyte" is coming to Disney+, but what do we know about the live-action High Republic series?

The restaurant said ‘we aren’t above criticism, but we are above being demeaned’.