Close

Presentation

Herding Llamas: A Sneak Peek Into Meta's Infrastructure for Generative AI
DescriptionLlama 3.2 is the latest edition of Meta’s Generative AI models. Llama represents a collection of openly available models that rival the top AI models in terms of state-of-the-art capabilities in general knowledge, steerability, math, tool use, and multilingual translation. In this talk, I’ll dive into the infrastructure behind the Llama series of models and explore the scaling challenges, innovative solutions and lessons learned, particularly those related to its compute, network, storage, and software ecosystem.