713: Llama 2, Toolformer and BLOOM: Open-Source LLMs with Meta's Dr. Thomas Scialom

<p>Artificial General Intelligence, RLHF’s application in AI, and how entrepreneurs can enter the AI industry: Meta’s AI Research Scientist Thomas Scialom gives us behind-the-scenes insights into developing Llama 2 and what’s in the works for Llama 3. With host Jon Krohn, he discusses the future of Artificial General Intelligence, why the Galactica science-focused LLM was taken down, and what he learned from it.<br/><br/>This episode is brought to you by <a href='https://go.aws/3zWS0au'>AWS Inferentia</a>, by <a href='https://grafbase.com/'>Grafbase</a>, the unified data layer, and by <a href='https://modelbit.com/'>Modelbit</a>, for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit <a href='https://jonkrohn.com/podcast'>JonKrohn.com/podcast</a> for sponsorship information.<br/><br/>In this episode you will learn:<br/>• Llama 2: Behind the Scenes of Today’s Top Open-Source LLM [05:04]<br/>• Responsible use of Llama 2 [15:26]<br/>• Toolformer: LLM That Learns How to Use External Tools [24:57]<br/>• Galactica: The Science-Specific LLM and Why It Was Brought Down [36:57]<br/>• Is AGI Around the Corner? [57:03]<br/>• Advice for AI entrepreneurs [1:05:46]<br/>• How Thomas develops and manages large-scale AI projects [1:14:42]<br/><br/>Additional materials: <a href='https://www.superdatascience.com/713'>www.superdatascience.com/713</a></p>