Practical AI

Practical AI Artwork

Making artificial intelligence practical, productive & accessible to everyone

Practical AI Practical AI #225

Controlled and compliant AI applications

Play
2023-05-31T17:00:00Z #ai +2 🎧 27,859

You can’t build robust systems with inconsistent, unstructured text output from LLMs. Moreover, LLM integrations scare corporate lawyers, finance departments, and security professionals due to hallucinations, cost, lack of compliance (e.g., HIPAA), leaked IP/PII, and “injection” vulnerabilities.

In this episode, Chris interviews Daniel about his new company called Prediction Guard, which addresses these issues. They discuss some practical methodologies for getting consistent, structured output from compliant AI systems. These systems, driven by open access models and various kinds of LLM wrappers, can help you delight customers AND navigate the increasing restrictions on “GPT” models.

Practical AI Practical AI #223

Creating instruction tuned models

Play
2023-05-16T18:20:00Z #ai +1 🎧 27,641

At the recent ODSC East conference, Daniel got a chance to sit down with Erin Mikail Staples to discuss the process of gathering human feedback and creating an instruction tuned Large Language Models (LLM). They also chatted about the importance of open data and practical tooling for data annotation and fine-tuning. Do you want to create your own custom generative AI models? This is the episode for you!

Practical AI Practical AI #226

Accidentally building SOTA AI

Play
2023-06-06T20:45:00Z #ai +2 🎧 27,563

Lately.AI has been working for years on content generation systems that capture your unique “voice” and are tailored to your unique audience. At first, they didn’t know that they were going to build an AI system, but now they have a state-of-the-art generative platform that provides much more than “prompting” out of thin air. Lately.AI’s CEO Kate explain their journey, her perspective on generative AI in marketing, and much more in this episode!

Practical AI Practical AI #261

Prompting the future

Play
2024-03-20T13:45:00Z #ai +2 🎧 26,712

Daniel & Chris explore the state of the art in prompt engineering with Jared Zoneraich, the founder of PromptLayer. PromptLayer is the first platform built specifically for prompt engineering. It can visually manage prompts, evaluate models, log LLM requests, search usage history, and help your organization collaborate as a team. Jared provides expert guidance in how to be implement prompt engineering, but also illustrates how we got here, and where we’re likely to go next.

Practical AI Practical AI #217

Accelerated data science with a Kaggle grandmaster

Play
2023-04-04T20:00:00Z #ai +3 🎧 26,687

Daniel and Chris explore the intersection of Kaggle and real-world data science in this illuminating conversation with Christof Henkel, Senior Deep Learning Data Scientist at NVIDIA and Kaggle Grandmaster. Christof offers a very lucid explanation into how participation in Kaggle can positively impact a data scientist’s skill and career aspirations. He also shared some of his insights and approach to maximizing AI productivity uses GPU-accelerated tools like RAPIDS and DALI.

Practical AI Practical AI #207

Machine learning at small organizations

Play
2023-01-17T20:15:00Z #ai +1 🎧 26,660

Why is ML is so poorly adopted in small organizations (hint: it’s not because they don’t have enough data)? In this episode, Kirsten Lum from Storytellers shares the patterns she has seen in small orgs that lead to a successful ML practice. We discuss how the job of a ML Engineer/Data Scientist is different in that environment and how end-to-end project management is key to adoption.

Practical AI Practical AI #246

Generating product imagery at Shopify

Play
2023-11-21T18:45:00Z #ai +1 🎧 26,495

Shopify recently released a Hugging Face space demonstrating very impressive results for replacing background scenes in product imagery. In this episode, we hear the backstory technical details about this work from Shopify’s Russ Maschmeyer. Along the way we discuss how to come up with clever AI solutions (without training your own model).

Practical AI Practical AI #254

Large Action Models (LAMs) & Rabbits 🐇

Play
2024-01-30T21:00:00Z #ai +2 🎧 26,342

Recently the release of the rabbit r1 device resulted in huge interest in both the device and “Large Action Models” (or LAMs). What is an LAM? Is this something new? Did these models come out of nowhere, or are they related to other things we are already using? Chris and Daniel dig into LAMs in this episode and discuss neuro-symbolic AI, AI tool usage, multimodal models, and more.

Practical AI Practical AI #213

Success (and failure) in prompting

Play
2023-02-28T21:15:00Z #ai +1 🎧 26,299

With the recent proliferation of generative AI models (from OpenAI, co:here, Anthropic, etc.), practitioners are racing to come up with best practices around prompting, grounding, and control of outputs.

Chris and Daniel take a deep dive into the kinds of behavior we are seeing with this latest wave of models (both good and bad) and what leads to that behavior. They also dig into some prompting and integration tips.

Practical AI Practical AI #253

Collaboration & evaluation for LLM apps

Play
2024-01-23T22:30:00Z #ai +1 🎧 26,230

Small changes in prompts can create large changes in the output behavior of generative AI models. Add to that the confusion around proper evaluation of LLM applications, and you have a recipe for confusion and frustration. Raza and the Humanloop team have been diving into these problems, and, in this episode, Raza helps us understand how non-technical prompt engineers can productively collaborate with technical software engineers while building AI-driven apps.

Practical AI Practical AI #248

Suspicion machines ⚙️

Play
2023-12-05T21:45:00Z #ai +1 🎧 26,071

In this enlightening episode, we delve deeper than the usual buzz surrounding AI’s perils, focusing instead on the tangible problems emerging from the use of machine learning algorithms across Europe. We explore “suspicion machines” — systems that assign scores to welfare program participants, estimating their likelihood of committing fraud. Join us as Justin and Gabriel share insights from their thorough investigation, which involved gaining access to one of these models and meticulously analyzing its behavior.

Practical AI Practical AI #161

OpenAI and Hugging Face tooling

Play
2021-12-14T20:00:00Z #ai +3 🎧 25,867

The time has come! OpenAI’s API is now available with no waitlist. Chris and Daniel dig into the API and playground during this episode, and they also discuss some of the latest tool from Hugging Face (including new reinforcement learning environments). Finally, Daniel gives an update on how he is building out infrastructure for a new AI team.

Practical AI Practical AI #215

AI search at You.com

Play
2023-03-15T19:15:00Z #ai +1 🎧 25,533

Neural search and chat-based search are all the rage right now. However, You.com has been innovating in these topics long before ChatGPT. In this episode, Bryan McCann from You.com shares insights related to our mental model of Large Language Model (LLM) interactions and practical tips related to integrating LLMs into production systems.

Practical AI Practical AI #218

Computer scientists as rogue art historians

Play
2023-04-12T13:30:00Z #ai +2 🎧 25,205

What can art historians and computer scientists learn from one another? Actually, a lot! Amanda Wasielewski joins us to talk about how she discovered that computer scientists working on computer vision were actually acting like rogue art historians and how art historians have found machine learning to be a valuable tool for research, fraud detection, and cataloguing. We also discuss the rise of generative AI and how we this technology might cause us to ask new questions like: “What makes a photograph a photograph?”

Practical AI Practical AI #245

AI trailblazers putting people first

Play
2023-11-14T17:45:00Z #ai +2 🎧 24,776

According to Solana Larsen: “Too often, it feels like we have lost control of the internet to the interests of Big Tech, Big Data — and now Big AI.” In the latest season of Mozilla’s IRL podcast (edited by Solana), a number of stories are featured to highlight the trailblazers who are reclaiming power over AI to put people first. We discuss some of those stories along with the issues that they surface.

Practical AI Practical AI #212

Applied NLP solutions & AI education

Play
2023-02-22T15:15:00Z #ai +2 🎧 24,253

We’re super excited to welcome Jay Alammar to the show. Jay is a well-known AI educator, applied NLP practitioner at co:here, and author of the popular blog, “The Illustrated Transformer.” In this episode, he shares his ideas on creating applied NLP solutions, working with large language models, and creating educational resources for state-of-the-art AI.

Practical AI Practical AI #214

End-to-end cloud compute for AI/ML

Play
2023-03-07T20:00:00Z #ai +2 🎧 24,161

We’ve all experienced pain moving from local development, to testing, and then on to production. This cycle can be long and tedious, especially as AI models and datasets are integrated. Modal is trying to make this loop of development as seamless as possible for AI practitioners, and their platform is pretty incredible!

Erik from Modal joins us in this episode to help us understand how we can run or deploy machine learning models, massively parallel compute jobs, task queues, web apps, and much more, without our own infrastructure.

Practical AI Practical AI #166

Exploring deep reinforcement learning

Play
2022-02-01T20:00:00Z #ai +3 🎧 24,090

In addition to being a Developer Advocate at Hugging Face, Thomas Simonini is building next-gen AI in games that can talk and have smart interactions with the player using Deep Reinforcement Learning (DRL) and Natural Language Processing (NLP). He also created a Deep Reinforcement Learning course that takes a DRL beginner to from zero to hero. Natalie and Chris explore what’s involved, and what the implications are, with a focus on the development path of the new AI data scientist.

Practical AI Practical AI #257

Leading the charge on AI in National Security

Play
2024-02-20T15:15:00Z #ai +2 🎧 24,028

Chris & Daniel explore AI in national security with Lt. General Jack Shanahan (USAF, Ret.). The conversation reflects Jack’s unique background as the only senior U.S. military officer responsible for standing up and leading two organizations in the United States Department of Defense (DoD) dedicated to fielding artificial intelligence capabilities: Project Maven and the DoD Joint AI Center (JAIC).

Together, Jack, Daniel & Chris dive into the fascinating details of Jack’s recent written testimony to the U.S. Senate’s AI Insight Forum on National Security, in which he provides the U.S. government with thoughtful guidance on how to achieve the best path forward with artificial intelligence.

Practical AI Practical AI #259

YOLOv9: Computer vision is alive and well

Play
2024-03-06T17:00:00Z #ai 🎧 23,929

While everyone is super hyped about generative AI, computer vision researchers have been working in the background on significant advancements in deep learning architectures. YOLOv9 was just released with some noteworthy advancements relevant to parameter efficient models. In this episode, Chris and Daniel dig into the details and also discuss advancements in parameter efficient LLMs, such as Microsofts 1-Bit LLMs and Qualcomm’s new AI Hub.

Practical AI Practical AI #255

Data synthesis for SOTA LLMs

Play
2024-02-06T22:00:00Z #ai +1 🎧 23,819

Nous Research has been pumping out some of the best open access LLMs using SOTA data synthesis techniques. Their Hermes family of models is incredibly popular! In this episode, Karan from Nous talks about the origins of Nous as a distributed collective of LLM researchers. We also get into fine-tuning strategies and why data synthesis works so well.

Practical AI Practical AI #152

The mathematics of machine learning

Play
2021-10-05T20:15:00Z #ai +2 🎧 23,648

Tivadar Danka is an educator and content creator in the machine learning space, and he is writing a book to help practitioners go from high school mathematics to mathematics of neural networks. His explanations are lucid and easy to understand. You have never had such a fun and interesting conversation about calculus, linear algebra, and probability theory before!

Practical AI Practical AI #211

Serverless GPUs

Play
2023-02-14T21:30:00Z #ai +2 🎧 23,641

We’ve been hearing about “serverless” CPUs for some time, but it’s taken a while to get to serverless GPUs. In this episode, Erik from Banana explains why its taken so long, and he helps us understand how these new workflows are unlocking state-of-the-art AI for application developers. Forget about servers, but don’t forget to listen to this one!

Practical AI Practical AI #252

Advent of GenAI Hackathon recap

Play
2024-01-17T20:00:00Z #ai 🎧 23,316

Recently, Intel’s Liftoff program for startups and Prediction Guard hosted the first ever “Advent of GenAI” hackathon. 2,000 people from all around the world participated in Generate AI related challenges over 7 days. In this episode, we discuss the hackathon, some of the creative solutions, the idea behind it, and more.

Practical AI Practical AI

Welcome to Practical AI

Play
2020-03-25T21:10:28Z #ai +2 🎧 23,263

Practical AI is a weekly podcast that’s marking artificial intelligence practical, productive, and accessible to everyone. If world of AI affects your daily life, this show is for you.

From the practitioner wanting to keep up with the latest tools & trends…

(clip from episode #68)

To the AI curious trying to understand the concepts at play and their implications on our lives…

(clip from episode #39)

Expert hosts Chris Benson and Daniel Whitenack are here to keep you fully-connected with the world of machine learning and data science.

Please listen to a recent episode that interests you and subscribe today. We’d love to have you as a listener!

Practical AI Practical AI #193

Stable Diffusion

Play
2022-09-13T22:20:00Z #ai +1 🎧 22,943

The new stable diffusion model is everywhere! Of course you can use this model to quickly and easily create amazing, dream-like images to post on twitter, reddit, discord, etc., but this technology is also poised to be used in very pragmatic ways across industry. In this episode, Chris and Daniel take a deep dive into all things stable diffusion. They discuss the motivations for the work, the model architecture, and the differences between this model and other related releases (e.g., DALL·E 2).

alt text
(Image from stability.ai)

Player art
  0:00 / 0:00