How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acceleration. We explore how Groq optimizes the serving layer, adapts to industry shifts, and supports emerging model architectures. 

Featuring:

Dhananjay Singh ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Links:

Groq

Sponsors:

Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates. ? Support this podcast ?

Kyle Daigle, COO of GitHub, joins the hosts to discuss the evolving role of AI in software development, GitHub Copilot?s impact, and the challenges of AI-assisted coding. The conversation covers licensing concerns, ethical considerations, and how developers can navigate these complexities. Kyle also shares his vision for ambient AI, which seamlessly integrates into workflows to enhance productivity and innovation, shaping the future of developer tools. 

Featuring:

Kyle Daigle ? LinkedInChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Sponsors:

Domo ? The AI and data products platform. Strengthen your entire data journey with Domo?s AI and data products. ? Support this podcast ?

We often judge AI models by leaderboard scores, but what if efficiency matters more? Kate Soule from IBM joins us to discuss how Granite AI is rethinking AI at the edge?breaking tasks into smaller, efficient components and co-designing models with hardware. She also shares why AI should prioritize efficiency frontiers over incremental benchmark gains and how seamless model routing can optimize performance. 

Featuring:

Kate Soule ? LinkedInChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Links:

IBM GraniteIBM Granite on Hugging FaceIBM Expands Granite Model Family with New Multi-Modal and Reasoning AI Built for the Enterprise  ? Support this podcast ?

How can every single person build a personal AI protégé and then accumulate (and share) a host of other assistants? In this episode, we dive into the world of no-code AI with Scott Meyer from Chipp.ai. We discuss AI tooling for people that can't code, the cultural shift that needs to happen for widespread AI adoption in businesses, and the predicted growth trajectory of AI assistant that you can own.

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, XScott Meyer - LinkedIn, X

Sponsors:

Domo ? The AI and data products platform. Strengthen your entire data journey with Domo?s AI and data products.

Show Notes:

Chipp.aiChipp.ai's Discord ? Support this podcast ?

It seems like all we hear about are the great use cases for GenAI, but where should you NOT be using the technology? On this episode Chris and Daniel share their hot takes and bad use cases. Some may surprise you!

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Domo ? The AI and data products platform. Strengthen your entire data journey with Domo?s AI and data products. Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Something missing or broken? PRs welcome!

? Support this podcast ?

It seems like everyone is uses the term ?agent? differently these days. In this episode, Chris and Daniel dig into the details of tool calling and its connection to agents. They help clarify how LLMs can ?talk to? and ?interact with? other systems like databases, APIs, web apps, etc. Along the way they share related learning resources.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Notion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

smolagentsHugging Face agents course

Something missing or broken? PRs welcome!

? Support this podcast ?

There is crazy hype and a lot of confusion related to DeepSeek?s latest model DeepSeek R1. The products provided by DeepSeek (their version of a ChatGPT-like app) has exploded in popularity. However, ties to China have raised privacy and geopolitical concerns. In this episode, Chris and Daniel cut through the hype to talk about the model, privacy implications, running DeepSeek models securely, and what this signals for open models in 2025.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Notion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. Domo ? The AI and data products platform. Strengthen your entire data journey with Domo?s AI and data products. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Daniel?s blog post on DeepSeekDeepSeek R1 on Hugging FaceDeepSeek

Something missing or broken? PRs welcome!

? Support this podcast ?

We seem to be experiencing a surge of video generation tools, models, and applications. However, video generation models generally struggle with some basic physics, like realistic walking motion. This leaves some generated videos lacking true motion with disappointing, simplistic panning camera views. Genmo is focused on the motion side of video generation and has released some of the best open models. Paras joins us to discuss video generation and their journey at Genmo.

Join the discussion

Changelog++ members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Domo ? The AI and data products platform. Strengthen your entire data journey with Domo?s AI and data products. 

Featuring:

Paras Jain ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Genmo

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel and Chris groove with Jeff Smith, Founder and CEO at CHRP.ai. Jeff describes how CHRP anonymously analyzes emotional wellness data, derived from employees? music preferences, giving HR leaders actionable insights to improve productivity, retention, and overall morale. By monitoring key trends and identifying shifts in emotional health across teams, CHRP.ai enables proactive decisions to ensure employees feel supported and engaged.

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Shopify ? Sign up for a $1/month trial period at shopify.com/practicalaiEight Sleep ? Up to $600 off Pod 4 Ultra ? Go to eightsleep.com/changelog and use the code CHANGELOG. You can try it for free for 30 days - but we?re confident you will not want to return it (we love ours). Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. DeleteMe ? DeleteMe makes it quick, easy and safe to remove your personal data online. 

Featuring:

Jeff Smith ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

CHRP | WebsiteMyCHRPCHRP | InstagramCHRP | LinkedIn

Something missing or broken? PRs welcome!

? Support this podcast ?

Today, Chris explores Shopify Magic and other AI offerings with Mike Tamir, Distinguished ML Engineer and Head of Machine Learning, and Matt Colyer, Director of Product Management for Sidekick. They talk about how Shopify uses generative AI and LLMs to enhance their products, and they take a deeper dive into Sidekick, a first-of-its-kind, AI-enabled commerce assistant that understands a merchant?s business (products, orders, customers) and has been trained to know all about Shopify.

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Timescale ? Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai. Eight Sleep ? Up to $600 off Pod 4 Ultra ? Go to eightsleep.com/changelog and use the code CHANGELOG. You can try it for free for 30 days - but we?re confident you will not want to return it (we love ours). Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. 

Featuring:

Mike Tamir ? LinkedInMatt Colyer ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, X

Show Notes:

ShopifyShopify?s Winter Edition ?25

Something missing or broken? PRs welcome!

? Support this podcast ?

Kyutai, an open science research lab, made headlines over the summer when they released their real-time speech-to-speech AI assistant (beating OpenAI to market with their teased GPT-driven speech-to-speech functionality). Alex from Kyutai joins us in this episode to discuss the research lab, their recent Moshi models, and what might be coming next from the lab. Along the way we discuss small models and the AI ecosystem in France.

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Timescale ? Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai. WorkOS ? AuthKit offers 1,000,000 monthly active users (MAU) free ? The world?s best login box, powered by WorkOS + Radix. Learn more and get started at WorkOS.com and AuthKit.com

Featuring:

Alexandre Défossez ? Website, GitHub, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

KyutaiKyutai on GitHubKyutai on Hugging Face

Something missing or broken? PRs welcome!

? Support this podcast ?

Chris and Daniel dive into what Trump?s impending second term could mean for AI companies, model developers, and regulators, unpacking the potential shifts in policy and innovation. Next, they discuss the latest models, like Qwen, that blur the performance gap between open and closed systems. Finally, they explore new AI tools for meeting clones and AI-driven commerce, sparking a conversation about the balance between digital convenience and fostering genuine human connections.

Join the discussion

Changelog++ members save 8 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

WorkOS ? AuthKit offers 1,000,000 monthly active users (MAU) free ? The world?s best login box, powered by WorkOS + Radix. Learn more and get started at WorkOS.com and AuthKit.comNotion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. Retool ? The low-code platform for developers to build internal tools ? Some of the best teams out there trust Retool?Brex, Coinbase, Plaid, Doordash, LegalGenius, Amazon, Allbirds, Peloton, and so many more ? the developers at these teams trust Retool as the platform to build their internal tools. Try it free at retool.com/changelog

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

New Models Qwen2.5 Alibaba?s Qwen AI ModelQwen2.5 Turbo Reads Ten Novels in One MinuteDeepSeek DeepSeek API Docs UpdateFLUX Black Forest Labs? FLUX.1-dev on Hugging FaceOuteTTS OuteTTS 0.1 - 350M BlogOuteTTS 0.2 - 500M BlogSmol TTS Update on LinkedInSmolLVM SmolLVM Updates on LinkedInWhat Donald Trump?s Win Means for AIPractical AI Podcast: Episode 244GetPickle.aiDocling Docling Paper on arXivDocling GitHub RepositoryRed Hat Blog on DoclingLinkedIn Post on PDF Table ExtractionHugging Face Blog on Observers SDKAI and Commerce Stripe Blog: Adding Payments to Agentic WorkflowsLinkedIn Announcement: Payments Integration SDK

Something missing or broken? PRs welcome!

? Support this podcast ?

We are at GenAI saturation, so let?s talk about scikit-learn, a long time favorite for data scientists building classifiers, time series analyzers, dimensionality reducers, and more! Scikit-learn is deployed across industry and driving a significant portion of the ?AI? that is actually in production. :probabl is a new kind of company that is stewarding this project along with a variety of other open source projects. Yann Lechelle and Guillaume Lemaitre share some of the vision behind the company and talk about the future of scikit-learn!

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Timescale ? Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai. WorkOS ? A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.comShopify ? Sign up for a $1/month trial period at shopify.com/practicalai

Featuring:

Yann Lechelle ? LinkedInGuillaume Lemaitre ? GitHub, LinkedIn, Mastodon, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

:probabl.TechCrunch: Probabl is a new AI company built around popular library scikit-learnscikit-learn

Something missing or broken? PRs welcome!

? Support this podcast ?

It can be frustrating to get an AI application working amazingly well 80% of the time and failing miserably the other 20%. How can you close the gap and create something that you rely on? Chris and Daniel talk through this process, behavior testing, and the flow from prototype to production in this episode. They also talk a bit about the apparent slow down in the release of frontier models.

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Timescale ? Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai. Eight Sleep ? Up to $600 off Pod 4 Ultra Go to eightsleep.com/changelog and use the code CHANGELOG. You can try it for free for 30 days - but we?re confident you will not want to return it (we love ours). Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

MLOps Community ?Agents in Production? event

Something missing or broken? PRs welcome!

? Support this podcast ?

This week, Chris is joined by Gregory Richardson, Vice President and Global Advisory CISO at BlackBerry, and Ismael Valenzuela, Vice President of Threat Research & Intelligence at BlackBerry. They address how AI is changing the threat landscape, why human defenders remain a key part of our cyber defenses, and the explain the AI standoff between cyber threat actors and cyber defenders.

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Notion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. Eight Sleep ? Take your sleep and recovery to the next level. Go to eightsleep.com/PRACTICALAI and use the code PRACTICALAI to get $350 off your very own Pod 4 Ultra. You can try it for free for 30 days - but we?re confident you will not want to return it. Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. 

Featuring:

Gregory Richardson ? LinkedInIsmael Valenzuela ? GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, X

Show Notes:

The AI Standoff: Attackers vs. Defenders | Blackberry BlogBlackberry

Something missing or broken? PRs welcome!

? Support this podcast ?

Elham Tabassi, the Chief AI Advisor at the U.S. National Institute of Standards & Technology (NIST), joins Chris for an enlightening discussion about the path towards trustworthy AI. Together they explore NIST?s ?AI Risk Management Framework? (AI RMF) within the context of the White House?s ?Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence?.

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Timescale ? Real-time analytics on Postgres, seriously fast. Over 3 million Timescale databases power loT, sensors, Al, dev tools, crypto, and finance apps ? all on Postgres. Postgres, for everything. Retool ? The low-code platform for developers to build internal tools ? Some of the best teams out there trust Retool?Brex, Coinbase, Plaid, Doordash, LegalGenius, Amazon, Allbirds, Peloton, and so many more ? the developers at these teams trust Retool as the platform to build their internal tools. Try it free at retool.com/changelogDeleteMe ? DeleteMe makes it quick, easy and safe to remove your personal data online. 

Featuring:

Elham Tabassi ? Website, LinkedInChris Benson ? Website, GitHub, LinkedIn, X

Show Notes:

Elham Tabassi | NISTElham Tabassi | TIME 100 / AINIST Trustworthy & Responsible AI Resource CenterNIST AI Risk Management Framework (AI RMF)NIST Artificial Intelligence Risk Management Framework (AI RMF 1.0) (PDF)NIST AI RMF PlaybookNIST AI RMF DevelopmentNIST AI Risk Management Framework - EngageNIST Risk Management Framework Aims to Improve Trustworthiness of Artificial IntelligenceWhite House Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence

Something missing or broken? PRs welcome!

? Support this podcast ?

We are on the other side of ?big data? hype, but what is the future of analytics and how does AI fit in? Till and Adithya from MotherDuck join us to discuss why DuckDB is taking the analytics and AI world by storm. We dive into what makes DuckDB, a free, in-process SQL OLAP database management system, unique including its ability to execute lighting fast analytics queries against a variety of data sources, even on your laptop! Along the way we dig into the intersections with AI, such as text-to-sql, vector search, and AI-driven SQL query correction.

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Timescale ? Real-time analytics on Postgres, seriously fast. Over 3 million Timescale databases power loT, sensors, Al, dev tools, crypto, and finance apps ? all on Postgres. Postgres, for everything. Notion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. 

Featuring:

Till Döhmen ? Website, GitHub, LinkedIn, XAdithya Krishnan ? Website, GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

DuckDBMotherDuckIntroducing FixIt: an unreasonably effective AI error fixer for SQL

Something missing or broken? PRs welcome!

? Support this podcast ?

Workflow orchestration has always been a pain for data scientists, but this is exacerbated in these AI hype days by agentic workflows executing arbitrary (not pre-defined) workflows with a variety of failure modes. Adam from Prefect joins us to talk through their open source Python library for orchestration and visibility into python-based pipelines. Along the way, he introduces us to things like Marvin, their AI engineering framework, and ControlFlow, their agent workflow system.

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

WorkOS ? A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.comShopify ? Sign up for a $1/month trial period at shopify.com/practicalaiNotion ? Notion is a place where any team can write, plan, organize, and rediscover the joy of play. It?s a workspace designed not just for making progress, but getting inspired. Notion is for everyone ? whether you?re a Fortune 500 company or freelance designer, starting a new startup or a student juggling classes and clubs. 

Featuring:

Adam Azzam ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

PrefectMarvinControlFlow

Something missing or broken? PRs welcome!

? Support this podcast ?

As Argilla puts it: ?Data quality is what makes or breaks AI.? However, what exactly does this mean and how can AI team probably collaborate with domain experts towards improved data quality? David Berenstein & Ben Burtenshaw, who are building Argilla & Distilabel at Hugging Face, join us to dig into these topics along with synthetic data generation & AI-generated labeling / feedback.

Join the discussion

Changelog++ members save 11 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. WorkOS ? A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.comEight Sleep ? Take your sleep and recovery to the next level. Go to eightsleep.com/PRACTICALAI and use the code PRACTICALAI to get $350 off your very own Pod 4 Ultra. You can try it for free for 30 days - but we?re confident you will not want to return it. Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. 

Featuring:

Ben Burtenshaw ? GitHub, LinkedIn, XDavid Berenstein ? GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

ArgillaDistilabelSynthetic Data Generator UIHugging Face and Argilla meetups

Something missing or broken? PRs welcome!

? Support this podcast ?

We are constantly hearing about disillusionment as it relates to AI. Some of that is probably valid, but Mike Lewis, an AI architect from Cincinnati, has proven that he can consistently get LLM and GenAI apps to the point of real enterprise value (even with the Big Cos of the world). In this episode, Mike joins us to share some stories from the AI trenches & highlight what it takes (practically) to show what is possible, doable & scalable with AI.

Join the discussion

Changelog++ members save 11 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. WorkOS ? A platform that gives developers a set of building blocks for quickly adding enterprise-ready features to their application. Add Single Sign-On (Okta, Azure, Google, Microsoft OAuth), sync users from any SCIM directory, HRIS integration, audit trails (SIEM), free magic link sign-in. WorkOS is designed for developers and offers a single, elegant interface that abstracts dozens of enterprise integrations. Learn more and get started at WorkOS.comEight Sleep ? Take your sleep and recovery to the next level. Go to eightsleep.com/PRACTICALAI and use the code PRACTICALAI to get $350 off your very own Pod 4 Ultra. You can try it for free for 30 days - but we?re confident you will not want to return it. Once you experience AI-optimized sleep, you?ll wonder how you ever slept without it. Currently shipping to: United States, Canada, United Kingdom, Europe, and Australia. 

Featuring:

Mike Lewis ? LinkedInDaniel Whitenack ? Website, GitHub, X

Show Notes:

Synthoni

Something missing or broken? PRs welcome!

? Support this podcast ?

Seems like we are hearing a lot about GraphRAG these days, but there are lots of questions: what is it, is it hype, what is practical? One of our all time favorite podcast friends, Prashanth Rao, joins us to dig into this topic beyond the hype. Prashanth gives us a bit of background and practical use cases for GraphRAG and graph data.

Join the discussion

Changelog++ members save 8 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Assembly AI ? Turn voice data into summaries with AssemblyAI?s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more. Speakeasy ? Production-ready, enterprise-resilient, best-in-class SDKs crafted in minutes. Speakeasy takes care of the entire SDK workflow to save you significant time, delivering SDKs to your customers in minutes with just a few clicks! Create your first SDK for free!

Featuring:

Prashanth Rao ? Website, GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Kùzu: A highly scalable, extremely fast, easy-to-use embeddable, open source graph database: GitHub repoThe goals and vision of Kùzu: Blog postKùzu YouTube channelGraph RAG strategies with Kùzu: GitHub repoPrashanth Rao?s blog: thedataquarry.com

Something missing or broken? PRs welcome!

? Support this podcast ?

Recently the company stewarding the open source library scikit-learn announced their seed funding. Also, OpenAI released ?o1? with new behavior in which it pauses to ?think? about complex tasks. Chris and Daniel take some time to do their own thinking about o1 and the contrast to the scikit-learn ecosystem, which has the goal to promote ?data science that you own.?

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Assembly AI ? Turn voice data into summaries with AssemblyAI?s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more. Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Speakeasy ? Production-ready, enterprise-resilient, best-in-class SDKs crafted in minutes. Speakeasy takes care of the entire SDK workflow to save you significant time, delivering SDKs to your customers in minutes with just a few clicks! Create your first SDK for free!

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Probabl seed funding announcementOpenAI o1 announcementPurdue Data4Good competitionMLOps Community homepage and Slack workspaceLatent Space homepage and Discord server

Join the Practical AI community ? it?s free! Connect with us in the #practicalai Slack channel. The community is here for you as a place to below, to bounce ideas around, or to get feedback on a conference to attend or talk you?d like to give.

Something missing or broken? PRs welcome!

? Support this podcast ?

Dinis Cruz drops by to chat about cybersecurity for generative AI and large language models. In addition to discussing The Cyber Boardroom, Dinis also delves into cybersecurity efforts at OWASP and that organization?s Top 10 for LLMs and Generative AI Apps.

Join the discussion

Changelog++ members save 7 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Speakeasy ? Production-ready, enterprise-resilient, best-in-class SDKs crafted in minutes. Speakeasy takes care of the entire SDK workflow to save you significant time, delivering SDKs to your customers in minutes with just a few clicks! Create your first SDK for free!Fly.io ? The home of Changelog.com ? Deploy your apps close to your users ? global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes. Shopify ? Sign up for a $1/month trial period at shopify.com/practicalai

Featuring:

Dinis Cruz ? Website, GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

The Cyber BoardroomOWASP - Top 10 for LLMs and Generative AI AppsOWASP - Generative AI

Something missing or broken? PRs welcome!

? Support this podcast ?

GenAI is often what people think of when someone mentions AI. However, AI is much more. In this episode, Daniel breaks down a history of developments in data science, machine learning, AI, and GenAI in this episode to give listeners a better mental model. Don?t miss this one if you are wanting to understand the AI ecosystem holistically and how models, embeddings, data, prompts, etc. all fit together.

Join the discussion

Changelog++ members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Speakeasy ? Production-ready, enterprise-resilient, best-in-class SDKs crafted in minutes. Speakeasy takes care of the entire SDK workflow to save you significant time, delivering SDKs to your customers in minutes with just a few clicks! Create your first SDK for free!

Featuring:

Daniel Whitenack ? Website, GitHub, X

Show Notes:

scikit-learnAutoML in Google Cloud

Something missing or broken? PRs welcome!

? Support this podcast ?

How do you systematically measure, optimize, and improve the performance of LLM applications (like those powered by RAG or tool use)? Ragas is an open source effort that has been trying to answer this question comprehensively, and they are promoting a ?Metrics Driven Development? approach. Shahul from Ragas joins us to discuss Ragas in this episode, and we dig into specific metrics, the difference between benchmarking models and evaluating LLM apps, generating synthetic test data and more.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Assembly AI ? Turn voice data into summaries with AssemblyAI?s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more. 

Featuring:

Shahul Es ? GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Ragas

Something missing or broken? PRs welcome!

? Support this podcast ?

If you have questions at the intersection of Cybersecurity and AI, you need to know Donato at WithSecure! Donato has been threat modeling AI applications and seriously applying those models in his day-to-day work. He joins us in this episode to discuss his LLM application security canvas, prompt injections, alignment, and more.

Join the discussion

Changelog++ members save 9 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Assembly AI ? Turn voice data into summaries with AssemblyAI?s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more. Porkbun ? Go to porkbun.com to get .app, .dev, or .foo domain names at Porkbun for only $1 for the first year! Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. 

Featuring:

Donato Capitella ? WebsiteDaniel Whitenack ? Website, GitHub, X

Show Notes:

The Security Canvas for LLM ApplicationsLLM Security Chronicles Playlist on YouTubeShould you let ChatGPT control your browser?When your AI assistant has an evil twinPliny the Liberator - jailbreak guru

Something missing or broken? PRs welcome!

? Support this podcast ?

You might have heard that ?AI is only as good as the data.? What does that mean and what data are we talking about? Chris and Daniel dig into that topic in the episode exploring the categories of data that you might encounter working in AI (for training, testing, fine-tuning, benchmarks, etc.). They also discuss the latest developments in AI regulation with the EU?s AI Act coming into force.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Assembly AI ? Turn voice data into summaries with AssemblyAI?s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more. Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Something missing or broken? PRs welcome!

? Support this podcast ?

There is an increasing desire for and effort towards GPU alternatives for AI workloads and an ability to run GenAI models on CPUs. Ben and Greg from Intel join us in this episode to help us understand Intel?s strategy as it related to AI along with related projects, hardware, and developer communities. We dig into Intel?s Gaudi processors, open source collaborations with Hugging Face, and AI on CPU/Xeon processors.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Intel Innovation 2024 ? Early bird registration is now open for Intel Innovation 2024 in San Jose, CA! Learn more OR registerMotific ? Accelerate your GenAI adoption journey. Rapidly deliver trustworthy GenAI assistants. Learn more at motific.ai

Featuring:

Benjamin Consolvo ? GitHub, LinkedIn, XGreg Serochi ? LinkedInChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Intel?s AI & Machine Learning Ecosystem Developer ResourcesIntel® Tiber? Developer CloudIntel Gaudi AI ProcessorsOptimum HabanaOverview of AI tools from IntelOpenVINOCase Study: Prediction Guard De-Risks LLM Applications at ScaleHow Prediction Guard Delivers Trustworthy AI on Intel® Gaudi® 2 AI Accelerators

Something missing or broken? PRs welcome!

? Support this podcast ?

We discussed ?? Broccoli AI? a couple weeks ago, which is the kind of AI that is actually good/healthy for a real world business. Bengsoon Chuah, a data scientist working in the energy sector, joins us to discuss developing and deploying NLP pipelines in that environment. We talk about good/healthy ways of introducing AI in a company that uses on-prem infrastructure, has few data science professionals, and operates in high risk environments.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Intel Innovation 2024 ? Early bird registration is now open for Intel Innovation 2024 in San Jose, CA! Learn more OR registerMotific ? Accelerate your GenAI adoption journey. Rapidly deliver trustworthy GenAI assistants. Learn more at motific.ai

Featuring:

Bengsoon Chuah ? GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

MLFlowPrefectDuckDBAgrilla

Something missing or broken? PRs welcome!

? Support this podcast ?

This week Daniel & Chris hang with repeat guest and good friend Demetrios Brinkmann of the MLOps Community. Together they review, debate, and poke fun at the 2024 Gartner Hype Cycle chart for Artificial Intelligence. You are invited to join them in this light-hearted fun conversation about the state of hype in artificial intelligence.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Intel Innovation 2024 ? Early bird registration is now open for Intel Innovation 2024 in San Jose, CA! Learn more OR registerMotific ? Accelerate your GenAI adoption journey. Rapidly deliver trustworthy GenAI assistants. Learn more at motific.ai

Featuring:

Demetrios Brinkmann ? XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

MLOps CommunityMLOps Community PodcastGartner Hype Cycle for Artificial Intelligence, 2024

Something missing or broken? PRs welcome!

? Support this podcast ?

In the midst of the demos & discussion about OpenAI?s GPT-4o voice assistant, Kyutai swooped in to release the first real-time AI voice assistant model and a pretty slick demo (Moshi). Chris & Daniel discuss what this more open approach to a voice assistant might catalyze. They also discuss recent changes to Gartner?s ranking of GenAI on their hype cycle.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Plumb ? Low-code AI pipeline builder that helps you build complex AI pipelines fast. Easily create AI pipelines using their node-based editor. Iterate and deploy faster and more reliably than coding by hand, without sacrificing control. Motific ? Accelerate your GenAI adoption journey. Rapidly deliver trustworthy GenAI assistants. Learn more at motific.ai

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

KyutaiKyutai keynote videoGartner Hype Cycle for AI

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris explore the advantages of vector databases with Roie Schwaber-Cohen of Pinecone. Roie starts with a very lucid explanation of why you need a vector database in your machine learning pipeline, and then goes on to discuss Pinecone?s vector database, designed to facilitate efficient storage, retrieval, and management of vector data.

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Plumb ? Low-code AI pipeline builder that helps you build complex AI pipelines fast. Easily create AI pipelines using their node-based editor. Iterate and deploy faster and more reliably than coding by hand, without sacrificing control. 

Featuring:

Roie Schwaber-Cohen ? GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

PineconePinecone | Blog

Something missing or broken? PRs welcome!

? Support this podcast ?

We?ve had representatives from Stanford?s Institute for Human-Centered Artificial Intelligence (HAI) on the show in the past, but we were super excited to talk through their 2024 AI Index Report after such a crazy year in AI! Nestor from HAI joins us in this episode to talk about some of the main takeaways including how AI makes workers more productive, the US is increasing regulations sharply, and industry continues to dominate frontier AI research.

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Plumb ? Low-code AI pipeline builder that helps you build complex AI pipelines fast. Easily create AI pipelines using their node-based editor. Iterate and deploy faster and more reliably than coding by hand, without sacrificing control. 

Featuring:

Nestor Maslej ? LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Stanford HAI2024 AI Index Report

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris engage in an impromptu discussion of the state of AI in the enterprise. Then they dive into the recent Apple Intelligence announcement to explore its implications. Finally, Daniel leads a deep dive into a new topic - Advanced RAG - covering everything you need to know to be practical & productive.

Join the discussion

Changelog++ members save 6 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Plumb ? Low-code AI pipeline builder that helps you build complex AI pipelines fast. Easily create AI pipelines using their node-based editor. Iterate and deploy faster and more reliably than coding by hand, without sacrificing control. Backblaze ? Unlimited cloud backup for Macs, PCs, and businesses for just $99/year. Easily protect business data through a centrally managed admin. Protect all the data on your machines automatically. Easy to deploy across multiple workstations with various deployment options. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Apple IntelligenceIntroducing Apple Intelligence, the personal intelligence system that puts powerful generative models at the core of iPhone, iPad, and MacThe top AI features Apple announced at WWDC 2024Hybrid Search: Combining BM25 and Semantic Search for Better Results with LangchainAdvanced RAG: Precise Zero-Shot Dense Retrieval with HyDE

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris sit down with Denis Yarats, Co-founder & CTO at Perplexity, to discuss Perplexity?s sophisticated AI-driven answer engine. Denis outlines some of the deficiencies in search engines, and how Perplexity?s approach to information retrieval improves on traditional search engine systems, with a focus on accuracy and validation of the information provided.

Join the discussion

Changelog++ members save 6 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Backblaze ? Unlimited cloud backup for Macs, PCs, and businesses for just $99/year. Easily protect business data through a centrally managed admin. Protect all the data on your machines automatically. Easy to deploy across multiple workstations with various deployment options. NordVPN ? Get NordVPN 2Y plan + 4 months extra at nordvpn.com/practicalai It?s risk-free with Nord?s 30-day money-back guarantee. 

Featuring:

Denis Yarats ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

PerplexityPerplexity | BlogPerplexity | Getting Started

Something missing or broken? PRs welcome!

? Support this podcast ?

We?ve all heard about breaches of privacy and leaks of private health information (PHI). For healthcare providers and those storing this data, knowing where all the sensitive data is stored is non-trivial. Ramin, from Tausight, joins us to discuss how they have deploy edge AI models to help company search through billions of records for PHI.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Backblaze ? Unlimited cloud backup for Macs, PCs, and businesses for just $99/year. Easily protect business data through a centrally managed admin. Protect all the data on your machines automatically. Easy to deploy across multiple workstations with various deployment options. 

Featuring:

Ramin Mohammadi ? GitHub, LinkedInDaniel Whitenack ? Website, GitHub, X

Show Notes:

Tausight

Something missing or broken? PRs welcome!

? Support this podcast ?

We?ve seen a rise in interest recently and a number of major announcements related to local LLMs and AI PCs. NVIDIA, Apple, and Intel are getting into this along with models like the Phi family from Microsoft. In this episode, we dig into local AI tooling, frameworks, and optimizations to help you navigate this AI niche, and we talk about how this might impact AI adoption in the longer term.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Ladder Life Insurance ? 100% digital ? no doctors, no needles, no paperwork. Don?t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you?re instantly approved. They?re rated A and A plus. Life insurance costs more as you age, now?s the time to cross it off your list. Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

OllamaLM Studiollama.cppOpenVINOMLPerf client working groupArticle - 5 top small language modelsGPTQ articleArticle - Which quantization method is right for you

Something missing or broken? PRs welcome!

? Support this podcast ?

At the age of 72, U.S. Representative Don Beyer of Virginia enrolled at GMU to pursue a Master?s degree in C.S. with a concentration in Machine Learning.

Rep. Beyer is Vice Chair of the bipartisan Artificial Intelligence Caucus & Vice Chair of the NDC?s AI Working Group. He is the author of the AI Foundation Model Transparency Act & a lead cosponsor of the CREATE AI Act, the Federal Artificial Intelligence Risk Management Act & the Artificial Intelligence Environmental Impacts Act.

We hope you tune into this inspiring, nonpartisan conversation with Rep. Beyer about his decision to dive into the deep end of the AI pool & his leadership in bringing that expertise to Capitol Hill.

Join the discussion

Changelog++ members save 1 minute on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Don Beyer ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

U.S. Representative Don BeyerCongressman Don Beyer, Mason student and lifelong learnerBeyer Statement On President Biden?s AI Executive OrderBeyer Appointed To Bipartisan Task Force On Artificial Intelligence

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris share their first impressions of OpenAI?s newest LLM: GPT-4o and Daniel tries to bring the model into the conversation with humorously mixed results. Together, they explore the implications of Omni?s new feature set - the speed, the voice interface, and the new multimodal capabilities.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Ladder Life Insurance ? 100% digital ? no doctors, no needles, no paperwork. Don?t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you?re instantly approved. They?re rated A and A plus. Life insurance costs more as you age, now?s the time to cross it off your list. Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. 

Featuring:

Daniel Whitenack ? Website, GitHub, XChris Benson ? Website, GitHub, LinkedIn, X

Show Notes:

Hello GPT-4oAI Engineer World?s FairAIQCON - the AI Quality ConferenceBrave New Words: How AI Will Revolutionize Education (and Why That?s a Good Thing)

Something missing or broken? PRs welcome!

? Support this podcast ?

There?s a lot of hype about AI agents right now, but developing robust agents isn?t yet a reality in general. Imbue is leading the way towards more robust agents by taking a full-stack approach; from hardware innovations through to user interface. In this episode, Josh, Imbue?s CTO, tell us more about their approach and some of what they have learned along the way.

Join the discussion

Changelog++ members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Josh Albrecht ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

CARBS (Imbue?s cost-aware hyperparameter optimizer)Imbue paper on the stepwise nature of self-supervised learningA paper on initialization/feature learning co-authored by Jamie Simon, a member of Imbue?s technical teamImbue

Something missing or broken? PRs welcome!

? Support this podcast ?

Yep, you heard that right. Autonomous fighter jets are in the news. Chris and Daniel discuss a modified F-16 known as the X-62A VISTA and autonomous vehicles/ systems more generally. They also comment on the Linux Foundation?s new Open Platform for Enterprise AI.

Join the discussion

Changelog++ members save 10 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Ladder Life Insurance ? 100% digital ? no doctors, no needles, no paperwork. Don?t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you?re instantly approved. They?re rated A and A plus. Life insurance costs more as you age, now?s the time to cross it off your list. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Pentagon takes AI dogfighting to next level in real-world flight tests against human F-16 pilotTop US Air Force official rides in front seat of autonomous F-16Open Platform for Enterprise AI

Something missing or broken? PRs welcome!

? Support this podcast ?

We recently gathered some Practical AI listeners for a live webinar with Danny from LibreChat to discuss the future of private, open source chat UIs. During the discussion we hear about the motivations behind LibreChat, why enterprise users are hosting their own chat UIs, and how Danny (and the LibreChat community) is creating amazing features (like RAG and plugins).

Join the discussion

Changelog++ members save 1 minute on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Danny Avila ? XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Register for our next webinar (similar to this one) focused on multimodal AILibreChatPrediction Guard

Something missing or broken? PRs welcome!

? Support this podcast ?

First there was Mamba? now there is Jamba from AI21. This is a model that combines the best non-transformer goodness of Mamba with good ?ol attention layers. This results in a highly performant and efficient model that AI21 has open sourced! We hear all about it (along with a variety of other LLM things) from AI21?s co-founder Yoav.

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. 

Featuring:

Yoav Shoham ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

Jamba - A Groundbreaking SSM - Transformer Open ModelAI21 Labs

Something missing or broken? PRs welcome!

? Support this podcast ?

2024 promises to be the year of multi-modal AI, and we are already seeing some amazing things. In this ?fully connected? episode, Chris and Daniel explore the new Udio product/service for generating music. Then they dig into the differences between recent multi-modal efforts and more ?traditional? ways of combining data modalities.

Join the discussion

Changelog++ members save 26 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

UdioCLIPBridgeTowerLLaVA

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris delight in conversation with ?the funniest guy in AI?, Demetrios Brinkmann. Together they explore the results of the MLOps Community?s latest survey. They also preview the upcoming AI Quality Conference.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

The Hacker Mindset ? ?The Hacker Mindset? written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side ? the side focused on innovation, problem-solving, and ethical principles. Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Demetrios Brinkmann ? XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

MLOps CommunityAI Quality ConferenceEvaluation SurveyRAG failover talk from Jerry LuiPrompt Templates the Song

Something missing or broken? PRs welcome!

? Support this podcast ?

In this fully connected episode, Daniel & Chris discuss NVIDIA GTC keynote comments from CEO Jensen Huang about teaching kids to code. Then they dive into the notion of ?community? in the AI world, before discussing challenges in the adoption of generative AI by non-technical people. They finish by addressing the evolving balance between generative AI interfaces and search engines.

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Ladder Life Insurance ? 100% digital ? no doctors, no needles, no paperwork. Don?t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you?re instantly approved. They?re rated A and A plus. Life insurance costs more as you age, now?s the time to cross it off your list. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

NVIDIA GTC March 2024 Keynote with NVIDIA CEO Jensen Huang5 Forces That Will Drive the Adoption of GenAI | Harvard Business ReviewHere?s why AI search engines really can?t kill Google | The Verge

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel and Chris are out this week, so we?re bringing you conversations all about AI?s complicated relationship to software developers from other Changelog pods: JS Party, Go Time & The Changelog.

Join the discussion

Changelog++ members save 2 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Visit Neo4j.com/developer to get started. The Hacker Mindset ? ?The Hacker Mindset? written by Garrett Gee, a seasoned white hat hacker with over 20 years of experience, is available for pre-order now. This book reveals the secrets of white hat hacking and how you can apply them to overcome obstacles and achieve your goals. In a world where hacking often gets a bad rap, this book shows you the white hat side ? the side focused on innovation, problem-solving, and ethical principles. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Kent Quirk ? GitHub, Mastodon, XSharon DiOrio ? XSteven Pyle ? LinkedInJosé Valim ? Website, GitHub, XJerod Santo ? GitHub, LinkedIn, Mastodon, XKevin Ball ? Website, GitHub, LinkedIn, XNick Nisi ? Website, GitHub, Mastodon, XJohnny Boursiquot ? Website, GitHub, XAdam Stacoviak ? Website, GitHub, LinkedIn, Mastodon, X

Show Notes:

JS Party #317 (This will 404 until Thursday!)Go Time #306Changelog & Friends #28

Something missing or broken? PRs welcome!

? Support this podcast ?

Daniel & Chris explore the state of the art in prompt engineering with Jared Zoneraich, the founder of PromptLayer. PromptLayer is the first platform built specifically for prompt engineering. It can visually manage prompts, evaluate models, log LLM requests, search usage history, and help your organization collaborate as a team. Jared provides expert guidance in how to be implement prompt engineering, but also illustrates how we got here, and where we?re likely to go next.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Shopify ? Sign up for a $1/month trial period at shopify.com/practicalaiFly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Jared Zoneraich ? LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

PromptLayer

Something missing or broken? PRs welcome!

? Support this podcast ?

Runway is an applied AI research company shaping the next era of art, entertainment & human creativity. Chris sat down with Runway co-founder / CTO, Anastasis Germanidis, to discuss their rise and how it?s defining the future of the creative landscape with its text & image to video models. We hope you find Anastasis?s founder story as inspiring as Chris did.

Join the discussion

Changelog++ members save 4 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Neo4j ? Is your code getting dragged down by JOINs and long query times? The problem might be your database?Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it?s easy to integrate into your tech stack. Visit Neo4j.com/developer to get started. Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. 

Featuring:

Anastasis Germanidis ? Website, GitHub, LinkedIn, XChris Benson ? Website, GitHub, LinkedIn, X

Show Notes:

Runway | WebsiteRunway | TwitterRunway | AI Film Festival (AIFF)Runway | Gen-2Runway | Gen48

Something missing or broken? PRs welcome!

? Support this podcast ?

While everyone is super hyped about generative AI, computer vision researchers have been working in the background on significant advancements in deep learning architectures. YOLOv9 was just released with some noteworthy advancements relevant to parameter efficient models. In this episode, Chris and Daniel dig into the details and also discuss advancements in parameter efficient LLMs, such as Microsofts 1-Bit LLMs and Qualcomm?s new AI Hub.

Join the discussion

Changelog++ members save 3 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

Changelog News ? A podcast+newsletter combo that?s brief, entertaining & always on-point. Subscribe today. Fly.io ? The home of Changelog.com ? Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs. Sentry ? Launch week! New features and products all week long (so get comfy)! Tune in to Sentry?s YouTube and Discord daily at 9am PT to hear the latest scoop. Too busy? No problem - enter your email address to receive all the announcements (and win swag along the way). Use the code CHANGELOG when you sign up to get $100 OFF the team plan. Typesense ? Lightning fast, globally distributed Search-as-a-Service that runs in memory. You literally can?t get any faster! 

Featuring:

Chris Benson ? Website, GitHub, LinkedIn, XDaniel Whitenack ? Website, GitHub, X

Show Notes:

YOLOv9:

Yolov9: Learning What You Want to Learn Using Programmable Gradient InformationYolov9 Object Detection with Programmable Gradient Information (PGI) and Generalized EfficientYolov9: A Comprehensive Guide and Custom Dataset Fine-TuningYOLOv9 SOTA Machine Learning Object Detection ModelYOLOv9Unleashing the Power of YOLOv9YOLOv9 with NNCF and OpenVINOArXiv:2402.13616

Parameter efficient LLMs:

Hugging Face Paper page, 1-Bit LLMsArXiv paper: ?The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits?Qualcomm AI Hub

Something missing or broken? PRs welcome!

? Support this podcast ?