Run local AI on any PC or Mac - Microsoft Foundry Local

Microsoft Mechanics Podcast

Build powerful AI apps that run locally on any device—Windows, macOS, or mobile—without relying on the cloud using Foundry Local. Leverage full hardware performance, keep data private, reduce latency, and predict costs, even in offline or low-connectivity scenarios.

Simplify development and deploy AI apps across diverse hardware and OS platforms with the Foundry Local SDK. Manage models locally, switch AI engines easily, and deliver consistent, multi-modal experiences, voice or text, without complex cross-platform setup.

Raji Rajagopalan, Microsoft CoreAI Vice President, shares how to start quickly, test locally, and scale confidently.

► QUICK LINKS:

00:00 - Run AI locally

01:48 - Local AI use cases

02:23 - App portability

03:18 - Run apps on any device

05:14 - Run on older devices

05:58 - Run apps on MacOS

06:18 - Local AI is Multi-modal

07:25 - How it works

08:20 - How to get it running on your device

09:26 - Start with AI Toolkit in VS Code with new SDK

10:11 - Wrap up

► Link References

Check out https://aka.ms/foundrylocalSDK

Build an app using code in our repo at https://aka.ms/foundrylocalsamples

► Unfamiliar with Microsoft Mechanics?

As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft.

• Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries

• Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog

• Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast

► Keep getting this insider knowledge, join us on social:

• Follow us on Twitter: https://twitter.com/MSFTMechanics

• Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/

• Enjoy us on Instagram: https://www.instagram.com/msftmechanics/

• Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics