Local AI

Latest about Local AI

Happy boy using system AI Chatbot in computer or mobile application. Chatbot conversation, Ai Artificial Intelligence technology. Open AI generate. Futuristic technology. Virtual assistant on internet.

We gave AI a kid’s exam. It tried its best.

By Richard Devine published

AI OpenAI has finally released some AI models folks can use at home on their local machines, so I decided to see if it was better at a test designed for children than my own kid.

AI
A Huawei MateBook D running Ollama on Fedora 42

AI on a 7‑year‑old laptop. Because why not.

By Richard Devine published

AI While most of my local AI work takes place on a fairly well-equipped desktop PC, I was curious to see what mileage I could get from an old laptop I have lying around, and it surprised me.

AI
Ollama stats in Windows Terminal showing eval rate and the split of CPU and GPU being used.

Even With a Beastly GPU, Ollama Can Lag — Here’s What You’re Missing

By Richard Devine published

AI Ollama is one of the easiest ways to integrate localized AI LLMs into your daily workflow, but you might be leaving performance on the table by making one crucial mistake, like I was.

AI
Ollama running the Gemma3:12b model on a Razer Blade 18.

Skip the Cloud: 5 Reasons to Use Local AI Instead of ChatGPT or Copilot

By Richard Devine published

AI AI is far more than the likes of ChatGPT and Copilot, and while these online tools are accessible to all, there are plenty of reasons to start using localized tools on your PC instead.

AI
Ollama app running on Windows 11

Say Goodbye to Terminal: Ollama's User-Friendly Windows 11 App

By Richard Devine published

AI Ollama is already one of the best ways to run local LLMs on your PC, but with the release of a new GUI app for the tool, it's easier than ever.

AI
1 2 Archives