Watch: How Much GPU Do You Really Need for Local AI? RTX 5070 Ti vs 5090 vs PRO 6000
Daniel and Jordan test a 16GB RTX 5070 Ti, a 32GB RTX 5090, and a 96GB RTX PRO 6000 with LM Studio to find out how much GPU local AI really takes.AI
In this video, Daniel and Jordan put three very different GPUs through their paces to find out how much hardware local AI really takes: a 16GB GeForce RTX 5070 Ti, a 32GB GeForce RTX 5090, and a 96GB NVIDIA RTX PRO 6000.
All of the testing runs in LM Studio, with a 27-billion-parameter Qwen model and the much larger Qwen 3.5 122B put through the same kinds of tasks. The point isn't a benchmark chart so much as a feel for what each card can and can't handle, and how model size, VRAM, and context length decide what's actually practical.
The 5070 Ti is where the story starts, and the video shows exactly where its 16GB of VRAM tops out. From there, the RTX 5090 shows what 32GB buys you, including more than 10 times the token speed in one test. The RTX PRO 6000 then handles huge context windows that simply wouldn't fit on a 32GB card.
We also step back to weigh local AI against the cloud, covering performance, subscription costs, privacy, and the appeal of owning your own hardware.
The big takeaway is that you don't need the most expensive GPU. Start with the workload you actually run, the size of the models you want, and how much VRAM that takes. Ready to shop? Browse graphics cards at Micro Center or see all AI solutions.
More from MC News
- Run AI Locally: The Best LLMs for 8GB, 16GB, 32GB Memory and Beyond
- How to Use Local AI With Your Own Files: A Beginner's Guide to RAG
- Reading vs. Answering: The Two Hardware Bottlenecks Behind Local AI Performance
- How to Use a Local LLM in Visual Studio Code
- Hands-On with the AMD Ryzen AI Halo
- Quantization Explained: Why the Same LLM Gives Better Results on High-End Hardware
- Why Context Length, Not AI Model Size, Is Your Biggest VRAM Problem
- How to Use LM Studio to turn your PC into an AI Server
- Why VRAM and Memory Bandwidth are Key for Powering Local AI
- Keyboard 101: Intro to Computer Keyboards
- Fix It Yourself: Talking to iFixit on Why Repairable Tech Matters
- The Local LLM Your Laptop's Been Waiting For
- Gemma vs Qwen: Which Local AI is Best?
