AI Local Check

How to check if your PC can run an AI model?

Running a large language model locally means loading it entirely into your computer's memory — ideally your graphics card's VRAM, which is far faster than system RAM. Whether a given model fits depends on three things: its size, the quantization you pick, and how long a context you run. Here's how to find your answer in under a minute.

What decides whether a model fits?

Weights & quantization Quantization shrinks a model by storing its weights at fewer bits. An 8-bit copy is roughly half the size of 16-bit; 4-bit halves it again, with a small quality cost. Picking the right level is usually what makes a model fit.

What can each GPU run?

As a rough starting point, here's the largest model size that typically fits at a balanced 4-bit quantization. Your exact result depends on the model and context — check your own card for precise numbers.