スタート サイトを登録
quantized.uk

quantized.uk

quantized.ukDR 3 Accessible 300 views

開発・プログラミング Pick your GPU and see which of 117 quantized LLMs fit its VRAM, at what quantization level, with how much memory to spare, plus the command to run each model.

Editor's Review

For reference only
quantized.uk page preview

The site's value is its GPU-first approach: instead of browsing model cards, you select your exact card from a long list covering RTX 50/40/30 series, datacenter A100/H100, and Apple Silicon, then get a fit verdict per model. Quant-level granularity and spare-VRAM figures make it more practical than

Site introduction

quantized.uk is a reference site built around a single question: will this local LLM actually run on the graphics card I own? Rather than starting from model pages, it starts from hardware, letting you pick a specific GPU or Apple Silicon chip and then showing which entries in its index of 117 quantized models fit within that memory budget.

The core output is a fit table. For each model you see whether it fits, at which quantization level it fits, how much VRAM remains spare, and the command needed to run it. The GPU list is unusually broad for a hobbyist resource, spanning consumer RTX 50/40/30 cards, workstation and datacenter parts like the A100, L40S, A40 and H100, plus a wide range of Mac M-series configurations from 8GB up to 512GB.

It suits people running local inference on their own hardware: hobbyists deciding what to download, buyers checking whether a card is worth upgrading to, and Mac users who want to know how far unified memory stretches. Anyone comparing a 12GB and 16GB card for LLM work will find the spare-VRAM column more useful than raw benchmark charts.

Use it as a pre-download filter. Pick your exact card, note the highest quant level that fits with comfortable headroom, then copy the run command. Treat results as estimates rather than guarantees, since real usage depends on context length and runtime overhead. The site also links out to a quant hub, benchmarks, cookbook and tools sections for further reading.

Comments & Ratings

0

No comments yet. Be the first to review.

Write the first comment

Your email won't be made public; fields marked with * are required.

Rate this site

Click the stars to rate; rating is optional, and clicking the selected star again cancels it.