DEV Community

Genrius AI profile picture

Genrius AI

404 bio not found

Joined Joined on 
8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

8 open models, 77-85% smaller: what 2-bit quantization costs and what it keeps

1
Comments
1 min read
Benchmarking 2-bit GGUFs fairly: paired windows, and the NaN trap on RTX 50 GPUs

Benchmarking 2-bit GGUFs fairly: paired windows, and the NaN trap on RTX 50 GPUs

1
Comments
1 min read
How we fit a 27B model on a 12 GB laptop GPU

How we fit a 27B model on a 12 GB laptop GPU

1
Comments
9 min read
How to Compare Quantized LLMs Fairly in llama.cpp: Same Bytes, Same Windows, Same GPU

How to Compare Quantized LLMs Fairly in llama.cpp: Same Bytes, Same Windows, Same GPU

1
Comments
9 min read
How to Run a 4B LLM Locally on Windows with a Small NVIDIA GPU (3 Steps)

How to Run a 4B LLM Locally on Windows with a Small NVIDIA GPU (3 Steps)

1
Comments
6 min read
How We Shrank an AI Model by 85% and Kept 90% of Its Smarts

How We Shrank an AI Model by 85% and Kept 90% of Its Smarts

1
Comments
8 min read
loading...