228
Generative AI Is an Engineering Disaster. A shockingly inefficient trillion-dollar project.
(www.theatlantic.com)
This is a most excellent place for technology news and articles.
Is that quantized? 4 bit Qwen 3.6 can get 22tps on a 1060.
It's the q4 quantization, but it requires 20+GB vram and my 5080 only has 16