Qwen3.8 27B at 1-Bit: What r/LocalLLaMA's 'Brain Damage' Quant Actually Reveals
A 1-bit GGUF of Qwen3.8 27B went viral on r/LocalLLaMA for its jokes. Unsloth's real accuracy numbers on it are the actual story.
Local Inference
Notes on running your own LLMs at home: hardware, quantization, and the tool stack, without a hosted API in the loop.
Qwen 3.8 27B Hits r/LocalLLaMA: Real Quant Numbers Across 16GB to 32GB Rigs
r/LocalLLaMA's release-day thread for Qwen 3.8 27B, with quantization results from 16GB to 32GB VRAM rigs and the community's benchmark skepticism.
What Qwen3.8's MoE Lineup Means for Sizing Your Local Rig
Qwen3.8-27B and 3.8-Max landed this week. r/LocalLLaMA's reaction says more about active-parameter counts and offload rigs than about the models themselves.
Self-Hosted LLMs for Fiction and Roleplay Writing: Hardware, Models, and Stack
Why homelabbers run local LLMs for fiction and roleplay writing instead of a hosted API, what 'uncensored' and 'abliterated' actually mean, and which models r/LocalLLaMA, r/LocalLLM, and r/SillyTavernAI actually recommend for it.
Running Kimi K3 Locally: A 16x GB10 Cluster and the Community's Alternatives
A hobbyist ran the full Kimi K3 model across 16 NVIDIA GB10 nodes, and the ensuing r/LocalLLaMA thread digs into the real throughput, hardware costs, and cheaper single-node alternatives commenters proposed.
Optimizing Local LLM Deployment: Insights from r/LocalLLaMA
A r/LocalLLaMA thread on Qwen3.8-27B's VRAM footprint turns into a debate over whether 17GB is really news, plus community tips on offloading, quantization, and MoE alternatives for low-VRAM setups.