/ Discover

Trending Now

🔍

📬 Weekly trends — free:

150 items · Sorted by stars & momentum✕ Clear filters

article🟤 Reddit

⭐ 50

PrismML just released Binary and Ternary Bonsai Image 4B: 1-bit/ternary text-to-image diffusion transformers that can even run 100% locally in your browser on WebGPU. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 50

A rare look inside Qwen 3.7’s open source model release approval process: ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 50

Turning local agents into self-optimizing agents ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 50

OpenMOSS-Team/MOSS-TTS-v1.5 · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 50

I made a Windows app for managing llama.cpp in WSL/Ubuntu ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 50

Small comparison on full compute performance (Anima) of 5090 (600,475 and 400W) vs 6000 PRO MaxQ (325W), and 6000 PRO WS/SE (600W). ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 20

KVarN: new KV-cache quant from Huawei. 3–5× KV cache compression with actual speed-up instead of slow-down, and unlike TurboQuant it holds up on reasoning (Apache 2.0, vLLM single flag) ↗

r/LocalLLaMA · 20 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 10

Gemma 4 12b 8Q Heretic Oneshot Coding ↗

r/LocalLLaMA · 10 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 3

13 abliterated Gemma 4 E2B variants, 44 GPU hours, Benchmark and Comparison - Abliterlitics ↗

r/LocalLLaMA · 3 upvotes

localllama reddit

Details →

article🟤 Reddit

⭐ 2

Qwen3.6-35B-A3B tool calling benchmark: ByteShape vs. Unsloth GGUFs, KV cache quants & long context performance ↗

r/LocalLLaMA · 2 upvotes

localllama reddit

Details →

article🟤 Reddit

Stop traumatizing AI into loops and turn hallucinations into an honest "I don't know!" by being NICE to them (Proof of Concept, Research, I don't want to sell anything) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

New DeepSWE benchmark finds Claude Opus cheats ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen3.6 huge quality gain from Q4 to Q6 for coding agent ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

AI is not for everyone ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I ran 8 open-weight models as agents in a persistent MMO for 10 days. Here's the 93k event dataset and some things that I learned ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

SWE-rebench Leaderboard (March, April and May 2026): GPT-5.5, Opus 4.7, Cursor (Composer 2.5), Kimi K2.6 and More ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Is Granite-4.1-30b Overshadowed by Qwen3.6 & Gemma4 models? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

260K-param LLM running on an emulated 90s CPU inside an 18-year-old RTOS ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Folks running qwen 3.6 27b for agentic work. Do you dare to use q4_k_m? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Vulnerability found in framework used by VLLM, many MCP servers, and other LLM tools ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen3.6 35B-A3B successfully completed the FoodTruck Bench! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

How can Deepseek v4 top the coding leaderboards and still sit 8 months behind the frontier? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Behold! Probably the most ghetto local AI server: ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Info: Nvidia Cuda 13.3 landed ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

$400 Qwen 3.6-27B Setup - Dual RTX 3060 - 30-50 t/s ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I built a 103B-token Usenet corpus (1980–2013) — pre-web, human-only, zero AI contamination. Got strong traction on r/ML, thought this community would find it useful. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Looks like Miminax-M3 is just around the corner ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Cactus Hybrid Router: Gemma4-2B can match Gemini-3.1-Flash-Lite by routing 15-55% of tasks to Gemini And Running The Rest Locally. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

nvidia/Qwen3.6-35B-A3B-NVFP4 · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

125 tok/s for Qwen3.6 q4xl on 2x 4060ti is insane perf/dollar ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Someone out there likely needs this ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Cost Analysis of my $6.4k Local LLM Server ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gryphe/Pantheon-Reasoning-27B · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Open source : Turning vocal imitations into sound effects. (New UX for sound generation) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Zai replaced the network architecture running GLM-5.1 inference and the gains are pretty wild ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I've just benchmarked myself: ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

My new home office radiator 🥵 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

HF models page now has a "Base only" toggle to filter out finetunes/quants/etc ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Reachy Mini goes fully local! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

LiquidAI/LFM2.5-8B-A1B · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

StepFun 3.7 Flash ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen/Qwen-Image-Bench · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

PaddlePaddle/PaddleOCR-VL-1.6 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

The frontier reasoning race is starting to look like a crowded subway station ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen3.6 35B - TXT vs Markdown vs HTML vs HTML+CSS ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

"Western Open-Weight SOTA is between Gemma4-31B and Nemotron3-Super-120B" ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Nvidia LocateAnything - Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding. (10x faster than Qwen3-VL) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

What's your favorite local MCP server? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Upgrade path from 4x 3090s ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

this new Moss tts 1.5 is damn good with voice cloning ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Got Really lucky and need your advice ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Fulloch V2: 100% Local Voice Assistant for Home Assistant & Obsidian (Runs on 16GB VRAM) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

My home data center ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

STT -> LLM -> TTS pipeline ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Keeping multi-GPU rigs cool? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

[PSA] 5060ti 16GB for $300.99. 5070ti 16GB for $699.99. Best Buy in store clearance. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Running Qwen 3.6 35b MoE With Zoo Code On M1 Max is Amazing! Fully local, battery-powered coding powerhouse! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Has anyone experimented with stabilizing low quant models with lower temp and top p? ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Fused MoE dispatch kernel in pure Triton: 89-131% of Megablocks, runs on AMD with zero code changes ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

You don't need a GPU to run gemma-4-26B-A4B ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 12B is my new main squeeze ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Open models to win ✌ ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Cohere's unreleased coding model (early access for localllama) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

120 tok/s on 12GB VRAM with Gemma 4 12B QAT MTP ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

KV cache quant benchmarks: KVarN 6-bit matches q8_0, 4-bit matches q5_0. Massive! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

dots.tts 2B🎙️ SOTA TTS from RedNote ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 QAT Unquantized Heretic is here ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 QAT benchmark results (AMD 7900 XTX): faster, less VRAM, no quality loss ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Fuck, sucessfully ran minecraft server on GLM AI's Agent lol. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Github Copilot finally supporting custom endpoints ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Replaced Claude with local Qwen3.6-27B in my multi-agent orchestrator for 2 weeks ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Moss tts 1.5 8b Examples. It is the currently best voice cloning model for English as of June 2026 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

1-bit Bonsai Image 4B and Ternary Bonsai Image 4B Image Generation for Local Devices with just 0.93 GB and 1.21 GB respectively of Diffusion Transformer Footprint. So tiny! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen 3.6-35B-A3B with 977 tk/s prompt processing and 262k context window on Intel Arc B70 Pro ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

NVIDIA releases Cosmos 3 Omnimodal world modelson HF ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

ui: Add Thinking mode toggle with reasoning effort levels + improvements for Chat Form Add Action UI by allozaur · Pull Request #23434 · ggml-org/llama.cpp ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Dual rtx 3090 build ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Intel Arc Pro B70 llama.cpp benchmarks posted ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

google/gemma-4-12B · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Calling it now Microsoft is buying Unsloth. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

More Gemma 4 models incoming ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Introducing Gemma 4 12B: a unified, encoder-free multimodal model ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Me visiting this sub ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Nous Research — Hermes Desktop ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Let us let Google know that we want the Gemma 4 124b ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Microsoft Aion 1.0 Instruct and Aion 1.0 Plan models! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

New Google Gemma 4 12B Claims Near-26B Performance - We Tested Both! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

gemma-4-12b-it vs Qwen3.5-9B on shared benchmarks: Qwen is overall winner beating gemma in 5/8 benchmarks despite a smaller footprint ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 Unified is coming ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

This day in LLM history….105 years ago today, Qwen 3.6 27b was released open source. /s ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Another shout out to llama.cpp build b9455 2x3090 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

qwen35: use post-norm hidden state for MTP by am17an · Pull Request #24025 · ggml-org/llama.cpp ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Ideogram 4 is open source! (top ranked on DesignArena) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 with quantization-aware training ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

PSA ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Breaking the music supply constraint ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

llama: use f16 mask for FA to save VRAM by am17an · Pull Request #23764 · ggml-org/llama.cpp ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Liquid AI releases LFM2.5-8B-A1B ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen3.6-27B Quantization Benchmark ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Fed up with vibe coders, dev sneaks data-nuking prompt injection into their code ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

A moment of thanks for DeepSeek ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Shoutout to Gemma4 as a conversational assistant / agent ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

llama : website + unified `llama` binary · ggml-org/llama.cpp · Discussion #23875 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Use HTML as the primary chat language for your agents so they can draw diagrams ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I compared all specs of the major GPUs/machines that are being used here, because bandwidth is not everything. Some of ya'll need a reality check. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

StepFun 3.7 Flash - Speed Benchmark in M5 Max ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Step 3.7 Flash passes the car wash test ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Qwen 3.6 27B overdoing it ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

New LFM2.5 8b A1b model!! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

(YT) PewDiePie released his harness/webui ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

It's funny how everything changes, yet somehow stays the same. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Stepfun 3.7 Flash is very good ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

MiniMax M3 - Coding & Agentic Frontier, 1M Context, Multimodal ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

God dammit Qwen ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I ported NVIDIA Parakeet (speech-to-text) to ggml: same output as NeMo, faster, GGUF-quantized, no Python ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Cool stuff to do with NVIDIA RTX 6000 PRO 96GB VRAM ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

mudler/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-APEX-MTP-GGUF just released ! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Get you some GPUs, it's not worth the hacks around lack of RAM ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

We might have a winner with the upcoming N1X ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

when you spend 5 days fine-tuning a model and it still confidently makes things up ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Llama Studio v0.2.0 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Flash Attention for llama.cpp on RDNA3: 47% less KV VRAM than Vulkan f16 K, KLD almost losselss on F16 K / q4_0 V. Part 1. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

<Think> toggle button for llama.cp web chat for QWEN3.6 ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Added an old 2070 Super to my rig and I can't go back...worse, now I need more ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

MoQ GGUFs and GSQ: Low-Bit GGUFs Are About to Get Much Better ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Clustering 3x Jetson Nano Orin Supers ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

How to compare Original vs QAT Gemma 4 31B Q4 quants ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I have become George Jetson: my job is now Yes/No supervision for a machine I don’t fully understand. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Nvidia's been paying shills on LinkedIn ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 · Hugging Face ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Today made me realize just how bad things have gotten without Meta ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

VibeOS - Fully Hallucinated Operating System ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

You guys were right - Qwen 3.6 35B IS good...and KV Cache DOES matter. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

finally ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Gemma 4 QAT confirmed to release soon! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Hi Reddit, I posted my Build Your Own LLM workshop to Youtube (GPT2 & Qwen3.6 style) ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Nemotron 3 Ultra. 550 billion parameters, 55B active. 1 million context ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

The first Gemma 4 12B finetunes are ready ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

AMD & Intel, now onwards it's your turn to release your own models ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Higgs Audio v3 TTS 4B. Built for voice chat. Support 100 languages and inline control. ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

The DeepSWE benchmark was runned rather incompetently and the results are completely invalid ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

438 USD for a 3080 20GB isn’t bad ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

I implemented KVarN in my llama.cpp fork and ran KLD benchmarks. It's promising! ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Suggestion - this sub should have post flairs that mention the amount of vram/unified ram ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Bringing Gemma 4 12B to your Laptop: Unlocking Local, Agentic Workflows with Google AI Edge ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

[NEW MODEL] SupraLabs just released a new model! - Supra-50M-Reasoning ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 · ggml-org/llama.cpp ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →

article🟤 Reddit

qwen3.6-27b tools call loop ↗

r/LocalLLaMA · 0 upvotes

localllama reddit

Details →