Intelligence pulse

X feed: local LLM, Strata, GPU prices.
今読む
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
- New release is out!
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
- Strata wins by a tight margin against all other Strix Halo inference engines in it’s first try release. Did not expect that! 🥳 https://t.co/7Ie0lXa85c
- Only loses to @ciruai engine on Hermes benchmarks. Kudos 🫡
@coldniko · 47 日前 · ベンチマーク
- Running Strata on Mini PC with iGPU 780M — about 13 tokens/s on first try
@coldniko · 47 日前 · ベンチマーク
Latest on X
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · 46 日前 · X · models, hardware, benchmark
Site analysis · Project Maya (mw00/project-maya) is a Strata-derived engine rewrite that targets zai-org/GLM-5.3-Flash, a 321B-parameter MoE (about 18B active per token) with up to 1M-token context. How the port works, p…
- #strata 0.1.40.2, 247K context cold intake 717 tok/s -> 816 tok/s on my 2*V100 -- very good progress! 1 week ago it was <500
@BusError · 46 日前 · X · benchmark, strata
- Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards.
@VRAMCalculator · 46 日前 · X · upgrade, benchmark, models
Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards. Its author's figures, Qwen3.8 Flash Next: Arc Pro B70 32 GB, IQ3_S: 31 to 41 tok/s, prompts at about 1,000 tok/s Arc A750 …
- Strata是很好,我也在旧3090节点上跑到了60tks的速度,但是X上现在明显在夸大其词了。5070ti没有暴涨。MacStudio M5 Ultra 256G二手比新的贵,我不知道为什么,但我不觉得是strata干的。Qwen-3.8-F-N的能力还没到那么强
@HMLGGGG · 46 日前 · X · benchmark, models, strata
- Small patch coming in approx 1h for this issue
@coldniko · 46 日前 · X · upgrade, update, signal
- En dan hier de poging met Qwen 3.8 flash next code via Strata
@bsteinthorsson · 46 日前 · X · benchmark, models, strata
- 5060Ti16GBx2枚のstrataでqwen3.8-flash-next iq3_xxs, だいたい85tok/s出てて、読むより書く方が早いw 8末に9tok/sで1ヵ月で10倍早くなった。
@nabeyakitwin · 46 日前 · X · benchmark, models, strata
- Antigravityがローカルqwen内蔵型チャッピーもどき作ってくれた。内部的にはStrataがうごいててそれをウェブアプリとしてラップしてるっぽい?
@ozouniVRC · 46 日前 · X · models, strata
- StrataでQwen-Flash-Next(Nvidia-NVFP4より賢い)が93TPS プリフィル2500TPSで動いたことを受けて、本日GPUを買い増ししました。少なくともこれで2x 93TPSの飼い主です。
@Tono_Ken3 · 46 日前 · X · benchmark, models, strata
- New release is out!
@coldniko · 46 日前 · X · upgrade, update, benchmark
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick https://github.com/Niko1221/Strata/releas…
- @leypascua @HuggingModels X reports: 150-180 tok/s on RTX 5090 (Strata), 35-45 on 20-series for the Coder GGUF; 44 tps claimed on 32GB+ syst…
@grok · 47 日前 · X · benchmark, models, strata
@leypascua @HuggingModels X reports: 150-180 tok/s on RTX 5090 (Strata), 35-45 on 20-series for the Coder GGUF; 44 tps claimed on 32GB+ systems. Reddit/HF: 29.6 GB resident works with SSD n-gram mmap. Coding benches hold…
- Old Ethereum mining GPUs got a new job: running a 125B model.
@ElmoVT · 47 日前 · X · benchmark, models, strata
Old Ethereum mining GPUs got a new job: running a 125B model. Qwen3.8-Flash-Next + Strata, 16/24 GB GPUs, 64 GB RAM. Up to 138.7 tok/s. Real benchmarks, first-token latency, and cached turns. https://t.co/gFM9KnQeVq #Loc…
- 125B params at 94 tok/s on a 12GB RTX 5070. Strata runs Qwen 3.8 Flash Next on a gaming PC with 64GB RAM, Q2 quant. a year ago this needed a…
@arnabkarmkr · 47 日前 · X · benchmark, models, strata
- @Androthon @Oluwaphilemon1 Qwen3.8-Flash-Next (125B MoE, ~6B active + 51B n-gram). Inference server is Strata. Needs 12GB+ VRAM and 64GB+ sy…
@grok · 47 日前 · X · benchmark, models, strata
@Androthon @Oluwaphilemon1 Qwen3.8-Flash-Next (125B MoE, ~6B active + 51B n-gram). Inference server is Strata. Needs 12GB+ VRAM and 64GB+ system RAM for solid performance (32GB RAM minimum for lighter quants like Coder).…
Comparisons & benchmarks · Upgrades & migration
Comparisons & benchmarks
- Time for test results of Qwen3.8-flash-next-GSQ-RSO-IQ3_S on my 3090
@ItsmeAjayKV · 47 日前 · X · models, strata, gpu
Time for test results of Qwen3.8-flash-next-GSQ-RSO-IQ3_S on my 3090 Here is a jungle fps theme game one-shot generated by IQ3_S System: - RTX 3090 - 64GB RAM - Strata Inference engine IQ3_S does produce better graphics …
- @ItsmeAjayKV @0xSero @coldniko came here looking for this those tok/s numbers look anemic compared to what I'm experiencing with Strata
@rskjr · 47 日前 · X · benchmark, strata, comparison
- Strata vs llama.cpp, same model and four GPUs: a 64K input took ~26s vs ~134s to first reasoning token. Decode was ~2-2.6x faster with Strat…
@AgentWorkflowLa · 47 日前 · X · benchmark, models, strata
Strata vs llama.cpp, same model and four GPUs: a 64K input took ~26s vs ~134s to first reasoning token. Decode was ~2-2.6x faster with Strata (MTP on). Cache reuse narrows the gap. Full benchmark: https://t.co/cpx6NOcU9i
- another few ns here
@CCDavidCode · 47 日前 · X · benchmark, models, strata
another few ns here saved memory 8 times there. hmm dont need to wait on that Q8, plain decode llama.cpp: 22.0 tok/s Q8, MTP Early Q8 Strata prototype: 87.5 tok/s coding at 8K Strata now: 156.2 tok/s at 32K
- @coldniko Strix Halo 385 w/ 64gb memory getting 42 tp/s with strata IQ3_ XXS - on my llama.cpp build I was getting peak 27. Great job
@Prod_Philosophy · 47 日前 · X · hardware, models, strata
- Same PC, same model files, same prompts. Upstream Strata 0.1.40.1 vs strata-rdna4, median of 3 runs:
@vectorweft · 47 日前 · X · benchmark, strata, comparison
Same PC, same model files, same prompts. Upstream Strata 0.1.40.1 vs strata-rdna4, median of 3 runs: 📥 Prompt 32K: 515 → 1,826 tok/s 📥 Prompt 128K: 493 → 1,415 tok/s 📤 Output 32K: 51.5 → 84.7 tok/s ⏱️ First token at 1…
- Built on Qwen3.8 architecture with MoE (Mixture of Experts) and Flash-Next efficiency. Abliterated to remove refusal directions. GGUF format…
@HuggingModels · 47 日前 · X · models, comparison
Built on Qwen3.8 architecture with MoE (Mixture of Experts) and Flash-Next efficiency. Abliterated to remove refusal directions. GGUF format for easy local inference. Vision-language capable. Optimized for llama.cpp. A p…
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
@coldniko · 47 日前 · X · benchmark, hardware, release
Community benchmark attention on Ryzen AI Max / Strix Halo builds with Strata v0.1.40.
- Atomic Chat shipped a TensorRT integration into their engine last week. Qwen3.5-4B and Qwen3-8B through CUDA on a Blackwell RTX 5090: 3.43 s…
@0xPascual · 47 日前 · X · models, release, gpu
Atomic Chat shipped a TensorRT integration into their engine last week. Qwen3.5-4B and Qwen3-8B through CUDA on a Blackwell RTX 5090: 3.43 seconds, against 10.49 seconds on llama.cpp. A 206% throughput gap on identical s…
- @steeve definitely not mistral. deepseek v4.1 flash, the fastest non-cerebras model in the world beats mistral large 4. qwen3.8 27b, SOTA fo…
@notnullptr · 47 日前 · X · models, comparison
@steeve definitely not mistral. deepseek v4.1 flash, the fastest non-cerebras model in the world beats mistral large 4. qwen3.8 27b, SOTA for local people can actually run, almost matches it. qwen3.8-flash-next, runnable…
Upgrades & migration
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · 46 日前 · X · models, hardware, benchmark
Site analysis · Project Maya (mw00/project-maya) is a Strata-derived engine rewrite that targets zai-org/GLM-5.3-Flash, a 321B-parameter MoE (about 18B active per token) with up to 1M-token context. How the port works, p…
- Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards.
@VRAMCalculator · 46 日前 · X · upgrade, benchmark, models
Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards. Its author's figures, Qwen3.8 Flash Next: Arc Pro B70 32 GB, IQ3_S: 31 to 41 tok/s, prompts at about 1,000 tok/s Arc A750 …
- Small patch coming in approx 1h for this issue
@coldniko · 46 日前 · X · upgrade, update, signal
- New release is out!
@coldniko · 46 日前 · X · upgrade, update, benchmark
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick https://github.com/Niko1221/Strata/releas…
- @IDFkushoverlord for dense models like qwen27B it was very slow for me even with all my efforts i could get preprocessing fast enough for my…
@l3d3ka · 47 日前 · X · benchmark, models, strata
@IDFkushoverlord for dense models like qwen27B it was very slow for me even with all my efforts i could get preprocessing fast enough for my liking but since literally today i switched to strata inference engine and i’ve…
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
@coldniko · 47 日前 · X · benchmark, hardware, release
Community benchmark attention on Ryzen AI Max / Strix Halo builds with Strata v0.1.40.
- Strata wins by a tight margin against all other Strix Halo inference engines in it’s first try release. Did not expect that! 🥳 https://t.co…
@coldniko · 47 日前 · X · hardware, release, strata
- @lxfater @redefinemee @ivanalog_com It's likely to be a model problem, not Strata problem. I run into a loop with ik_llama.cpp + 3.8 flash …
@wu89_j · 47 日前 · X · models, strata, comparison
- Strix Halo officially supported in Strata v0.1.40
@coldniko · 48 日前 · X · release, hardware, strata
AMD GPU improvements, multi-GPU batching, decode and Turing/Arc fixes — see release notes on site.
- tldr: if you're on 3090 + 64GB ram system, you should be running IQ3_S instead of IQ3_XXS.
@ItsmeAjayKV · 48 日前 · X · models, strata, upgrade
tldr: if you're on 3090 + 64GB ram system, you should be running IQ3_S instead of IQ3_XXS. I switched to Qwen3.8-flash-next-GSQ-RSO-IQ3_S from IQ3_XXS since strata is fast. I noticed even tho model is bigger, the speed d…
GPU quotes
| Model | Price | Date | Source |
|---|---|---|---|
| RTX 5090 | $1,999 | 2026-10-07 | @investies |
| RX 9070 XT | $700 | 2026-10-06 | @bottleneck_pc |
| RX 9060 XT 8GB | $299 | 2026-10-06 | @CoastalBendTech |
| RTX 5090 | $36 | 2026-10-06 | @0xoLand |
| RTX 5090 | $4,500 | 2026-10-06 | @Amir_rz_k |
| RTX 5090 | $4,500 | 2026-10-06 | @Amir_rz_k |
| RTX 5090 | $7.55 | 2026-10-06 | @Temperatur2com |
| RTX 3090 24GB | $3,450 | 2026-10-06 | @grok |
| RTX 5090 | $3 | 2026-10-06 | @chainbrain |
| RTX 5090 | $9,600 | 2026-10-05 | @DigitalNav |
All signals (incl. GitHub fallback)
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · 46 日前 · X · models, hardware, benchmark
Site analysis · Project Maya (mw00/project-maya) is a Strata-derived engine rewrite that targets zai-org/GLM-5.3-Flash, a 321B-parameter MoE (about 18B active per token) with up to 1M-token context. How the port works, p…
- #strata 0.1.40.2, 247K context cold intake 717 tok/s -> 816 tok/s on my 2*V100 -- very good progress! 1 week ago it was <500
@BusError · 46 日前 · X · benchmark, strata
- Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards.
@VRAMCalculator · 46 日前 · X · upgrade, benchmark, models
Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards. Its author's figures, Qwen3.8 Flash Next: Arc Pro B70 32 GB, IQ3_S: 31 to 41 tok/s, prompts at about 1,000 tok/s Arc A750 …
- Strata是很好,我也在旧3090节点上跑到了60tks的速度,但是X上现在明显在夸大其词了。5070ti没有暴涨。MacStudio M5 Ultra 256G二手比新的贵,我不知道为什么,但我不觉得是strata干的。Qwen-3.8-F-N的能力还没到那么强
@HMLGGGG · 46 日前 · X · benchmark, models, strata
- Small patch coming in approx 1h for this issue
@coldniko · 46 日前 · X · upgrade, update, signal
- En dan hier de poging met Qwen 3.8 flash next code via Strata
@bsteinthorsson · 46 日前 · X · benchmark, models, strata
- 5060Ti16GBx2枚のstrataでqwen3.8-flash-next iq3_xxs, だいたい85tok/s出てて、読むより書く方が早いw 8末に9tok/sで1ヵ月で10倍早くなった。
@nabeyakitwin · 46 日前 · X · benchmark, models, strata
- Antigravityがローカルqwen内蔵型チャッピーもどき作ってくれた。内部的にはStrataがうごいててそれをウェブアプリとしてラップしてるっぽい?
@ozouniVRC · 46 日前 · X · models, strata
- StrataでQwen-Flash-Next(Nvidia-NVFP4より賢い)が93TPS プリフィル2500TPSで動いたことを受けて、本日GPUを買い増ししました。少なくともこれで2x 93TPSの飼い主です。
@Tono_Ken3 · 46 日前 · X · benchmark, models, strata
- New release is out!
@coldniko · 46 日前 · X · upgrade, update, benchmark
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick https://github.com/Niko1221/Strata/releas…
Methods
- X-first: users + comparison + upgrade search queries
- GitHub community (fallback, INTAKE_COMMUNITY_LIMIT)
- INTAKE_CHEAP_X_URL → w95/x-api + twscrape (cookie, $0 posts)
- X API v2 (X_BEARER_TOKEN) — use INTAKE_X_API=off in production
- RSSHub self-host + TWITTER_AUTH_TOKEN — see docs/INTAKE-CHEAP.md
- github.com/w95/x-api + vladkens/twscrape
- DIYgod/RSSHub (twitter routes + TWITTER_AUTH_TOKEN)
- github.com/zedeus/nitter (legacy; mostly dead)