Intelligence pulse

X feed: local LLM, Strata, GPU prices.
Para leer
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · hace 46 días · Versiones · Benchmarks
- New release is out!
@coldniko · hace 46 días · Versiones · Benchmarks
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
@coldniko · hace 47 días · Versiones · Benchmarks
- Strata wins by a tight margin against all other Strix Halo inference engines in it’s first try release. Did not expect that! 🥳 https://t.co/7Ie0lXa85c
@coldniko · hace 47 días · Versiones · Benchmarks
- Only loses to @ciruai engine on Hermes benchmarks. Kudos 🫡
@coldniko · hace 47 días · Benchmarks
- Running Strata on Mini PC with iGPU 780M — about 13 tokens/s on first try
@coldniko · hace 47 días · Benchmarks
Latest on X
- Antigravityがローカルqwen内蔵型チャッピーもどき作ってくれた。内部的にはStrataがうごいててそれをウェブアプリとしてラップしてるっぽい?
@ozouniVRC · hace 46 días · X · models, strata
- @Androthon @Oluwaphilemon1 It's just Strata. Strata is the complete open-source inference engine for Qwen3.8-Flash-Next. It handles expert c…
@grok · hace 47 días · X · models, strata
@Androthon @Oluwaphilemon1 It's just Strata. Strata is the complete open-source inference engine for Qwen3.8-Flash-Next. It handles expert caching (VRAM/RAM/SSD), memory tiering, and speculative decoding on its own, then…
- Single DGX Spark owners have a new model worth paying attention to.
@Oluwaphilemon1 · hace 47 días · X · models, deploy
Single DGX Spark owners have a new model worth paying attention to. Qwen3.8-Flash-Next NVFP4 can now be served on one Spark with a setup that is surprisingly capable for a single 128GB unified-memory machine. The headlin…
- MLX-Serve 26.9.5 is starting to look less like a local model runner and more like an actual AI serving stack for Apple Silicon.
@Oluwaphilemon1 · hace 47 días · X · models
MLX-Serve 26.9.5 is starting to look less like a local model runner and more like an actual AI serving stack for Apple Silicon. The headline additions are Qwen-Image-2.1 and Prism Bonsai 2. But the concurrency work is ar…
- NVIDIA launched its high-end RTX 50 "Blackwell" graphics cards, with the RTX 5090 as the flagship model.
@investies · hace 47 días · X · release, gpu, pricing
NVIDIA launched its high-end RTX 50 "Blackwell" graphics cards, with the RTX 5090 as the flagship model. The RTX 5090 boasts impressive specs and a price tag of $1,999. What's the first game you'd play with this powerhou…
- @LundukeJournal But it's a sad state if all the tokens are cloud based. Do at least some of the work on local LLMs. Strata is the best curre…
@Robert_of_Maine · hace 47 días · X · strata
@LundukeJournal But it's a sad state if all the tokens are cloud based. Do at least some of the work on local LLMs. Strata is the best current inference engine for this if you've got at least 32GB of system ram.
- Prime Big Deal Days is live until 11:59pm PT tomorrow. New drops at midnight, 8am and 1pm Pacific.
@bottleneck_pc · hace 47 días · X · gpu, pricing
Prime Big Deal Days is live until 11:59pm PT tomorrow. New drops at midnight, 8am and 1pm Pacific. The three lines to refresh for: RX 9070 XT under $700, Ryzen 7 9800X3D under $420, Corsair RM850e under $85. RAM and SSD …
- @rskjr Hey Robert! I have seen your live stream and concerns in Strata and totally agree. Things are progressing a bit fast, just wanted to …
@coldniko · hace 47 días · X · update, strata
- @JJismusic @MiaAI_lab Yes, that's an effective approach. EmbeddingGemma 2's 740M modular size loads easily alongside Qwen3.8-Flash-Next as a…
@grok · hace 47 días · X · models
@JJismusic @MiaAI_lab Yes, that's an effective approach. EmbeddingGemma 2's 740M modular size loads easily alongside Qwen3.8-Flash-Next as a retrieval tool. Use it for unified search across text/code/images/video/audio, …
- Shopping Big Deal Days for a Radeon? Ignore the crossed-out "list" price and check it against launch price.
@CoastalBendTech · hace 47 días · X · gpu, pricing
Shopping Big Deal Days for a Radeon? Ignore the crossed-out "list" price and check it against launch price. RX 9060 XT 8GB: $299 RX 9060 XT 16GB: $349 RX 9070: $549 RX 9070 XT: $599 Under that, real deal. Over it, just a…
- New Qwen name just surfaced: Qwen3.8-Next-Flash. 125B MoE plus a 51B n-gram head, and it apparently runs locally on a single 32GB GPU.
@avynsrc · hace 47 días · X · models
New Qwen name just surfaced: Qwen3.8-Next-Flash. 125B MoE plus a 51B n-gram head, and it apparently runs locally on a single 32GB GPU. Coding and agent focus. The local-models crowd is about to eat. via @NFT_Chen https:/…
- 🥇 Niko1221/Strata: 14,862 ⭐ +2,332
@goodailist · hace 47 días · X · models, strata, deploy
🥇 Niko1221/Strata: 14,862 ⭐ +2,332 Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine,... 🥈 lexmount/moli: 10,293 +1,765 🥉 Panniantong/Agent-Reach: 92,304 +934 …
Comparisons & benchmarks · Upgrades & migration
Comparisons & benchmarks
- #strata 0.1.40.2, 247K context cold intake 717 tok/s -> 816 tok/s on my 2*V100 -- very good progress! 1 week ago it was <500
@BusError · hace 46 días · X · benchmark, strata
- Strata是很好,我也在旧3090节点上跑到了60tks的速度,但是X上现在明显在夸大其词了。5070ti没有暴涨。MacStudio M5 Ultra 256G二手比新的贵,我不知道为什么,但我不觉得是strata干的。Qwen-3.8-F-N的能力还没到那么强
@HMLGGGG · hace 46 días · X · benchmark, models, strata
- En dan hier de poging met Qwen 3.8 flash next code via Strata
@bsteinthorsson · hace 46 días · X · benchmark, models, strata
- 5060Ti16GBx2枚のstrataでqwen3.8-flash-next iq3_xxs, だいたい85tok/s出てて、読むより書く方が早いw 8末に9tok/sで1ヵ月で10倍早くなった。
@nabeyakitwin · hace 46 días · X · benchmark, models, strata
- StrataでQwen-Flash-Next(Nvidia-NVFP4より賢い)が93TPS プリフィル2500TPSで動いたことを受けて、本日GPUを買い増ししました。少なくともこれで2x 93TPSの飼い主です。
@Tono_Ken3 · hace 46 días · X · benchmark, models, strata
- @leypascua @HuggingModels X reports: 150-180 tok/s on RTX 5090 (Strata), 35-45 on 20-series for the Coder GGUF; 44 tps claimed on 32GB+ syst…
@grok · hace 47 días · X · benchmark, models, strata
@leypascua @HuggingModels X reports: 150-180 tok/s on RTX 5090 (Strata), 35-45 on 20-series for the Coder GGUF; 44 tps claimed on 32GB+ systems. Reddit/HF: 29.6 GB resident works with SSD n-gram mmap. Coding benches hold…
- Old Ethereum mining GPUs got a new job: running a 125B model.
@ElmoVT · hace 47 días · X · benchmark, models, strata
Old Ethereum mining GPUs got a new job: running a 125B model. Qwen3.8-Flash-Next + Strata, 16/24 GB GPUs, 64 GB RAM. Up to 138.7 tok/s. Real benchmarks, first-token latency, and cached turns. https://t.co/gFM9KnQeVq #Loc…
- 125B params at 94 tok/s on a 12GB RTX 5070. Strata runs Qwen 3.8 Flash Next on a gaming PC with 64GB RAM, Q2 quant. a year ago this needed a…
@arnabkarmkr · hace 47 días · X · benchmark, models, strata
- @Androthon @Oluwaphilemon1 Qwen3.8-Flash-Next (125B MoE, ~6B active + 51B n-gram). Inference server is Strata. Needs 12GB+ VRAM and 64GB+ sy…
@grok · hace 47 días · X · benchmark, models, strata
@Androthon @Oluwaphilemon1 Qwen3.8-Flash-Next (125B MoE, ~6B active + 51B n-gram). Inference server is Strata. Needs 12GB+ VRAM and 64GB+ system RAM for solid performance (32GB RAM minimum for lighter quants like Coder).…
- Time for test results of Qwen3.8-flash-next-GSQ-RSO-IQ3_S on my 3090
@ItsmeAjayKV · hace 47 días · X · models, strata, gpu
Time for test results of Qwen3.8-flash-next-GSQ-RSO-IQ3_S on my 3090 Here is a jungle fps theme game one-shot generated by IQ3_S System: - RTX 3090 - 64GB RAM - Strata Inference engine IQ3_S does produce better graphics …
Upgrades & migration
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · hace 46 días · X · models, hardware, benchmark
Site analysis · Project Maya (mw00/project-maya) is a Strata-derived engine rewrite that targets zai-org/GLM-5.3-Flash, a 321B-parameter MoE (about 18B active per token) with up to 1M-token context. How the port works, p…
- Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards.
@VRAMCalculator · hace 46 días · X · upgrade, benchmark, models
Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards. Its author's figures, Qwen3.8 Flash Next: Arc Pro B70 32 GB, IQ3_S: 31 to 41 tok/s, prompts at about 1,000 tok/s Arc A750 …
- Small patch coming in approx 1h for this issue
@coldniko · hace 46 días · X · upgrade, update, signal
- New release is out!
@coldniko · hace 46 días · X · upgrade, update, benchmark
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick https://github.com/Niko1221/Strata/releas…
- @IDFkushoverlord for dense models like qwen27B it was very slow for me even with all my efforts i could get preprocessing fast enough for my…
@l3d3ka · hace 47 días · X · benchmark, models, strata
@IDFkushoverlord for dense models like qwen27B it was very slow for me even with all my efforts i could get preprocessing fast enough for my liking but since literally today i switched to strata inference engine and i’ve…
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
@coldniko · hace 47 días · X · benchmark, hardware, release
Community benchmark attention on Ryzen AI Max / Strix Halo builds with Strata v0.1.40.
- Strata wins by a tight margin against all other Strix Halo inference engines in it’s first try release. Did not expect that! 🥳 https://t.co…
@coldniko · hace 47 días · X · hardware, release, strata
- @lxfater @redefinemee @ivanalog_com It's likely to be a model problem, not Strata problem. I run into a loop with ik_llama.cpp + 3.8 flash …
@wu89_j · hace 47 días · X · models, strata, comparison
- Strix Halo officially supported in Strata v0.1.40
@coldniko · hace 48 días · X · release, hardware, strata
AMD GPU improvements, multi-GPU batching, decode and Turing/Arc fixes — see release notes on site.
- tldr: if you're on 3090 + 64GB ram system, you should be running IQ3_S instead of IQ3_XXS.
@ItsmeAjayKV · hace 48 días · X · models, strata, upgrade
tldr: if you're on 3090 + 64GB ram system, you should be running IQ3_S instead of IQ3_XXS. I switched to Qwen3.8-flash-next-GSQ-RSO-IQ3_S from IQ3_XXS since strata is fast. I noticed even tho model is bigger, the speed d…
GPU quotes
| Model | Price | Date | Source |
|---|---|---|---|
| RTX 5090 | $1999 | 2026-10-07 | @investies |
| RX 9070 XT | $700 | 2026-10-06 | @bottleneck_pc |
| RX 9060 XT 8GB | $299 | 2026-10-06 | @CoastalBendTech |
| RTX 5090 | $36 | 2026-10-06 | @0xoLand |
| RTX 5090 | $4500 | 2026-10-06 | @Amir_rz_k |
| RTX 5090 | $4500 | 2026-10-06 | @Amir_rz_k |
| RTX 5090 | $7,55 | 2026-10-06 | @Temperatur2com |
| RTX 3090 24GB | $3450 | 2026-10-06 | @grok |
| RTX 5090 | $3 | 2026-10-06 | @chainbrain |
| RTX 5090 | $9600 | 2026-10-05 | @DigitalNav |
All signals (incl. GitHub fallback)
- Project Maya deep dive: running GLM-5.3-Flash (321B MoE) on your own NVIDIA GPUs, built on Strata
@coldniko · hace 46 días · X · models, hardware, benchmark
Site analysis · Project Maya (mw00/project-maya) is a Strata-derived engine rewrite that targets zai-org/GLM-5.3-Flash, a 321B-parameter MoE (about 18B active per token) with up to 1M-token context. How the port works, p…
- #strata 0.1.40.2, 247K context cold intake 717 tok/s -> 816 tok/s on my 2*V100 -- very good progress! 1 week ago it was <500
@BusError · hace 46 días · X · benchmark, strata
- Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards.
@VRAMCalculator · hace 46 días · X · upgrade, benchmark, models
Strata now officially supports Intel Arc, on Linux. 0.1.40.2 ports its own engine to Intel cards. Its author's figures, Qwen3.8 Flash Next: Arc Pro B70 32 GB, IQ3_S: 31 to 41 tok/s, prompts at about 1,000 tok/s Arc A750 …
- Strata是很好,我也在旧3090节点上跑到了60tks的速度,但是X上现在明显在夸大其词了。5070ti没有暴涨。MacStudio M5 Ultra 256G二手比新的贵,我不知道为什么,但我不觉得是strata干的。Qwen-3.8-F-N的能力还没到那么强
@HMLGGGG · hace 46 días · X · benchmark, models, strata
- Small patch coming in approx 1h for this issue
@coldniko · hace 46 días · X · upgrade, update, signal
- En dan hier de poging met Qwen 3.8 flash next code via Strata
@bsteinthorsson · hace 46 días · X · benchmark, models, strata
- 5060Ti16GBx2枚のstrataでqwen3.8-flash-next iq3_xxs, だいたい85tok/s出てて、読むより書く方が早いw 8末に9tok/sで1ヵ月で10倍早くなった。
@nabeyakitwin · hace 46 días · X · benchmark, models, strata
- Antigravityがローカルqwen内蔵型チャッピーもどき作ってくれた。内部的にはStrataがうごいててそれをウェブアプリとしてラップしてるっぽい?
@ozouniVRC · hace 46 días · X · models, strata
- StrataでQwen-Flash-Next(Nvidia-NVFP4より賢い)が93TPS プリフィル2500TPSで動いたことを受けて、本日GPUを買い増ししました。少なくともこれで2x 93TPSの飼い主です。
@Tono_Ken3 · hace 46 días · X · benchmark, models, strata
- New release is out!
@coldniko · hace 46 días · X · upgrade, update, benchmark
New release is out! - Intel Arc works fast now! - Multi-GPU (+40%) boost - Low-RAM setups now fly - DGX Spark 10X faster - Outputs 4% faster - Short prompts are now blazing quick https://github.com/Niko1221/Strata/releas…
Methods
- Cascade per job: X gateway → cheap-x → RSSHub → paid X API. First source with posts wins.
- Budget plan: priority users, the current release tag, and one rotating search lane. Default gateway cooldown 240 min stays under 50 jobs/day.
- Lanes are exclusive: upgrade, else comparison/benchmark, else latest.
- GitHub community fills gaps (INTAKE_COMMUNITY_LIMIT). A quiet round keeps the last JSON.
- github.com/w95/x-api + vladkens/twscrape
- DIYgod/RSSHub (twitter routes + TWITTER_AUTH_TOKEN)
- github.com/zedeus/nitter (legacy; mostly dead)