v0.1.43.1
125B-class AI on your desk
NVIDIA or AMD · 12 GB+ VRAM · Windows & Linux · MIT licensed engine from the community.
v0.1.43.1
Strata v0.1.43.1
A hotfix for 0.1.43: Linux NVIDIA decode is fast again on desktops (the adaptive overlap is opt-in again), long prompts no longer stall on Windows and SATA SSDs, two-card batch serving is about 35% faster again, RX 6000 prompts are fast again, and fixes for AMD multi-slot serving…
Worth reading now
- Strata wins by a tight margin against other Strix Halo inference engines on first try release
@coldniko · 6 days ago · Releases · Benchmarks
- Strata wins by a tight margin against all other Strix Halo inference engines in it’s first try release. Did not expect that! 🥳 https://t.co/7Ie0lXa85c
@coldniko · 6 days ago · Releases · Benchmarks
- Only loses to @ciruai engine on Hermes benchmarks. Kudos 🫡
@coldniko · 6 days ago · Benchmarks
- Running Strata on Mini PC with iGPU 780M — about 13 tokens/s on first try
@coldniko · 6 days ago · Benchmarks
Nothing leaves your PC
Setup keeps the models and the chats on this PC.
60+ tokens/s on RTX 5070 class GPUs
Compare daily tokens, power cost, and break-even on the benchmark board.
OpenAI-compatible API for Cursor, Claude Code, Codex
Download the engine, then point Cursor or Codex at 127.0.0.1:8080.
Let your AI install Strata
Set up Strata on this PC for me: https://github.com/Niko1221/Strata - follow docs/AI_SETUP.md in that repository.
Creator pulse
Latest from @coldniko — Strix Halo, local benchmarks, Qwen3.8-Flash-Next.