Issues / #3246

#3246 Feature: make Strata support CPU + RAM + NVMe only!

open · @eGit · 4 comentarios · En GitHub

needs-format

Descripción

Is there a technical reason not to support STRATA's mechanism of clever expert memory-management to run on CPU + RAM + NVME only?

1. Only CPU, RAM and NVMe means less complexity. Fewer moving parts.

2. CPU only means: longer time for token generation - more time to pre-fetching upcoming experts from NVME to RAM.

Especially with smaller models like Qwen3.6-35B-A3B. They often fit easily into RAM but if you want super long context, a Strata-Like reduction of resident RAM would help A LOT!!

En el sitio

Enlaces a install, modelos, releases.