Issues / #2269

#2269 Dell 7920超过9分钟的启动bug

open · @tacom1 · 0 Kommentare · Auf GitHub

NVIDIA / CUDAModels & quants

Beschreibung

Machine: Dell Precision 7920 Tower
CPU: 2 × Intel Xeon Silver 4210R, 20 cores / 40 threads total
RAM: 188 GiB, 2 NUMA nodes
GPU: NVIDIA GeForce RTX 3090 24GB
GPU compute capability: 8.6
NVIDIA driver: 595.84
PCIe: 3.0 ×16
Strata version: v0.1.43.1
Git commit: a0116b27
Model: SC117 Qwen3.8-Flash-Next GSQ-RCO abliterated IQ3_S

NUMA node 0: ~95 GB RAM
NUMA node 1: ~97 GB RAM

Node distances:
     0   1
0:  10  21
1:  21  10

cat /sys/kernel/mm/transparent_hugepage/enabled
always [madvise] never

ai加了一个export STRATA_NO_ARENA_THP=1,莫名奇妙就好了,可以的话能设置成默认行为吗

Mehr auf der Site

Links zu Install, Modellen, Releases.