Issues / #437

#437 State connecting

closed · @ekibanu4 · 4 Kommentare · Auf GitHub

Server & APINVIDIA / CUDAModels & quants

Beschreibung

System info 

i14700kf 64gbram 12vram rtx4070

downloaded and started with 


```
Strata - Qwen3.8-Flash-Next on a normal PC (a GPU + system RAM + CPU)
  [ok] GPU: GPU 0 (NVIDIA GeForce RTX 4070 Ti, 12 GB)

  ----------------------------------------------------------------------------------------------------
  Starting qwen3.8-flash-next-coder-iq1_m: it loads about 30 GB into RAM and locks part of it for the GPU.
  While it does, YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES (longer the first time after a
  restart). That is normal: please wait and don't close this window - the browser opens when it is ready.
  Later, closing this window stops the model.
  ----------------------------------------------------------------------------------------------------
loading the model (the first start takes a minute or two) ...
[strata] starting the engine: reading the model's weights ...
[strata] loading the experts into RAM (about 30 GB) and locking part of them for the GPU.
         YOUR PC CAN BE SLOW OR STOP RESPONDING FOR 1-3 MINUTES NOW - this is normal.
         Please wait and don't close this window; the browser opens when it is ready.
[strata] experts loaded: 23.42 GiB at 5.22 GiB/s (12 s so far)
[strata] filling the GPU's expert cache (2103 experts, 4.04 GiB of VRAM) ...
[strata] almost ready ...
ready: http://127.0.0.1:8080/v1  (OpenAI: /v1/chat/completions, Anthropic: /v1/messages, context 262144 tokens)
       open http://127.0.0.1:8080/ in a browser to chat; close this window to stop the model


```

in http://127.0.0.1:8080/

state connection

<img width="2527" height="1293" alt="Image" src="https://github.com/user-attachments/assets/caac4406-5096-4397-93af-8507b4149311" />
Also the page in reload brokes and seemed to restart all the time



Mehr auf der Site

Links zu Install, Modellen, Releases.