Pull requests / #673
#673 Load the vision encoder lazily with the model
closed · @ANBAL534 · 0 comentários · No GitHub
Descrição
## Summary - Load the vision encoder on first use instead of during server startup. - Ensure the encoder is ready before starting the native engine for a request, and clean it up if engine startup fails. - Document the lazy-loading behavior. ## Scope This PR contains only the lazy vision encoder change and its documentation. ## Tests Not run.
No site
Links install, modelos, releases.