Pull requests / #673

#673 Load the vision encoder lazily with the model

closed · @ANBAL534 · 0 comments · View on GitHub

Models & quants

Description

## Summary
- Load the vision encoder on first use instead of during server startup.
- Ensure the encoder is ready before starting the native engine for a request, and clean it up if engine startup fails.
- Document the lazy-loading behavior.

## Scope
This PR contains only the lazy vision encoder change and its documentation. 

## Tests
Not run.

Related on strata.com

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.