Pull requests / #673

#673 Load the vision encoder lazily with the model

closed · @ANBAL534 · 0 コメント · GitHub で見る

Models & quants

本文

## Summary
- Load the vision encoder on first use instead of during server startup.
- Ensure the encoder is ready before starting the native engine for a request, and clean it up if engine startup fails.
- Document the lazy-loading behavior.

## Scope
This PR contains only the lazy vision encoder change and its documentation. 

## Tests
Not run.

関連リンク

インストール・モデル・リリースへの站内リンク。