Pull requests / #673

#673 Load the vision encoder lazily with the model

closed · @ANBAL534 · 0 评论 · 在 GitHub 查看

Models & quants

描述

## Summary
- Load the vision encoder on first use instead of during server startup.
- Ensure the encoder is ready before starting the native engine for a request, and clean it up if engine startup fails.
- Document the lazy-loading behavior.

## Scope
This PR contains only the lazy vision encoder change and its documentation. 

## Tests
Not run.

站内延伸阅读

链到安装、模型与版本说明,便于 SEO/GEO,非官方 issue 正文。