Issues / #2277
#2277 Feature: legacy completions on /v1/completions (raw-prompt clients)
open · @kossum · 0 コメント · GitHub で見る
本文
clients that did their own templating send a prompt as a string and want the old shape back, text_completion, cmpl- ids, usage. old openai sdk, eval harnesses, promptfoo, the usual. llama.cpp and vllm answer those with POST /v1/completions, here it's a 404 wanting: raw passthrough (no template, caller already did it), stream + non-stream, usage in the last chunk like the other dialects do built it already, running with tests. can send a PR
関連リンク
インストール・モデル・リリースへの站内リンク。