Issues / #2277
#2277 Feature: legacy completions on /v1/completions (raw-prompt clients)
open · @kossum · 0 comments · View on GitHub
Description
clients that did their own templating send a prompt as a string and want the old shape back, text_completion, cmpl- ids, usage. old openai sdk, eval harnesses, promptfoo, the usual. llama.cpp and vllm answer those with POST /v1/completions, here it's a 404 wanting: raw passthrough (no template, caller already did it), stream + non-stream, usage in the last chunk like the other dialects do built it already, running with tests. can send a PR
Related on strata.com
Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.