Issues / #2277

#2277 Feature: legacy completions on /v1/completions (raw-prompt clients)

open · @kossum · 0 comments · View on GitHub

Server & API

Description

clients that did their own templating send a prompt as a string and want the old shape back, text_completion, cmpl- ids, usage. old openai sdk, eval harnesses, promptfoo, the usual. llama.cpp and vllm answer those with POST /v1/completions, here it's a 404

wanting: raw passthrough (no template, caller already did it), stream + non-stream, usage in the last chunk like the other dialects do

built it already, running with tests. can send a PR

Related on strata.com

Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.