Pull requests / #2369
#2369 Add benchmark results for v0.1.44
open · @bretmckee · 0 comments · View on GitHub
Description
I ran with default settings and with --prefill auto:32768. For my system, --prefill auto:32768 was faster for almost all tests.
Related on strata.com
Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.