Issues / #1613
#1613 Feature Request: Token repetition penalty
open · @comet13579 · 1 comments · View on GitHub
Description
When using strata with Hermes' agent, usually there will be some repetition issues, especially in IQ2_XS model and sometimes on IQ3_XXS model. Please implement that to improve the usability of lower quant models
Related on strata.com
Editorial links to help you install, pick models, or read release notes — not part of the upstream thread.