Issues / #1613
#1613 Feature Request: Token repetition penalty
open · @comet13579 · 1 Kommentare · Auf GitHub
Beschreibung
When using strata with Hermes' agent, usually there will be some repetition issues, especially in IQ2_XS model and sometimes on IQ3_XXS model. Please implement that to improve the usability of lower quant models
Mehr auf der Site
Links zu Install, Modellen, Releases.