Issues / #1613
#1613 Feature Request: Token repetition penalty
open · @comet13579 · 1 comentarios · En GitHub
Descripción
When using strata with Hermes' agent, usually there will be some repetition issues, especially in IQ2_XS model and sometimes on IQ3_XXS model. Please implement that to improve the usability of lower quant models
En el sitio
Enlaces a install, modelos, releases.