#1613 Feature Request: Token repetition penalty

open · @comet13579 · 1 comentários · No GitHub

Descrição

When using strata with Hermes' agent, usually there will be some repetition issues, especially in IQ2_XS model and sometimes on IQ3_XXS model. Please implement that to improve the usability of lower quant models

No site

Install Strata
Model sizes & RAM
Release notes

Links install, modelos, releases.