#1613 Feature Request: Token repetition penalty

open · @comet13579 · 1 commentaires · Sur GitHub

Description

When using strata with Hermes' agent, usually there will be some repetition issues, especially in IQ2_XS model and sometimes on IQ3_XXS model. Please implement that to improve the usability of lower quant models

Sur le site

Install Strata
Model sizes & RAM
Release notes

Liens install, modèles, releases.