#3279 [Engine] What about yandex/AliceAI-Foundation-80B-A3B-Base?

open · @gomes2000024-commits · 2 Kommentare · Auf GitHub

Beschreibung

Hardware: NVIDIA GeForce RTX 5070Ti 16 GB, 64 Gb RAM, Windows 11 Pro (26H2)

Engine: (tag , engine 0.1.45.3) plus:v0.2.0-beta3d1fb480

The model [https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base](https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base) relatively new, massive, and MoE. Strata 0.2.0-beta is able to unleash its capabilities most fully. Someone has already tried to quantize it. Everything is available on HuggingFace. Are you implementing support?

Mehr auf der Site

Install Strata
Model sizes & RAM
Release notes

Links zu Install, Modellen, Releases.