#3279 [Engine] What about yandex/AliceAI-Foundation-80B-A3B-Base?

open · @gomes2000024-commits · 2 comentários · No GitHub

Descrição

Hardware: NVIDIA GeForce RTX 5070Ti 16 GB, 64 Gb RAM, Windows 11 Pro (26H2)

Engine: (tag , engine 0.1.45.3) plus:v0.2.0-beta3d1fb480

The model [https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base](https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base) relatively new, massive, and MoE. Strata 0.2.0-beta is able to unleash its capabilities most fully. Someone has already tried to quantize it. Everything is available on HuggingFace. Are you implementing support?

No site

Install Strata
Model sizes & RAM
Release notes

Links install, modelos, releases.