#3279 [Engine] What about yandex/AliceAI-Foundation-80B-A3B-Base?

open · @gomes2000024-commits · 2 commentaires · Sur GitHub

Description

Hardware: NVIDIA GeForce RTX 5070Ti 16 GB, 64 Gb RAM, Windows 11 Pro (26H2)

Engine: (tag , engine 0.1.45.3) plus:v0.2.0-beta3d1fb480

The model [https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base](https://huggingface.co/yandex/AliceAI-Foundation-80B-A3B-Base) relatively new, massive, and MoE. Strata 0.2.0-beta is able to unleash its capabilities most fully. Someone has already tried to quantize it. Everything is available on HuggingFace. Are you implementing support?

Sur le site

Install Strata
Model sizes & RAM
Release notes

Liens install, modèles, releases.