Pull requests / #1518

#1518 Start Porting for DeepSeek4-Flash

open · @perronemirko · 0 comentários · No GitHub

NVIDIA / CUDA

Descrição

## Title
[<!-- If Applicable, reference the GitHub issue -->](https://github.com/Niko1221/Strata/issues/1501)
Issue: Resolves # 
support the  deepseek v4 flash  (https://github.com/Niko1221/Strata/issues/1501)
## Summary
Adding add_subdirectory(dsv4_ext)  to keep the Strata core clean
Adding DeepSeekV4 Flash

## What changed
All the files inside the subdirectory dsv4_ext are used to port the DeepSeekV4 Flash

## Extra Notes
Everything is done with my supervision and have been tested on /DeepSeek-V4-Flash-UD-IQ1_M
Device: NVIDIA driver: nvidia v: 610.57.04
CUDA 12.8
export CXX=/usr/bin/g++-10
export CC=/usr/bin/gcc-10
ninja --version
   1.10.1
lsb_release -a
 Distributor ID:	Ubuntu
 Description:	Ubuntu 22.04.5 LTS
 Release:	22.04
 Codename:	jammy

No site

Links install, modelos, releases.