#1256 Feature Request: Support for RPCs

closed · @cumal · 1 评论 · 在 GitHub 查看

描述

First of all, thanks for the effort, with this repo I duplicated TG over default llama.cpp.

As request, I use a rpc server with 2x3060s and maybe it will possible to add rpc connections as llama.cpp.

Thanks!

站内延伸阅读

Install Strata
Model sizes & RAM
Release notes

链到安装、模型与版本说明，便于 SEO/GEO，非官方 issue 正文。