Issues / #1256

#1256 Feature Request: Support for RPCs

closed · @cumal · 1 comentarios · En GitHub

Descripción

First of all, thanks for the effort, with this repo I duplicated TG over default llama.cpp.

As request, I use a rpc server with 2x3060s and maybe it will possible to add rpc connections as llama.cpp.

Thanks!

En el sitio

Enlaces a install, modelos, releases.