The English introduction is being prepared.
llama.cpp
LLM inference engine in C/C++ with minimal dependencies. Runs quantized GGUF models on CPU and GPU across Apple Silicon, x86 and CUDA, and powers many local AI applications.
SuperAPI AI DirectorySuperAPI AI DirectoryLLM inference engine in C/C++ with minimal dependencies. Runs quantized GGUF models on CPU and GPU across Apple Silicon, x86 and CUDA, and powers many local AI applications.
The English introduction is being prepared.
