llama-cpp-rs

Rust bindings for llama.cpp. Minimal, close to raw bindings, kept up to date with upstream.

Quick start

git clone --recursive https://github.com/intentee/llama-cpp-bindings
cd llama-cpp-rs
cargo build --release

Add --features cuda for GPU acceleration.

Name		Name	Last commit message	Last commit date
Latest commit History 1,854 Commits
.claude		.claude
.github		.github
llama-cpp-bindings-build		llama-cpp-bindings-build
llama-cpp-bindings-sys		llama-cpp-bindings-sys
llama-cpp-bindings-tests		llama-cpp-bindings-tests
llama-cpp-bindings-types		llama-cpp-bindings-types
llama-cpp-bindings		llama-cpp-bindings
llama-cpp-error-recorder		llama-cpp-error-recorder
llama-cpp-gbnf		llama-cpp-gbnf
llama-cpp-log-decoder		llama-cpp-log-decoder
llama-cpp-test-harness-macros		llama-cpp-test-harness-macros
llama-cpp-test-harness		llama-cpp-test-harness
.clang-tidy		.clang-tidy
.dockerignore		.dockerignore
.editorconfig		.editorconfig
.gitignore		.gitignore
.gitmodules		.gitmodules
AGENTS.md		AGENTS.md
CLAUDE.md		CLAUDE.md
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
package-lock.json		package-lock.json
package.json		package.json
rust-toolchain.toml		rust-toolchain.toml
rustfmt.toml		rustfmt.toml
shell.nix		shell.nix
test-build.Dockerfile		test-build.Dockerfile