Pinned Loading

1. NVIDIA/nvcf NVIDIA/nvcf Public

   Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

   Go 181 32

2. higress-group/higress higress-group/higress Public

   🤖 AI Gateway | AI Native API Gateway

   Go 8.9k 1.2k

3. LMCache/LMCache LMCache/LMCache Public

   LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

   Python 10.7k 1.6k

4. fusioninfer/fusioninfer fusioninfer/fusioninfer Public

   A Kubernetes-native platform for orchestrating distributed LLM inference at scale

   Go 10 3

5. ai-infra-learning ai-infra-learning Public

   This repository organizes materials, recordings, and schedules related to AI-infra learning meetings.

   526 63

6. elasticsearch-mcp-server elasticsearch-mcp-server Public

   A Model Context Protocol (MCP) server implementation that provides Elasticsearch and OpenSearch interaction.

   Python 299 62