Training neural networks in TensorFlow 2.0 with 5x less memory
-
Updated
Feb 21, 2022 - Python
#
gpu-memory
Here are 23 public repositories matching this topic...
A Toolkit for Training, Tracking, Saving Models and Syncing Results
-
Updated
Mar 12, 2020 - Python
A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
-
Updated
May 30, 2026 - Python
Demonstration of generating mini-batches in Tensorlfow from GPU memory.
-
Updated
Apr 20, 2017 - Python
Dynamic GPU Layer Swapping: Train large models on consumer GPUs with intelligent memory management
-
Updated
Sep 12, 2025 - Python
Detailed VRAM profiler for transformer inference with per-layer breakdown, activation analysis, and a predictive memory model that predicts VRAM with <1.2% error. Shows that FFN layers dominate static memory and that measured runtime VRAM exceeds KV-cache estimates by 2-4x.
benchmarking capacity-planning transformers pytorch gpu-memory profiling memory-analysis vram kv-cache llm-inference
-
Updated
Jul 14, 2026 - Python
A CLI tool for estimating GPU VRAM requirements for Hugging Face models, supporting various data types, parallelization strategies, and fine-tuning scenarios like LoRA.
gpu-memory vram huggingface pipeline-parallelism memory-estimation huggingface-models hugging-face-transformers huggingface-datasets vram-monitoring vram-calculator vram-memory-estimation
-
Updated
Oct 22, 2025 - Python
Event-driven benchmark of adaptive batch composition policies for LLM serving, measuring how prefill and decode interference affects TTFT, TPOT, and throughput under different memory pressure regimes.
python performance-engineering benchmark simulation latency scheduler inference batching systems decode gpu-memory throughput serving prefill event-driven-simulation kv-cache llm continuous-batching
-
Updated
Jul 24, 2026 - Python
Deadline-aware KV-cache scheduling for protecting decode-critical request-state under long-context LLM inference pressure.
inference gpu-memory memory-management nvme hbm kv-cache memory-tiering cxl llm long-context vllm pagedattention ai-infrastructure systems-research
-
Updated
Jun 19, 2026 - Python
Research harness for evaluating query-time bounded elimination of reconstructable KV-cache witnesses in long-context transformer inference workloads. Related provisional filing: IN 202641062451.
transformer gpu-memory memory-systems kv-cache cxl long-context llm-inference transformer-memory ai-infrastructure flashattention transformer-optimization systems-research long-context-inference attention-optimization
-
Updated
May 18, 2026 - Python
Research prototype for short-horizon working-set residency in Mixture-of-Experts inference
-
Updated
Jul 22, 2026 - Python
📊 A command line monitoring tool (graph) for NVIDIA GPUs
-
Updated
Apr 22, 2020 - Python
Event-driven benchmark of KV-cache migration policies for LLM serving scale-down, measuring session drop rate, infrastructure linger, and user-visible pause across workload types and concurrent session counts.
python performance-engineering benchmark simulation latency scheduler inference checkpoint systems gpu-memory autoscaling serving event-driven-simulation scale-down kv-cache llm live-migration session-continuity
-
Updated
Jul 24, 2026 - Python
Tiered GPU memory architecture for consumer AI inference. VRAM as execution cache, system RAM as passive staging layer.
inference pytorch transformer gpu-memory memory-management offloading vram llm local-ai consumer-gpu vram-optimization
-
Updated
Jun 11, 2026 - Python
Will a Hugging Face LLM fit your GPU or DGX? Plan weights, KV cache or recurrent state, context, TP/DP, and measured calibration
python cli capacity-planning gpu-memory model-serving huggingface kv-cache llm long-context vllm sglang gb10 vram-calculator dgx-spark tensor-parallel inference-memory
-
Updated
Jul 22, 2026 - Python
GPU memory fragmentation tracing, replay, and visualization for Megatron-LM training
-
Updated
Jul 20, 2026 - Python
Event-driven benchmark of per-tenant KV-cache isolation policies for multi-tenant LLM serving, measuring SLO compliance, fairness, and stability under noisy neighbor and burst scenarios.
python performance-engineering benchmark multi-tenant simulation latency scheduler inference systems gpu-memory slo throughput isolation fairness serving event-driven-simulation kv-cache llm noisy-neighbor
-
Updated
Jul 24, 2026 - Python
SLA-aware GPU request scheduler with sub-millisecond KV-cache offloading to pinned host memory (0.6 ms/4 MB, bit-exact CUDA gather/scatter). Raises request admission 31% -> 100% under memory pressure; 47/47 tests passing. Multi-tenant LLM serving, PyTorch/vLLM.
multi-tenant scheduling cuda pytorch gpu-memory cuda-kernels sla kv-cache llm-serving vllm llm-inference
-
Updated
Jul 21, 2026 - Python
GPU memory-efficient training for PyTorch - 90%+ memory savings through gradient compression
machine-learning deep-learning pytorch neural-networks gpu-memory memory-optimization gradient-compression training-optimization
-
Updated
Aug 6, 2025 - Python
Event-driven benchmark of speculative decoding KV-cache overhead under memory pressure, comparing baseline, oracle, expected-reserve, and peak-reserve scheduler policies.
python benchmark research simulation latency scheduler inference systems gpu-memory throughput serving event-driven-simulation kv-cache llm speculative-decoding
-
Updated
Jul 22, 2026 - Python
Improve this page
Add a description, image, and links to the gpu-memory topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the gpu-memory topic, visit your repo's landing page and select "manage topics."