Skip to content

huhusmang/Awesome-LLMs-for-Vulnerability-Detection

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

607 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome Large Language Models for Vulnerability Detection

A curated list of papers, projects, and agent skills on using LLMs for vulnerability detection and discovery.


📄 Papers

Only showing 2025 and later. For earlier work, see Papers Archive (2024 and earlier).

Title Venue Year Paper Github
VulnGym: A Real-World, Project-Level Vulnerability Benchmark for White-Box Vulnerability-Hunting Agents 2026 link
VulTriage: Triple-Path Context Augmentation for LLM-Based Vulnerability Detection 2026 link link
Synthesizing Multi-Agent Harnesses for Vulnerability Discovery 2026 link link
QRS: A Rule-Synthesizing Neuro-Symbolic Triad for Autonomous Vulnerability Discovery 2026 link
Seclens: Role-specific Evaluation of LLM's for security vulnerablity detection 2026 link link
Do Fine-Tuned LLMs Understand Vulnerabilities? An Investigation into the Semantic Trap 2026 link
Sifting the Noise: A Comparative Study of LLM Agents in Vulnerability False Positive Filtering 2026 link
AgenticSCR: An Autonomous Agentic Secure Code Review for Immature Vulnerabilities Detection 2026 link
LLM-based Vulnerability Detection at Project Scale: An Empirical Study 2026 link
MulVul: Retrieval-augmented Multi-Agent Code Vulnerability Detection via Cross-Model Prompt Evolution 2026 link
VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection 2025 link
VULPO: Context-Aware Vulnerability Detection via On-Policy LLM Optimization 2025 link
VulInstruct: Teaching LLMs Root-Cause Reasoning for Vulnerability Detection via Security Specifications 2025 link
From Large to Mammoth: A Comparative Evaluation of Large Language Models in Vulnerability Detection NDSS 2025 link
Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositories ACL 2025 link link
A Systematic Literature Review on Detecting Software Vulnerabilities with Large Language Models 2025 link link
LLMxCPG: Context-Aware Vulnerability Detection Through Code Property Graph-Guided Large Language Models Usenix 2025 link link
CLeVeR: Multi-modal Contrastive Learning for Vulnerability Code Representation ACL Findings 2025 link link
Mono: Is Your "Clean" Vulnerability Dataset Really Solvable? Exposing and Trapping Undecidable Patches and Beyond 2025 link link
Learning to Focus: Context Extraction for Efficient Code Vulnerability Detection with Language Models 2025 link
SV-TrustEval-C: Evaluating Structure and Semantic Reasoning in Large Language Models for Source Code Vulnerability Analysis SP 2025 link link
SecVulEval: Benchmarking LLMs for Real-World C/C++ Vulnerability Detection 2025 link link
CVE-Bench: Benchmarking LLM-based Software Engineering Agent's Ability to Repair Real-World CVE Vulnerabilities NAACL 2025 link link
R2Vul: Learning to Reason about Software Vulnerabilities with Reinforcement Learning and Structured Reasoning Distillation 2025 link link
Neuro-symbolic Static Analysis with LLM-generated Vulnerability Patterns 2025 link
Context-Enhanced Vulnerability Detection Based on Large Language Model 2025 link
Everything You Wanted to Know About LLM-based Vulnerability Detection But Were Afraid to Ask 2025 link link
MOS: Towards Effective Smart Contract Vulnerability Detection through Mixture-of-Experts Tuning of Large Language Models 2025 link
Abundant Modalities Offer More Nutrients: Multi-Modal-Based Function-Level Vulnerability Detection TOSEM 2025 link link
Generative Large Language Model usage in Smart Contract Vulnerability Detection 2025 link
Closing the Gap: A User Study on the Real-world Usefulness of AI-powered Vulnerability Detection & Repair in the IDE ICSE 2025 link link
Vulnerability Detection with Code Language Models: How Far Are We? ICSE 2025 link link
Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications ICSE 2025 link
LAMD: Context-driven Android Malware Detection and Classification with LLMs 2025 link
LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights 2025 link link
One-for-All Does Not Work! Enhancing Vulnerability Detection by Mixture-of-Experts (MoE) 2025 link

🚀 Projects

Name Description Github
OpenAnt (Knostic) LLM-powered multi-stage vulnerability discovery with adversarial verification link
DeepAudit Multi-agent AI red-team platform with Docker sandbox exploit validation link
AutoCVE Automated vulnerability detection and reporting with multi-agent architecture link
Darkmoon Open-source (GPL-3.0) autonomous AI pentest platform and MCP host; per-technology offensive sub-agents, Active Directory and Kubernetes coverage, 80+ orchestrated tools, evidence trail per finding link
strix Open-source autonomous AI penetration testing tool via pip link
deepsec (Vercel) Security harness for deep codebase vulnerability scanning with coding agents link

🧩 Agent Skills

Name Description Link
codex-security (OpenAI) Autonomous repo-level vulnerability scanning via Codex agents link
defending-code-reference-harness (Anthropic) Reference skills for threat modeling, scanning, triage, and patching with Claude Code link
security-audit-skill (Cloudflare) Six-phase security audit skill with parallel hunting agents and adversarial validation link

📡 arxiv.md

Automated daily capture and update of Arxiv papers for specified keywords through workflows.

Acknowledgements

The project's Updated Arxiv Papers Daily workflow borrows from this project LLM4SE. I refactored its original code by using the arxiv library.

About

The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection — papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.

Topics

Resources

License

Contributing

Stars

1.1k stars

Watchers

24 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages