This is the project repository of our ASE22 paper: Natural Test Generation for Precise Testing of Question Answering Software
-
Updated
Dec 1, 2022 - Python
#
metamorphic-testing
Here are 18 public repositories matching this topic...
Squeeze your model with pressure prompts to see if its behavior leaks.
reliability evaluation calibration alignment quality-assurance metamorphic-testing ai-safety trustworthiness hallucinations prompt-engineering llm-eval llm-evals
-
Updated
Mar 1, 2026 - Python
Detecting Relational Boundary Erosion in AI systems. A framework for testing whether models maintain honest, calibrated, and appropriate boundaries.
python yaml calibration alignment metamorphic-testing model-evaluation ai-safety red-teaming prompt-injection hallucination-detection llm-evals evaluation-harness
-
Updated
Feb 22, 2026 - Python
Is your RAG understanding your data - or guessing?
python open-source evaluation-metrics metamorphic-testing evaluation-framework rag rag-evaluation rag-pipeline robustness-testing
-
Updated
May 11, 2026 - Python
Your agent test passed. Would it pass again? Checks whether AI agent test results are repeatable and varied enough to trust as a regression baseline. Reads Promptfoo and DeepEval runs you already have.
python software-testing metamorphic-testing ai-agents opentelemetry ai-evaluation llm agentic-ai ai-reliability
-
Updated
Jul 28, 2026 - Python
An official implementation for "Fairness Evaluation in Deepfake Detection Models using Metamorphic Testing"
-
Updated
Jul 24, 2024 - Python
Implementation for the paper "Leveraging Mutants for Automatic Prediction of MetamorphicRelations using Machine Learning"
machine-learning graph control-flow-graph metamorphic-testing svm-classifier source-code-analysis graphkernel program-understanding
-
Updated
Mar 24, 2023 - Python
Enhancing test generation for Autonomous Driving using multiple conditionings Probabilistic Diffusion Models
-
Updated
Nov 6, 2024 - Python
MetaProbe: Auditable Metamorphic Evaluation of Causal Consistency in Repository-Level Coding Agents (ICSE 2027)
software-engineering program-repair reproducibility metamorphic-testing evaluation-framework coding-agents swe-bench
-
Updated
Jun 5, 2026 - Python
MetaGlitch: Physics-grounded metamorphic testing for VLM-based video game bug detection (ASE 2026)
-
Updated
Apr 2, 2026 - Python
Using metamorphic testing on Weather API
-
Updated
May 28, 2024 - Python
A payment system built by an AI agent from a frozen spec, zero hand written tests, guarded by a four layer verification pyramid (structural, behavioral, agent judgment, mutation). 73.1 percent mutation kill rate.
python mutation-testing verification payments test-automation property-based-testing code-generation software-testing hypothesis metamorphic-testing sdlc ai-agents fastapi mutmut trustworthy-ai llm fitness-functions ai-code-generation langgraph agentic-ai
-
Updated
Jul 12, 2026 - Python
Research benchmark measuring whether an authorized synthetic cyber capability keeps working as its environment changes — independently verified, policy-gated, and adaptive.
python docker benchmark sqlalchemy research reliability cybersecurity metamorphic-testing policy-engine synthetic-environment security-research adversary-emulation pydantic fastapi llm ollama capability-testing-tool
-
Updated
Jul 28, 2026 - Python
Fuzzing framework for sparse tensor compilers — first open-source implementation of TENSURE (NDSS Fuzzing Workshop 2026). Finds crashes and silent miscompilations via constraint-based einsum generation and metamorphic testing.
python testing security numpy sparse fuzzing tensor metamorphic-testing taco differential-testing bug-finding compiler-testing einsum ndss
-
Updated
Mar 30, 2026 - Python
An Inspect AI extension that audits an LLM decision point against six reliability contracts by replaying a decision log — keyless, no model calls, no API keys.
python reliability contract-testing metamorphic-testing test-oracles ai-evaluation llm llm-evaluation llm-testing inspect-ai
-
Updated
Jul 28, 2026 - Python
Metamorphic test-vector generator for parsers, CLIs, normalizers, and developer tools.
python testing property-based-testing developer-tools metamorphic-testing local-first agent-evaluation
-
Updated
May 28, 2026 - Python
Executable metamorphic contracts for persistent agent memory
-
Updated
Jul 26, 2026 - Python
Reproducible study of JSON Schema serialization-order robustness in black-box LLM generation
-
Updated
Jul 29, 2026 - Python
Improve this page
Add a description, image, and links to the metamorphic-testing topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the metamorphic-testing topic, visit your repo's landing page and select "manage topics."