Hero Finding · S01
Adversarial Verification — Hunt for Invariant Violations
LLM REASONING
AWAITING EVIDENCE
Awaiting Adversarial Challenge
Adversarial report (adversarial-report.json) has not yet been written to the session directory.
Execute IBM Bob in adversarial mode or run the ProofLoop CLI.
Stage 1
Change Contract — Machine-Readable Specification
CONTRACT
AWAITING EVIDENCE
Awaiting Change Contract
Change contract (change-contract.json) not found in .proofloop/session/.
Initiate S01 or run Bob in proofloop mode to formulate the contract.
Stage 2
Repair Log — Defect Remediation & Invariant Guard
REPAIR CYCLE
AWAITING EVIDENCE
Awaiting Repair Log
Repair log (repair-log.json) has not yet been recorded.
Generated when an adversarial finding is remediated with an invariant floor guard.
Stage 3
Deterministic Verification — Real Tool Output (Exit Codes)
DETERMINISTIC TOOLS
AWAITING EVIDENCE
Deterministic Evidence Discipline: All numbers and outcomes in this section reflect actual tool process exit codes (
pytest, mypy, ruff). Zero LLM simulation or paraphrasing.
Awaiting Verification Evidence
Tool evidence (verification-evidence.json) not present in .proofloop/session/.
Run python proofloop/cli.py verify --all to execute verification tools.
Final Artifact
Proof Pack — Traceable Evidence Audit
ASSEMBLER ARTIFACT
INCOMPLETE
Awaiting Proof Pack Assembly
Proof Pack artifact (proof-pack.json) has not yet been assembled.
Run python proofloop/cli.py proof-pack once deterministic verification passes.
Generalization
ProofLoop Benchmark Suite — Scenarios S01–S05
5 SCENARIOS
S01 HERO ACTIVE
| Scenario | Category | Challenge / Seeded Defect | Critical Invariant | Verification Status |
|---|---|---|---|---|
| S01 (Hero) Coupon Support |
Financial Math | Discount exceeds subtotal ($50 − $75 = -$25) | inv-01: Payment amount must never be negative |
VERIFIED |
| S02 Payment Retry |
Distributed Tx | Network retries without idempotency keys cause duplicate charges | inv-01: Retry must not duplicate charge |
NOT RUN |
| S03 API Contract Break |
API Contract | Field renamed ('total' → 'order_total') without backward-compatible alias | inv-01: Consumers receive required contract |
NOT RUN |
| S04 Auth Regression |
Security & Auth | Protected order lookup endpoint missing route authorization dependency | inv-01: Protected resources remain protected |
NOT RUN |
| S05 Schema Migration |
Data Persistence | Non-nullable column added without default value on existing records | inv-01: Migration preserves data compatibility |
NOT RUN |
Auditing
READ-ONLY AUDIT
Session Artifact Inspector — Inspect Raw JSON Payloads
// Select an artifact above to inspect JSON