Assume vs Assert: Constraint Hygiene and Over-Constraint Risk: Reports and Metrics

Reports and metrics

Reports and Metrics for Assume vs Assert: Constraint Hygiene and Over-Constraint Risk is anchored on non-vacuous closure rate, counterexample turnaround, and residual-risk trend by requirement class. Convert outcomes into assumption-aware, evidence-backed actions.

A useful report explains why closure quality moved, not only that status changed.

Evidence matrix

EVIDENCE MATRIX - Assume vs Assert: Constraint Hygiene and Over-Constraint Risk

+-----------------------------+--------------------------------+--------------------------------+---------------------------+
| Evidence                    | Tells you                      | Does not prove                 | Next action               |
+-----------------------------+--------------------------------+--------------------------------+---------------------------+
| property status by class    | closure shape by requirement   | model realism                  | pair with cover reachability |
| vacuity and trigger checks  | assertion meaningfulness       | full legal-path exploration    | inspect assumptions       |
| counterexample traces       | concrete divergence path       | complete bug-space closure     | classify and replay       |
| assumption audit trail      | model boundary confidence      | implementation correctness     | review spec traceability  |
| before/after trend packet   | mitigation movement quality    | long-window stability          | run broader matrix        |
+-----------------------------+--------------------------------+--------------------------------+---------------------------+

• Track non-vacuous closure rate, counterexample turnaround, and residual-risk trend by requirement class by requirement class and risk tier.

• Include assumption and tool metadata in every report header.

• Correlate status with vacuity and cover reachability movement.

• Call out contradictory evidence explicitly.

Formal deep dive

Property and constraint engineering is successful when decomposition, reuse, and abstraction preserve legal behavior.

Concept diagram

PROPERTY DEVELOPMENT PIPELINE

spec clause -> decomposed properties -> constraints -> covers -> closure packet

Metric graph

CONSTRAINT HYGIENE TREND

over-constraint risk    ████
cover reachability      ███████
library consistency     █████

Metrics and artifacts to collect

• assume/assert separation coverage

• critical cover reachability score

• checker library adoption and drift

• over-constraint warning trend

Mini case study

A reusable checker library reduced regression noise after assumptions were explicitly documented and reviewed per IP.

Debug branches

• Review every assumption against a spec citation.

• Use covers to confirm legal corner scenarios remain reachable.

• Track abstraction choices in a rollback-ready ledger.

Senior review question

Ask: which requirement intent is proven, under which assumptions, and what residual risk remains?

Key takeaways

• Tie each proof claim to assumption boundaries and reachability evidence.

• Prefer minimal reversible fixes and preserve legal behavior visibility.

Common pitfalls

• Treating runtime reduction as proof-quality improvement without audits.

• Declaring closure while critical covers remain unreachable.

• Using broad waivers instead of first-divergence root-cause ownership.

Report interpretation

Report status with vacuity, cover reachability, and assumption influence side by side.

Promote only when trend data supports reproducible closure behavior.