You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

step-03-risk-and-testability.md 3.9KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130
  1. ---
  2. name: 'step-03-risk-and-testability'
  3. description: 'Perform testability review (system-level) and risk assessment'
  4. nextStepFile: '{skill-root}/steps-c/step-04-coverage-plan.md'
  5. outputFile: '{test_artifacts}/test-design-progress.md'
  6. ---
  7. # Step 3: Testability & Risk Assessment
  8. ## STEP GOAL
  9. Produce a defensible testability review (system-level) and a risk assessment matrix (all modes).
  10. ## MANDATORY EXECUTION RULES
  11. - 📖 Read the entire step file before acting
  12. - ✅ Speak in `{communication_language}`
  13. - 🎯 Base conclusions on evidence from loaded artifacts
  14. ---
  15. ## EXECUTION PROTOCOLS:
  16. - 🎯 Follow the MANDATORY SEQUENCE exactly
  17. - 💾 Record outputs before proceeding
  18. - 📖 Load the next step only when instructed
  19. ## CONTEXT BOUNDARIES:
  20. - Available context: config, loaded artifacts, and knowledge fragments
  21. - Focus: this step's goal only
  22. - Limits: do not execute future steps
  23. - Dependencies: prior steps' outputs (if any)
  24. ## MANDATORY SEQUENCE
  25. **CRITICAL:** Follow this sequence exactly. Do not skip, reorder, or improvise.
  26. ## 1. System-Level Mode: Testability Review
  27. If **system-level**, evaluate architecture for:
  28. - **Controllability** (state seeding, mockability, fault injection)
  29. - **Observability** (logs, metrics, traces, deterministic assertions)
  30. - **Reliability** (isolation, reproducibility, parallel safety)
  31. **Structure output as:**
  32. 1. **🚨 Testability Concerns** (actionable issues first)
  33. 2. **✅ Testability Assessment Summary** (what is already strong)
  34. Also identify **ASRs** (Architecturally Significant Requirements):
  35. - Mark each as **ACTIONABLE** or **FYI**
  36. ---
  37. ## 2. All Modes: Risk Assessment
  38. Using `risk-governance.md` and `probability-impact.md` (if loaded):
  39. - Identify real risks (not just features)
  40. - Classify by category: TECH / SEC / PERF / DATA / BUS / OPS
  41. - Score Probability (1–3) and Impact (1–3)
  42. - Calculate Risk Score (P × I)
  43. - Flag high risks (score ≥ 6)
  44. - Define mitigation, owner, and timeline
  45. ---
  46. ## 3. NFR Planning Assessment
  47. Using `nfr-criteria.md` when loaded:
  48. - Identify NFR categories in scope: security, performance, reliability, scalability, maintainability, compliance, and any project-specific categories
  49. - Extract measurable thresholds from PRD, architecture, ADRs, epics, or stories
  50. - Mark missing thresholds as **UNKNOWN** and convert them into clarification items or risks; do not guess values
  51. - Define planned evidence sources for later validation (tests, scans, metrics, logs, monitoring, CI reports)
  52. - Convert NFR gaps into the existing risk register using SEC / PERF / OPS / TECH / DATA categories
  53. **Boundary:** This workflow plans NFR validation. It does not assess final PASS/CONCERNS/FAIL from implementation evidence. Use `nfr-assess` after implementation evidence exists.
  54. ---
  55. ## 4. Summarize Risk Findings
  56. Summarize the highest risks and their mitigation priorities.
  57. ---
  58. ### 5. Save Progress
  59. **Save this step's accumulated work to `{outputFile}`.**
  60. - **If `{outputFile}` does not exist** (first save), create it with YAML frontmatter:
  61. ```yaml
  62. ---
  63. workflowStatus: 'in-progress'
  64. totalSteps: 5
  65. stepsCompleted: ['step-03-risk-and-testability']
  66. lastStep: 'step-03-risk-and-testability'
  67. nextStep: '{nextStepFile}'
  68. lastSaved: '{date}'
  69. ---
  70. ```
  71. Then write this step's output below the frontmatter.
  72. - **If `{outputFile}` already exists**, update:
  73. - Set `workflowStatus: 'in-progress'`
  74. - Set `totalSteps: 5`
  75. - Add `'step-03-risk-and-testability'` to `stepsCompleted` array (only if not already present)
  76. - Set `lastStep: 'step-03-risk-and-testability'`
  77. - Set `nextStep: '{nextStepFile}'`
  78. - Set `lastSaved: '{date}'`
  79. - Append this step's output to the appropriate section of the document.
  80. Load next step: `{nextStepFile}`
  81. ## 🚨 SYSTEM SUCCESS/FAILURE METRICS:
  82. ### ✅ SUCCESS:
  83. - Step completed in full with required outputs
  84. ### ❌ SYSTEM FAILURE:
  85. - Skipped sequence steps or missing outputs
  86. **Master Rule:** Skipping steps is FORBIDDEN.