You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

step-02-define-thresholds.md 3.3KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118
  1. ---
  2. name: 'step-02-define-thresholds'
  3. description: 'Identify NFR categories and thresholds'
  4. nextStepFile: '{skill-root}/steps-c/step-03-gather-evidence.md'
  5. outputFile: '{test_artifacts}/nfr-assessment.md'
  6. ---
  7. # Step 2: Define NFR Categories & Thresholds
  8. ## STEP GOAL
  9. Establish the NFR categories to assess and the thresholds used for validation.
  10. ## MANDATORY EXECUTION RULES
  11. - 📖 Read the entire step file before acting
  12. - ✅ Speak in `{communication_language}`
  13. - 🚫 Never guess thresholds
  14. ---
  15. ## EXECUTION PROTOCOLS:
  16. - 🎯 Follow the MANDATORY SEQUENCE exactly
  17. - 💾 Record outputs before proceeding
  18. - 📖 Load the next step only when instructed
  19. ## CONTEXT BOUNDARIES:
  20. - Available context: config, loaded artifacts, and knowledge fragments
  21. - Focus: this step's goal only
  22. - Limits: do not execute future steps
  23. - Dependencies: prior steps' outputs (if any)
  24. ## MANDATORY SEQUENCE
  25. **CRITICAL:** Follow this sequence exactly. Do not skip, reorder, or improvise.
  26. ## 0. Check for Existing Test-Design NFR Plan
  27. Before deriving thresholds from raw documents, check if a `test-design` output exists with NFR planning:
  28. - Look for `test-design-architecture.md`, `test-design-qa.md`, or any test-design output in `{test_artifacts}/` that contains an NFR section.
  29. - If found, **load it as the primary source of NFR categories and thresholds**. Use those values directly; do not re-derive them from scratch.
  30. - Only fall back to raw documents (tech-spec, PRD, story) for categories or thresholds that are still missing or marked **UNKNOWN** in the test-design output.
  31. - If no test-design NFR plan exists, proceed with step 1 using raw documents.
  32. ---
  33. ## 1. Select Categories
  34. Use the ADR Quality Readiness Checklist (8 categories):
  35. 1. Testability & Automation
  36. 2. Test Data Strategy
  37. 3. Scalability & Availability
  38. 4. Disaster Recovery
  39. 5. Security
  40. 6. Monitorability/Debuggability/Manageability
  41. 7. QoS/QoE
  42. 8. Deployability
  43. Add any `custom_nfr_categories` if provided.
  44. ---
  45. ## 2. Define Thresholds
  46. For each category, use thresholds from the test-design NFR plan (step 0) where available. For any remaining UNKNOWN or missing thresholds, extract from:
  47. - tech-spec (primary)
  48. - PRD (secondary)
  49. - story (feature-specific)
  50. If a threshold is still unknown after checking all sources, mark it **UNKNOWN** and plan to report **CONCERNS**.
  51. ---
  52. ## 3. Confirm NFR Matrix
  53. List each NFR category with its threshold or UNKNOWN status.
  54. ---
  55. ## 4. Save Progress
  56. **Save this step's accumulated work to `{outputFile}`.**
  57. - **If `{outputFile}` does not exist** (first save), create it using the workflow template (if available) with YAML frontmatter:
  58. ```yaml
  59. ---
  60. stepsCompleted: ['step-02-define-thresholds']
  61. lastStep: 'step-02-define-thresholds'
  62. lastSaved: '{date}'
  63. ---
  64. ```
  65. Then write this step's output below the frontmatter.
  66. - **If `{outputFile}` already exists**, update:
  67. - Add `'step-02-define-thresholds'` to `stepsCompleted` array (only if not already present)
  68. - Set `lastStep: 'step-02-define-thresholds'`
  69. - Set `lastSaved: '{date}'`
  70. - Append this step's output to the appropriate section of the document.
  71. Load next step: `{nextStepFile}`
  72. ## 🚨 SYSTEM SUCCESS/FAILURE METRICS:
  73. ### ✅ SUCCESS:
  74. - Step completed in full with required outputs
  75. ### ❌ SYSTEM FAILURE:
  76. - Skipped sequence steps or missing outputs
  77. **Master Rule:** Skipping steps is FORBIDDEN.