|
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101 |
- ---
- name: 'step-03-map-criteria'
- description: 'Map coverage oracle items to tests and build traceability matrix'
- nextStepFile: '{skill-root}/steps-c/step-04-analyze-gaps.md'
- outputFile: '{test_artifacts}/traceability-matrix.md'
- ---
-
- # Step 3: Map Coverage Oracle to Tests
-
- ## STEP GOAL
-
- Create the traceability matrix linking the resolved oracle items to tests.
-
- ## MANDATORY EXECUTION RULES
-
- - 📖 Read the entire step file before acting
- - ✅ Speak in `{communication_language}`
-
- ---
-
- ## EXECUTION PROTOCOLS:
-
- - 🎯 Follow the MANDATORY SEQUENCE exactly
- - 💾 Record outputs before proceeding
- - 📖 Load the next step only when instructed
-
- ## CONTEXT BOUNDARIES:
-
- - Available context: config, loaded artifacts, and knowledge fragments
- - Focus: this step's goal only
- - Limits: do not execute future steps
- - Dependencies: prior steps' outputs (if any)
-
- ## MANDATORY SEQUENCE
-
- **CRITICAL:** Follow this sequence exactly. Do not skip, reorder, or improvise.
-
- ## 1. Build Matrix
-
- For each resolved oracle item (formal requirement, endpoint/spec item, or synthetic journey):
-
- - Map to matching tests
- - Mark coverage status: FULL / PARTIAL / NONE / UNIT-ONLY / INTEGRATION-ONLY
- - Record test level and priority
- - Preserve each mapped test's stable identity fields (`id`, `title`, `file`, `line`, `level`, status flags) so Phase 1 can deduplicate unique tests before JSON export
- - Record heuristic signals:
- - Endpoint coverage present/missing (for API-impacting items)
- - Auth/authz coverage present/missing (positive and negative paths)
- - Error-path coverage present/missing (validation, timeout, network/server failures)
- - UI journey E2E coverage present/missing (for source-derived journeys)
- - UI state coverage present/missing (loading, empty, validation, error, permission-denied)
-
- ---
-
- ## 2. Validate Coverage Logic
-
- Ensure:
-
- - P0/P1 items have coverage
- - No duplicate coverage across levels without justification
- - Items are not happy-path-only when the oracle implies error handling or alternate states
- - API items are not marked FULL if endpoint-level checks are missing
- - Auth/authz items include at least one denied/invalid-path test where applicable
- - Synthetic UI journeys are not marked FULL when no E2E or component test asserts the critical path and key failure states
-
- ---
-
- ### 3. Save Progress
-
- **Save this step's accumulated work to `{outputFile}`.**
-
- - **If `{outputFile}` does not exist** (first save), create it using the workflow template (if available) with YAML frontmatter:
-
- ```yaml
- ---
- stepsCompleted: ['step-03-map-criteria']
- lastStep: 'step-03-map-criteria'
- lastSaved: '{date}'
- ---
- ```
-
- Then write this step's output below the frontmatter.
-
- - **If `{outputFile}` already exists**, update:
- - Add `'step-03-map-criteria'` to `stepsCompleted` array (only if not already present)
- - Set `lastStep: 'step-03-map-criteria'`
- - Set `lastSaved: '{date}'`
- - Append this step's output to the appropriate section of the document.
-
- Load next step: `{nextStepFile}`
-
- ## 🚨 SYSTEM SUCCESS/FAILURE METRICS:
-
- ### ✅ SUCCESS:
-
- - Step completed in full with required outputs
-
- ### ❌ SYSTEM FAILURE:
-
- - Skipped sequence steps or missing outputs
- **Master Rule:** Skipping steps is FORBIDDEN.
|