Architecture / Security Architecture Operating Models / Roadmaps

06 · Adoption

Implementation roadmaps

Take every measure from stable definition and manual baseline to automated, decision-relevant evidence.

16metric roadmaps
5maturity stages
6implementation facets

Choose an outcome

Each roadmap covers mechanics, data contract, stages, readiness, anti-gaming controls and asks.

ODM-01 · Implementation roadmap

Design-Stage Defect Capture

Staged plan for a federated organisation: one definition and a minimal data contract per PMO - not a single defect repository. Report the ODM value AND its coverage at every stage. Companion tabs: ODM Register, ODM Contributing Indicators (CI-03/05/07), ODM Data Lineage.

Back to index ↑

1. Metric definition and mechanics

AttributeDetail
DefinitionSecurity design defects identified at or before the Design gate ÷ all security design defects found in the period, including escapes discovered in build, test, penetration testing or production.
Type / targetKPI · % · Green ≥80, Amber ≥65 (illustrative pending PLA negotiation with CIO / Portfolio Board)
Numerator sourceSecurity design review findings registers
Denominator additionsEscapes: build/test defects, pen-test findings and incident RCAs flagged security + design-attributable
Design gate definitionLinear delivery: the design stage gate. Agile: end of inception / design spike. Both defined in the version-controlled metric specification.
Reporting ruleAlways publish two numbers: the ODM value AND coverage (% of Tier-1 projects whose data meets the contract). Coverage is the honesty device and the PMO improvement lever.

2. The data contract (six fields per defect - any tracker qualifies)

#FieldNotes
1Project / portfolio IDMaps the record to a PMO and the Tier-1 scope list
2Date and lifecycle phase foundPhase at detection, not at fix
3Security flag (Y/N)Set at triage
4Design-attributable flag (Y/N)“Should this have been caught at design?” - governed by the written triage rule with QA sampling
5SeverityLocal scale mapped to the common 4-point scale
6SourceDesign review / SAST / test / pen test / incident RCA

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence label
0 - Define4–6 weeksPublish metric specification (data contract, severity mapping per tool, Design-gate definitions, triage rule). Select one pilot portfolio. Name metric owner (SSA lead) and PMO counterpart.Specification signed by pilot PMO; Tier-1 scope list agreed-
1 - Manual baselineQ1–Q2Design review findings logged in one simple register. Quarterly manual sweep of pilot trackers for security defects; SSA triages design-attributability. Publish first cut with coverage.Two quarterly cuts published; triage rule stableDirectional - trends only, no targets
2 - Standardise at sourceQ2–Q4Each PMO adds security + design-attributable flags and phase field to its own tracker workflow (field mapping, not migration). Design review becomes a Tier-1 gate requirement. Escapes tagged at pen-test triage and incident RCA. Onboarding checklist makes new projects contract-compliant by default.≥70% Tier-1 coverage; classification QA sampling runningIndicative - thresholds drafted
3 - Federate & automateYear 2 H1Scheduled exports / API pulls into a small metrics store; automated quarterly cut (MP-01 credit). After 2–3 stable quarters, negotiate the PLA target.≥90% coverage; manual adjustment rarePLA-grade - target negotiated; ambers actioned
4 - InstitutionaliseOngoingODM-readiness embedded in PMO project onboarding. Coverage reported per portfolio; laggards visible by name. Annual specification review.Coverage held through organisational changeSustained

4. PMO readiness ladder (a PMO’s level = the floor of its Tier-1 projects)

LevelCriteriaTarget date
L0No security design review; defects untracked or ad hoc-
L1Security design review held at the gate; findings logged in a register (any tool)All Tier-1 by end of Stage 1
L2Tracker carries security + phase fields; severity mapped to common scaleAll Tier-1 by end of Stage 2
L3Design-attributable triage in workflow; escapes tagged at test / pen test / RCATier-1 during Stage 3
L4Automated feed to the metrics storeWith Stage 3 tooling

5. Quality and anti-gaming controls

RiskEffectControl
Sparse design reviewsNumerator undercounted - metric looks artificially badPair with CI-03 (review coverage and findings-per-review rate) from day one
Rubber-stamp reviewsZero-finding reviews inflate the metricCI-03 findings-per-review rate exposes hollow reviews
Escape reclassificationTeams protect their number by disputing design-attributabilityWritten triage rule with worked examples; 10% quarterly QA sample outside the delivery line; disputes settled by design authority and folded into the rule
Org change breaks ownershipMetric orphaned in restructuresAnchor to gates and artefacts, not org units; PMOs sign the data contract, never a tool choice
Thin early denominatorRatio meaningless in first quartersReport the inverse story - escape count trend + review coverage - until the ratio stabilises

6. Asks of each PMO

#Ask
1Sign the data contract for Tier-1 projects (not a tooling commitment)
2Nominate a data counterpart for the quarterly cut
3Add the two flags and phase field to the local tracker workflow during Stage 2
4Adopt the security design review as a Tier-1 gate requirement
5Include ODM-readiness (L2) in project onboarding from Stage 2 onward

ODM-02 · Implementation roadmap

Security Rework Cost

KRI · % of delivery spend · Green ≤2, Amber ≤4 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: CFO / Portfolio Board · Cadence: Quarterly, reported with coverage. Organising principle: Do not wait for perfect financials. Effort-days recorded at the change board are a credible proxy until finance cost codes can isolate security rework. The flag discipline matters more than the currency.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionEffort/cost of post-build change attributable to security design decisions, as a percentage of total delivery spend on in-scope (Tier-1) initiatives.
Why it mattersThis is the money slide of the framework: the invisible tax of late security redesign made visible. It funds the case for early engagement (ODM-15) and design-stage capture (ODM-01), and typically reveals 3–6% of delivery spend on first measurement.
NumeratorPost-build changes flagged security-driven (control retrofit, redesign after review/pen test/incident, compliance rework), costed in £ or effort-days
DenominatorTotal delivery spend (or effort) on in-scope initiatives in the period
What countsRework caused by security decisions that could reasonably have been made at design - not new scope, not threat-landscape change
Reporting rulePublish the ODM value AND coverage (% of Tier-1 change volume passing through boards applying the flag)

2. The data contract (per change record)

#FieldNotes
1Change record IDFrom each PMO’s change/delivery tooling
2Project / portfolio IDMaps to PMO and Tier-1 scope
3Security-driven flag (Y/N)Set at CAB/change triage against the written definition
4TriggerDesign review / pen test / incident / compliance / audit finding
5Effort or costEffort-days acceptable until finance codes mature
6Linked defect/exception IDConnects rework to its cause (feeds ODM-01, ODM-11)

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksPublish the security-rework definition with worked examples (what counts, what does not). Agree effort-days as the interim unit with finance. Pick one pilot portfolio.Definition signed by pilot CAB chair and finance-
1 - Manual baselineQ1–Q2CAB applies the flag; PMs record effort on flagged changes. Quarterly manual roll-up against delivery effort.Two quarterly cuts; flag applied consistently at pilot CABDirectional
2 - Standardise at sourceQ2–Q4Flag and trigger fields added to each PMO’s change tooling. Finance maps cost codes where feasible; effort-days retained elsewhere. Onboard remaining portfolios.≥70% of Tier-1 change volume flagged at sourceIndicative
3 - Federate & automateYear 2 H1Automated quarterly extract from change tooling and finance. Convert effort to £ where codes allow. Negotiate the PLA target.≥90% coverage; manual adjustment rarePLA-grade
4 - InstitutionaliseOngoingRework cost appears in portfolio investment reviews; trends drive design-stage investment decisions.Metric cited in investment decisions (MP-02)Sustained

4. Readiness ladder - PMOs and Finance

LevelCriteriaTarget
L0No change-level flagging; rework invisible inside project budgets-
L1CAB applies security-driven flag using the written definitionPilot by end of Stage 1
L2Effort recorded on flagged changes; trigger classifiedAll Tier-1 by end of Stage 2
L3Finance cost codes or consistent effort-to-cost conversion in placeDuring Stage 3
L4Automated extract; rework linked to causal defect/exception recordsWith Stage 3 tooling

5. Quality and anti-gaming controls

RiskEffectControl
Rework hidden as enhancementNumerator undercountedCAB challenge question in the template; QA sample of unflagged changes each quarter
Reporter punishmentTeams stop flagging if the number is used against themAttribute rework to the design stage, never the reporting team - say so publicly and mean it
Effort estimates gamed lowValue understatedStandard effort bands rather than free-text estimates; sample against timesheets where they exist
Scope-change conflationNew requirements counted as reworkDefinition excludes genuine scope change; disputed cases settled by design authority and folded into the examples

6. Asks of PMOs and Finance

#Ask
1Add the security-driven flag and trigger field to change templates
2Chairs apply the definition at CAB and challenge unflagged candidates
3Record effort-days on flagged changes (bands, not precision theatre)
4Finance counterpart to map cost codes during Stage 2–3
5Nominate a data counterpart for the quarterly cut

ODM-03 · Implementation roadmap

Pattern Adoption & Conformance

KCI · % · Green ≥85, Amber ≥70 (illustrative pending PLA negotiation) · Owner: Operational Security Architecture lead · Consumer: Domain / Platform Owners · Cadence: Monthly, reported with scan coverage. Organising principle: Machine-checkable baselines before broad scanning. A pattern that exists only as a diagram cannot be conformance-tested; start by expressing your top patterns as testable configuration baselines.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of new deployments conformant with the approved reference pattern that specifies them, with configuration drift detected within 30 days.
Why it mattersThe estate either converges on approved architecture or it silently forks. This is also the reality-check twin of ODM-10: paper coverage claims are audited against what is actually running.
NumeratorDeployments matching their specifying pattern baseline at scan
DenominatorAll new deployments that a published pattern specifies
Drift clockDays from non-conformant change to detection; 30-day threshold
Reporting rulePublish the ODM value AND scan coverage (% of pattern-specified estate actually scanned) - unscanned is not conformant

2. The data contract (per deployment)

#FieldNotes
1Deployment / CI identifierCMDB configuration item or platform deployment ID
2Specifying pattern + versionFrom the architecture repository; version-controlled
3Scan result (conformant Y/N)From configuration compliance tooling or IaC policy checks
4Deviation detailFailing rules, with severity
5Drift detection dateFirst scan detecting divergence from baseline
6Remediation statusOpen / accepted (with expiry) / closed

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksSelect top 3 patterns by deployment volume. Express each as a version-controlled, machine-checkable baseline (IaC policy / CIS-style checks).Three baselines published as code-
1 - Manual baselineQ1–Q2Manual conformance sampling of recent deployments against the three baselines. Map CIs to patterns in the CMDB.Two monthly cuts on sampled estate; CI-to-pattern mapping startedDirectional
2 - Standardise at sourceQ2–Q4Onboard scanning tooling per platform; extend baselines to remaining priority patterns; pattern release process updated to ship a baseline with every pattern.Scan coverage ≥70% of pattern-specified estateIndicative
3 - Federate & automateYear 2 H1Automated monthly cut with drift alerting; accepted deviations carry owners and expiry (feeds ODM-11).Coverage ≥95%; drift MTTD under 30 daysPLA-grade
4 - InstitutionaliseOngoingNo pattern published without a baseline; conformance in platform teams’ service reviews.Baseline-with-pattern rule enforced at design authoritySustained

4. Readiness ladder - Platform teams and the Architecture Repository owner

LevelCriteriaTarget
L0Patterns exist as documents only; no conformance checking-
L1Top patterns have machine-checkable baselines; manual sampling runningEnd of Stage 1
L2Platform onboarded to scanning; CI-to-pattern mapping maintainedEnd of Stage 2
L3Drift alerting live; deviations managed with owners and expiryDuring Stage 3
L4Automated monthly reporting; baseline ships with every pattern releaseWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Blind-spot conformanceUnscanned estate flatters the numberReport scan coverage alongside; treat unscanned as non-conformant in the headline
Stale baselinesTeams fail against outdated rules and lose faithBaselines version-controlled with the pattern; grace period on pattern updates
Pattern forkingTeams copy-adapt patterns and claim conformance to their forkConformance is to the published version only; forks surface as deviations for design authority decision
Gaming by exclusionDeployments argued out of pattern scopeScope decided by the repository mapping, not the delivery team

6. Asks of Platform teams and the Architecture Repository owner

#Ask
1Onboard platform estates to configuration/IaC scanning
2Maintain CI-to-pattern mapping in the CMDB
3Ship a machine-checkable baseline with every pattern release
4Manage deviations with owner and expiry, not silent acceptance

ODM-04 · Implementation roadmap

Requirements Traceability Integrity

KCI · % of Tier-1 changes · Green ≥95, Amber ≥85 (illustrative pending PLA negotiation) · Owner: Security Solutions Architecture lead · Consumer: Change / Programme Boards · Cadence: Quarterly, reported with coverage. Organising principle: The chain is the deliverable. Tooling can be federated across PMOs if every Tier-1 project maintains requirement→control→evidence links in whatever tool it uses - the trace is snapshotted at the go-live gate.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of Tier-1 changes whose security requirements trace to implemented and verified controls at go-live (requirement → control → verification evidence).
Why it mattersThe audit-surviving answer to “was what we required actually built?”. It also protects delivery: traceable requirements are testable requirements, and disputes about scope get settled by the record.
NumeratorTier-1 changes with a complete trace chain at go-live
DenominatorAll Tier-1 changes reaching go-live in the period
Chain definitionSecurity requirement → design element/control → verification evidence (test result, scan, review record)
Reporting rulePublish the ODM value AND coverage (% of Tier-1 changes assessed at gate)

2. The data contract (per security requirement)

#FieldNotes
1Requirement ID + sourceCatalogue-derived or bespoke; bespoke requires design authority note
2Project / change IDMaps to Tier-1 scope
3Linked control / design elementThe thing that satisfies the requirement
4Verification evidence linkTest result, scan output or review record
5Status at go-liveVerified / waived (with risk acceptance) / open
6Gate snapshot dateTrace assessed and frozen at the go-live gate

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksPublish the chain definition and minimal linkage convention per tool (Jira/ADO field mapping). Agree the gate snapshot rule.Convention signed by pilot PMO and test lead-
1 - Manual baselineQ1–Q2Manual traceability audit at go-live gates on pilot Tier-1 projects; broken links logged and classified.Two quarterly cuts; broken-link taxonomy stableDirectional
2 - Standardise at sourceQ2–Q4Linkage fields configured in each PMO’s tooling; evidence attachment made mandatory in test workflow; requirements catalogue adoption pushed to reduce bespoke sprawl.≥70% Tier-1 coverage at gateIndicative
3 - Federate & automateYear 2 H1Automated broken-link reports per project; gate report generated from tooling. Negotiate PLA target.≥90% coverage; gate report automatedPLA-grade
4 - InstitutionaliseOngoingTrace report is a standing go-live gate artefact; catalogue requirements version-managed.Gate rule enforced without exception process abuseSustained

4. Readiness ladder - PMOs, Test/QA and Requirements-tooling owners

LevelCriteriaTarget
L0Requirements in documents; no linkage to controls or evidence-
L1Security requirements itemised in tracker with IDsPilot by end of Stage 1
L2Requirement→control linkage maintained; evidence attached at testAll Tier-1 by end of Stage 2
L3Broken-link reporting; waivers carry risk acceptanceDuring Stage 3
L4Automated gate report; catalogue-first requirement sourcingWith Stage 3 tooling

5. Quality and anti-gaming controls

RiskEffectControl
Verified without evidenceChain complete on paper, hollow in factEvidence link mandatory for “verified”; QA sample links quarterly
Bespoke requirement sprawlUntestable one-off requirements bypass the catalogueBespoke requires design authority note; sprawl reported per project
Trace decay after go-liveChain rots and misleads later assuranceSnapshot at gate is the record of account; in-life changes handled by ODM-03/10
Tool migration breaks linksCoverage collapses during PMO tooling changesContract is tool-agnostic; migration plans must include link preservation

6. Asks of PMOs, Test/QA and Requirements-tooling owners

#Ask
1Adopt the linkage convention in local tooling
2Make evidence attachment mandatory at test completion
3Produce the trace report at every Tier-1 go-live gate
4Route bespoke requirements through the design authority

ODM-05 · Implementation roadmap

Third-Party Assurance Coverage

KRI · % · Green 100 critical suppliers, Amber ≥90 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: CPO / Supplier Board · Cadence: Quarterly; expiry alerts monthly. Organising principle: The tier list is the metric’s foundation and its most political artefact. Settle tiering criteria and ownership before arguing about assessment methods - a perfect assessment of the wrong supplier list measures nothing.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of critical suppliers holding current security assurance within agreed thresholds (assessment age, score, remediation status); high-tier suppliers reported alongside.
Why it mattersSupply chain is where other people’s immaturity becomes your incident. This metric turns “we assess our suppliers” from an assertion into a coverage statement with named gaps.
NumeratorCritical suppliers with in-date, in-threshold assurance
DenominatorAll suppliers on the critical tier list
CurrencyAssessment age within cadence for tier; remediation actions within SLA
Reporting ruleCritical and high tiers reported separately - never blended into one flattering number

2. The data contract (per supplier)

#FieldNotes
1Supplier IDFrom the contract register - the authoritative population
2TierCritical / high / standard, per agreed criteria
3Last assessment date + methodEvidence-based for critical; questionnaire acceptable below
4Outcome / scoreAgainst the agreed scheme
5Remediation statusOpen actions with due dates
6Contract referencesRenewal date; security schedule version

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksAgree tiering criteria (data access, service criticality, connectivity) and name the tier-list owner. Baseline the critical list from the contract register.Tier list baselined and owned-
1 - Manual baselineQ1–Q2Reconcile existing assessments against the critical list; publish first coverage cut with gaps named.Two quarterly cuts; gap list actionedDirectional
2 - Standardise at sourceQ2–Q4Assessment cadence per tier agreed; expiry alerting from the register; evidence-based method for critical tier; assurance clauses into renewal templates.Critical-tier coverage ≥90%; expiry alerts liveIndicative
3 - Federate & automateYear 2 H1Supplier assurance platform (or disciplined register) automates currency tracking; remediation SLAs reported. Negotiate PLA.100% critical coverage sustained one quarterPLA-grade
4 - InstitutionaliseOngoingAssurance status is a contract renewal gate; tier list reviewed annually and on M&A/org change.Renewal gate operating; tier review on calendarSustained

4. Readiness ladder - Procurement and Supplier Management

LevelCriteriaTarget
L0No tier list; assessments ad hoc and unrecorded centrally-
L1Critical tier list baselined from contract register with an ownerEnd of Stage 0–1
L2Assessment cadence per tier; expiry alerting operatingEnd of Stage 2
L3Evidence-based assessment for critical tier; remediation SLAs trackedDuring Stage 3
L4Platform-automated currency; renewal gate enforcedWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Stale tieringNew critical suppliers invisible; departed ones flatter coveragePopulation from the contract register, not memory; annual tier review plus trigger on M&A/new contracts
Questionnaire theatreCurrency without assuranceEvidence-based method mandatory for critical tier; sample-audit questionnaire answers below it
Blended reportingHigh-tier gaps hidden inside a healthy critical numberTiers reported separately by contract
Assessment backlog dumpingCoverage spikes from bulk low-quality reviews before reportingMethod and reviewer recorded per assessment; QA sample quarterly

6. Asks of Procurement and Supplier Management

#Ask
1Own and maintain the tier list from the contract register
2Operate expiry alerting and assessment scheduling
3Adopt evidence-based assessment for the critical tier
4Make assurance status a renewal gate from Stage 2
5Notify tier-list owner on M&A and major contract changes

ODM-06 · Implementation roadmap

Procurement Security Cycle Time

KPI · working days (median) · Green ≤10, Amber ≤15 (illustrative pending PLA negotiation) · Owner: Security Solutions Architecture lead · Consumer: CPO / Procurement · Cadence: Quarterly, segmented by category. Organising principle: Define the start and stop events with procurement, not for them. Most cycle-time disputes are definition disputes; a shared clock ends them.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionMedian working days from procurement engagement to issue of security requirements for RFP/contract.
Why it mattersThis is the metric that buys goodwill: security volunteering to be measured on its own responsiveness. It protects procurement velocity as an explicit business value and disarms the “security slows everything” narrative with data.
Clock startProcurement initiation record naming a security-relevant category (not when security happens to hear about it)
Clock stopSecurity requirements issued to the procurement (versioned document or workflow state)
Median, segmentedReported by category/complexity - framework call-offs and bespoke builds are different populations
Reporting rulePublish the ODM value AND coverage (% of security-relevant procurements with both timestamps)

2. The data contract (per procurement case)

#FieldNotes
1Procurement IDFrom procurement workflow tooling
2Category / complexityFramework / catalogue / bespoke; drives segmentation
3Engagement timestampClock start per the shared definition
4Requirements-issued timestampClock stop; links to the requirements artefact
5Queue vs work splitDays waiting vs days in active security work (optional but diagnostic)
6OutcomeRequirements issued / not required / escalated

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define3–4 weeksAgree start/stop events and security-relevant categories with procurement. Publish the requirement pattern library for common categories.Shared clock definition signed-
1 - Manual baselineQ1SSA team logs engagements and issue dates in a simple register; first median published by category.One quarterly cut with segmentationDirectional
2 - Standardise at sourceQ2–Q3Timestamps captured in procurement workflow tooling; requirement patterns cover top categories so routine cases are near-instant.≥70% of security-relevant procurements timestamped at sourceIndicative
3 - Federate & automateQ4–Year 2Automated quarterly cut from workflow; queue-vs-work split reported; PLA target negotiated both ways (security commits to cycle time, procurement commits to early notification).≥90% coverage; two-sided PLA agreedPLA-grade
4 - InstitutionaliseOngoingCycle time in mutual SLAs; stuck-case escalation route operating.Escalations rare and resolved in-quarterSustained

4. Readiness ladder - Procurement and the SSA team (jointly)

LevelCriteriaTarget
L0Security engaged by email, late, untracked-
L1Engagements logged with dates in a registerEnd of Stage 1
L2Workflow timestamps at source; categories appliedEnd of Stage 2
L3Pattern library covers top categories; queue/work split visibleDuring Stage 3
L4Automated reporting; two-sided SLA operatingWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Late engagement gamingClock started late makes security look fast while procurements still stallClock starts at procurement initiation, not security awareness - that is the point of the shared definition
Mix shiftMedian moves because case mix changed, not performanceAlways segment by category; never report one blended median
Email-shadow procurementCases bypass the workflow and the metricCoverage reported; unlogged cases surfaced at the joint review
Speed over substanceFast issuance of boilerplate requirementsPair with ODM-04/05 quality signals; pattern library keeps speed and substance compatible

6. Asks of Procurement and the SSA team (jointly)

#Ask
1Adopt the shared clock definition and categories
2Capture both timestamps in workflow tooling
3Notify security at procurement initiation for relevant categories
4Joint quarterly review of stuck cases and the segmented median

ODM-07 · Implementation roadmap

Regulatory Trace Completeness

KRI · % of obligations · Green ≥95, Amber ≥85 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: CISO / Risk Committee · Cadence: Quarterly; regime-by-regime rollout. Organising principle: One regime at a time. A complete, defensible trace for the ISO 27001 SoA beats a shallow gesture at every regulation; each completed regime becomes the template for the next.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of in-scope regulatory obligations (UK GDPR, NIS, ISO/IEC 27001 SoA) with a demonstrable obligation → control → architecture evidence chain.
Why it mattersAudit-readiness becomes a state rather than a quarterly panic. The same chain answers regulators, certification auditors and insurers - built once, cited many times.
NumeratorObligations with complete obligation→control→architecture-evidence chains
DenominatorAll obligations in the in-scope regimes (declared scope)
Chain definitionObligation (register) → control (library) → evidence (architecture repository artefact, assurance result)
Reporting rulePublish per regime with regime scope declared - no blended “compliance %” across regimes

2. The data contract (per obligation)

#FieldNotes
1Obligation ID + sourceRegime, article/clause reference
2Obligation ownerNamed accountable individual
3Linked control(s)From the control library
4Architecture evidence linkRepository artefact, pattern, assurance result
5Review dateChain re-validated on cycle and on regulatory change
6Gap statusUnmapped / mapped-unevidenced / complete

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksConsolidate the obligation register for the first regime (recommend ISO 27001 SoA - bounded and certification-driven). Name the register owner.Single owned register for regime 1-
1 - Manual baselineQ1–Q2Mapping sprint: obligations→controls→evidence for regime 1; gaps classified; first cut published.Regime 1 baseline complete with gap registerDirectional
2 - Standardise at sourceQ2–Q4Repository linkage convention; orphan-control and broken-link reports; onboard regime 2 (UK GDPR) using the template.Regime 1 ≥85% complete; regime 2 baselinedIndicative
3 - Federate & automateYear 2GRC-to-repository integration replaces manual chain maintenance; regulatory-change process updates the register within SLA.Chains maintained automatically; change SLA metPLA-grade
4 - InstitutionaliseOngoingNew regimes onboarded by template; chain evidence used directly in audits and certification.Auditors accept chain evidence without parallel spreadsheetsSustained

4. Readiness ladder - GRC function and the Architecture Repository owner

LevelCriteriaTarget
L0Obligations tracked in scattered spreadsheets; no control linkage-
L1Single owned obligation register for the active regimeEnd of Stage 0
L2Controls mapped; gaps classified and ownedEnd of Stage 1–2
L3Evidence links live in the repository; orphan reports runningDuring Stage 2–3
L4GRC-repository integration; regulatory-change SLA operatingWith Stage 3

5. Quality and anti-gaming controls

RiskEffectControl
Register duplicationCompeting obligation lists across teams destroy trust in the denominatorOne owned register per regime; others retired explicitly
Map-once rotChains complete at baseline, stale within a yearReview dates on every chain; regulatory-change trigger process
Evidence-link breakageRepository restructures orphan the evidenceStable artefact identifiers; broken-link report monthly
Regime scope creepDenominator argued down to flatter the numberRegime scope declared and version-controlled; changes need risk committee sign-off

6. Asks of GRC function and the Architecture Repository owner

#Ask
1Name a single owner per regime register
2Fund the regime-1 mapping sprint
3Adopt the repository linkage convention
4Route regulatory change through the register update process
5Prioritise GRC-repository integration in Year 2

ODM-08 · Implementation roadmap

Design-Attributable Audit Findings

KRI · count per year · Green ≤2 (none critical), Amber ≤4 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: CISO / Audit Committee · Cadence: Per audit; reported annually with 3-year rolling context. Organising principle: This is a partnership metric - the data belongs to audit. Approach it as a joint classification exercise with the audit function, or it will die of contested attribution.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionCount of internal and external audit findings in the period whose root cause is an architecture or design defect.
Why it mattersThe lagging, independent proof of the whole framework: if design quality is genuinely improving, it eventually shows up as clean audits. Because the evidence comes from audit rather than from security, it is unusually hard to dismiss.
NumeratorFindings root-caused to architecture/design defects (joint classification)
PopulationAll internal/external audit findings in the period
Small-number handlingAnnual count reported with 3-year rolling trend - single-year swings are noise
Reporting ruleClassification jointly signed by audit and ESA; disputes recorded, not buried

2. The data contract (per audit finding)

#FieldNotes
1Finding ID + audit referenceFrom the audit findings register
2SeverityAudit’s own scale, mapped once
3Root-cause classAgreed taxonomy: design / configuration / process / people / vendor
4Design-attributable flagJoint audit + ESA sign-off
5Linked remediationTracks closure and connects to ODM-11 where accepted as debt
6Classification date + classifiersAccountability for the judgement

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksAgree the root-cause taxonomy and joint classification protocol with the audit function. Settle access to the findings register.Taxonomy and protocol signed by audit leadership-
1 - Retrospective baselineQ1–Q2Jointly classify the last 24 months of findings; publish the baseline with rolling context.Baseline classified; disputes documentedDirectional
2 - Standardise at sourceQ2–Q4Classification step embedded in finding-closure workflow; new findings classified within 30 days of issue.All new findings classified in-cycleIndicative
3 - Trend & negotiateYear 2Two audit cycles of consistent classification; PLA target negotiated with audit committee awareness.Stable classification across cyclesPLA-grade
4 - InstitutionaliseOngoingAudit planning consumes the trend (risk-based audit scoping); design authority reviews every design-attributable finding.Findings feed pattern/standard updatesSustained

4. Readiness ladder - Internal Audit and the ESA function (jointly)

LevelCriteriaTarget
L0No root-cause classification on findings-
L1Taxonomy agreed; retrospective baseline classifiedEnd of Stage 1
L2Classification embedded in closure workflowEnd of Stage 2
L3Consistent classification across audit cycles; disputes rareDuring Stage 3
L4Trend informs audit planning and design authority actionWith Stage 4

5. Quality and anti-gaming controls

RiskEffectControl
Contested attributionEvery finding argued out of “design” - count collapses to zero credibilityJoint sign-off protocol; disputes recorded with both positions; annual calibration session
Small-n noiseOne bad audit year read as systemic failure3-year rolling reporting; narrative on each finding, not just the count
Perverse dispute incentiveTeams fight findings to protect the metricThe metric measures the design system, not teams - findings drive pattern fixes, not blame
Independence sensitivitiesAudit resists co-owning a security metricFrame as root-cause enrichment of their data; audit retains final classification authority

6. Asks of Internal Audit and the ESA function (jointly)

#Ask
1Agree the root-cause taxonomy and joint protocol
2Grant register access for classification
3Add the classification step to finding closure
4Join an annual calibration session with the design authority

ODM-09 · Implementation roadmap

Standards Currency

KCI · % · Green ≥90, Amber ≥75 (illustrative pending PLA negotiation) · Owner: Operational Security Architecture lead · Consumer: Design Authority · Cadence: Monthly report; quarterly review. Organising principle: Currency fails from capacity, not intent. The roadmap is mostly about making review workload visible and planned - the reporting is trivial once owners and dates exist.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of technical security standards reviewed and reissued within their defined review cycle (12 or 24 months by class).
Why it mattersStale standards are worse than no standards: teams conform to obsolete guidance with full confidence. Currency is the cheapest health signal for the whole standards estate.
NumeratorStandards with a completed review inside their cycle
DenominatorAll standards in the register
Review classes12-month (fast-moving: cloud, crypto, endpoint) / 24-month (stable: physical, media handling)
Reporting ruleA review must produce either changes or a recorded “reviewed, no change required” rationale - re-dating alone does not count

2. The data contract (per standard)

#FieldNotes
1Standard ID + titleFrom the standards register
2Class12- or 24-month cycle, assigned by design authority
3OwnerNamed individual, not a team
4Last review date + outcomeChanged / no-change-with-rationale
5Next review dueDerived; drives expiry flags
6StatusCurrent / due / overdue / retired

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define3–4 weeksInventory all standards; assign owners and review classes; retire the dead ones honestly.Register complete with owners and classes-
1 - Manual baselineQ1Publish first currency cut; overdue standards triaged into a review backlog.Baseline published; backlog sizedDirectional
2 - Standardise at sourceQ1–Q3Review-date and outcome fields mandatory; expiry flags automated; review workload scheduled into team plans.Overdue backlog cleared or explicitly rescheduledIndicative
3 - Automate & negotiateQ4Monthly automated report; PLA target set with design authority.Two clean monthly cyclesPLA-grade
4 - InstitutionaliseOngoingCurrency in the design authority dashboard; class assignments reviewed annually.Sustained ≥ target with stable capacitySustained

4. Readiness ladder - Design Authority and standard owners

LevelCriteriaTarget
L0Standards undated, unowned, of unknown vintage-
L1Register complete; owners and classes assignedEnd of Stage 0
L2Review outcomes recorded; expiry flagging liveEnd of Stage 2
L3Review capacity planned; backlog managedDuring Stage 2–3
L4Automated monthly reporting to design authorityWith Stage 3

5. Quality and anti-gaming controls

RiskEffectControl
Re-date rubber-stampingCurrency without reviewOutcome field mandatory; “no change” requires rationale; QA sample reviews
Orphaned standardsOrg change leaves standards ownerless and silently overdueOwnership by role with named holder; orphan report monthly
Class inflationEverything argued into the 24-month classClass assignment owned by design authority, reviewed annually
Retirement avoidanceDead standards padding the denominatorExplicit retirement path; register hygiene in the annual review

6. Asks of Design Authority and standard owners

#Ask
1Name an owner for every standard
2Approve class assignments and hold them
3Plan review capacity in team schedules
4Retire dead standards rather than ignoring them

ODM-10 · Implementation roadmap

Control-Objective Coverage

KRI · % of Tier-1 objectives · Green ≥95, Amber ≥85 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: Domain Owners / Risk Committee · Cadence: Quarterly, reported with modelling coverage. Organising principle: Model two domains deeply before touting breadth. The SRM chain (domain → control objective → control → mechanism) must exist in the repository for a domain before its coverage means anything; two credible domains beat ten hollow ones.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of Tier-1 domain control objectives realised by at least one implemented, operating control, with residual gaps formally risk-accepted by the domain owner.
Why it mattersThe flagship coverage claim: “critical domains are demonstrably protected end-to-end”. It is also the framework’s most demanding metric - it cannot exist until control objectives are modelled per domain.
NumeratorTier-1 control objectives realised by ≥1 implemented AND operating control (assurance-evidenced)
DenominatorAll control objectives across modelled Tier-1 domains
Gap handlingUnrealised objectives require a domain-owner risk acceptance with expiry - silence is a red flag, not a gap
Reporting rulePublish the ODM value AND modelling coverage (% of Tier-1 domains with objectives modelled); pair with ODM-03 so paper claims meet the running estate

2. The data contract (per control objective)

#FieldNotes
1Domain + objective IDFrom the architecture repository (SRM conceptual layer)
2Realising control(s)Logical controls mapped to the objective
3Implementation statusDeployed mechanisms/CIs from CMDB
4Operating evidenceControl assurance/testing result within cycle
5Gap risk-acceptance recordOwner, rationale, expiry
6Last assessed dateChain re-validated per cycle

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define6–8 weeksSelect two pilot Tier-1 domains with engaged owners. Model 8–15 control objectives per domain in the repository.Two domains modelled; owners signed up-
1 - Manual baselineQ1–Q2Map objectives→controls→CIs; classify each objective (realised / partial / gap); domain owners risk-accept or fund gaps.Pilot coverage published; every gap ownedDirectional
2 - Standardise at sourceQ2–Q4Add assurance linkage (operating evidence, not just deployed). Extend modelling to next 3–4 Tier-1 domains using the pilot template.Modelling coverage ≥50% of Tier-1 domainsIndicative
3 - Federate & automateYear 2Repository–CMDB–assurance joins automated; quarterly cut generated; PLA negotiated with domain owners and risk committee.Modelling coverage ≥90%; automated reportingPLA-grade
4 - InstitutionaliseOngoingNew domains modelled at policy creation; coverage standing item at risk committee.No Tier-1 domain unmodelled >2 quartersSustained

4. Readiness ladder - Domain Owners and the ESA/repository function

LevelCriteriaTarget
L0Domain has no modelled control objectives-
L1Objectives modelled (8–15) with an engaged ownerPilot domains by Stage 0–1
L2Controls mapped to objectives; gaps classified and risk-acceptedEnd of Stage 1–2
L3Operating evidence linked (assurance results in cycle)During Stage 2–3
L4Automated chain validation; drift from ODM-03 reconciledWith Stage 3

5. Quality and anti-gaming controls

RiskEffectControl
Paper coverageChains complete in the repository, absent in productionMandatory pairing with ODM-03 configuration scans; “operating” requires assurance evidence
Granularity wars500 micro-objectives or 3 vague ones make the % meaningless8–15 objectives per domain, calibrated by design authority across domains
Owner disengagementGaps unowned; acceptance theatreRisk acceptance is the owner’s act, with expiry; unaccepted gaps escalate to risk committee by default
Modelling stallTwo pilot domains foreverModelling coverage reported beside the ODM - the unmodelled estate stays visible

6. Asks of Domain Owners and the ESA/repository function

#Ask
1Sponsor modelling for your domain and own the gaps
2Risk-accept or fund every unrealised objective - with expiry
3Provide assurance results for operating evidence
4Fund repository modelling capacity through Stage 2

ODM-11 · Implementation roadmap

Security Debt Exposure

KRI · weighted index · Green ≤100 and falling, Amber ≤130 (illustrative pending PLA negotiation) · Owner: Enterprise Security Architecture lead · Consumer: Risk Committee · Cadence: Monthly register hygiene; quarterly index. Organising principle: Hygiene before index. An index computed over a register full of ownerless, expiry-less items is theatre; the first quarter’s work is making every item carry an owner, a severity and an expiry.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionWeighted index (severity × age) of open security technical-debt items and design exceptions on critical domains; no exception older than 12 months without owner re-authorisation.
Why it mattersRisk debt is what accumulates in the gap between “accepted for now” and “forgotten forever”. The index makes the accumulation visible, owned and priced - and the 12-month rule forces the forgetting to stop.
IndexΣ (severity weight × age factor) across open items on critical domains, normalised to baseline = 100
PopulationDesign exceptions + technical debt items from all sources (CAB, design reviews, assessments, ODM-03 deviations)
The 12-month ruleAny exception older than 12 months without re-authorisation is escalated automatically
Reporting ruleIndex reported with the top-5 items narrated - a number without its stories misleads

2. The data contract (per debt item / exception)

#FieldNotes
1Item ID + typeException / debt; source recorded
2Domain + affected assetsMaps to critical domains for weighting
3SeverityCommon 4-point scale
4Raised dateDrives the age factor
5Owner + expiryMandatory; no item without both
6Remediation path + re-authorisation historyEvidence that acceptance is a decision, not a default

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksAgree the register schema and weights with the risk committee (then freeze weights for 12 months). Identify all exception sources.Schema agreed; weights frozen; sources listed-
1 - Hygiene sprintQ1Consolidate items into the schema (register can stay federated); assign owners, severities, expiries to every item. Kill duplicates.100% of items carry owner/severity/expiryDirectional
2 - Baseline & routineQ2–Q3Baseline the index at 100. Monthly orphan report; CAB and design review feeds create items at source; ODM-03 deviations flow in.Two quarterly index cuts; orphan count ~zeroIndicative
3 - Automate & negotiateQ4–Year 2Automated index computation; expiry-driven re-authorisation workflow; PLA target (trajectory, not point) negotiated.Re-authorisation workflow live; index trend crediblePLA-grade
4 - InstitutionaliseOngoingDebt burn-down tranches priced in planning; index trajectory reviewed quarterly at risk committee.Burn-down funded against trajectorySustained

4. Readiness ladder - Risk function and exception-source owners (CAB, design authority)

LevelCriteriaTarget
L0Exceptions scattered, verbal, or expired-in-place-
L1All items in schema with owner, severity, expiryEnd of Stage 1
L2New items created at source (CAB, reviews, scans)End of Stage 2
L3Expiry-driven re-authorisation operatingDuring Stage 3
L4Automated index; burn-down tranches in planningWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Weight-fiddlingIndex “improves” by re-weighting, not remediatingWeights frozen for 12 months; changes need risk committee sign-off and restated history
Bulk closuresItems closed without remediation evidence before reportingClosure requires evidence or formal risk-acceptance renewal; closures QA-sampled
Shadow exceptionsVerbal acceptances at CAB never reach the registerCAB workflow creates the item automatically; minutes audited quarterly
Index without narrativeA falling number hides one monstrous itemTop-5 items narrated in every report; single-item concentration flagged

6. Asks of Risk function and exception-source owners (CAB, design authority)

#Ask
1Sign off the schema and weights, then hold them
2Resource the hygiene sprint
3Create items at source in CAB and review workflows
4Operate the 12-month re-authorisation rule without exception

ODM-12 · Implementation roadmap

Roadmap Delivery

KPI · % of milestones · Green ≥80, Amber ≥65 (illustrative pending PLA negotiation) · Owner: Security Solutions Architecture lead · Consumer: CISO / Investment Board · Cadence: Quarterly. Organising principle: The baseline is the metric. Without change control on plan dates, the target is met by quietly moving it; the entire delivery effort here is baseline discipline, which the portfolio office already knows how to run.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of security capability roadmap milestones delivered within one quarter of the baselined plan.
Why it mattersInvestment credibility. The board funded a roadmap; this is the metric that says whether funding turns into capability - and it is the first metric a sceptical CFO will check against reality.
NumeratorMilestones delivered within +1 quarter of baselined date
DenominatorMilestones due in the period per the baseline
Baseline rulePlan dates change only via approved re-baseline; history preserved
Reporting ruleVariance reasons classified (security-controllable vs external dependency) - the metric should drive the right conversation

2. The data contract (per roadmap milestone)

#FieldNotes
1Milestone ID + capabilityFrom the security roadmap
2Baselined dateUnder change control with history
3Actual / forecast dateFrom portfolio tooling
4Variance reasonTaxonomy: scope / resource / dependency / funding / estimate
5Funding statusLinks slippage to investment decisions
6Definition of doneAgreed acceptance criteria per milestone

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define3–4 weeksBaseline the roadmap with dated, DoD-carrying milestones; agree the re-baseline governance with the portfolio office.Baseline v1 approved-
1 - Manual baselineQ1First quarterly RAG cut against baseline; variance reasons classified.One quarterly cut with variance taxonomyDirectional
2 - StandardiseQ2–Q3Milestones tracked in portfolio tooling; re-baseline requests logged and approved formally; DoD verified at delivery.Silent date changes eliminatedIndicative
3 - Automate & negotiateQ4Automated cut from portfolio tooling; PLA target negotiated with investment board.Two clean automated cutsPLA-grade
4 - InstitutionaliseOngoingRoadmap delivery reviewed alongside funding decisions; chronic external-dependency variance escalated structurally.Variance drives decisions, not excusesSustained

4. Readiness ladder - Portfolio Office and the security capability owners

LevelCriteriaTarget
L0Roadmap is a slide; dates move freely-
L1Baselined milestones with DoDEnd of Stage 0
L2Tracked in portfolio tooling; re-baseline governedEnd of Stage 2
L3Variance taxonomy applied consistentlyDuring Stage 2–3
L4Automated reporting into investment governanceWith Stage 3

5. Quality and anti-gaming controls

RiskEffectControl
Baseline driftTarget met by moving datesRe-baseline requires approval; original dates preserved and reported
Milestone inflation“Phase 1 delivered” by renaming half the scopeDefinition of done fixed at baseline; delivery verified against it
External-dependency fogSlippage blamed outward without evidenceVariance taxonomy separates controllable from external; chronic external causes escalated as their own issue
SandbaggingTrivially safe dates guarantee greenInvestment board reviews baseline ambition, not just delivery %

6. Asks of Portfolio Office and the security capability owners

#Ask
1Run re-baseline governance and preserve history
2Track milestones with DoD in portfolio tooling
3Classify variance honestly by the taxonomy
4Review ambition and delivery together at the investment board

ODM-13 · Implementation roadmap

Architectural Lessons Closed

KPI · % of P1/P2 incidents · Green 100 within 90 days, Amber ≥80 (illustrative pending PLA negotiation) · Owner: Security Solutions Architecture lead · Consumer: CISO / Resilience Board · Cadence: Quarterly; cumulative view for small numbers. Organising principle: The lesson must land as a published artefact change, not a lessons-learned document. Documents are where lessons go to be forgotten; patterns and standards are where they change the next design.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of P1/P2 security incidents whose architectural lessons produce a published pattern or standard change within 90 days of incident closure.
Why it mattersIncidents are the most expensive design reviews you will ever run - this metric makes sure you collect the findings. It is the difference between an organisation that has ten years of experience and one that has one year of experience ten times.
NumeratorP1/P2 incidents with a published pattern/standard change within 90 days of closure
DenominatorP1/P2 security incidents closed in the period (including “reviewed, no architectural lesson” with rationale)
The clockStarts at incident closure; stops at publication of the artefact change
Reporting ruleSmall quarterly numbers reported cumulatively over rolling 12 months; adoption of changes checked via ODM-03

2. The data contract (per P1/P2 incident)

#FieldNotes
1Incident ID + priorityFrom incident management tooling
2Closure dateClock start
3Architectural RCA (Y/N + date)RCA template carries a mandatory architecture section
4Lesson classificationPattern change / standard change / no architectural lesson (with rationale)
5Artefact change reference + publish dateRepository change record - the evidence
6Adoption checkDownstream conformance via ODM-03 where applicable

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define3–4 weeksAdd the architecture section to the P1/P2 RCA template; agree the closure-gate rule with incident management.Template updated; gate rule agreed-
1 - Manual baselineQ1–Q2Track incidents on a simple sheet; SSA reviews each P1/P2 RCA; first cumulative cut published.All P1/P2 RCAs reviewed; first cut outDirectional
2 - Standardise at sourceQ2–Q4Pattern/standard change referencing convention; incident closure blocked until the architecture section is complete; 90-day tracking automated from the sheet.No P1/P2 closes without architectural reviewIndicative
3 - Automate & negotiateYear 2Join incident records to repository change records; automated quarterly cut; PLA negotiated with resilience board.Automated join working; clean quarterPLA-grade
4 - InstitutionaliseOngoingQuarterly “lessons landed” review at design authority; chronic lesson themes trigger proactive pattern work.Themes drive pattern roadmapSustained

4. Readiness ladder - Incident Management / SOC and the Design Authority

LevelCriteriaTarget
L0RCAs stop at operational cause; no architectural review-
L1Architecture section in every P1/P2 RCAEnd of Stage 0–1
L2Lessons classified; artefact changes referencedEnd of Stage 2
L390-day clock tracked; closure gate enforcedDuring Stage 2–3
L4Automated incident–repository join; themes reviewedWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Blame-the-analyst RCAsOperational scapegoats, no architectural lesson foundRCA template forces the architecture question; SSA reviews every P1/P2 RCA
Slow-closure gamingIncidents held open to defer the 90-day clockIncident closure SLAs owned by incident management; both clocks reported
Published ≠ adoptedPattern changed, estate unchangedAdoption checked via ODM-03 conformance for affected patterns
Lesson inflationTrivial edits claimed as lessons to hit 100%Design authority validates the change is substantive; “no lesson, here’s why” is an acceptable and honest outcome

6. Asks of Incident Management / SOC and the Design Authority

#Ask
1Adopt the RCA architecture section and closure gate
2Reference repository changes from incident records
3Hold the joint quarterly lessons review
4Accept “no architectural lesson” only with recorded rationale

ODM-14 · Implementation roadmap

Resilience Design Verification

KCI · % of critical services · Green ≥95, Amber ≥85 (illustrative pending PLA negotiation) · Owner: Operational Security Architecture lead · Consumer: Service Owners / Resilience Board · Cadence: Quarterly; rolling 12-month window. Organising principle: The criticality list is the battleground; settle its ownership first. Every service argued off the list is a blind spot with a lobbyist - the list belongs to the resilience board, not to service teams.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of critical services whose recovery architecture has been exercised within 12 months and met agreed RTO/RPO - including compromise-recovery variants.
Why it mattersBackups that have never restored and failovers that have never failed over are hopes, not capabilities. This metric converts recovery from an assertion in a document to a demonstrated, dated result.
NumeratorCritical services exercised within 12 months meeting agreed RTO/RPO
DenominatorAll services on the resilience board’s criticality list
Exercise validityResult recorded against RTO/RPO targets; exercise type recorded (desktop / partial / full / compromise-recovery)
Reporting ruleExercise depth mix reported alongside the % - twelve desktop walkthroughs are not a recovery capability

2. The data contract (per critical service)

#FieldNotes
1Service ID + criticality tierFrom the owned criticality list
2RTO / RPO targetsAgreed with the service owner; versioned
3Last exercise date + typeDesktop / partial / full / compromise-recovery
4Result vs RTO/RPOMeasured, not asserted
5Findings + actionsWith owners and due dates
6Next exercise dueDrives the calendar

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksResilience board confirms ownership of the criticality list and the exercise-validity rules; result-recording template published.List owned; rules and template agreed-
1 - Baseline & triageQ1–Q2Reconcile exercise history against the list (expect a large unexercised backlog); publish the honest baseline; build the exercise calendar.Baseline published; calendar covers the backlogDirectional
2 - StandardiseQ2–Q4Exercises run to calendar with results in the template; depth rotated (desktop → partial → full); findings tracked to closure.On-calendar exercise rate ≥80%Indicative
3 - Extend & negotiateYear 2Compromise-recovery variants added for top-tier services; automated reporting from the exercise register; PLA negotiated.Top tier has compromise-recovery evidencePLA-grade
4 - InstitutionaliseOngoingExercise cadence funded in service budgets; list reviewed annually and on major change.Cadence survives budget cyclesSustained

4. Readiness ladder - Resilience Board and Service Owners

LevelCriteriaTarget
L0No owned criticality list; exercises ad hoc-
L1List owned; exercise history baselinedEnd of Stage 0–1
L2Calendar operating; results recorded vs RTO/RPOEnd of Stage 2
L3Depth rotation including full failover for top tierDuring Stage 2–3
L4Compromise-recovery exercised; automated reportingWith Stage 3

5. Quality and anti-gaming controls

RiskEffectControl
“Test passed” without measurementExercise happened; RTO/RPO unknownTemplate requires measured times; unmeasured exercises do not count
Scope shrinkThe easy component exercised, the service claimedExercise scope defined per service in the validity rules
Criticality-list politicsServices lobby off the list to escape the calendarList owned by resilience board; removals need board sign-off with rationale
Exercise fatigueFull failovers everywhere burn teams and budgetsDepth rotation by tier - full for top tier, partial/desktop below, all measured

6. Asks of Resilience Board and Service Owners

#Ask
1Own the criticality list and its changes
2Fund the exercise cadence in service budgets
3Record results against RTO/RPO in the template
4Accept compromise-recovery exercising for top-tier services

ODM-15 · Implementation roadmap

Early Engagement Rate

KPI · % of Tier-1 initiatives · Green ≥90, Amber ≥75 (illustrative pending PLA negotiation) · Owner: Security Solutions Architecture lead · Consumer: CIO / Delivery Leadership · Cadence: Quarterly, reported with coverage. Organising principle: Measure the relationship, not just the compliance. An engagement rate enforced as a gate but resented in practice will be gamed; pair the rate with security’s own responsiveness (review turnaround, CI-03) so both sides are visibly held to the bargain.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionPercentage of in-scope (Tier-1) initiatives with security architecture engagement completed before build commences.
Why it mattersThe framework’s best leading indicator: when early engagement falls, design defects and rework follow within two quarters. It is also the cultural metric - it measures whether teams come to security by default or under duress.
NumeratorTier-1 initiatives with a qualifying engagement before the build-start event
DenominatorAll Tier-1 initiatives passing build-start in the period
Qualifying engagementDefined minimum (scoping session + risk view), not a calendar invite
Reporting rulePublish the ODM value AND the tier-classification coverage; report security’s review turnaround beside it

2. The data contract (per initiative)

#FieldNotes
1Initiative ID + tierTier assigned by criteria owned outside delivery
2Build-start event dateDefined per methodology (first sprint of build / development gate)
3Engagement date + typeScoping / threat review / design session
4Engagement outcomeProceed / conditions / escalate
5Engaging architectCapacity and coverage planning
6SourcePipeline gate telemetry or engagement log

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define3–4 weeksAgree Tier-1 criteria and their owner; define the build-start event per methodology and the qualifying-engagement minimum.Criteria and definitions signed-
1 - Manual baselineQ1Engagement log maintained by the SSA team; first quarterly cut against the initiative register.One cut published with coverageDirectional
2 - Standardise at sourceQ2–Q3Pipeline/gate tooling captures engagement status; tier classification applied at intake; engagement becomes a gate precondition for Tier-1.≥80% of Tier-1 flowing through instrumented gatesIndicative
3 - Automate & negotiateQ4–Year 2Automated quarterly cut from gate telemetry; PLA negotiated with delivery leadership - two-sided with security’s turnaround commitment.Two-sided PLA agreedPLA-grade
4 - InstitutionaliseOngoingEngagement default in delivery playbooks; repeat-engagement (teams returning voluntarily) tracked as the culture signal.Voluntary early engagement risingSustained

4. Readiness ladder - PMOs and Delivery-pipeline owners

LevelCriteriaTarget
L0Security discovers initiatives at go-live-
L1Initiative register visible; engagements loggedEnd of Stage 1
L2Tier applied at intake; gates instrumentedEnd of Stage 2
L3Engagement precondition enforced with an exception pathDuring Stage 2–3
L4Automated telemetry; voluntary-return rate trackedWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Denominator gamingInitiatives classified out of Tier-1 to dodge the gateTier criteria owned outside delivery; classification coverage reported
Drive-by engagementA calendar invite counted as engagedQualifying-engagement minimum defined; outcomes recorded
Compliance resentmentGate hit, relationship poisoned, quality theatre followsTwo-sided PLA: security is measured on turnaround in the same report
Capacity failureEngagement demand exceeds architect supply and the gate becomes the bottleneckEngagement volume forecast from pipeline; capacity escalated before the gate jams

6. Asks of PMOs and Delivery-pipeline owners

#Ask
1Adopt tier classification at intake
2Instrument gates to capture engagement status
3Enforce the precondition with a sane exception path
4Hold security to its turnaround commitment in the same review

ODM-16 · Implementation roadmap

Capability Uplift

KPI · composite trend · growth year-on-year (targets set after baseline) · Owner: Enterprise Security Architecture lead · Consumer: CIO / HR (capability) · Cadence: Annual, with in-year indicators. Organising principle: Accreditation must mean something and self-service must stay safe. The design authority owns the accreditation bar; self-served designs are sample-checked for conformance (via ODM-03) so speed never silently trades against quality.

Back to index ↑

1. Metric definition and mechanics

AspectDetail
DefinitionNumber of accredited secure-design practitioners in delivery teams, and the percentage of routine designs completed via self-served patterns without security architect escalation.
Why it mattersThe scale-out metric: security architecture cannot review its way to a secure estate. Capability uplift measures whether routine secure design is becoming something delivery teams do, freeing scarce architects for the hard problems.
Component 1Accredited practitioners by team (register, with currency)
Component 2% of routine (pattern-eligible) designs self-served without escalation
Routine definitionDesign classes declared pattern-eligible by the design authority
Reporting ruleTrend-based; self-served share reported WITH its conformance sample result

2. The data contract (per practitioner / design event)

#FieldNotes
1Practitioner recordPerson, team, accreditation level, date, expiry
2Accreditation evidenceAssessment against design-authority criteria
3Design eventProject, design class, pattern used
4Self-served flagCompleted without architect escalation
5Escalation reasonWhere escalated: complexity / gap / confidence
6Conformance sample resultFrom the ODM-03 scan or design spot-check

3. Staged roadmap

StageTimeframeActivityExit criteriaConfidence
0 - Define4–6 weeksDesign authority sets accreditation criteria and the pattern-eligible design classes; register schema agreed with L&D.Criteria and classes published-
1 - BaselineQ1–Q2Count existing practitioners against criteria (expect a small, honest number); baseline self-served share from project records - manual is fine.Baseline publishedDirectional
2 - BuildQ2–Year 2Training pathway live with L&D; pattern library made genuinely self-serveable (guidance, examples, checklists); telemetry started even if manual (pattern pull requests, register lookups).First cohort accredited; self-serve pathway usedIndicative
3 - Measure & negotiateYear 2Trend across two cycles; conformance sampling of self-served designs routine; growth targets agreed with CIO/HR.Two-cycle trend; conformance holdingPLA-grade
4 - InstitutionaliseOngoingAccreditation in role profiles for senior engineers; self-serve default for routine classes; architects redeployed to Tier-1 complexity.Architect time measurably shifted to complex workSustained

4. Readiness ladder - L&D / HR and the Design Authority

LevelCriteriaTarget
L0No accreditation; all designs routed through architects-
L1Criteria published; baseline counted honestlyEnd of Stage 1
L2Training pathway live; first cohort throughDuring Stage 2
L3Self-serve operating for eligible classes with samplingStage 2–3
L4Telemetry-based trend; accreditation in role profilesWith Stage 3–4

5. Quality and anti-gaming controls

RiskEffectControl
Accreditation inflationBar lowered to show growthCriteria owned by design authority; pass rates and assessor calibration reviewed
Unsafe self-serviceSpeed bought with silent quality lossConformance sampling of self-served designs; share reported with its sample result
Telemetry fantasyPattern-usage data assumed where none existsManual proxies for year one (PRs, register lookups, project records) - honestly labelled
Attrition maskingGross accreditations up, net capability flatReport net practitioners by team; concentration risk flagged

6. Asks of L&D / HR and the Design Authority

#Ask
1Co-own the training pathway and accreditation register
2Hold the accreditation bar at design-authority criteria
3Declare and maintain the pattern-eligible design classes
4Fund pattern self-serve usability (examples, checklists) - it is cheaper than architects