PALO

Research dossier · 10 October 2026

Effective oversight and agentic trustworthiness

Connect human intervention, trajectory-level bias and data quality to the evidence supporting each delegated action.

Extension proposal, with tested research code.
Full oversight draft and 106-page bias sneak-peek revision reviewed. Tracked changes and unresolved editorial issues are documented. No live runtime integration, representative-user validation or conformity claim.
90oversight + bias mapping records
61synthetic prototype checks
7existing-fitness probes
Explore the bias demoOversight research screenDownload evidence package

PALO: effective oversight and agentic trustworthiness

Research and extension proposal · 10 October 2026 · Prepared for the European AI Office technical discussion

Decision brief

PALO has a credible foundation for this work: a six-stage governance lifecycle, explicit fairness and data-lifecycle controls, evidence contracts, action-bound approval, data-fitness decisions and outcome verification. The next development step is to connect those foundations to measured human intervention, trajectory-level bias evaluation and multidimensional data fitness. Treating trustworthiness as a single score would weaken that design.

The strongest contribution PALO can bring to the discussion is a reviewable chain from a harm scenario to a selected control, a test, its result, the affected action and an accountable decision. An integration, signed record or successful code test does not establish legal conformity or real-world effectiveness. A person named as a reviewer is not evidence that effective oversight exists.

Six proposed extensions form one coherent work programme:

  1. Scenario-based oversight qualification: reaction windows, complete intervention timing and supported modes.
  2. Human review capacity and independence: realistic load, competence, accessibility, escalation and active challenge.
  3. Verified intervention and recovery: distinguish rejection, substitution, reversal, containment and safe resumption.
  4. Agentic bias assessment: evaluate data, routing, tools, outcomes and repeated feedback at relevant population levels.
  5. Purpose-bound data quality: measure separate dimensions on versioned sources and invalidate dependent decisions after change.
  6. A composed assurance case: preserve applicability, evidence quality, unresolved findings and distinct authority boundaries.

The deliverable includes 45 oversight and 45 bias mapping records, a proposed machine-readable research profile, read-only evidence-screening prototypes and a concrete evaluation programme. The profile is an additive research artifact; it has not been installed into PALO-AI's live enforcement path or accepted as a new canonical framework release.

What was reviewed and source boundaries

The supplied prEN 18229-3:2026, July 2026 enquiry draft was read across all 29 PDF pages. Its scope, definitions, operative clauses, Annex ZA and bibliography were inspected. The reaction-time, intervention and Annex ZA pages were also rendered to check extraction and layout. Clause references below refer to that supplied edition. The PDF and extracted standard text remain outside the public deliverable.

The supplied prEN 18283:2026 N1240 sneak-peek revision, identified on its cover as 16 September 2026, has now been read across all 106 PDF pages. Its visible tracked changes, unstable numbering and editorial conflicts are documented in the reconciliation below. The analysis covers the full supplied text; it does not treat this copy as an adopted standard or a clean final enquiry edition. The earlier public-announcement-only boundary is superseded. Neither supplied PDF nor its full extraction is published. Official public enquiry announcement

The PALO review spans methodology, canonical control and indicator registries, all twelve governance control packs, all six decision gates, relevant evidence schemas, interoperability documentation, runtime data-assurance and approval code, swarm cancellation code, source/version governance and the complete existing 40-slide presentation. A repository inventory records 320 candidate files: 127 resident files and 193 cloud placeholders. Thirty-six selected framework paths were collected as 57 current working-tree and/or published versions, with SHA-256 provenance. Cloud placeholders were not silently treated as reviewed source. Published counterparts were used where needed and are identified in the baseline manifest. This is a cross-layer architecture and evidence assessment, not a line-by-line security audit of every repository file or an independent deployment audit.

The review identifies capabilities in source and published specifications. It does not infer their production deployment from documentation. The current scalar data-fitness function was additionally exercised with seven synthetic in-memory probes. The original research prototype passed 31 synthetic checks; the new fixed-family bias screen passed 30 additional checks. No real company system, worker population, protected group, production connector or live model was evaluated in those checks.

The supplied human-oversight document is an enquiry draft, not an adopted European Standard. Its Annex ZA describes a conditional relationship to Article 14; the table's coverage labels do not themselves establish a current presumption of conformity. A draft crosswalk must not be labelled harmonised compliance. NEN independently identifies the document as a draft for consultation. NEN oversight announcement

The legal baseline was rechecked against the 27 July 2026 consolidated AI Act. Articles 9, 10 and 14 are relevant within their high-risk scope; proportional PALO safeguards can also be adopted for other systems without importing every high-risk duty. Article 10(6) distinguishes testing-data requirements for high-risk systems without model training. The current consolidated text locates the special-category bias-processing provisions in Article 4a, rather than the former Article 10(5). Article 4a(2) covers additional actors/systems under strict conditions, but does not create a general bias-testing obligation. It is not blanket permission to collect demographic data or send it to a cloud copilot. Article 40 conditions presumption of conformity on the applicable published Official Journal references and their scope. AI Act consolidated text

For the RBI-specific draft provisions, Article 14(5) concerns the relevant Annex III biometric-identification systems and includes stated legal exceptions. The two-natural-person arrangement must therefore be handled as an applicability-reviewed profile, not a universal requirement for every agent. Two model agents do not count as two natural persons.

ISO/IEC 5259-2:2024 provides a data-quality model and measures for analytics and machine learning, including structured and unstructured data. Its public overview supports the direction of multidimensional measurement; a licensed full-text crosswalk has not been performed here. ISO/IEC TS 12791:2024 concerns unwanted-bias treatment in classification and regression ML tasks; extending a measure to open-ended agent trajectories requires a separately justified method. ISO/IEC FDIS 42105 remains under development in the official catalogue checked for this review; it is informative background, not a substitute for the supplied European draft. ISO 5259-2, ISO TS 12791, ISO FDIS 42105

The current PALO foundation

The published v3.1 control plane contains 31 controls, 38 indicators, 12 control packs and 6 gates. Its own documentation distinguishes governance completeness, operational effectiveness, production readiness and certification. That separation should be retained, with any completeness statement explicitly tied to a named release, source set and review date. A new draft or operating context can expose additional needs in a previously complete registry.

Layer Evidence found What it establishes What it does not establish
Lifecycle and semantic foundation Frame, Classify, Assess, Control, Measure, Prove; versioned IDs, mapping and release manifests Consistent governance vocabulary and decision/evidence structure Correct legal applicability or effectiveness of an adopter's controls
Human review ctrl-human-review, review completion and override-failure indicators Recognised need for information, authority, time and escalation Scenario-specific response feasibility, safe-state performance or reviewer capacity
Fairness Quality-of-service, allocation and harmful-representation controls; subgroup and residual-disparity indicators Existing scope for group/intersection and whole-system evaluation Automatic fairness testing by the action runtime or valid universal fairness thresholds
Data lifecycle Training, evaluation, prompt, retrieval, embedding and operational lineage; annotation, permission and retention Broad governance scope for data and knowledge assets Scientific validity of labels, representative samples or actual deletion
Data-fitness runtime Required evidence, scalar quality, freshness, purpose, ownership, access, source authority and conservative conflict checks Selected deterministic checks over supplied metadata A multidimensional ISO 5259 implementation, subgroup parity or causal validity
Action and effect Exact Action Claim approval, one-time capability, Effect Contract, receipt, attestation and incident A reference chain separating permission, attempted execution and observed effect Non-bypassability, independent truth of observations or universal exactly-once execution
Distributed work snapshot Shared exposure, authority revocation, cancellation request and separate observation A useful prototype distinction between a stop request and evidence of stopping Deployment-qualified end-to-end containment within every harm window
Rights, competence and management Notice/remedy, accessibility, literacy, AIMS, incident and retirement packs Accountable organisational workflows and evidence expectations Certified management systems, valid legal conclusions or operating effectiveness
Knowledge and copilot Source retrieval, selected-slide context and reasoned assistance Navigation and interpretation support Legal approval, reliable causal explanations, fairness certification or operational intervention

The full twelve-domain review also covers GPAI roles, systemic risk, Article 50, serious incidents, retirement and environmental performance. These remain connected: an oversight change may affect accessibility, energy demand, privacy, provider responsibilities or incident reporting. No domain should be silently marked complete because another domain's metrics are good.

Source pointers: control packs, control library, indicator registry, governance control plane, data-assurance design.

1. Qualify oversight against the action's harm window

The most consequential requirement is the comparison between the available reaction window and a realistically achievable human intervention. Both must terminate when mitigation takes effect. An alert arriving in five seconds is insufficient if interpretation, approval, connector delivery and physical or digital actuation require another minute. An approval TTL describes how long approval is accepted; it is not a measurement of time-to-harm.

For engineering evaluation, PALO should record a complete-loop decomposition:

T_effect = T_queue + T_notification + T_understanding_and_decision + T_actuation + uncertainty_margin

The proposed feasibility screen is T_effect <= T_reaction_window. This is an engineering proposal derived from the draft's timing distinction, not an equation mandated by the draft. It must use a justified operational envelope and end-to-end measurements. Adding component p95 values does not produce an end-to-end p95 guarantee. Minimum feasible human time, a measured response distribution, the tolerated tail probability and any bounded worst-case claim are different quantities and must be labelled separately.

For an agent swarm, shared human attention is a limited resource. Four individually manageable agents can generate a correlated burst of alerts that overwhelms a single person. Measure queue age, simultaneous scenarios, assignment conflicts, shift coverage, handovers, language/accessibility needs and fatigue. Capacity policy must slow or contain the workload when the qualified envelope is exceeded; it must not silently bypass review.

Where no human loop can fit the reaction window, the draft's route is automated protection and retrospective oversight. A pre-execution hold can create time only if it actually prevents the consequential effect and is safe for the process. An industrial process may require controlled degradation rather than an abrupt halt. The operator must qualify that choice.

PALO delta: add a versioned oversight-scenario profile linked to the Case File, Action Claim, harm scenario and evidence bundle. Bind its validity to model/tool/UI versions, staffing assumptions, deployment and workload. Reopen the profile after material change. The existing human-review control remains the anchor; it gains concrete operational evidence rather than a duplicate policy slogan.

2. Separate approval, intervention and safe recovery

PALO already binds approval to the exact Action Claim. That is valuable protection against substituting a different operation after approval. It does not demonstrate that the reviewer understood the action or that an intervention can change an in-flight outcome.

Function Meaning for an agentic workflow Required observation
Disregard Reject a proposed output before any protected action The rejected claim does not execute, including through retries and alternate in-scope routes
Override Halt the original path and introduce a human alternative Original and replacement claims are linked; the alternative receives current policy/authority checks
Reverse Undo an executed effect where technically possible The relevant prior/safe state and affected dependent processes are observed; remaining harm is explicit
Stop / safe-state transition Contain the scenario without creating a greater hazard Verified active/inactive functions, end-to-end transition time and a controlled recovery procedure

The draft requires at least one of disregard, override or reverse, plus a stop function or equivalent procedure. It does not require pretending that every real-world action is reversible. PALO's existing compensation design appropriately uses a new governed Action Claim. A compensating transfer, corrected email or reverted database field does not necessarily erase all effects of the original action.

The proposed event model should distinguish requested → received → applied → externally observed, with late, unsupported and unknown terminal evidence states. A worker acknowledgement is not sufficient. The current cancellation code already makes that distinction through a separately provisioned verifier; qualification must add scenario timing, cross-worker dependencies, network partitions and restart control.

A stop-path study must test the availability of the intervention trigger independently of the failed agent path, stale UI state, connection loss, irreversible actions, partial effects and unsafe automatic resumption. In-flight uncertainty retains the hold and exposure until accountable reconciliation. Do not return a green result merely because no new log line arrived.

3. Assess automation bias as a property of the human-system interaction

Automation bias is not the same as demographic disparity. A reviewer may accept a technically valid, source-cited answer too readily; a demographically balanced model may still induce passive human acceptance. Conversely, an attentive reviewer does not make biased data representative.

Extend PALO's existing explanation and literacy controls with a controlled evaluation: representative designated persons receive a counterbalanced mix of correct, ambiguous and deliberately flawed recommendations under realistic load. Compare UI variants with explicit uncertainty, counter-evidence, alternatives and action consequences. Measure incorrect acceptance, hazard detection, appropriate intervention, time to effective action, review consistency and workload. Record the task mix, training, population, learning effects and uncertainty.

A high override rate is not inherently good: it can indicate model defects, reviewer error or inappropriate thresholds. A low override rate may reflect correct recommendations or ineffective oversight. Review completion, source citation and self-reported confidence should never be substituted for task performance. The copilot should present evidence and concise reasons without suggesting that fluent rationale is proof of correctness.

4. Extend bias assessment from model output to the whole trajectory

The full supplied prEN 18283 revision supports data, component, output and outcome analysis. The stage-specific design below is PALO's agentic application; Sections 7A–7F reconcile it with the supplied clauses and document unresolved editorial issues.

Agentic stage Potential disparity or bias mechanism Evaluation unit and evidence
Input and knowledge retrieval Under-covered language, region, group, source or recency; selective memory Relevant-query cohort, source coverage, retrieval recall, citation support and missingness
Planning and decomposition Different goals, constraints or assumptions for comparable cases Matched task plans, retained requirements and human-coded harmful assumptions
Routing and tool access Some cohorts receive weaker models, fewer retries, worse tools or lower budgets Per-case tool/model allocation, fallback rates, cost/latency and task difficulty
Execution and service A correct answer fails more often when acted upon for a particular group Complete task success, harmful-action and unresolved-error rates with case denominators
Human escalation Some groups face longer waits, inaccessible review or higher abandonment End-to-end review and remedy completion, queue distributions and accessibility evidence
External outcome Allocation, exclusion, exposure or representational harm persists despite valid local actions Affected-person outcomes, approved comparisons and complaint/remedy evidence
Feedback and adaptation Successful-looking biased outcomes become future memory, labels or optimisation targets Versioned feedback lineage, holdout evaluation and change-triggered reassessment

The unit of analysis matters. Ten tool calls from one task are not ten independent people or cases. Repeated interactions, agents sharing a model and overlapping cohorts create dependence. The production analysis should use a design that handles those dependencies, such as justified case-level aggregation or cluster-aware resampling, rather than manufacturing sample size from message counts.

Group definitions, comparator choice, metric direction, utility/harm trade-offs and thresholds require stakeholder and accountable review. Record intersectional groups and unknown membership; protect people from unnecessary inference of sensitive attributes. A small or missing group yields insufficient evidence, not a fairness pass. Examine selection effects: only analysing completed cases can hide who was excluded, abandoned the process or was routed away.

A minimum metric record should include system/model/tool versions, stage, population, evaluation window, selection protocol, denominator, outcome definition, uncertainty method, threshold rationale, exclusions, evidence reference and owner. A rate difference is descriptive unless the study supports a causal claim. Passing one fairness criterion does not establish compliance with anti-discrimination law or absence of representational and individual harm.

The original 0.1 research prototype demonstrates these principles with synthetic binomial outcomes only. It uses separate Wilson intervals as a conservative descriptive screening envelope. This is not a calibrated simultaneous confidence interval for a difference, not a multiple-testing method and not a validated general agentic fairness evaluator. It deliberately returns insufficient evidence when the envelope crosses the illustrative threshold. The separate 0.2 bias screen below adds fixed-family error control and absolute performance criteria; it remains a bounded research method.

5. Replace the scalar-quality inference with purpose-bound dimensions

PALO's current data-fitness evaluator checks an imported scalar score alongside freshness, authority, ownership, approval, lineage, access, incidents, classification and permitted purpose. The synthetic probes confirm those controls behave as expected. They also confirm that the configured scalar policy can return allowed without evaluating subgroup disparity or human reaction time. That is a boundary of the tested policy, not evidence that the framework claims those properties.

A proposed data-quality record should keep separate dimensions and prohibit compensation between critical failures:

Dimension Agentic interpretation Suggested evidence
Accuracy and validity The value or assertion is correct for the stated object and time; units/schema are valid Reference comparison, error sample and schema/unit checks
Completeness and coverage Necessary fields, populations, languages and decision constraints are present Missingness by cohort and stage; retrieval and requirement-coverage tests
Consistency Sources and transformations do not create unresolved contradictory assertions Conflict inventory, reconciliation rule and source/version trace
Timeliness Source age and delay are appropriate to the action and harm window Observation time, validity interval, propagation delay and expiry tests
Representativeness Evaluation supports the relevant target population and context Sampling design, inclusion/exclusion analysis, subgroup adequacy and drift assessment
Provenance and lineage An output or retrieved claim can be traced through transformations Versioned source/transform graph and source authority evidence
Semantic fitness The data actually measures the construct needed for this decision Construct definition, annotation protocol, expert challenge and counterexamples

These are proposed measurement areas informed by the published ISO 5259 direction and PALO's existing lineage controls, not a reproduced or complete ISO 5259 measure catalogue. A reliable source can be outdated; a fresh source can be wrong; complete fields can encode a biased construct; high annotator agreement can preserve a shared misconception.

Quality must be re-evaluated along the trajectory: a summarised memory, retrieved chunk, tool result and generated plan may each change meaning or lose constraints. Bind the decision to purpose, subject/version, source snapshot, metrics and expiry. A model update, new retrieval corpus, changed tool schema, new subgroup or feedback loop should identify and invalidate affected assessments. PALO's assurance-signal and fitness-binding mechanisms provide a useful technical starting point, but a full multi-asset dependency graph and verified enterprise reopening workflow remain development work.

6. Compose a trustworthiness case without a universal trust score

The proposed case structure is:

Claim → applicability and scope → risk scenario → selected controls → independent challenge → evidence and uncertainty → accountable decision → expiry/reopen trigger.

Use distinct results for legal applicability, data fitness, bias evaluation, oversight qualification, action authority, external outcome and production admission. Critical failures are conjunctive: a good fairness result cannot offset a missing stop path, and a safe execution cannot legalise a prohibited purpose. Unknown evidence must remain visible.

Three evidence questions recur: is the artifact authentic and current; is the measurement scientifically and operationally appropriate; and does the claimed conclusion follow? A digest answers an integrity-binding question, not all three. A signed record with a false source assertion remains false. Evidence review must examine source independence, selection, denominators, conflicts and adverse cases.

Provider responsibilities, deployer arrangements, connector/operator obligations, designated-person authority and affected-person remedies belong in one responsibility matrix. Contractual allocation does not automatically eliminate legal duties. The existing system-card, assurance, affected-person and AIMS records can hold most of this structure; the extension should add typed scenario and evaluation records rather than replace them.

Concrete extension architecture

Proposed flow: enterprise evidence adapters → versioned source/quality records → oversight and bias assessment records → composed review dossier → accountable governance gate → existing exact Action Claim / authority path → governed executor → independently observed outcomes → monitoring and reassessment.

The new research profile binds caseId, systemVersion, scenarioId, actionClaimDigest and purpose; it carries reviewed evidence references, an applicability record, complete-loop timing, workload assumptions, intervention declarations, separate data dimensions and cohort comparisons. The prototype accepts a separate expected context so that an old or substituted record cannot silently match itself.

Its results are eligible_for_review, hold and insufficient_evidence. None authorises execution. The program performs structural and numerical screening over supplied records; it does not authenticate an evidence source, confirm that a user study happened or resolve legal applicability. A future production gate must load evidence from a trusted registry, verify signatures and revocation, enforce tenant and role boundaries, validate chronology and measurement units, and prevent unreviewed profile replacement.

For interoperability, use a sidecar evidence record composed into existing Case Files and evidence bundles. Do not insert unknown fields into strict Action Claim 1.4 schemas. A later runtime integration requires a reviewed versioned binding or envelope, compatibility fixtures and migration documentation. Existing stable controls and source IDs must retain their meaning. The first integration should remain in shadow mode: compare assessments without controlling real actions.

Suggested control additions

Proposed control Existing anchor New evidence / acceptance condition
ext-oversight-window ctrl-human-review Complete-loop timing, scenario reaction bounds and operational assumptions
ext-review-capacity ctrl-human-review, literacy Joint-load test, backup coverage, accessibility and bounded assignment policy
ext-safe-state-assurance authority, incidents, override failure Observed containment, dependency handling and recovery qualification
ext-automation-bias-study explanations, literacy Representative-user comparison with deliberately flawed outputs
ext-trajectory-bias fairness, allocation, representation Stage and outcome measures, cohort/sample rationale and residual findings
ext-quality-dimensions data lifecycle, provenance, annotation Separate metrics with units, population, purpose and expiry
ext-assurance-revalidation change gate, semantic mappings Dependency-aware invalidation after evidence or configuration changes
ext-rbi-review-profile human review and identity Optional, legally scoped natural-person review and independence controls

These are proposed extension identifiers, not newly released canonical ctrl-* entries.

7A. Full bias draft reconciliation and source quality

The second supplied document is now available and has been read across all 106 PDF pages, including scope, definitions, Clauses 6–13, informative Annexes A/B/ZA and bibliography. The cover identifies CEN/CLC/JTC 21/WG 3 N1240, 18283_sneak_peek_for_ENQ_15092026, with document date 16 September 2026; the internal title page retains 5 March 2026. This is a supplied sneak-peek revision with visible tracked changes, not a clean final enquiry text and not an adopted standard. PDF page numbers below count the committee cover as page 1. Broken references and changing clause numbers make the heading and page essential identifiers.

Original analysis and the crosswalk are published; the supplied PDF and its full extracted text are excluded from the website, copilot corpus and downloads. Full-text review closes the earlier source-availability gap. It does not establish compliance with a future edition, public availability of this committee copy, or implementation of all its requirements.

Earlier proposal Reconciliation against the supplied text PALO consequence
Trajectory-level bias as a PALO proposal Clauses 6–9 expressly connect data, components, outputs, outcomes, risk and lifecycle evidence Retain the agent-specific mapping; distinguish it from the draft's general requirements
A small cohort yields insufficient evidence Clause 8.2 includes documentation and risk-management handling where suitable testing data cannot be obtained Keep the research screen inconclusive; record any subsequent accountable risk decision separately
Separate 95% Wilson intervals Clause 7.4.4 requires a predefined test-family error limit, allocation method, common confidence level and precision criteria The old envelope remains a descriptive demonstration; it does not implement this protocol
Relative disparity threshold Clause 8 also evaluates group-specific quality or correctness against acceptance thresholds Require absolute fitness and relative disparity evidence; equal poor service cannot pass
Review every operational outcome Outcome analysis contains a visible shall-to-should edit while Clause 8.1 still lists outcomes under a general shall Flag the unresolved force; keep end-to-end outcome evidence as an explicit PALO engineering choice
Reconcile the unavailable bias draft Full supplied text is now reviewed Next: obtain the clean authoritative enquiry edition and resolve editorial questions, then validate implementation

Five source issues need standards-review attention. First, the outcome-analysis modal conflict appears on PDF pages 43 and 50. Second, Clause 6.4.2 asks for disjoint scenario comparison groups, while Clause 8 also uses an unconditioned full-data baseline; record the aggregate diagnostic separately from the disjoint scenario comparison. Third, references such as 10.7[10.8] and repeated 8.3 labels show ongoing renumbering. Fourth, several metric descriptions contain sign, ratio-versus-difference or formatting inconsistencies; do not turn raw PDF extraction into executable formulas. Fifth, Clause 9's visible revision refers to the final pre-deployment iteration for required reporting; it does not support claiming that every historical iteration must be published. PALO can retain the complete internal version history as its own stronger evidence practice.

The draft's informative Annex ZA, PDF page 104, aims at Article 10(2)(f) and (g). It is not a mapping to the whole AI Act. Its conditional language concerning a future Official Journal citation is not a present presumption of conformity. Use the current consolidated legislation and its actual applicability alongside the draft; draft text cannot supply a data-processing legal basis or a certificate. AI Act, Articles 10 and 40

7B. A versioned bias profile as part of the PALO assurance case

Clauses 6 and 7, PDF pages 26–42, make the bias profile a living collection of evidence connected to risk management. This is a particularly good fit for PALO's Case File and evidence-bundle architecture. It should be an evidence sidecar with a defined owner and version, not a new unverified fairness score attached to every Action Claim.

The profile receives inputs from three processes: quality management supplies the intended purpose and system requirements; risk management supplies affected persons, harm scenarios and risk-acceptance criteria; data-quality governance supplies population assumptions, sampling validity, provenance, dimensions and results. Functional-correctness evidence and reusable component profiles are further inputs. Missing inputs must be identified and completed rather than silently omitted.

The proposed PALO sidecar has six linked records:

  1. Profile identity and applicability: source edition, system and component versions, deployment, intended purpose, affected population, legal route, owner and predecessor. Reusing a component creates a scoped reuse review; its previous acceptance does not transfer automatically.
  2. Group and scenario register: category, group definition, relevant intersections, at-risk and vulnerable populations, comparator, hazard, potential cause, hazardous situation and foreseeable harm. Each inclusion, exclusion and grouping decision has a reason and evidence source.
  3. Metric and protocol register: level, task, positive class or outcome, unit, denominator, selection rationale, quality floor, disparity criterion, uncertainty method, family, error allocation, confidence, precision and preregistration record.
  4. Completion and evaluation reports: qualified dataset snapshots, measurement results, all registered comparisons, failed or unavailable evaluations, uncertainty and interpretation. Preserve original and conditioned estimates together.
  5. Risk decision and treatment: accountable reviewer, decision rationale, selected mitigation, trade-offs, residual risk, post-treatment evaluation and monitoring. The numerical evaluator cannot fill this role.
  6. Lifecycle dependencies: source/model/tool/router/UI/policy/memory versions, validity period, incidents, complaints and explicit reopening triggers. Retirement includes retention, deletion and unresolved impacts.

A proposed interoperability flow is: enterprise test or monitoring adapters produce scoped evidence → a bias-profile assembler binds versions and studies → an independent measurement service evaluates the registered protocol → PALO composes findings into the Case File → accountable risk review selects the disposition → existing policy and exact-action authority checks remain necessary → independent observations feed reopening. This is an integration design, not a claim that a new service is already enforcing production traffic.

Sensitive case-level records remain in controlled enterprise storage. PALO receives permitted aggregates and controlled evidence references. The copilot explains the dossier, sources and limitations; it does not invent missing demographic labels, infer protected attributes from a conversation or pronounce a company compliant from an uploaded document.

7C. Agentic scope: where the draft changes the implementation plan

The draft distinguishes the source level of an observation from a potential cause of bias. Data, component, output and outcome are levels. Historical exclusion, automation bias, selection effects and presentation bias are possible mechanisms. A disparity does not prove its cause. This distinction must appear in PALO records and copilot explanations.

Level or mechanism Agentic application Concrete evidence and PALO connection
Data and knowledge Retrieval corpus, embeddings, tool observations, prompts, memory and feedback Per-group coverage, provenance, missingness, freshness, label/construct validity and sampling justification; extend data-lifecycle and fitness records
Component Retriever, planner, router, model, tool selector and verifier Qualified component tests plus intended-context reuse review; a component pass does not prove composite-system performance
System output Plans, recommended actions, allocation of tools/budget, executed instructions Group-specific correctness and allocation metrics with task definitions; bind observations to the action/effect evidence chain
Outcome Successful service, denied access, harmful action, waiting, abandonment and remedy Reliable downstream measurements with complete case denominators; retain unresolved and unsuccessful cases
Human interaction Escalation, acceptance of advice, intervention and appeal Oversight timing/capacity studies alongside accessibility and disparity studies; a trained reviewer is not proof of effective intervention
Adaptation Self-generated memory, optimisation and feedback loops Versioned feedback lineage, stable holdouts, drift and complaints; reopen the relevant profile after change

Clause 7.2 and informative Annex A support considering channel, language, accessibility and intersectional groups where the purpose, evidence and risk analysis justify them. Do not restrict the inventory to attributes explicitly provided to the model. Also do not mechanically collect every sensitive attribute listed in the illustrative lending annex. Relevance, legal authority, data minimisation, measurement validity and affected-person engagement must determine the approach.

For an agentic enterprise-service pilot, define the cohort at case admission, before routing or completion. Measure retrieval sufficiency, tool availability, avoidable retries, escalation delay, verified completion and remedy at successive stages. Publish stage-specific denominators and the end-to-end denominator; otherwise a router can hide excluded users before the model benchmark begins. A tool-call log is not a population sample. Repeated cases, shared users, time effects and clustered deployments require an appropriate dependence-aware design beyond the new fixed-case research screen.

Equal numerical error rates do not imply equal harm severity. A five-minute delay can be harmless in one process and consequential in another. Record both frequency and severity in the risk scenario. The consequence may result from the combined model, interface and human process, so the outcome observation must not be described as causal attribution to one component.

7D. Metric selection: five families and a conditioning layer

Clause 10 provides a non-exhaustive catalogue. The numbers in this supplied revision are unstable after regression: identify each family by its heading and PDF pages. The following is a selection guide for PALO research, not an implementation claim for every metric.

Family What the draft offers Agentic use and limitation
Classification, pages 55–65 Demographic difference/ratio, conditional difference, predictive parity, equal opportunity and predictive equality Admission, escalation or tool-allocation decisions. Specify the beneficial/harmful positive class. Parity of allocation is different from parity of false-positive or false-negative errors; labels and base rates matter
Regression, pages 65–68 Mean output distance and loss difference Predicted waiting time, cost or burden. Preserve units, distributions, loss function and hyperparameters. Equal means can conceal different tails; equal losses can conceal poor absolute performance
Ranking, pages 68–70 Averaged representation difference Retrieval or prioritisation only where group membership of ranked items and the comparison target are meaningful. Register reference shares and cutoff positions. This metric is not a measured user-attention/exposure model
Outcomes, pages 70–73 Outcome demographic difference and ratio Verified task completion, access or remedy. Reliable downstream observation is essential. An outcome gap combines system and surrounding-process effects; a ratio with a zero denominator is undefined
Data, pages 74–77 Relevant group information and label imbalance Diagnostic probes on representations, including embeddings, and label distributions. Recoverable group information is not evidence that the system uses it unfairly; a weak probe near chance does not prove that no stronger probe could recover it
Conditioning, pages 77–81 Stratified and distribution-conditioned versions of a base measure Examine justified task/context differences while retaining the unconditioned finding. Small cells, weak overlap, hidden confounding and feature choice constrain interpretation

The draft's Relevant Group Information procedure specifically constrains the probe's purpose and treats intermediate inferences as sensitive. PALO should isolate these diagnostics, restrict access and retention, and prevent their reuse as an operational demographic inference service. Removal of an explicit attribute does not prove its proxies are absent.

Conditioning is particularly easy to misuse in agents: task complexity, channel and language may affect outcomes, but a feature can also encode the very disadvantage under investigation. Clause 10.7[10.8].2 requires risk-based justification and excludes direct or indirect proxies of the protected attribute under investigation from conditioning features. Retain a reviewed admissibility decision. Do not choose a conditioning variable merely because it makes the disparity smaller.

Report the original and conditioned estimates together. Distribution matching in this draft selects existing comparison observations or uses constrained weights; an observation must not be replicated or receive a weight above one. Document overlap, achieved balance, sample loss and uncertainty. A zero adjusted gap is not causal proof and is not a legal non-discrimination conclusion. Training re-sampling under Clause 12 is a different procedure from constructing the evaluation comparator; permissions and assumptions must not be mixed.

For each metric, use the Clause 11 template: name, alternative names, level, task, intent, motivation, applicability, limitations, inputs, outputs, interpretation, formula/algorithm, references and per-use definitions. A custom agentic measure needs a distinct name, justification and disclosure of limited validation. For the research demo, the endpoint is a binary verified case completion within a defined service window, with difference-of-outcome-rates and separate absolute completion-rate criteria. The profile must justify why comparison is appropriate; it does not cover representational harm, individual fairness, unequal harm severity or every possible outcome.

7E. Statistical acceptance: a measured gap is not a decision

Clause 7.4.4 and Clause 8, PDF pages 40–52, require a protocol chosen before estimation: a family-wise error-rate limit and allocation method for the hypothesis-test family, a common confidence level for estimates, and a maximum permissible margin for each estimate. The family covers the bias hypothesis tests in a procedure iteration. A set of convenient independent 95% intervals does not automatically meet that requirement.

Keep four quantities separate: the absolute performance floor; the acceptable disparity band selected through risk management; the precision limit; and the statistical error budget. A five-percentage-point disparity limit is not a five-percent probability of error. The null described by the draft is non-acceptability; failure to detect a difference is not affirmative evidence of acceptability. In addition, comparisons against a best-performing group selected from observed results need a selection-aware or simultaneous method.

The new bias-evaluation.mjs is a deliberately narrow research implementation. For K registered group means, independent binary cases within each group, fixed sample sizes and unweighted sampling, let alpha be the smaller of the registered FWER limit and one minus the required confidence. For each group with n cases, use radius sqrt(log(2K/alpha)/(2n)) around its observed success rate, clipped to [0,1]. Hoeffding's bound and a union bound yield simultaneous coverage of at least 1-alpha for the registered means under those assumptions. Difference bounds follow by subtracting opposite interval endpoints. Dependence between comparisons does not invalidate the union bound; dependence between cases within a group invalidates this implementation's sampling assumption. Hoeffding, original paper, 1963

This conservative construction is our engineering choice, not an algorithm prescribed by prEN 18283. Simultaneous intervals support the registered floor and equivalence decisions without treating their individual false-acceptance risks as unrelated. No favourable outcome is returned unless every required group and comparison satisfies its floor/band and precision requirement. Bounds crossing a criterion remain inconclusive; bounds entirely on an adverse side flag adverse evidence. Neither state is an accountable legal/risk decision.

An independently supplied digest binds the expected protocol and context. Protocol timestamps must precede collection, missing groups remain in the family, and changed sample sizes are not silently accepted. The digest is an integrity comparison at a caller trust boundary, not an authenticated signature or proof of genuine preregistration. Sampling, representativeness and measurement-review declarations are checked for presence; their truth needs external evidence. Real raw records, deduplication, group disjointness and population validity are not authenticated by this module.

The illustrative fixture uses two disjoint synthetic channels, 10,000 cases each, 95.0% and 94.8% completion, a 90% floor, a ±5 percentage-point disparity band, 95% confidence and a 5% FWER limit. These are demonstration parameters, not recommended regulatory thresholds. The demo also exercises equal poor performance, disparity, uncertainty, missing groups and protocol tampering. The method does not implement classification-error families, regression, ranking, weighted estimators, meta-metrics, optional stopping or correlated/sequential monitoring. If other metrics belong to the iteration, their full family must be integrated and reviewed before claiming iteration-wide control. Cross-iteration monitoring requires a separate sequential error-control design.

The original 31-check oversight/data prototype remains available and retains its scope. Its Wilson-based bias envelope is descriptive only; use the separate fixed-family screen to inspect the new statistical design. Neither prototype is a full implementation or validation of the draft.

7F. Mitigation, consultation and a practical adoption programme

Clauses 12 and 13, PDF pages 82–91, make treatment part of risk management and require evidence beyond a favourable metric. For each mitigation, record the hazard, selected method, rationale, trade-offs, post-treatment results, newly introduced or amplified bias, residual risk and continuing monitoring. Training, representation of affected persons, accessible interaction and organisational procedures are relevant alongside data, model and output interventions.

For PALO, a router change, tool-budget adjustment, revised escalation UI or retriever re-ranking is a controlled intervention. Bind the before/after configurations, test the original target hazard and the other affected groups, repeat oversight-capacity checks, and reopen the corresponding Case File. Better parity must not conceal lower accuracy, worse service for everyone, greater privacy intrusion or an overloaded human-review queue. Synthetic data can help test coverage and rare scenarios; synthetic parity does not validate real-population representativeness.

Consultation is an evidence process, not a generic claim that stakeholders were consulted. Record who participated, group coverage, representative qualifications, timing, accessibility and language accommodations, conflicting views, and the decisions actually changed. If consultation is the selected method, the draft calls for the known at-risk groups, particularly vulnerable groups or representatives. Other evidence routes are available under Clause 13.1; choosing only expert consultation or research requires the stated justification. Reusing earlier consultation requires a justified unchanged deployment context and documented use in the current decision.

The recommended first integration is one bounded enterprise workflow in shadow mode:

  1. Register the purpose, risk route, relevant population, oversight scenario, endpoint and qualified datasets. Resolve draft ambiguities with standards/domain reviewers.
  2. Create the bias sidecar and a complete measurement protocol, with immutable external registration, metric-template records and individual data-quality criteria.
  3. Run paired reference workflows over the same tasks; collect stage and outcome evidence, failed/abandoned cases, workload, interventions and residual impacts.
  4. Challenge protocol tampering, missing cohorts, proxy conditioning, correlated tool-call counts, poor ground truth, favourable aggregate scores and ineffective stop acknowledgements.
  5. Review results with the domain owner, data-quality/statistics lead, human-factors lead and accountable risk owner. Choose proceed, revise or stop without delegating that decision to the copilot.
  6. Only then qualify authenticated evidence exchange, tenant isolation, expiry/revocation, schema compatibility and production admission. A released profile needs registry/mapping/version governance; current strict Action Claim 1.4 fields remain unchanged.

The 45 oversight records and the accompanying bias crosswalk are review work items, not a count of satisfied legal requirements. The strengthened proposal makes PALO more ready for future standards because it can absorb new metrics, source editions and evidence findings without collapsing them into a universal compliance score.

Evaluation programme and release gates

Phase Work and owners Exit evidence
0 — Source and scope Framework maintainers, legal/standards reviewers and domain owners resolve the supplied revision’s editorial issues against the clean enquiry edition, current legal text and versioned mappings Reviewed source dossier, explicit applicability and unresolved questions
1 — Controlled specification Risk, data, HCI and runtime specialists define scenarios, metric protocols, sidecar schemas and evidence trust boundaries Agreed controls, thresholds, test plan and compatibility fixtures
2 — Synthetic comparison Engineers run baseline versus extension on identical seeded tasks and independent holdouts Reproducible results, denied/unknown cases, burden and performance trade-offs
3 — Representative human study HCI researchers and intended users test oversight under load, ambiguity and degraded operation Measured effectiveness and limitations, accessibility and fatigue findings
4 — Isolated enterprise adapter System operators validate identity, data lineage, notifications, execution observation and safe-state paths Deployment-specific negative tests and independent assurance findings
5 — Reviewed release Accountable owners resolve findings, migrate contracts and regenerate semantic/public artifacts Approved version, source/mapping manifest, documented limitations and reopen triggers

No date should be treated as evidence of completion. The twelve-week pilot already proposed in the deck can allocate these workstreams, but duration must depend on access to representative users and valid operating evidence.

Minimum challenge set

Evaluate against a baseline consisting of the existing PALO control path and a documented conventional approval workflow, with comparable task populations. Pre-register the acceptance protocol. Include adverse effects of the extension itself: alert fatigue, extra delay, discriminatory hold rates, privacy intrusion and excessive operator burden.

Deployment and privacy boundaries

Current PALO-AI documentation explicitly describes a developer preview. The runtime uses reference persistence, in-process trust and operator-provisioned connectors. Production readiness still depends on isolation, credential custody, durable recovery, tenant controls, trustworthy observations and independent evaluation. The proposed extension cannot overcome those limits by adding a score or schema.

Bias assessment should minimise personal data. Prefer suitable synthetic or anonymised evaluation where it answers the question; where it does not, use the applicable lawful route and safeguards, with reviewed necessity, restricted access, retention and deletion. Public reports should expose aggregated findings and controlled evidence references. Do not send demographic microdata, raw personnel records or biometric material to the meeting copilot as a shortcut to assessment.

The supplied attachments were analysed as source material. They have not been added to the public site or copied into the copilot corpus. Public materials contain original analytical insights and source references. The new proposal and code are not an endorsement by CEN, CENELEC, ISO or the European Commission.

What changes in the Commission presentation

The existing deck's authority, budget, outcome and recovery material remains relevant. The revision adds a focused trustworthiness sequence: existing foundations and gaps; oversight timing; safe-state evidence; bias across trajectories; data-quality dimensions; and a concrete research-profile/code boundary. Executive viewers receive the key architectural and decision implications; the full route retains the implementation detail.

Existing slides on Article 9/10/14, proportional risk routes, enterprise interoperability, evidence maturity, adversarial testing, measures, the pilot and next steps are updated to connect those concepts. English notes explain the source status and limits. The audience view continues to omit the speaker script. Public slide retrieval is rebuilt from the updated audience content, with the analytical proposal clearly marked as a proposal.

The central meeting claim becomes: PALO can make delegated action and the evidence supporting trustworthiness reviewable across the lifecycle. Effective human control, fair outcomes and fit-for-purpose data require distinct tests and accountable decisions.

Technical evidence index

The full supplied prEN 18283 revision has now been compared. The next source-review step is reconciliation against a clean authoritative enquiry edition, especially outcome-analysis force, comparator rules and renumbered references. The new 45-row bias crosswalk records proposals and evidence needs; it is not an assertion that every draft requirement is implemented.

Executable synthetic example

Challenge the supplied evidence

These scenarios execute the published research evaluator in your browser. They use a fixed synthetic profile and assessment date. They do not inspect your systems, evaluate real people or call an AI provider.

Research evaluator loading…

The dossier and downloadable fixtures remain usable without JavaScript.

Boundary: thresholds and evidence declarations are illustrative. “Eligible for review” is neither execution permission nor a fairness or legal finding. The original Wilson-based bias envelope is descriptive; the separate protocol below demonstrates fixed-family error control. See method and limitations.

Statistical protocol · research 0.2

Equal outcomes can still be unacceptable

Fixed-family, independent binary-case example. Two synthetic channels, 10,000 cases each. A 90% absolute completion floor and ±5 percentage-point disparity band are illustrative choices. Bounds use the preregistered 95% confidence / 5% error budget; no AI call or personal data is involved.

Statistical research screen loading…

Boundary: “Supported” concerns only the registered numerical criteria under declared assumptions. It cannot authorise an action or accept residual risk. Independent case sampling, valid outcome measurement, genuine preregistration and complete family registration require external evidence. Read the method and limits.

Clause-to-evidence mapping

90 points to challenge and qualify

45 oversight and 45 bias records: original analytical paraphrases of the supplied July oversight draft and September N1240 bias revision. Bias headings and PDF pages disambiguate unstable clause numbering. Expand each point to inspect the PALO foundation, gap, proposed extension and acceptance evidence. “Shall”, “should” and “can” are distinguished; applicability still requires review.

90 mapping records

HO-1Provider-oriented, cross-sector scope§ 1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · scope · PDF pages 7
PALO foundation
Case File context, system registry and risk-route assessment
Gap
The presentation must distinguish applicability from a generic maturity score.
Proposed extension
Pin provider/deployer roles, system, intended use, jurisdictions and version before selecting controls.
Acceptance evidence
Reject a scope record with undetermined roles or unreviewed applicability.
Status
partial foundation; extension proposed
HO-2Dependencies on risk, logging and transparency drafts§ 2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · normative references · PDF pages 7
PALO foundation
source registry and semantic mappings
Gap
A mapping to one draft does not cover its dependencies.
Proposed extension
Version-pin each referenced source and maintain change-impact decisions.
Acceptance evidence
Change a referenced draft version and require crosswalk review.
Status
partial foundation; extension proposed
HO-3-4Human role, overload and three different timing concepts§ 3.4 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · definitions · PDF pages 11, 12, 13
PALO foundation
ctrl-human-review; system-card humanOversight
Gap
Approval timestamps do not measure the complete human-to-effect loop.
Proposed extension
Distinguish reaction window, minimum feasible human intervention, response initiation and actuator latency.
Acceptance evidence
Use event timestamps with a common reference and documented clock uncertainty.
Status
partial foundation; extension proposed
HO-5-1Effective oversight protects people and fundamental rights§ 5.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · objectives and informative notes · PDF pages 13
PALO foundation
ctrl-human-review; impact assessment
Gap
A business-loss-only definition misses harm to affected people.
Proposed extension
Use a harm scenario and causal chain; justify oversight within the risk-control hierarchy.
Acceptance evidence
Record technical prevention options and their adequacy before assigning human responsibility.
Status
partial foundation; extension proposed
HO-5-2-1Identify risk scenarios§ 5.2.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 13
PALO foundation
Frame, Assess; ctrl-adversarial-testing
Gap
Generic use-case descriptions do not identify each agent/tool causal chain.
Proposed extension
Scenario IDs link outputs, hazards, downstream effects and affected groups.
Acceptance evidence
Trace each consequential action to an approved scenario and owner.
Status
partial foundation; extension proposed
HO-5-2-2Determine a reaction timeframe for each scenario§ 5.2.2 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 14
PALO foundation
kpi-incident-triage-time; action/capability expiry
Gap
TTL and incident-triage time are not time-to-harm.
Proposed extension
Add reaction-window bounds and their operational justification.
Acceptance evidence
Measure from the relevant hazardous output to mitigation taking effect, with clock uncertainty.
Status
partial foundation; extension proposed
HO-5-2-3Select and justify collectively adequate measures§ 5.2.3 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 14
PALO foundation
ctrl-human-review; lifecycle Control gate
Gap
No typed per-scenario allocation of review modes and measured response budget.
Proposed extension
Link retrospective, alert-triggered and continuous measures to each scenario.
Acceptance evidence
Show that the combined operational loop fits the available time under specified load.
Status
partial foundation; extension proposed
HO-5-2-4When real-time human intervention is infeasible§ 5.2.4 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 14, 15
PALO foundation
Authority gates and guarded execution; preview resource holds
Gap
An approval button cannot protect a subsecond external effect after it starts.
Proposed extension
Specify tested automated protection plus retrospective review; never substitute nominal oversight.
Acceptance evidence
Fast-action fixture holds or applies a validated protective path; human-only configuration fails.
Status
partial foundation; extension proposed
HO-5-2-5Overload and conflicts across simultaneous scenarios§ 5.2.5 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 15
PALO foundation
AI-literacy and human-review controls; swarm exposure bounds
Gap
Exposure reservation is not reviewer-capacity reservation.
Proposed extension
Measure reviewer queues, concurrent alerts, fatigue and conflicting duties; define backup coverage.
Acceptance evidence
Representative-user testing at peak joint load, including correlated alert bursts.
Status
partial foundation; extension proposed
HO-5-2-6Review assignments after changes or monitoring findings§ 5.2.6 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 15
PALO foundation
ctrl-change-gate; assurance signals; immutable version records
Gap
Fitness invalidation does not yet reopen typed oversight qualifications.
Proposed extension
Invalidate scenario qualification on model, tool, UI, staffing, workload or deployment change.
Acceptance evidence
Version change prevents reuse of the old assessment until accountable requalification.
Status
partial foundation; extension proposed
HO-5-3-1Combine oversight categories per scenario§ 5.3.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 15
PALO foundation
PALO lifecycle tailoring
Gap
A single human-in/on/out-loop label loses scenario-specific adequacy.
Proposed extension
Allow several modes per scenario and document why their combination is sufficient.
Acceptance evidence
Two scenarios on one agent can require different modes without ambiguity.
Status
partial foundation; extension proposed
HO-5-3-2-1Retrospective review interface and context§ 5.3.2.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 15, 16
PALO foundation
Receipts, attestations, trace records; system cards
Gap
Technical event logs alone do not demonstrate a usable review interface.
Proposed extension
Associate input references, output, model/version, available scores, alarms and human annotations.
Acceptance evidence
Reconstruct a selected trajectory through authorized evidence access; missing data remains visible.
Status
partial foundation; extension proposed
HO-5-3-2-2Retention, navigation and corrective-action trace§ 5.3.2.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 16
PALO foundation
Lineage, privacy, retention and incident contracts
Gap
Retention periods and filters are not qualified against harm discovery and review tasks.
Proposed extension
Define privacy-minimized review retention, scenario filters and annotation-to-remedy links.
Acceptance evidence
Retrieve a historical case within the justified retention window and verify access restrictions.
Status
partial foundation; extension proposed
HO-5-3-2-3-1Verify review effectiveness and fallback§ 5.3.2.3.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 16, 17
PALO foundation
Generic assurance record and adversarial test controls
Gap
No reviewed user-study evidence in this assessment establishes oversight effectiveness.
Proposed extension
Specify acceptance criteria and degraded-interface/logging fallback.
Acceptance evidence
Representative reviewers detect hazardous cases; outage drill retains required review capability.
Status
partial foundation; extension proposed
HO-5-3-2-3-2Possible retrospective metrics§ 5.3.2.3.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · can · PDF pages 17
PALO foundation
KPI/KRI registry
Gap
Completion rate misses false negatives, inconsistency and fatigue.
Proposed extension
Add review accuracy, missed-harm rate, time distribution, agreement and workload measurements.
Acceptance evidence
Publish denominators, scenario mix and uncertainty; do not label suggested metrics mandatory.
Status
partial foundation; extension proposed
HO-5-3-3-1Design risk-calibrated notifications§ 5.3.3.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 17
PALO foundation
Runtime telemetry; incident records
Gap
An emitted event does not prove it reached an available human in time.
Proposed extension
Specify routing, triggering, acknowledgement and escalation contracts.
Acceptance evidence
Measure end-to-end delivery and mitigation time, including unavailable reviewers.
Status
partial foundation; extension proposed
HO-5-3-3-2Perceivable, interpretable and validated alerts§ 5.3.3.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 18
PALO foundation
Accessibility and explanation-comprehension packs
Gap
Dashboard visibility alone does not validate alert discrimination or prioritisation.
Proposed extension
Test modality, urgency, accessibility and advance warning in the intended environment.
Acceptance evidence
Inject noisy concurrent alerts and verify correct priority and timely action.
Status
partial foundation; extension proposed
HO-5-3-4-1Continuous access to operational and intervention status§ 5.3.4.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 18
PALO foundation
Operational snapshot; execution and cancellation status
Gap
Distributed stop availability and freshness need a reviewer-facing contract.
Proposed extension
Show current actions, stale observations, alerts and available controls separately.
Acceptance evidence
Partitioned worker displays unknown status and cannot be reported safely stopped.
Status
partial foundation; extension proposed
HO-5-3-4-2HMI supports judgment and protects against accidental mitigation§ 5.3.4.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall plus informative guidance · PDF pages 18
PALO foundation
System-card explanation and accessibility controls
Gap
No specific oversight HMI study or accidental-trigger evidence reviewed.
Proposed extension
Use explicit action context, uncertainty and guarded critical controls.
Acceptance evidence
Usability trials cover accidental activation and reversible confirmation design.
Status
partial foundation; extension proposed
HO-5-3-4-3Functions support capability and limitation understanding§ 5.3.4.3 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 19
PALO foundation
Knowledge Reader, system cards, evidence references
Gap
A grounded answer does not demonstrate a reviewer can operate the control.
Proposed extension
Separate explanation, current-state evidence and actual intervention affordances.
Acceptance evidence
Reviewer identifies stale data, unavailable actions and policy limitations.
Status
partial foundation; extension proposed
HO-5-3-4-4Verify task completion within the scenario timeframe§ 5.3.4.4 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 19
PALO foundation
Control tests and generic governance-assurance measurements
Gap
Runtime tests do not establish human task performance.
Proposed extension
Bind the oversight qualification to system/UI version, user population and load envelope.
Acceptance evidence
Predefined task-success and timing criteria must be met before claiming effective oversight.
Status
partial foundation; extension proposed
HO-5-3-4-5Representative usability studies and metrics§ 5.3.4.5 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · should/can · PDF pages 19
PALO foundation
AI-literacy competence and comprehension indicators
Gap
Suggested generic percentages are not evidence-based safety thresholds.
Proposed extension
Pre-register task success, initiation time, misinterpretation and workload criteria.
Acceptance evidence
Compare distributions and failure cases; qualify thresholds as case-specific.
Status
partial foundation; extension proposed
HO-5-4-1Provider-deployer implementation and verification contract§ 5.4.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 20
PALO foundation
Integration guide, enterprise adapters and case owners
Gap
An API contract does not allocate staffing, competence and residual-risk acceptance.
Proposed extension
Create a provider/deployer responsibility matrix with technical, procedural and staffing prerequisites.
Acceptance evidence
Deployer signs measured readiness evidence for each transferred measure.
Status
partial foundation; extension proposed
HO-5-4-2Residual risks and conditions of use§ 5.4.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 21
PALO foundation
System-card limitations; assurance findings
Gap
A residual-risk note needs to constrain operation when a prerequisite is absent.
Proposed extension
Link missing staffing, unavailable monitoring or unqualified connectors to operating restrictions.
Acceptance evidence
Run configuration without required coverage; gate remains held.
Status
partial foundation; extension proposed
HO-5-4-3Deployer notification implementation specification§ 5.4.3 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall when applicable · PDF pages 21
PALO foundation
HTTPS/MCP schemas and event telemetry
Gap
Notification thresholds, payload, modalities and delivery expectations are not a complete qualified specification.
Proposed extension
Publish an integrator contract sufficient to implement and test alerts.
Acceptance evidence
Independent implementer builds the alert path from the specification without hidden assumptions.
Status
partial foundation; extension proposed
HO-5-5-1Design against passive acceptance and over-reliance§ 5.5.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 21
PALO foundation
ctrl-human-review; explanation and AI-literacy packs
Gap
Exact approval proves binding, not independent critical judgment.
Proposed extension
Require active review, counter-evidence access and explicit uncertainty; keep automation-bias risk visible.
Acceptance evidence
Reviewer can reject an incorrect but confidently worded recommendation without workflow penalty.
Status
partial foundation; extension proposed
HO-5-5-2Automation-bias testing§ 5.5.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · can; scenario recommendation uses should · PDF pages 21, 22
PALO foundation
Generic adversarial/user-evaluation framework
Gap
No controlled evaluation of wrong-answer acceptance is available.
Proposed extension
Design counterbalanced trials with intentionally flawed outputs, workload variation and mitigation variants.
Acceptance evidence
Report erroneous acceptance, corrective action and decision quality, with sample and task limitations.
Status
partial foundation; extension proposed
HO-5-6-1Interpretation of capability, scores and unreliability§ 5.6.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 22
PALO foundation
System-card performance and limitations; source-based copilot
Gap
Citation presence and model confidence are not calibrated correctness probabilities.
Proposed extension
Explain measurement meaning, calibration population, unavailable evidence and failure conditions.
Acceptance evidence
Test whether reviewers distinguish source provenance, confidence, data quality and observed effect.
Status
partial foundation; extension proposed
HO-5-6-2Training relevant to oversight tasks and learning feedback§ 5.6.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · should · PDF pages 22
PALO foundation
AI-literacy pack; role-based competencies
Gap
Training may omit whether human corrections enter future learning or agent memory.
Proposed extension
Document correction scope and prevent unreviewed feedback-to-training loops.
Acceptance evidence
Reviewer correctly predicts whether an edit changes only the case or future behaviour.
Status
partial foundation; extension proposed
HO-5-7-1At least one intervention function, plus a stop procedure§ 5.7.1 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 22, 23
PALO foundation
Approval denial, capability revocation, incidents
Gap
These controls do not prove every deployed system can reach an appropriate safe state.
Proposed extension
Declare supported intervention semantics, measured latency and abstention events.
Acceptance evidence
Separate initiated, acknowledged, effected and verified states; require stop capability.
Status
partial foundation; extension proposed
HO-5-7-2Reject output before execution without re-execution§ 5.7.2 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall for disregard · PDF pages 23
PALO foundation
Exact-claim denial and one-time capability
Gap
Workflow retries or alternative credentials can defeat a local rejection.
Proposed extension
Bind the rejected action and invalidate dependent retries; acknowledge the human event.
Acceptance evidence
Rejected output never executes through any in-scope route.
Status
partial foundation; extension proposed
HO-5-7-3Block original action and integrate human alternative§ 5.7.3 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall for override · PDF pages 23
PALO foundation
New Action Claim can bind changed arguments
Gap
A replacement flow is not yet a complete typed override record.
Proposed extension
Link original and replacement claims and revalidate the alternative under current policy.
Acceptance evidence
Original path halts; changed action cannot inherit the old exact approval.
Status
partial foundation; extension proposed
HO-5-7-4Reversal including dependent processes and infeasible cases§ 5.7.4 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall for reverse · PDF pages 23
PALO foundation
Effect Contracts; compensation explicitly requires a new Action Claim
Gap
Automatic rollback is deliberately absent; compensation does not undo every external harm.
Proposed extension
Specify reversibility boundaries, dependency propagation and safe-state fallback.
Acceptance evidence
Undo or compensate a synthetic action; verify downstream effects; retain irreversibility as a finding.
Status
partial foundation; extension proposed
HO-5-7-5Safe state and recovery qualification§ 5.7.5 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall subject to scenario/design conditions · PDF pages 23, 24
PALO foundation
Preview hold, revocation and cancellation mechanisms
Gap
Revocation/worker acknowledgement is not a system-wide safe-state proof.
Proposed extension
Define active functions, independent trigger, transition budget and recovery authority for each scenario.
Acceptance evidence
Test delayed/unreachable workers, harmful abrupt halt and forbidden automatic restart.
Status
partial foundation; extension proposed
HO-5-8-1Prevent action before required natural-person review§ 5.8.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 24, 25
PALO foundation
Approval binding and controlled-executor concepts
Gap
Single-resolver approval is not the draft RBI review barrier.
Proposed extension
Separate optional RBI profile with reviewed legal applicability and two-person barrier.
Acceptance evidence
Unreviewed identification cannot cause an in-scope downstream action or transmission.
Status
partial foundation; extension proposed
HO-5-8-2-1Authenticated review state machine§ 5.8.2.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 25
PALO foundation
Approval statuses and actor identity
Gap
Generic approval statuses do not establish two distinct completed reviews.
Proposed extension
Use review-required, review-complete and rejected with natural-person review records.
Acceptance evidence
Duplicate identity or rejected result cannot complete the gate.
Status
partial foundation; extension proposed
HO-5-8-2-2Evidence required by each reviewer§ 5.8.2.2 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 25
PALO foundation
System-card and artifact-reference patterns
Gap
PALO has no qualified biometric review UI.
Proposed extension
Specify protected access to probe/reference material, quality indicators and context.
Acceptance evidence
Each authorized reviewer can inspect the relevant evidence without disclosure beyond scope.
Status
partial foundation; extension proposed
HO-5-8-2-3Biometric inspection and low-quality alerts§ 5.8.2.3 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 25
PALO foundation
Accessibility and explanation principles
Gap
Image inspection and alert functionality are not implemented by generic PALO evidence forms.
Proposed extension
Keep this as a sector adapter acceptance profile.
Acceptance evidence
Test usable visual comparison and quality alerts with representative operators.
Status
partial foundation; extension proposed
HO-5-8-2-4Explicit decisions, notes and timestamps§ 5.8.2.4 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 25, 26
PALO foundation
Approval rationale and event timestamps
Gap
Passive acknowledgement must not count as substantive review.
Proposed extension
Record separate active decisions and disagreement handling.
Acceptance evidence
No timeout, default choice or page visit completes a review.
Status
partial foundation; extension proposed
HO-5-8-3Distinct identities and sequential-review independence§ 5.8.3 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 26
PALO foundation
Authentication/tenant binding; independent-remedy concept
Gap
Two agents or two clicks by one person are not two natural persons.
Proposed extension
Keep reviewer decisions sealed until independent sequential submission.
Acceptance evidence
Same identity, shared credentials or premature visibility fails the qualification.
Status
partial foundation; extension proposed
HO-5-8-4Review architecture, independence tests and configuration documentation§ 5.8.4 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall within RBI profile · PDF pages 26
PALO foundation
Governance-assurance evidence contract
Gap
A schema-valid record is insufficient evidence of enforced independence.
Proposed extension
Attach architecture and negative integration tests for each review configuration.
Acceptance evidence
Attempt duplicate review and downstream bypass through actual adapters.
Status
partial foundation; extension proposed
HO-5-8-5Reviewer competence and training§ 5.8.5 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall plus recommended competence detail · PDF pages 26, 27
PALO foundation
AI-literacy effectiveness controls
Gap
Generic attendance records do not establish biometric review competence.
Proposed extension
Use system-specific competence and training evidence in the separate RBI profile.
Acceptance evidence
Representative review tasks demonstrate the declared competence.
Status
partial foundation; extension proposed
HO-6-1Oversight content in instructions for use§ 6.1 · P1
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 27
PALO foundation
System cards and integration guides
Gap
Provider/deployer requirements are distributed across artifacts.
Proposed extension
Generate a versioned deployer handover dossier from approved scenario records.
Acceptance evidence
Completeness checks link every applicable instruction to evidence and responsible roles.
Status
partial foundation; extension proposed
HO-6-2Technical documentation for verification and limitations§ 6.2 · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · shall · PDF pages 27
PALO foundation
Evidence bundle and governance-assurance record
Gap
No dedicated collection of timing, overload, fallback and intervention qualification evidence.
Proposed extension
Compose existing evidence records with the proposed oversight scenario profile.
Acceptance evidence
A reviewer can reproduce results and trace failed criteria to open corrective actions.
Status
partial foundation; extension proposed
HO-ZADraft mapping to Article 14 and conditional future presumption§ ZA · P0
Source and force
prEN 18229-3:2026, July 2026 user-supplied enquiry draft · informative · PDF pages 28
PALO foundation
Source-status and legal-applicability controls
Gap
An enquiry draft must not be labelled an adopted harmonised standard or certification.
Proposed extension
Track draft status, published edition and any applicable Official Journal reference separately.
Acceptance evidence
No presumption-of-conformity claim is emitted from a draft crosswalk.
Status
partial foundation; extension proposed
B-01Scope and unwantedness§ 1; 3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · scope/definitions · PDF pages 8, 9, 10, 11, 12
PALO foundation
Risk classification and applicability
Gap
Difference, unwanted bias and unacceptable risk are not identical
Proposed extension
Record intended purpose, harms and accountable acceptability separately
Acceptance evidence
Reviewed applicability and scenario rationale
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-02Lifecycle integration§ 5 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · conceptual model · PDF pages 22, 23, 24, 25, 26
PALO foundation
Six-stage lifecycle
Gap
A one-time model test misses operation and retirement
Proposed extension
Bind bias studies to all affected lifecycle stages
Acceptance evidence
Versioned activity and reopening records
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-03Profile within the risk file§ 6.1 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall/should distinctions · PDF pages 26, 27
PALO foundation
Case File and evidence bundles
Gap
No dedicated executable bias-profile contract
Proposed extension
Create a versioned sidecar without changing strict Action Claim fields
Acceptance evidence
Profile identity, owner, scope and predecessor
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-04Required profile inputs§ 6.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 27, 28
PALO foundation
Data lifecycle and AIMS
Gap
Quality, domain and correctness evidence not composed in one bias protocol
Proposed extension
Join purpose, stakeholders, risk, sampling and correctness inputs
Acceptance evidence
Input register with justified missing-input actions
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-05Profile structure and versioning§ 6.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 28, 29
PALO foundation
Evidence references and semantic versioning
Gap
Threshold and study versions require stronger binding
Proposed extension
Register groups, methods, scenarios, protocol and changes
Acceptance evidence
Independent protocol registry and digest
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-06Scenario and comparator§ 6.4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 29, 30
PALO foundation
Risk scenarios and fairness controls
Gap
Source level, cause and harm may be conflated
Proposed extension
Record hazard, group, cause, situation, harm and disjoint comparator
Acceptance evidence
Scenario-level comparison rationale
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-07Risk-management integration§ 7.1 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; lifecycle integration · PDF pages 31, 32, 33
PALO foundation
Governance gates
Gap
Numerical results cannot accept residual risk
Proposed extension
Separate study findings from authorised risk disposition
Acceptance evidence
Signed reviewed decision and residual-risk record
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-08Affected and relevant groups§ 7.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 34, 35, 36
PALO foundation
Subgroup and allocation controls
Gap
Attribute inventory alone misses channel and vulnerability
Proposed extension
Derive categories and groups from purpose, evidence and harms
Acceptance evidence
Inclusion/exclusion rationale and sources
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-09Intersections and absence of groups§ 7.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; conditional justification · PDF pages 35, 36
PALO foundation
Subgroup indicators
Gap
Small groups could disappear from the assessment
Proposed extension
Keep plausible intersectional risks visible and justify any grouping
Acceptance evidence
Coverage inventory including unresolved groups
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-10Hazards across outputs and outcomes§ 7.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 37, 38
PALO foundation
Effect Contracts and harm scenarios
Gap
Action correctness does not capture consequence severity
Proposed extension
Track agent-stage disparity and downstream harm
Acceptance evidence
Case-level trajectory and harm evidence
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-11Per-group quality and correctness§ 7.4.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 38, 39
PALO foundation
Data fitness and quality-of-service
Gap
Scalar or aggregate quality does not establish subgroup fitness
Proposed extension
Use the same relevant quality/correctness measures per group
Acceptance evidence
Qualified datasets and group-specific measures
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-12Metric selection and custom measures§ 7.4.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 39, 40
PALO foundation
Indicator registry
Gap
Agent metrics need explicit scientific scope
Proposed extension
Justify level, task, hazard coverage and custom names
Acceptance evidence
Clause 11-style metric records
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-13False-acceptance family§ 7.4.4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 40, 41
PALO foundation
Research evidence screening
Gap
Separate Wilson envelopes do not control a test family
Proposed extension
Register the complete iteration family and allocation before estimation
Acceptance evidence
Protocol, FWER budget and multiplicity calculation
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-14Confidence and precision§ 7.4.4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 40, 41
PALO foundation
Measurement methods
Gap
Disparity threshold can be confused with precision
Proposed extension
Store common confidence and per-estimate margin separately
Acceptance evidence
Interval method and precision results
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-15Reopening triggers§ 7.5 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 41, 42
PALO foundation
Incidents, source changes and gates
Gap
Router and memory changes can invalidate acceptance
Proposed extension
Trigger review on purpose, version, population, complaint and drift changes
Acceptance evidence
Dependency-linked reassessment events
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-16Four observation levels§ 8.1 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall with outcome conflict · PDF pages 43
PALO foundation
Stack governance
Gap
Component results may be mistaken for system findings
Proposed extension
Keep data/component/output/outcome evidence separate
Acceptance evidence
Level-specific completion reports
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-17Testing-data qualification§ 8.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 43, 44
PALO foundation
Evaluation lineage
Gap
Convenient samples may not represent target groups
Proposed extension
Approve quality, independence and proxy-sampling validity
Acceptance evidence
Dataset snapshot and sampling review
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-18Data unavailable and privacy§ 8.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; risk-decision route · PDF pages 44
PALO foundation
Privacy and access controls
Gap
Missing data could be interpreted as zero bias
Proposed extension
Return unknown and record the separate risk-management disposition
Acceptance evidence
Necessity, safeguards, limitations and decision
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-19Data bias estimation§ 8.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; renamed subclauses · PDF pages 45, 46
PALO foundation
Data-fitness evidence
Gap
Quality floors and descriptive gaps require distinct checks
Proposed extension
Evaluate per-group quality and registered differences
Acceptance evidence
Completion report with all registered groups
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-20Component analysis§ 8.4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · should; procedural shall when undertaken · PDF pages 47, 48
PALO foundation
Component evaluation
Gap
Optional analysis is not blanket component certification
Proposed extension
Apply the full qualified method where component studies are selected
Acceptance evidence
Component test report and context reuse review
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-21System output analysis§ 8.5 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; visible deletions inspected · PDF pages 48, 49, 50
PALO foundation
Action and output verification
Gap
End-to-end service outputs may escape model-only evaluation
Proposed extension
Evaluate complete system outputs and correctness per group
Acceptance evidence
Output study bound to system version
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-22Outcome analysis§ 8.6 heading · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · should in visible revision; 8.1 conflict · PDF pages 50, 51, 52
PALO foundation
Independent outcome observations
Gap
Modal conflict prevents clean requirement assertion
Proposed extension
Retain outcome studies as PALO engineering control; resolve source force
Acceptance evidence
Measured consequences and editorial issue record
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-23Adaptive best-group comparator§ 8; 9 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · procedure and reporting · PDF pages 45, 46, 48, 49, 51, 52
PALO foundation
Research bias statistics
Gap
Naive pairwise intervals ignore comparator selection
Proposed extension
Use a qualified simultaneous/selection-aware design
Acceptance evidence
All candidate groups and comparison selection trace
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-24Final pre-deployment report§ 9 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; tracked edit · PDF pages 52, 53
PALO foundation
Evidence bundles
Gap
Historical publication cannot be inferred as a universal duty
Proposed extension
Preserve internal version history; identify required final report
Acceptance evidence
Current evaluation with counts, intervals and interpretation
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-25Ongoing detection logs§ 9 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · should · PDF pages 53
PALO foundation
Runtime events and incident packs
Gap
A metric threshold is not itself a risk judgement
Proposed extension
Link detected events to reviewed criteria and reopening
Acceptance evidence
Threshold rationale and monitoring log
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-26Classification metrics§ 10.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · catalogue with per-use requirements · PDF pages 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65
PALO foundation
Allocation and quality-of-service
Gap
Rate parity and error parity answer different questions
Proposed extension
Choose the beneficial/harmful class and error costs
Acceptance evidence
Labels, denominators and complementary measures
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-27Mean and loss differences§ Regression metrics heading · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · catalogue with per-use requirements · PDF pages 65, 66, 67, 68
PALO foundation
Latency and burden measures
Gap
Equal averages hide distribution tails
Proposed extension
Specify units, loss function, tails and task validity
Acceptance evidence
Regression metric record and uncertainty
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-28Ranked representation§ Ranking metrics heading · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · catalogue with per-use requirements · PDF pages 68, 69, 70
PALO foundation
Retrieval and allocation
Gap
Ranking representation is not observed attention
Proposed extension
Register reference shares and task-relevant cutoffs
Acceptance evidence
Ranking protocol and utility trade-offs
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-29Outcome differences and ratios§ Outcome metrics heading · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · catalogue with per-use requirements · PDF pages 70, 71, 72, 73
PALO foundation
Observed effects and remedy
Gap
Downstream processes confound causal attribution
Proposed extension
Use reliable outcome measurements; reject zero ratio denominators
Acceptance evidence
Outcome definitions, measurement review and limits
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-30Representation probes§ Data metrics: RGI · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall on purpose and sensitive intermediates · PDF pages 74, 75, 76
PALO foundation
Embedding lineage and privacy
Gap
Attribute removal does not remove recoverable proxies
Proposed extension
Isolate diagnostic probes; never reuse as production profiling
Acceptance evidence
Access, purpose, split, retention and probe records
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-31Label imbalance§ Data metrics: LI · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · catalogue; formula text corrupted · PDF pages 76, 77
PALO foundation
Annotation and dataset controls
Gap
Label proportions are not absolute sample adequacy
Proposed extension
Check labels, counts, prevalence and source interpretation
Acceptance evidence
Metric definition reviewed independently of extraction
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-32Original plus conditioned results§ 10.7[10.8].1 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 77
PALO foundation
Fairness reporting
Gap
Conditioning can hide the initial disparity
Proposed extension
Publish both findings and distinct interpretations
Acceptance evidence
Paired original/conditioned report
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-33Conditioning admissibility§ 10.7[10.8].2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 78
PALO foundation
Purpose and risk review
Gap
Post-hoc proxy conditioning can rationalise harm
Proposed extension
Review legitimate features and excluded protected-attribute proxies
Acceptance evidence
Predeclared feature justification
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-34Stratified comparisons§ 10.7[10.8].3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; limitations · PDF pages 78, 79
PALO foundation
Intersectional analysis
Gap
Sparse cells destabilise findings
Proposed extension
Assess every registered cell and retain uncertainty
Acceptance evidence
Cell counts, confidence and family membership
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-35Distribution conditioning§ 10.7[10.8].4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall/should distinctions · PDF pages 79, 80, 81
PALO foundation
Sampling and comparative evidence
Gap
Matching may lack overlap or amplify a few records
Proposed extension
Constrain weights/sampling and document balance; no causal claim
Acceptance evidence
Overlap, sample loss, weight limits and sensitivity
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-36Metric template completeness§ 11 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 81, 82
PALO foundation
Registry extension design
Gap
Agent metrics otherwise lack reproducibility
Proposed extension
Record all template elements or justified inapplicability
Acceptance evidence
Named metric, algorithm, limitations and per-use choices
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-37Treatment design§ 12.1–12.3 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall on selection documentation · PDF pages 82, 83, 84
PALO foundation
Control selection
Gap
Mitigation may move harm between groups/stages
Proposed extension
Choose data, computation or organisational measures by scenario
Acceptance evidence
Treatment rationale and expected side effects
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-38People, interaction and access§ 12.4.1–12.4.4 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · method catalogue; external duties separate · PDF pages 84, 85, 86
PALO foundation
Human review, literacy, accessibility
Gap
Human involvement can itself introduce disparity
Proposed extension
Qualify UI, review burden and meaningful participation
Acceptance evidence
Representative-user study and accessibility evidence
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-39Data and model interventions§ 12.4.5–12.4.9 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · method catalogue · PDF pages 86, 87, 88
PALO foundation
Data provenance and change control
Gap
Synthetic/reweighted data may amplify noise or distort targets
Proposed extension
Reevaluate real-world validity and introduced disparities
Acceptance evidence
Before/after datasets and full outcome evaluation
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-40Thresholds, calibration, re-ranking§ 12.4.10–12.4.12 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · method catalogue · PDF pages 88, 89
PALO foundation
Router and policy configuration
Gap
Better parity can reduce utility or create other harms
Proposed extension
Version the intervention and evaluate cross-metric trade-offs
Acceptance evidence
New policy digest and comparative results
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-41Mitigation evidence and residual risk§ 12.5–12.6 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall · PDF pages 89
PALO foundation
Evidence gates and risk ownership
Gap
Selected treatment is not proof of resolution
Proposed extension
Retest target and other hazards; record residual risk and monitoring
Acceptance evidence
Post-treatment findings and accountable decision
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-42Evidence collection§ 13.1 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · shall; alternative evidence routes · PDF pages 90
PALO foundation
Source provenance
Gap
Expert opinion alone may be incomplete
Proposed extension
Record sources and justify expert/research-only selections
Acceptance evidence
State-of-art and impartiality rationale
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-43Meaningful consultation§ 13.2 · P1
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · conditional shall and should · PDF pages 90, 91
PALO foundation
Affected-person and remedy controls
Gap
Nominal consultation does not show influence
Proposed extension
Record representation, access, dissent and actual decision use
Acceptance evidence
Consultation record and reuse-context justification
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-44Illustrative groups and bias causes§ Annex A; Annex B · Review
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · informative · PDF pages 92, 93, 94, 95, 96, 97, 98, 99, 101, 102, 103
PALO foundation
Risk scenarios and case studies
Gap
An illustrative loan case is not a mandatory demographic checklist
Proposed extension
Adapt categories to the agentic purpose and lawful evidence
Acceptance evidence
Scenario-specific relevance, no automatic sensitive inference
Status
Draft analysis / PALO extension proposal; not a conformity finding
B-45Limited intended legal coverage§ Annex ZA · Review
Source and force
prEN 18283 supplied N1240 sneak-peek revision, September 2026 · informative; conditional future relationship · PDF pages 104
PALO foundation
Legal mapping
Gap
Draft mapping is not current harmonised conformity
Proposed extension
Map intended Article 10(2)(f)/(g) support, preserving Article 9/14 scope
Acceptance evidence
Source edition and legal applicability decision
Status
Draft analysis / PALO extension proposal; not a conformity finding

Reviewable and reproducible

Complete original research packageAnalysis · MarkdownOversight · CSVBias · CSVStatistical research code30 bias checksResearch code31 check results

The supplied standard and its extracted text are excluded. Downloads contain original analysis, mappings and synthetic research artifacts.