Paper deep dive
Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation
Zeshen Zheng, Yujia He, Qianmian Lin, Xiangyue Huang, Wenqing Chen
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Fairness evaluation concerns not only what a model produces, but also what its outputs ought to be compared against. When a model generates "a CEO in the United States," the prompt leaves demographic realization to the model. Existing group fairness definitions assume that sensitive attributes are given on the input side. Generative audits instead examine output-side demographic composition, yet the targets they compare it against are typically supplied rather than justified. The upstream question is what the target distribution should be. We formalize this missing-target problem for demographic-value-unspecified generation and decompose target construction into four commitments: the evaluative object, prior admissibility, allocation, and operationalization. In this framework, we admit the geographic prior under a geographic-membership interpretation for the declared public-world use. The occupational prior, under an incumbency interpretation, requires an independently defended objective such as workforce-composition fidelity. Instantiating this construction in AP-Bench, we find substantial distribution divergence from geography-derived targets, ranging from 0.508 to 0.606 on a 0-to-1 scale. Replacing each geography-derived target with an equal-category comparator, while holding generations and measurement fixed, produces model-specific mean absolute cell-level $\mathrm{JSD}_2$ changes ranging from 0.279 to 0.355. Target construction is therefore not a preliminary to fairness evaluation but a component of it. What we supply is not a universal target, but a framework that makes explicit the justification required before a distribution can serve as a fairness standard.
Tags
Links
- Source: https://arxiv.org/abs/2608.02551v1
- Canonical: https://arxiv.org/abs/2608.02551v1
Trouble viewing inline? Open PDF directly ā
Full Text
188,675 characters extracted from source content.
Expand or collapse full text
Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation Zeshen Zheng, Yujia He, Qianmian Lin, Xiangyue Huang, Wenqing Chen Abstract Fairness evaluation concerns not only what a model produces, but also what its outputs ought to be compared against. When a model generates āa CEO in the United States,ā the prompt leaves demographic realization to the model. Existing group fairness definitions assume that sensitive attributes are given on the input side. Generative audits instead examine output-side demographic composition, yet the targets they compare it against are typically supplied rather than justified. The upstream question is what the target distribution should be. We formalize this missing-target problem for demographic-value-unspecified generation and decompose target construction into four commitments: the evaluative object, prior admissibility, allocation, and operationalization. In this framework, we admit the geographic prior under a geographic-membership interpretation for the declared public-world use. The occupational prior, under an incumbency interpretation, requires an independently defended objective such as workforce-composition fidelity. Instantiating this construction in AP-Bench, we find substantial distribution divergence from geography-derived targets, ranging from 0.508 to 0.606 on a 0-to-1 scale. Replacing each geography-derived target with an equal-category comparator, while holding generations and measurement fixed, produces model-specific mean absolute cell-level JSD2JSD_2 changes ranging from 0.279 to 0.355. Target construction is therefore not a preliminary to fairness evaluation but a component of it. What we supply is not a universal target, but a framework that makes explicit the justification required before a distribution can serve as a fairness standard. 1 Introduction We prompted each of six frontier language models to create a CEO in the United States 30 times. Between 77% and 100% of the characters were coded into the female/woman category. Is that a fairness success or a fairness failure? The outputs alone do not determine the answer. Plausible comparators are 33.0% for current U.S. chief executives, 49.8% for the resident population, 50.0% for equal categories, or no distributional target at all (Figure 1) (U.S. Bureau of Labor Statistics 2025; United Nations Department of Economic and Social Affairs, Population Division 2024). Figure 1: Female/woman shares in U.S. CEO generationsāwhat should they be compared with? This is the missing-target problem: the generations induce an empirical composition, but not the target required to evaluate it. Prompts that fix a role and a place but leave demographic values to the model induce an empirical output composition q q (Figure 2). Any target-relative evaluation also requires a target PāP^*. None of the prompt, outputs, available data, or discrepancy functional determines which comparator, if any, should serve as that target. Classical group-fairness criteria assume input-side attributes and decisions; they do not select an output-side target. Generative audits typically characterize defaults or measure deviation from supplied targets, rather than justify why those targets should govern. Across language and image generation, recent work increasingly specifies target distributions and optimizes systems toward them, but generally does not explain why a particular target should govern the evaluation (Shrestha and Srinivasan 2025; Jiang et al. 2026; Nizam and Davis 2026). Figure 2: One omitted demographic value changes the fairness question. A specified value invites a portrayal audit; an unspecified value yields q q, but no warranted target for target-relative evaluationāthe missing-target problem. This omission matters because adopting the current occupational composition as PāP^*, for example, implicitly makes fidelity to the existing labor-market composition the governing evaluative objective. We therefore treat target construction as a distinct evaluative task requiring four commitments. The evaluator must specify (i) the evaluative object, use, and output unit; (i) the relationship that determines whose representation counts; (i) the allocation rule over the resulting domain; and (iv) numerical operationalization. Applying this framework, we admit the geographic prior under a geographic-membership interpretation for the declared public-world use. The occupational prior, under an incumbency interpretation, requires an independently defended objective such as workforce-composition fidelity (Ā§4.2). Equal-person allocation over the admitted public, operationalized with declared resident-population sources, then returns an operational targetānot yet a fairness verdict, which requires separate bridge premises (Ā§4.5). AP-Bench instantiates this construction with 51,840 generations from six models across 12 geographic contexts and six roles. Under joint elicitation, the three-module composite JSD2JSD_2 from geography-derived operational targets ranges from 0.508 to 0.606. Replacing each geography-derived target with an equal-category comparator, while holding generations and measurement fixed, produces model-specific mean absolute cell-level JSD2JSD_2 changes ranging from 0.279 to 0.355 under the stated aggregation hierarchy. ā¢ We formalize the missing-target problem and distinguish references, comparators, and targets. ā¢ We give a four-commitment construction framework and state the bridge required for a fairness claim. ā¢ We introduce AP-Bench and quantify divergence from constructed targets and sensitivity to comparator replacement. 2 Related Work and Applicability Boundary Classical fairness criteria typically presuppose existing persons and input-side groups, together with decisions, outcomes, similarity relations, or causal structures (Castelnovo et al. 2022). Applied to fictional generation, they do not themselves select an aggregate output-side target. Work on generation instead studies three settings: portrayal when a demographic value is specified, defaults when it is omitted, and deviation from supplied targets (Dhamala et al. 2021; Lucy and Bamman 2021; Guan et al. 2025). Across these regimes, behavior is characterized relative to supplied distributions variously termed references, desired distributions, comparison distributions, or targets. We use comparator for this broad analytic role and reserve target for a comparator adopted to govern a declared evaluative use (full comparison in Supplementary Appendix A). Broader work on representation and justice explains why the lack of target justification is consequential. Media and NLP scholarship treats patterned absence and portrayal as representational harms, including symbolic annihilation, stereotyping, demeaning portrayal, and erasure (Tuchman 1978; Blodgett et al. 2020; Corvi et al. 2025). Measurement and critical-classification research shows that constructs and demographic categories are situated rather than neutral givens (Jacobs and Wallach 2021; Hanna et al. 2020). Political-philosophical and participatory work further shows that fairness principles encode distinct commitments and remain open to stakeholder contestation (Binns 2018; Cheng et al. 2021). These traditions establish that target choice is normatively consequential, but they do not determine a target for demographic-value-unspecified generation or explain what would warrant one. Existing work thus explains how to quantify deviations from supplied comparators and why representational gaps may matter, but it does not establish what gives a comparator evaluative authority. We address this upstream question in the specific context of target-relative compositional evaluation for demographic-value-unspecified generation. Specified-group portrayal and representational harm more broadly fall outside our scope. 3 Demographic-Value-Unspecified Text Generation Consider a prompt defined by geographic context G, role R, and generation setting S, which includes its format and prompt regime. The model generates Yā¼M(ā ā£G,R,S),A~k=mk(ek(Y))āk(G)āŖā„,Y M(Ā· G,R,S),\; A_k=m_k(e_k(Y)) _k(G)āŖ\ \, where eke_k extracts the textual realization of demographic attribute k, and mkm_k is a pre-specified evaluator mapping to the source-supported category set kā(G)A_k(G) or to ā„ . We study implicit prompts, which omit demographic attributes, and joint-elicitation prompts, which require gender, race/ethnicity, religion, and sexual orientation but specify neither attribute values nor aggregate proportions. The resulting estimands are spontaneous and elicited composition, respectively. Here, ā„ denotes absent mappable evidence or an out-of-support value. We define Ļkā(G,R,S) _k(G,R,S) =Pr(A~kā ā„ā£G,R,S), = ( A_kā G,R,S), qkā(aā£G,R,S) q_k(a G,R,S) =Prā”(A~k=aā£G,R,S,A~kā ā„). = ( A_k=a G,R,S, A_kā ). We call Ļk _k the mapped-output rate and qkq_k the conditional mapped composition used for target-relative evaluation. A zero category count denotes absence among mapped outputs, whereas ā„ denotes output-level non-mapping; neither measures absolute group visibility. Repeated generations estimate qkq_k but do not determine its target. We distinguish a source-supplied reference PrefP^ref, any comparator C used in dā(q^k,C)d( q_k,C), and a target PāP^* adopted as the standard for a declared use. Section 4 explains what warrants that adoption and what additional premises are required for a fairness claim. 4 Justifying Demographic Targets A reference records what a population looks like; a target governs what a modelās outputs ought to look like. Turning the former into the latter requires four logically distinct commitments. These concern the evaluative object, use, and output unit (Ā§4.1); prior admissibility (Ā§4.2); allocation over the admitted domain (Ā§4.3); and operationalization into a scoreable distribution (Ā§4.4). They are resolved in dependency order. Table 1 summarizes their roles and the consequences of leaving any unresolved. Figure 3 shows the construction adopted here. These commitments yield an operational target. Interpreting divergence from it as fairness requires separate bridge premises (Ā§4.5). Commitment Determines If unresolved Object, use, output unit What is distributed, for what assessment, and what counts as one output observation No determinate target-relative object Prior admissibility Whose representation counts, under which relationship A reference governs without warrant Allocation How mass is divided over the admitted domain No shares; construction abstains Operationalization Taxonomy, mapping, and numerical magnitudes No scoreable distribution Bridge premises What an operational discrepancy licenses No fairness verdict Table 1: Logical roles of the four target-construction commitments and the separate bridge. Figure 3: One explicit target construction for demographic-value-unspecified generation. Step 1 declares the evaluative object, public-world use, and output unit. Step 2 identifies and defends the relationships that determine whose representation counts; geographic membership is admitted for this use, whereas occupational incumbency is not admitted absent a workforce-composition-fidelity objective. Step 3 assigns weights within the admitted domain, and Step 4 operationalizes the induced shares. Admission fixes neither weights nor source shares. Separate bridge premises are required for a fairness claim. 4.1 Evaluative Object, Use, and Output Unit Every target specifies the shares of an object, the purpose for assessing them, and the unit in which they are counted. All three must be specified, but doing so does not yet identify the population to which the shares answer. Representational realization. Our prompts ask a system to invent a role bearer in a stated context, not to identify, predict, or sample an existing person. No invented character has a ground-truth demographic identity, so no single generation is an error. Repeated generation instead produces a distribution over demographic realizations across focal characters, with some states recurring and others absent. This distribution is the evaluative object. The distributed good is representational possibility: the possibility of being realized as a bearer of R in the named social world, rather than access to the real-world role. Patterned absence can therefore be evaluatively relevant even when no single generation is erroneous (Tuchman 1978; Corvi et al. 2025). For the prompts studied here, which do not request historical reconstruction, audience targeting, or workforce simulation, we adopt a contemporary public-world use. The assessment asks how repeated generations distribute that possibility, rather than how accurately the system predicts a person, portrays a specified group, or reproduces a workforce. The output counting unit. Each output observation is one generated focal character. The allocation unit introduced in Ā§4.3 is one member of the admitted reference public. The output unit determines what each generation contributes to the empirical record. The allocation unit determines how representational mass is distributed before aggregation into demographic categories. An output without a reference-mapped value contributes no observation to the conditional mapped composition qkq_k, but remains counted when reporting the mapped-output rate Ļk _k. What remains open. Generated focal characters are invented and stand in no direct identity relation to any particular real person. Declaring the object does not settle whether these representations owe anything to an actual population or which population that would be. Write P for a candidate reference public whose members define the domain over which representational mass is allocated. Section 4.1 leaves the identity of that public open. Identifying P requires a defended relationship explaining why the representation of its members is evaluatively relevant for the declared use (Ā§4.2). Whether a source adequately measures that population is an operationalization question (Ā§4.4). 4.2 Admissible Priors: Relationship Identification and Defense We use demographic prior in a non-Bayesian sense to denote a candidate demographic reference proposed for target construction. It is assessed under a specified relationship that identifies a population and its membership condition. Admitting the prior under that relationship identifies whose representation counts for the declared use. We call this representational standing: the inclusion or exclusion of the identified persons is evaluatively relevant. Admission assigns neither weights nor shares and does not establish source adequacy. Admissible-Prior Principle. A demographic prior may enter target construction only when the evaluator identifies the relationship under which it is proposed and defends why that relationship gives the persons it identifies representational standing for the declared evaluative object and use. Relationship identification. Identifying a relationship requires naming both the population described by the prior and its membership condition. That condition may be residence in a place or incumbency in a role, and must be declared rather than read off the source. The same occupational shares may be interpreted as recording current incumbency or realized access to the role. Naming the population and membership condition makes the priorās proposed use sufficiently determinate to contest; measurement research has long established the contestability of such constructs (Jacobs and Wallach 2021; Selbst et al. 2019). The remaining question is whether the prior may constrain the target under the specified relationship. Source adequacy is addressed in Ā§4.4. Defense. Defense asks what warrants that standing. Admission is not neutral because it selects a relationship as the basis for determining whose representation counts. Existence, accurate measurement, and predictive fit establish descriptive relevance, not standing; naming the population alone is likewise insufficient. A portrayal record and a membership record may cover the same persons while supporting different commitments. The evaluator must therefore defend the relationship under which those persons count. Historically situated categories or measurements do not by themselves disqualify a reference. The relevant question is what commitment admission adds. Because admissibility judgments are indexed to the declared object and use, rejection under one interpretation does not preclude descriptive use or admission under another. Admission restricts the candidate target family without fixing a numerical target. Geographic membership. The geographic prior is proposed under a geographic-membership interpretation, under which PGP_G consists of residents of G, not incumbents of R. For the public-world use declared in Ā§4.1, the prompt asks for an otherwise unspecified bearer of R within the social world named by G. The place identifies the represented public, while the role constrains the focal character without selecting a reference population. We adopt a defeasible represented-public premise: for this use, the demographic inclusion or exclusion of members of PGP_G is evaluatively relevant. Accordingly, treating an identity present among members of PGP_G as incompatible with the represented role R requires justification (Berlin 1955; Gosepath 2015). This concerns demographic compatibility with the represented role, not qualification for or access to the real-world role. A target over qualified, eligible, or potential role bearers would require a separately defended reference relationship. Geographic membership thus identifies whose representation counts but neither assigns weights nor imports population shares. Section 4.3 supplies the allocation rule, and Ā§4.4 asks whether resident-population data adequately measure the induced shares. The promptās locative phrase does not itself entail this interpretation; we adopt it as a premise. Audience targeting, a language-community use, historical reconstruction, or workforce simulation could make another public or relationship relevant (Appendix B). Borders, migration, citizenship, and enumeration practices may also alter the domain or weaken resident population as its proxy (Morning 2008). Occupational incumbency. The occupational prior is proposed under an incumbency interpretation. Its population consists of current role incumbents, whose membership follows from occupying R in G. Unlike geographic membership, incumbency does not identify whose representation counts for the public-world use in Ā§4.1. It identifies a realized subset produced by labor-market allocation. Workforce statistics may measure that outcome accurately, but measurement accuracy does not show that the observed workforce distribution should govern role representations. A generated character can accurately depict the work without reproducing the demographic shares of current incumbents. Admitting the incumbency relationship would commit the evaluation to fidelity toward an outcome produced by historically contingent labor-market and organizational processes. These include education and training, entry and advancement barriers, personnel practices, and discrimination (Blau et al. 2013; Reskin 2003). Such fidelity does not necessarily endorse these causes, and the observed workforce composition cannot show which of its determinants are morally decisive rather than arbitrary in context (Truong et al. 2025). Figure 4 makes this downstream provenance explicit. The observed occupational distribution aggregates differences introduced before and during measurement, screening, and allocation; it does not reveal which of those differences should govern representation. Potential space innate potential at birth Construct space realized abilities Observed space measured proxies Decision space screening and allocation decisions Observed occupational incumbency downstream demographic composition lifeās biasmeasurement biasdirect discriminationrealized decisions Figure 4: Occupational incumbency as a downstream outcome, adapted from Hertweck, Heitz, and Loi (2021, Fig. 1b). Differences may enter during development, measurement, screening, and allocation. The observed distribution alone does not identify which differences are normatively decisive for the declared evaluative use. An objective of workforce-composition-fidelity can be declared. In workforce simulation or historical reconstruction, for example, reproducing the observed composition may be an avowed purpose rather than an unstated consequence. No such objective has been declared for the object and use in Ā§4.1, and the accuracy of workforce statistics cannot supply one. The occupational prior is therefore not admitted here under this interpretation. This does not make it categorically inadmissible. The line drawn is therefore not between geographic and occupational sources, but between the relationships under which the priors are proposed and the defenses offered for each. For the candidates considered here, the geographic prior is admitted under a geographic-membership interpretation for the declared public-world use. The occupational prior under an incumbency interpretation requires an independently defended workforce-composition-fidelity objective. This result supplies no warrant for role-dependent shares, although it leaves open independently defended role-specific allocation rules (Ā§4.3). 4.3 Allocation: From Admitted Priors to Shares An admitted prior, under the relationship for which it was defended, identifies whose representation counts but not how much weight each member receives. Allocation therefore requires a further premise. If none is defended, construction abstains at this stage. Because the allocation rule operates over the admitted reference public, it is defined over members of that public rather than category labels. A member-level rule induces category-level shares, though not conversely. This allocation unit differs from the output counting unit defined in Ā§4.1. Where more than one prior is admitted, the rule must also say how claims grounded in their respective relationships combine. Equal-person allocation. The geographic prior admitted in Ā§4.2 identifies the allocation domain GP_G. We again apply a local presumption of equality. In the absence of a defended allocation-relevant distinction, members receive equal representational weight (Berlin 1955; Gosepath 2015). 111This is an axiom on target construction rather than an individual-fairness criterion: Ļ allocates representational mass over members of a reference public rather than assigning treatment to pre-existing decision subjects (Dwork et al. 2012). The role condition supplies no such distinction among the audited attributes because it fixes R while leaving those attributes unspecified. Current occupational incumbency supplies none either, because the system invents a focal character rather than samples an actual worker. No further allocation-relevant distinction has been defended. Allocation symmetry therefore yields (Ļā(i)=Ļā(j))(Ļ(i)=Ļ(j)) for all i,jāGi,j _G. Aggregation therefore assigns each category its population share within GP_G. Because neither geographic membership nor the adopted rule introduces a role-specific distinction, the resulting target is role-invariant: Pāā(A=aā£G,R)=Pāā(A=aā£G)for all āa.P^*(A=a G,R)=P^*(A=a G) all a. (1) Role invariance follows only after the symmetry premise is added, not from rejecting occupational incumbency. If that premise is rejected and no alternative rule is defended, construction abstains at this stage. Alternative rules. Other rules remain available. Each requires a different allocation premise or a defended basis for differentiation. Equal-category allocation places symmetry over categories rather than persons. Under uniform weighting within each category, each member of a smaller category receives more weight than each member of a larger category. A categoryās smaller population share therefore becomes a shortfall relative to this comparator, even though no member-level representational deficit has been established. Allocated mass also depends on the taxonomy. Splitting one category increases the total mass assigned to its members even when neither the admitted domain nor any member-level distinction has changed. It is nonetheless a fully specified comparator, which is why Ā§5 reports it as a sensitivity result rather than as a rule with equal warrant (Ā§4.5). A minimum-visibility constraint is not by itself a distribution because it must specify the covered groups, thresholds, and allocation of residual mass. Corrective and harm-sensitive rules similarly require a declared objective, the affected groups, the direction and magnitude of adjustment, its basis, and redistribution of the remaining mass. Until these elements are stated and defended, such proposals express an intention rather than define a comparator. Appendix B gives the general form. 4.4 Operationalization: From an Abstract Rule to a Numerical Target Sections 4.1ā4.3 determine an abstract target. The admitted geographic prior identifies the domain GP_G, and allocation symmetry yields equal-person weights within it. What remains is to instantiate the resulting category shares through a declared taxonomy, mapping, and reference source. With resident population declared as the reference source, the operational target becomes Pgeoāā(A=aā£G) P^*_geo(A=a G) =Prefā(A=aā£G) =P_ref(A=a G) (2) ā|iāG:Aā(i)=a||G|, ā |\i _G:A(i)=a\||P_G|, aākā(G). a _k(G). The right-hand side is the share implied by the allocation rule of Ā§4.3; PrefP_ref is its measurable substitute. The approximation depends on how well resident population measures GP_G, so we treat it as an avowed proxy rather than as a definition of the public itself. Resident population can diverge from citizenship, cultural belonging, or the intended audience. Admissibility is therefore distinct from measurement adequacy. A weak proxy challenges the operational target but does not invalidate the admitted geographic prior in Ā§4.2. Section 5 consequently abstains where the declared source frame and pre-specified mapping do not jointly support the comparison. 4.5 From Operational Score to Fairness Claim: The Bridge Sections 4.1ā4.4 return an operational target and, with the composition of Ā§3, a computable number: the operational score dā(q^,Pgeoā)d( q,P^*_geo), reported in Ā§5. A fairness claim is a further step. Write q for the modelās limiting composition, estimated by q q. Let Pā P denote the target that would emerge after exhaustively considering the candidate priors, their relational interpretations and defenses, and the available allocation premises and rules, assuming that this process returns a unique target. Here, d denotes a generic distributional discrepancy functional, instantiated in Ā§5 as base-2 JensenāShannon divergence. Whether the declared object and use admit exactly one such target remains open (Ā§6). A verdict would then concern the estimand dā(q,Pā )d(q,P ). Neither term is directly available: q is unobserved because generation is finite, while Pā P remains unestablished because the justification space has not been exhausted. Bridge premise A (interpretation). For the object of Ā§4.1, compositional unfairness is divergence of the modelās limiting composition from the exhaustively justified target: dā(q,Pā )d(q,P ) orders fairness. A is no formality. It determines the form of a compositional verdict for an object on which no single generation is erroneous. It also ranks models using conditional mapped composition alone. Consequently, two models with identical conditional mapped compositions but sharply different mapped-output rates receive the same ranking (Ā§3).222Criteria that are not scalar discrepancies between distributionsāa floor on visibility, or a penalty on recurring defaultsāwould rank the same generations differently and would need a bridge of their own (Appendix B). What Premise A licenses depends on the target produced by exhaustive construction. Premise B bears the heavier burden. Bridge premise B (adequacy). The operational score inherits that interpretation: dā(q,Pā )Fairnessestimandādā(q^,Pgeoā)Operationalscore. subarraycFairness\\ estimand subarrayd(q,P )\;ā\; subarraycOperational\\ score subarrayd( q,P^*_geo). estimand (unobservable)operational score (Ā§5)q qdā(q,Pā )d(q,P )dā(q^,Pgeoā)d( q,P^*_geo)Pā P PāP^*PgeoāP^*_geofinite generation (Ā§5)candidate space(Ā§4.2ā4.3)source(Ā§4.4)Premise B: ā? ?ā Figure 5: Decomposition of Premise B. The fairness estimand and the operational score differ through finite generation, a declared source, and the examined construction space. Dashed links mark substitutions rather than derivations. In particular, Pā P is not constructed from PgeoāP^*_geo. Premise B requires three substitutions to be adequate. First, q q substitutes for q, which is a statistical issue (Ā§5). Second, resident-population shares substitute for the allocation-rule shares over GP_G, which is a measurement issue (Ā§4.4). Third, the candidate priors examined under their specified relationships and defenses, together with the allocation premises and rules considered here, stand in for an exhaustive construction space. This is a justificatory issue (Ā§4.2ā4.3). Section 5 calibrates the first substitution: even the smallest observed composite exceeds the upper endpoint of the exact-alignment finite-sample reference by more than a factor of fifteen. No sample size resolves the other two. We do not exhaust the construction space, so the third substitution remains unresolved. Section 5 therefore reports two target-relative results. It measures divergence from the geography-derived target justified by the present construction and tests sensitivity to replacing equal-person with equal-category allocation while holding generations, mappings, and aggregation fixed. This replacement isolates the effect of changing the comparator without treating the equal-category comparator as an equally justified target. A matching marginal composition may still coexist with homogeneous portrayal, stereotyped content, or intersectional collapse. Any further construction can change the target only by modifying a relationship, its defense, an allocation premise, or an allocation rule, and justifying that modification within the same framework. 5 AP-Bench: Target Instantiation and Comparator Sensitivity Design. AP-Bench instantiates the four commitments of Ā§4. It treats the public-world realization distribution as the evaluative object and admits the geographic prior under a geographic-membership interpretation. It uses equal-person allocation under the symmetry premise of Ā§4.3 and resident population as the declared source. AP-Bench asks two questions. How far are model-induced compositions from the resulting operational targets? How much does the divergence score change when those targets are replaced with equal-category comparators? The panel contains 51,840 outputs from six models. Each model completes the same 8,640 English-language tasks, spanning 12 geographic contexts, six roles, two generation formats, two prompt regimes, and 30 samples per cell. AP-Benchās primary portfolio contains three demographic modules: race/ethnicity, religion, and sexual orientation. Operational targets retain context-specific source-category support rather than imposing a global taxonomy. Separately, a gender-to-sex proxy compares textual gender realizations with source-reported sex through a predeclared cross-construct mapping. Operational mappability does not establish construct equivalence. A moduleācontext pair is source-scoreable only when a declared source frame and pre-specified mapping jointly support the limited comparison. Accordingly, the gender-to-sex diagnostic is source-scoreable in 12 contexts, religion in 11, sexual orientation in six, and race/ethnicity in five. Outputs without a reference-mapped value are reported as such rather than folded into the nearest category. Every model comparison uses the same common evaluation-cell portfolio, defined in Appendix D. This equalizes evaluation-cell availability across models, but not model-specific mapped-output rates Ļk _k, which are reported separately. Contexts, prompts, sources, mappings, and residual labels are documented in Appendix D. Measurement. An evidence-constrained extractor labels only explicit textual evidence attributable to the focal character. Under the fixed schema, it may not infer identity from names, occupations, or cultural cues. Records that fail validation remain failures rather than being converted into labels. Human validation yields macro-averaged precision of 0.905 and macro-averaged recall of 0.945 (Appendix D). Across joint-elicitation modelāprimary-module pairs, the median cell-level Ļ^k Ļ_k ranges from 0.800 to 1.000. The pooled fifth percentile and minimum are 0.767 and 0.033, respectively (Appendix D). Target-Relative Evaluation. For each source-scoreable cell, the operational score from Ā§4.5 is base-2 JensenāShannon divergence (JSD2ā[0,1]JSD_2ā[0,1]) between q q and PgeoāP^*_geo (Lin 1991). The composite follows a three-level hierarchy, averaging formatārole cells within contexts, contexts within modules, and the three primary modules within models. Equal final-level weighting prevents modules with broader source coverage from dominating. Under joint elicitation, composite JSD2JSD_2 ranges from 0.508 to 0.606 (Table 2). Under exact target alignment, finite-sample central 99% intervals conditioned on observed cell-level mapped counts have upper endpoints of 0.031ā0.033; the smallest observed composite is more than fifteenfold higher, so finite-sample plug-in divergence cannot explain the gap. Under implicit prompting, only the gender-to-sex diagnostic is reportable on cells shared by all models (JSD2=0.116JSD_2=0.116ā0.2910.291). An augmented-state sensitivity assigning zero target mass to ā„ preserves the primary conclusion, with only a GPTāLlama ordering swap (Appendix D). Appendix D reports source scoreability, mapped-output rates, aggregation equations, the bootstrap procedure, and both sensitivity analyses. Comparator sensitivity. To isolate sensitivity to the comparison distribution, the ablation replaces each geography-derived target with an equal-category comparator over the same support while holding generations, extractions, mappings, source-category support, the common evaluation-cell portfolio, scoring, and aggregation fixed. The comparator uses category rather than person symmetry (Ā§4.3). Across models, the substitution yields mean absolute cell-level JSD2JSD_2 changes of 0.279ā0.355 (Table 2). Across diagnostic tolerances Ļā0.1,0.2,0.3Ļā\0.1,0.2,0.3\, 12.8ā40.0% of hierarchy-weighted cells change classification. Changes occur in both directions; lower equal-category aggregates do not imply uniform improvement. Appendix D reports the classification rule, full sensitivity curves, and directional partitions. Model Geography-derived target Equal-category Mean |Īcell|| _cell| GPT-5.6 0.561 0.493 0.355 Claude Sonnet 5 0.599 0.558 0.330 Gemini 3.5 Flash 0.508 0.462 0.279 Kimi K3 0.554 0.486 0.333 Llama 4 Maverick 0.556 0.487 0.311 Qwen3.7-Max 0.606 0.536 0.333 Table 2: Joint-elicitation three-module composite JSD2. Mean |Īcell|| _cell| is the absolute cell-level change from comparator replacement; the gender-to-sex diagnostic is excluded. 6 Limitations and Conclusion Open problems. Two relationships and two allocation rules do not exhaust the space. A better-defended construction can replace ours. It must specify and defend both the relationship defining its domain and the allocation premise dividing mass within that domain. A new relationship must name its population and membership condition and explain why that relationship makes representation evaluatively relevant for the declared use. A differential allocation rule must state which distinctions it treats as relevant and how they alter weights. Whether the declared object and use admit exactly one justified construction remains open. Establishing uniqueness would discharge the third substitution in Premise B (Ā§4.5), but doing so would require an exhaustive search over candidate constructions. Criteria that are not distributional discrepancy measures, such as a visibility floor, require their own justification. The evidence is narrower than the framework: six models, twelve contexts, one language, marginal rather than intersectional composition, and divergence rather than harm. The multi-attribute results characterize composition under joint elicitation. A randomized protocol check found differences across regimes that varied by model and attribute (Appendix D). These results should therefore not be interpreted as estimates of demographic composition under implicit prompting. The gender-to-sex result is an avowed cross-construct diagnostic, not evidence that textual gender realization and source-reported sex are the same construct. Conclusion. What this paper supplies is not a universal target but a burden of proof. Any target-relative evaluation of demographic-value-unspecified generation must answer four questions before elevating a reference distribution into a standard. What does repeated generation distribute? Which prior, under which relationship and defense, identifies whose representation counts? How is representational mass divided within that domain? Which source instantiates the resulting target? These questions remain even when our particular answers are rejected. They recur wherever outputs are scored against a distribution whose evaluative authority has not been derived, including synthetic participants, persona pipelines, and diversity objectives in retrieval (Argyle et al. 2023; Venkit et al. 2025; Geyik et al. 2019). Two conclusions are especially consequential. The geographic prior is admissible under a geographic-membership interpretation and our represented-public premise: for the declared public-world use, the demographic inclusion or exclusion of members of the named public is evaluatively relevant. The occupational prior under an incumbency interpretation requires an independently defended objective such as workforce-composition fidelity rather than serving as a default target. Under the generated-character output unit and the public-member allocation unit adopted here, equal weighting applies to members of the allocation domain rather than to category labels. Equal-person allocation is therefore a conditional construction with a commitment of its own, not a neutral fallback. The result is a benchmark whose assumptions can be challenged rather than hidden. Each commitment is explicit, so rejecting one reveals what must be reconsidered. Fairness evaluation will gain little from finer discrepancy measures until it can say why a distribution deserves to be the standard. Who should be generated is a question every evaluator answers when choosing a target. It should be answered explicitly. References L. P. Argyle, E. C. Busby, N. Fulda, J. R. Gubler, C. Rytting, and D. Wingate (2023) Out of one, many: using language models to simulate human samples. Political Analysis 31 (3), p. 337ā351. External Links: Document Cited by: Ā§6. Australian Bureau of Statistics (2021) Religious affiliation in australia: 2021 census. Note: https://w.abs.gov.au/statistics/people/people-and-communities/cultural-diversity-census/latest-releaseTable 3; accessed July 21, 2026 Cited by: Table 9. Australian Bureau of Statistics (2024) Estimates and characteristics of lgbti+ populations in australia, 2022. Note: https://w.abs.gov.au/statistics/people/people-and-communities/estimates-and-characteristics-lgbti-populations-australia/latest-releaseTable 2.3; accessed July 8, 2026 Cited by: Table 9. I. Berlin (1955) Equality. Proceedings of the Aristotelian Society 56, p. 301ā326. Cited by: Ā§4.2, Ā§4.3. R. Binns (2018) Fairness in machine learning: lessons from political philosophy. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency, Proceedings of Machine Learning Research, Vol. 81, p. 149ā159. External Links: Link Cited by: Ā§2. F. D. Blau, P. Brummund, and A. Y. Liu (2013) Trends in occupational segregation by gender 1970ā2009: adjusting for the impact of changes in the occupational coding system. Demography 50 (2), p. 471ā492. External Links: Document, Link Cited by: Ā§4.2. S. L. Blodgett, S. Barocas, H. DaumĆ© I, and H. Wallach (2020) Language (technology) is power: a critical survey of ābiasā in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, p. 5454ā5476. External Links: Document, Link Cited by: Ā§2. A. Castelnovo, R. Crupi, G. Greco, D. Regoli, I. G. Penco, and A. C. Cosentini (2022) A clarification of the nuances in the fairness metrics landscape. Scientific Reports 12, p. 4209. External Links: Document Cited by: Appendix A, Appendix A, Table 3, Table 3, Table 4, Ā§C.1, Ā§2. E. Chen, R. Zhan, Y. Lin, and H. Chen (2025a) More women, same stereotypes: unpacking the gender bias paradox in large language models. In Proceedings of the 34th ACM International Conference on Information and Knowledge Management, p. 4639ā4643. External Links: Document, Link Cited by: Table 3. Y. Chen, V. C. Raghuram, J. Mattern, R. Mihalcea, and Z. Jin (2025b) Causally testing gender bias in LLMs: a case study on occupational bias. In Findings of the Association for Computational Linguistics: NAACL 2025, p. 4999ā5019. External Links: Document, Link Cited by: Table 3. H. Cheng, L. Stapleton, R. Wang, P. Bullock, A. Chouldechova, Z. S. Wu, and H. Zhu (2021) Soliciting stakeholdersā fairness notions in child maltreatment predictive systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, p. 1ā17. External Links: Document Cited by: Ā§2. M. Cheng, E. Durmus, and D. Jurafsky (2023) Marked personas: using natural language prompts to measure stereotypes in language models. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics, p. 1504ā1532. External Links: Document, Link Cited by: Table 3. E. Corvi, H. Washington, S. Reed, C. Atalla, A. Chouldechova, P. A. Dow, J. Garcia-Gathright, N. J. Pangakis, E. Sheng, D. Vann, M. Vogel, and H. Wallach (2025) Taxonomizing representational harms using speech act theory. In Findings of the Association for Computational Linguistics: ACL 2025, Vienna, Austria, p. 3907ā3932. External Links: Document, Link Cited by: Ā§2, Ā§4.1. E. Derner and K. BatistiÄ (2025) Gender representation bias analysis in LLM-generated czech and slovenian texts. In Proceedings of the 10th Workshop on Slavic Natural Language Processing, p. 124ā135. External Links: Document, Link Cited by: Table 3. J. Dhamala, T. Sun, V. Kumar, S. Krishna, Y. Pruksachatkun, K. Chang, and R. Gupta (2021) BOLD: dataset and metrics for measuring biases in open-ended language generation. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, p. 862ā872. External Links: Document, Link Cited by: Table 3, Ā§2. C. Dwork, M. Hardt, T. Pitassi, O. Reingold, and R. Zemel (2012) Fairness through awareness. In Proceedings of ITCS, Cited by: Table 3, Table 4, footnote 1. D. M. Endres and J. E. Schindelin (2003) A new metric for probability distributions. IEEE Transactions on Information Theory 49 (7), p. 1858ā1860. Cited by: Ā§B.2. B. Fuglede and F. TopsĆøe (2004) Jensenāshannon divergence and hilbert space embedding. In Proceedings of the IEEE International Symposium on Information Theory (ISIT), p. 31. Cited by: Ā§B.2. S. C. Geyik, S. Ambler, and K. Kenthapadi (2019) Fairness-aware ranking in search and recommendation systems with application to linkedin talent search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p. 2221ā2231. External Links: Document, Link Cited by: Ā§6. S. Gosepath (2015) The principles and the presumption of equality. In Social Equality: On What It Means to Be Equals, C. Fourie, F. Schuppert, and I. Wallimann-Helmer (Eds.), p. 167ā185. External Links: Document Cited by: Ā§4.2, Ā§4.3. X. Guan, N. Demchak, S. Gupta, Z. Wang, E. Ertekin Jr., A. Koshiyama, E. Kazim, and Z. Wu (2025) SAGED: a holistic bias-benchmarking pipeline for language models with customisable fairness calibration. In Proceedings of the 31st International Conference on Computational Linguistics, p. 3002ā3026. External Links: Link Cited by: Table 3, Ā§2. A. Hanna, E. Denton, A. Smart, and J. Smith-Loud (2020) Towards a critical race methodology in algorithmic fairness. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, p. 501ā512. External Links: Document Cited by: Ā§2. M. Hardt, E. Price, and N. Srebro (2016) Equality of opportunity in supervised learning. In Advances in Neural Information Processing Systems, Cited by: Table 3, Table 4. C. Hertweck, C. Heitz, and M. Loi (2021) On the moral justification of statistical parity. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, p. 747ā757. External Links: Document Cited by: Appendix A, Ā§B.1, Ā§B.1, Ā§B.1. Instituto Brasileiro de Geografia e EstatĆstica (2019) Pesquisa nacional de saĆŗde 2019: orientaĆ§Ć£o sexual autoidentificada da populaĆ§Ć£o adulta. Note: https://ftp.ibge.gov.br/PNS/2019/Orientacao_Sexual_Autoidentificada_da_Populacao_Adulta/PNS_2019_Orientacao_Sexual_Autoidentificada_xls.zipAccessed July 8, 2026 Cited by: Table 9. Instituto Brasileiro de Geografia e EstatĆstica (2022) Censo demogrĆ”fico 2022: populaĆ§Ć£o por cor ou raƧa, sidra table 9605. Note: https://apisidra.ibge.gov.br/values/t/9605/n1/all/v/93/p/2022/c86/allxtAccessed July 21, 2026 Cited by: Table 8. A. Z. Jacobs and H. Wallach (2021) Measurement and fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, External Links: Document Cited by: Ā§2, Ā§4.2. Y. Jiang, A. Keleg, R. Diandaru, J. H. Lau, L. Frermann, B. Fang, and F. Koto (2026) Controlling distributional bias in multi-round LLM generation via KL-optimized fine-tuning. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), p. 17634ā17649. External Links: Document, Link Cited by: Table 3, Ā§1. F. Kamiran, I. ŽliobaitÄ, and T. Calders (2013) Quantifying explainable discrimination and removing illegal discrimination in automated decision making. Knowledge and Information Systems 35 (3), p. 613ā644. External Links: Document Cited by: Ā§C.1. M. J. Kusner, J. Loftus, C. Russell, and R. Silva (2017) Counterfactual fairness. In Advances in Neural Information Processing Systems, Cited by: Table 3, Table 4. P. Lahoti, N. Blumm, X. Ma, R. Kotikalapudi, S. Potluri, Q. Tan, H. Srinivasan, B. Packer, A. Beirami, A. Beutel, and J. Chen (2023) Improving diversity of demographic representation in large language models via collective-critiques and self-voting. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, p. 10383ā10405. External Links: Document, Link Cited by: Table 3. P. Liang, R. Bommasani, T. Lee, D. Tsipras, D. Soylu, M. Yasunaga, Y. Zhang, D. Narayanan, Y. Wu, A. Kumar, B. Newman, B. Yuan, B. Yan, C. Zhang, C. Cosgrove, C. D. Manning, C. RĆ©, D. Acosta-Navas, D. A. Hudson, E. Zelikman, E. Durmus, F. Ladhak, F. Rong, H. Ren, H. Yao, J. Wang, K. Santhanam, L. Orr, L. Zheng, M. Yuksekgonul, M. Suzgun, N. Kim, N. Guha, N. Chatterji, O. Khattab, P. Henderson, Q. Huang, R. Chi, S. M. Xie, S. Santurkar, S. Ganguli, T. Hashimoto, T. Icard, T. Zhang, V. Chaudhary, W. Wang, X. Li, Y. Mai, Y. Zhang, and Y. Koreeda (2023) Holistic evaluation of language models. Transactions on Machine Learning Research. External Links: Link Cited by: Table 3. J. Lin (1991) Divergence measures based on the shannon entropy. IEEE Transactions on Information Theory 37 (1), p. 145ā151. External Links: Document Cited by: Ā§5. L. Lucy and D. Bamman (2021) Gender and representation bias in GPT-3 generated stories. In Proceedings of the Third Workshop on Narrative Understanding, Virtual, p. 48ā55. External Links: Document, Link Cited by: Table 3, Ā§2. A. Morning (2008) Ethnic classification in global perspective: a cross-national survey of the 2000 census round. Population Research and Policy Review 27 (2), p. 239ā272. External Links: Document, Link Cited by: Ā§4.2. National Center for Health Statistics (2024) National health interview survey 2024: sample adult public-use file. Note: https://ftp.cdc.gov/pub/health_Statistics/nchs/Datasets/NHIS/2024/adult24csv.zipSexual-orientation variables; accessed July 8, 2026 Cited by: Table 9. M. B. Nizam and J. Davis (2026) Who defines fairness? target-based prompting for demographic representation in generative models. arXiv preprint arXiv:2604.21036. External Links: Document, Link Cited by: Table 3, Ā§1. Office for National Statistics (2021a) Census 2021: ethnic group (ts021), england and wales. Note: https://w.nomisweb.co.uk/output/census/2021/census2021-ts021.zipAccessed July 21, 2026 Cited by: Table 8. Office for National Statistics (2021b) Census 2021: religion (ts030), england and wales. Note: https://w.ons.gov.uk/datasets/TS030/editions/2021/versions/3Accessed July 21, 2026 Cited by: Table 9. Office for National Statistics (2021c) Census 2021: sex (ts008), england and wales. Note: https://w.ons.gov.uk/datasets/TS008/editions/2021/versions/4All usual residents; accessed July 21, 2026 Cited by: Ā§D.2, Table 8. Office for National Statistics (2021d) Census 2021: sexual orientation (ts077), england and wales. Note: https://w.ons.gov.uk/datasets/TS077/editions/2021/versions/2Accessed July 8, 2026 Cited by: Table 9. F. Ćsterreicher and I. Vajda (2003) A new class of metric divergences on probability spaces and its applicability in statistics. Annals of the Institute of Statistical Mathematics 55 (3), p. 639ā653. Cited by: Ā§B.2. Our World in Data (2025) Religious composition by country, based on pew research center estimates. Note: https://ourworldindata.org/grapher/religious-compositionProcessed data for 2020; accessed July 21, 2026 Cited by: Table 9. J. Pan, C. Raj, and Z. Zhu (2026) Bias association discovery framework for open-ended LLM generations. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 32637ā32645. External Links: Document, Link Cited by: Table 3. S. Passi and S. Barocas (2019) Problem formulation and fairness. In Proceedings of the Conference on Fairness, Accountability, and Transparency, p. 39ā48. External Links: Document Cited by: Appendix A. Pew Research Center (2025) How the global religious landscape changed from 2010 to 2020. Note: https://w.pewresearch.org/religion/2025/06/09/how-the-global-religious-landscape-changed-from-2010-to-2020/Global religious-composition estimates; accessed July 21, 2026 Cited by: Table 9. R. Qadri, M. DĆaz, D. Wang, and M. Madaio (2025) The case for āthick evaluationsā of cultural representation in AI. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, Vol. 8, p. 2067ā2080. External Links: Document Cited by: Ā§E.4. B. F. Reskin (2003) Including mechanisms in our models of ascriptive inequality. American Sociological Review 68 (1), p. 1ā21. External Links: Document Cited by: Ā§4.2. Y. Ritov, Y. Sun, and R. Zhao (2017) On conditional parity as a notion of non-discrimination in machine learning. arXiv preprint arXiv:1706.08519. External Links: Link Cited by: Table 4, Ā§C.1. A. D. Selbst, d. boyd, S. A. Friedler, S. Venkatasubramanian, and J. Vertesi (2019) Fairness and abstraction in sociotechnical systems. In Proceedings of the Conference on Fairness, Accountability, and Transparency, p. 59ā68. External Links: Document Cited by: Ā§4.2. E. Sheng, K. Chang, P. Natarajan, and N. Peng (2019) The woman worked as a babysitter: on biases in language generation. In Proceedings of EMNLP-IJCNLP, External Links: Link Cited by: Table 3. E. Shieh, F. Vassel, C. R. Sugimoto, and T. Monroe-White (2026) Intersectional biases in narratives produced by open-ended prompting of generative language models. Nature Communications 17, p. 1243. External Links: Document, Link Cited by: Table 3. I. Shrestha and P. Srinivasan (2025) LLM bias detection and mitigation through the lens of desired distributions. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, p. 1464ā1480. External Links: Document, Link Cited by: Table 3, Ā§1. E. M. Smith, M. Hall, M. Kambadur, E. Presani, and A. Williams (2022) Iām sorry to hear that: finding new biases in language models with a holistic descriptor dataset. In Proceedings of EMNLP, External Links: Link Cited by: Table 3. Statistics Canada (2021) 2021 census of population: census profile, canada. Note: https://w12.statcan.gc.ca/census-recensement/2021/dp-pd/prof/details/download-telecharger/comp/getFile.cfm?LANG=E&GEONO=001&FILETYPE=CSVVisible-minority and religion classifications; accessed July 21, 2026 Cited by: Table 8, Table 9. Statistics Canada (2024) Distribution of sexual orientation, canada: 2024 census test and 2019 to 2021 canadian community health survey. Note: https://w12.statcan.gc.ca/census-recensement/2026/ref/98-20-0003/982000032024002-eng.cfmTable 6.1; benchmark uses the 2019ā2021 CCHS column; accessed July 8, 2026 Cited by: Table 9. Statistics South Africa (2022) Census 2022 statistical release. Note: https://census.statssa.gov.za/assets/documents/2022/P03014_Census_2022_Statistical_Release.pdfPopulation-group tables; accessed July 21, 2026 Cited by: Table 8. Statistics South Africa (2024) Census 2022 in brief. Note: https://w.statssa.gov.za/publications/Census2022inBrief/Census2022inBriefJune2024.pdfTable 3.9, religious belief; accessed July 21, 2026 Cited by: Table 9. Stats NZ (2024) 2023 census place and ethnic group summaries. Note: https://tools.summaries.stats.govt.nz/New Zealand national religious-affiliation comparison; accessed July 21, 2026 Cited by: Table 9. Stats NZ (2025) LGBT+ population of aotearoa new zealand: year ended june 2025. Note: https://w.stats.govt.nz/information-releases/lgbt-population-of-aotearoa-new-zealand-year-ended-june-2025/Tables 2 and 3; accessed July 8, 2026 Cited by: Table 9. K. L. Truong, A. Zimmermann, and H. Heidari (2025) Toward valid measurement of (un)fairness for generative AI: a proposal for systematization through the lens of fair equality of chances. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, Vol. 8, p. 2535ā2549. External Links: Document Cited by: Ā§B.1, Ā§4.2. G. Tuchman (1978) Introduction: the symbolic annihilation of women by the mass media. In Hearth and Home: Images of Women in the Mass Media, G. Tuchman, A. K. Daniels, and J. BenĆ©t (Eds.), p. 3ā38. Cited by: Ā§2, Ā§4.1. U.S. Bureau of Labor Statistics (2025) Labor force statistics from the current population survey: employed people by detailed occupation, sex, race, and hispanic or latino ethnicity. Note: https://w.bls.gov/cps/cpsaat11.htmAnnual averages, Table 11; accessed June 18, 2026 Cited by: Ā§D.8, Ā§1. U.S. Census Bureau (2020) 2020 census redistricting data (p.l. 94-171), table p2: hispanic or latino, and not hispanic or latino by race. Note: https://w2.census.gov/programs-surveys/decennial/2020/data/01-Redistricting_File--PL_94-171/National/us2020.npl.zipNational file; accessed July 21, 2026 Cited by: Table 8. United Nations Department of Economic and Social Affairs, Population Division (2024) World population prospects 2024: the 2024 revision. Note: https://population.un.org/wpp/2023 estimates at 1 July; accessed July 21, 2026 Cited by: Ā§D.2, Table 8, Ā§1. I. van der Linden, S. Kumar, A. Dixit, A. Sudan, S. Danda, J. Dietrich, D. C. Anastasiu, and K. Lukoff (2026) Generating the modal worker: a cross-model audit of race and gender in LLM-generated personas across 41 occupations. In Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency, p. 7835ā7863. External Links: Document, Link Cited by: Table 3. P. N. Venkit, J. Li, Y. Zhou, S. Rajtmajer, and S. Wilson (2025) A tale of two identities: an ethical audit of human and AI-crafted personas. arXiv preprint arXiv:2505.07850. External Links: Link Cited by: Ā§6. S. Verma and J. Rubin (2018) Fairness definitions explained. In Proceedings of the International Workshop on Software Fairness, Cited by: Table 3, Table 4. Y. Wan and K. Chang (2025) White men lead, black women help? benchmarking and mitigating language agency social biases in LLMs. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, p. 9082ā9108. External Links: Document, Link Cited by: Table 3. I. M. Young (1990) Justice and the politics of difference. Princeton University Press. Cited by: Ā§E.4. Supplementary Material Organization. This supplement develops the arguments and empirical checks summarized in the main paper. Appendix A formalizes the applicability boundary of Main Ā§2. Appendix B develops the scope, limits, and bridge analysis of Main Ā§4, while Appendix C considers two alternatives that remain informative without selecting a target. Appendix D documents AP-Benchās prompt protocol, source scoreability, extraction, common-support identification, aggregation, and sensitivity analyses. Appendices E and F clarify corrective target families and artifact provenance. Appendix A Applicability Boundary Appendix A expands the applicability boundary summarized in Main Ā§2. The question is not whether the listed criteria are useful in their intended settings, but whether their standard inputs and semantics determine an aggregate output-side target Pāā(Aoutā£G,R)P^*(A_out G,R) for demographic-value-unspecified generation. Table 3 maps the setup supplied by five research families. Table 4 then states the formal prerequisites of representative classical fairness criteria. The former is a task-level map. The latter establishes criterion-level non-derivation. Across the five families of Table 3, existing methods presuppose an input-side identity, a prompt-specified value, a descriptive reference, or a supplied target. None justifies which aggregate output-side demographic target should govern demographic-value-unspecified generation. Closest conceptual connections. Normative justification of fairness criteria. Hertweck et al. (2021) provide a closely related normative analysis in the predictive-decision setting. They argue that neither the mathematical properties of statistical parity nor the causal provenance of observed group differences suffices to determine whether independence should govern an evaluation. The justification also depends on what the decision distributes and on the claims or utilities at stake. Their analysis presupposes input-side groups and a decision rule, and therefore does not identify an aggregate output-side demographic target for demographic-value-unspecified generation. We draw on their stage model in Ā§B.1 to clarify why occupational incumbency is not self-justifying as a representational target. The transfer from metric selection to target construction is our adaptation rather than their conclusion. Problem formulation and target construction. Passi and Barocas (2019) show in supervised data-science practice that translating high-level goals into prediction targets and measurable proxies is discretionary, negotiated, and normatively consequential. Their target variable is an outcome to be predicted, not an output-side distribution adopted as an evaluative standard. The connection is therefore at the level of problem formulation. Our framework makes explicit the evaluative object and use (Main Ā§4.1) and separately identifies the source and mapping used to operationalize the resulting target (Main Ā§4.4). Formal prerequisites of classical fairness criteria. Table 4 gives the formal conditions of the principal classical criteria. The group-level criteria (rows 1ā9) are conditions on a decision d d about existing individuals whose input feature vector includes a sensitive attribute AinA^in. Separation and accuracy criteria additionally condition on a ground-truth outcome Y. The information-restriction criterion (row 10) excludes AinA^in from the decision ruleās admissible input features. The individual-similarity criterion (row 11) is a condition on pairs of existing individuals with respect to a task-specific distance. The causal criteria (rows 12ā13) are conditions over a structural causal model, with AinA^in as the intervened variable. We write AinA^in for this input-side role and reserve AoutA^out for the demographic realization of a generated character. Under their standard semantics, these criteria presuppose structures absent from the present taskāpre-existing individuals, input-side sensitive attributes, ground-truth outcomes, or a structural causal modelāand even if adapted to generated outputs, they do not by themselves identify an aggregate output-side demographic target. Why each criterion cannot select PāP^*. The thirteen rows of Table 4 fail for different reasons, so we take them in order. Demographic / statistical parity (row 1, independence). The criterion equalizes the decision rate across input groups, Pā(d^=1ā£Ain=a)=Pā(d^=1ā£Ain=aā²)P( d=1 A^in=a)=P( d=1 A^in=a ). It presupposes that every unit carries an input-side sensitive attribute and that a decision is emitted per unit. AP-Bench has no input-side AinA^in. The prompt fixes a role and a place and leaves demographics unspecified, and demographic quantities arise only after generation as AoutA^out. Substituting the realized AoutA^out for d d still requires the input-side partition that demographic-value-unspecified generation lacks. Under its standard semantics, the criterion presupposes that partition, which the present task does not supply. Conditional demographic parity (row 2, independence). Conditioning on legitimate factors L does not repair the missing input-side partition. It adds a normative choice on top of it. The conditioning set already carries normative content. For example, taking L=YL=Y reduces conditional demographic parity to equalized odds (row 4) (Castelnovo et al. 2022), which is why the choice of L cannot be read off the data (Appendix C). Family Representative criteria or works Required or supplied setup Unresolved boundary Group fairness Independence: demographic/statistical parity, conditional demographic parity; separation: equalized odds, equality of opportunity, predictive equality; sufficiency: predictive parity, calibration within groups; accuracy parity (Hardt et al. 2016; Verma and Rubin 2018; Castelnovo et al. 2022) Pre-existing individuals; input-side group attribute AinA^in; decision or score; observed outcome for separation, sufficiency, and accuracy criteria Fictional outputs have no ground-truth identity or outcome; the criteria do not select an aggregate output-side PāP^* Individual fairness Fairness Through Awareness (metric fairness); counterfactual and path-specific counterfactual fairness (Dwork et al. 2012; Kusner et al. 2017; Castelnovo et al. 2022) Existing individual(s); a task-specific similarity relation or a structural causal model, depending on the criterion Generated characters are not fixed individuals available for matched or causal comparison; no aggregate PāP^* follows Group portrayal Regard evaluation; BOLD; HolisticBias; Marked Personas; LABE (Sheng et al. 2019; Dhamala et al. 2021; Smith et al. 2022; Cheng et al. 2023; Wan and Chang 2025; Pan et al. 2026) A demographic value or group anchor is supplied; portrayal, toxicity, regard, stereotype, or agency is then scored How values should be allocated when the prompt supplies none Unspecified-value audits GPT-3 Stories; diversity under underspecification; Czech/Slovenian story audits; Shieh et al.; More Women, Same Stereotypes; Modal Worker (Lucy and Bamman 2021; Lahoti et al. 2023; Derner and BatistiÄ 2025; Shieh et al. 2026; Chen et al. 2025a; van der Linden et al. 2026; Chen et al. 2025b) The prompt leaves a value unspecified; outputs are measured, sometimes against a selected empirical reference Defaults and reference-relative differences are identified, but descriptive fit does not warrant PāP^* Supplied-reference evaluation and target control HELM; SAGED; desired-distribution evaluation and control for language models; target-based prompting for text-to-image generation (Liang et al. 2023; Guan et al. 2025; Shrestha and Srinivasan 2025; Jiang et al. 2026; Nizam and Davis 2026) A uniform, empirical, customizable, retrieved, or user-defined comparator or objective is supplied Deviation, calibration, or control is operationalized; why the comparator should govern fairness remains open Table 3: Applicability boundary. The first two rows separate group-level criteria from individual-level criteria by their formal requirements. The remaining rows locate generation evaluations by what their setup supplies. Each family is useful within its intended setup, but none by itself warrants an output-side demographic target for demographic-value-unspecified generation. Criterion (family) Formal condition Why it does not select an output-side PāP^* Demographic / statistical parity (independence) Pā(d^=1ā£Ain=a)=Pā(d^=1ā£Ain=aā²)P( d=1 A^in=a)=P( d=1 A^in=a ) Needs an input-side AinA^in on each unit and a decision d d per unit. The prompt has neither Conditional (statistical) demographic parity (independence) P(d^=1ā£L=l,Ain=a)=P(d^=1ā£L=l,Ain=aā²)P( d=1 L=l,A^in=a)=P( d=1 L=l,A^in=a ); equivalently d^āAinā£L d A^in L Needs legitimate factors L, input AinA^in, and a decision Equality of opportunity (separation) P(d^=1ā£Y=1,Ain=a)=P(d^=1ā£Y=1,Ain=aā²)P( d=1 Y=1,A^in=a)=P( d=1 Y=1,A^in=a ) Needs Y and input AinA^in Equalized odds (separation) P(d^=1ā£Y=y,Ain=a)=P(d^=1ā£Y=y,Ain=aā²)P( d=1 Y=y,A^in=a)=P( d=1 Y=y,A^in=a ) for yā0,1yā\0,1\; equivalently d^āAinā£Y d A^in Y Needs Y and input AinA^in Overall accuracy equality (accuracy parity) Pā(d^=Yā£Ain=a)=Pā(d^=Yā£Ain=aā²)P( d=Y A^in=a)=P( d=Y A^in=a ) Needs Y and input AinA^in Treatment equality (separation) FPa/FNa=FPaā²/FNaā²FP_a/FN_a=FP_a /FN_a Needs confusion-matrix counts, hence Y and d d Predictive parity / outcome test (sufficiency) P(Y=1ā£d^=1,Ain=a)=P(Y=1ā£d^=1,Ain=aā²)P(Y=1 d=1,A^in=a)=P(Y=1 d=1,A^in=a ) Needs a ground-truth outcome Y. A fictional character has none Test fairness / calibration (sufficiency) P(Y=1ā£S=s,Ain=a)=P(Y=1ā£S=s,Ain=aā²)P(Y=1 S=s,A^in=a)=P(Y=1 S=s,A^in=a ) Needs a calibrated score S, Y, and input AinA^in Balance for positive / negative class (sufficiency) Eā[Sā£Y=y,Ain=a]=Eā[Sā£Y=y,Ain=aā²]E[S Y=y,A^in=a]=E[S Y=y,A^in=a ], yā0,1yā\0,1\ Needs S, Y, and input AinA^in Fairness through unawareness (information restriction) d^=fā(XāAin) d=f(X_ A^in) for a deterministic f; equivalently, AinA^in is excluded from the decision ruleās admissible input features A condition on the inputs to a decision rule about existing individuals. Its content is that AinA^in is not an admissible feature. When the task supplies no input-side A, the condition is satisfied vacuously and neither detects output-side composition defaults nor selects a target Individual fairness / fairness through awareness (individual) Dā(Mā(xi),Mā(xj))ā¤kā(xi,xj)D(M(x_i),M(x_j))ā¤ k(x_i,x_j) Needs existing individuals and a task-specific similarity metric k Counterfactual fairness (causal) Pā(d^Aināa=cā£X=x)=Pā(d^Aināaā²=cā£X=x)P( d_A^inā a=c X=x)=P( d_A^inā a =c X=x) Needs a structural causal model and existing individuals Unresolved discrimination (causal) No path from AinA^in to d d in the causal graph except via resolving variables Needs a causal graph over individuals. The graph-free reading does not exhaust all no-proxy-discrimination definitions Table 4: Formal conditions of classical fairness criteria. The input-side sensitive attribute is written AinA^in, and Y is the ground-truth outcome. References cover independence, separation, sufficiency, and individual criteria (Verma and Rubin 2018; Hardt et al. 2016; Dwork et al. 2012), conditional demographic parity (Ritov et al. 2017), counterfactual fairness (Kusner et al. 2017), and the broader taxonomy (Castelnovo et al. 2022). Equality of opportunity (row 3, separation). The criterion compares decision rates among units with a positive ground-truth outcome, P(d^=1ā£Y=1,Ain=a)=P(d^=1ā£Y=1,Ain=aā²)P( d=1 Y=1,A^in=a)=P( d=1 Y=1,A^in=a ). It requires Y and input-side AinA^in. A generated character has no true demographic label that is right or wrong, so conditioning on Y=1Y=1 is undefined. Equalized odds (row 4, separation). Equalized odds conditions on both outcome values, P(d^=1ā£Y=y,Ain=a)=P(d^=1ā£Y=y,Ain=aā²)P( d=1 Y=y,A^in=a)=P( d=1 Y=y,A^in=a ) for yā0,1yā\0,1\. It inherits the same requirement. Without a ground-truth Y, true positives, false positives, and false negatives are undefined. This is the paperās point that no single generation is an error. Overall accuracy equality (row 5, accuracy parity). The criterion equalizes Pā(d^=Yā£Ain=a)P( d=Y A^in=a) across input groups. It is a condition on decision errors relative to a ground-truth outcome. Without Y, there is no accuracy to equalize and no input-side AinA^in to group by. Treatment equality (row 6, separation). The criterion compares error-rate ratios, FPa/FNa=FPaā²/FNaā²FP_a/FN_a=FP_a /FN_a . It needs confusion-matrix counts, hence both Y and a per-unit decision. Neither exists for generated characters. Predictive parity / outcome test (row 7, sufficiency). The criterion conditions on the predicted decision, P(Y=1ā£d^=1,Ain=a)=P(Y=1ā£d^=1,Ain=aā²)P(Y=1 d=1,A^in=a)=P(Y=1 d=1,A^in=a ), and requires the ground-truth outcome Y. A fictional character has none. Test fairness / calibration (row 8, sufficiency). Calibration requires a calibrated score S and ground truth Y, with P(Y=1ā£S=s,Ain=a)=P(Y=1ā£S=s,Ain=aā²)P(Y=1 S=s,A^in=a)=P(Y=1 S=s,A^in=a ). There is no per-generation score that could be calibrated against a nonexistent Y. Balance for positive / negative class (row 9, sufficiency). Balance conditions equalize expected scores within outcome classes, Eā[Sā£Y=y,Ain=a]=Eā[Sā£Y=y,Ain=aā²]E[S Y=y,A^in=a]=E[S Y=y,A^in=a ] for yā0,1yā\0,1\. They require S, Y, and input-side group membership. All three are absent. Fairness through unawareness (row 10, information restriction). The criterion requires d^=fā(XāAin) d=f(X_ A^in) for a deterministic f, thereby restricting the decision ruleās admissible inputs. It is a condition on a decision rule about persons, not on the aggregate output-side composition of generated text. One might object that the generation prompt indeed carries no demographic input, so the model is trivially āunaware.ā Yet trivial satisfaction says nothing about the composition that the benchmark evaluatesāit neither detects the systematic defaults we measure nor selects a target. Individual fairness (row 11, individual). The criterion constrains pairs of existing individuals, Dā(Mā(xi),Mā(xj))ā¤kā(xi,xj)D(M(x_i),M(x_j))ā¤ k(x_i,x_j). It needs existing individuals and a task-specific similarity metric k. Generated characters are not fixed individuals available for matched comparison, and no similarity metric over fictional persons returns an aggregate output-side distribution. Some formulations further shift the similarity to the target space and thereby rely on the ground-truth Y (Castelnovo et al. 2022), which is equally absent. Counterfactual fairness (row 12, causal). The criterion intervenes on the sensitive attribute in a structural causal model, Pā(d^Aināa=cā£X=x)=Pā(d^Aināaā²=cā£X=x)P( d_A^inā a=c X=x)=P( d_A^inā a =c X=x). It requires a structural causal model and existing individuals. There is no causal model of a fictional character, and no input-side attribute to intervene upon. Unresolved discrimination (row 13, causal). The criterion forbids paths from AinA^in to the decision except through resolving variables. It needs a causal graph over individuals. The graph-free reading does not exhaust all no-proxy-discrimination definitions, and over fictional characters there is neither a graph nor an input-side AinA^in to trace. Consequence. None of the thirteen conditions returns an aggregate Pāā(Aoutā£G,R)P^*(A^out G,R). Each constrains a decision or its errors. The benchmarkās questionāwhich aggregate demographic composition should govern repeated demographic-value-unspecified generationāis left open by all of them. This is the missing-target problem of the main paper in formal form. Appendix A therefore establishes an applicability boundary, not a claim that the reviewed criteria are defective or irrelevant. Each remains useful in its native setting, and none supplies the missing target. Appendix B Scope and Limits of the Normative Argument Appendix B does not derive a second target construction. It develops four questions left intentionally open by Main Ā§4. It explains why observed occupational incumbency cannot supply its own warrant, how the operational score differs from the fairness estimand, what follows when justified constructions are non-unique, and the explicit conditions under which equal-person allocation induces population-proportional category shares. Non-uniqueness and multiple publics. The main paper establishes one admissibility verdict, one allocation premise, and its resulting rule. It does not claim that population proportionality is uniquely correct. Audience, deployment locale, prompt language, genre, and declared purpose may identify publics beyond the geographic one. A prompt can add another relationship within the named place. āA doctor serving an impoverished districtā connects identity to social position in a way that an ordinary role-and-place prompt does not. Several priors may therefore be admitted at once, and the principle gives no general rule for combining them. This issue does not arise in AP-Bench, which admits only the geographic prior under a membership interpretation for ordinary character generation under the evaluative object of Main Ā§4.1. It remains a limit of the general framework. Why geography and occupation are examined. AP-Bench examines geographic membership and occupational incumbency because the prompt explicitly supplies both a place G and a role R. Population composition and workforce composition are therefore two immediately available empirical references that an evaluator might plausibly elevate into targets. The pair is diagnostic rather than exhaustive. Both references are descriptively relevant to the prompt, but each enters through a different demographic relationship. Illustrative competing publics and relationships. The represented-public premise of Main Ā§4.2 does not make residence the uniquely relevant relationship for demographic-value-unspecified generation. Different declared uses can identify different publics, or different relationships to the same persons. Table 5 makes several alternatives explicit. They are not rejected candidates in AP-Bench. Most are not adjudicated because the benchmark prompts do not specify the corresponding use, reference class, or membership condition. Candidate relationship Membership condition Use under which it may be relevant Status in AP-Bench Geographic public Residence in G Contemporary public-world representation Admitted under the represented-public premise Civic public Citizenship or legal membership in G Civic or national representation Not adjudicated; citizenship is not the declared relationship Audience public Membership in the intended audience Audience-targeted generation Not adjudicated; the audience is unspecified Language community Membership in a linguistic community Language- or culture-targeted representation Not adjudicated; English prompting does not identify the represented public Deployment public Exposure to the deployed system Deployment-specific representational evaluation Not adjudicated; the deployment population is unspecified Occupational incumbency Current incumbency in R within G Workforce-composition fidelity or historical reconstruction Not admitted for the declared public-world use under the incumbency interpretation Table 5: Illustrative alternatives to the relationship adopted in AP-Bench. The table records candidate interpretations, not an exhaustive construction space or a ranking of publics. A change in declared use can change the admissibility verdict. The contrast is not that geographic membership is historically or politically neutral while occupational incumbency is socially produced. Residence, citizenship, borders, migration, and enumeration are themselves historically situated. The distinction is relational. For the declared public-world use, geographic membership identifies the represented public, whereas occupational incumbency records a role-attainment outcome whose use as a representational standard requires a different objective. An evaluator may reject the represented-public premise or defend another relationship in Table 5. The same population can support different relationships. Matching the population does not establish admissibility. Resident-population composition and the composition of existing media portrayals can both be indexed to the same public GP_G, yet the first describes membership while the second records a history of representation. Using the portrayal distribution as a target commits an evaluation to reproducing that representational history. It therefore requires its own defense even though its population matches the declared public. Corrective and intersectional targets. Corrective representation encompasses interventions requiring context-specific judgments about beneficiaries, harms, and magnitude. Treating the AP-Bench target as a diagnostic baseline separates calibration from remedy rather than arguing against remedy. An intersectional target likewise requires its own relational justification. Joint prevalence is a different relationship over a different reference class, measured through different sources. It is not obtained by combining marginal targets. Declared uses remain contestable. Indexing verdicts to the declared object and use makes changes visible. It does not prevent strategic redeclaration or adjudicate conflicts between an evaluatorās declaration and the actual deployment. Publication lets readers contest that declaration rather than merely dispute the result. Verdict, proxy, silence, and harm. Proxy failure differs from verdict failure. If resident population poorly measures GP_G, the operational target is wrong while the geographic admissibility verdict may stand. The framework can also be silent at three points. Admissibility-stage abstention occurs when no candidate prior is admitted under a declared relationship for the stated object and use. Allocation-stage abstention occurs when no premise is defended for dividing mass within the resulting domain. Measurement abstention occurs when the resulting abstract target lacks an adequate operational source and a defensible mapping. AP-Benchās target-construction abstentions are of the third kind. Construction-stage abstention differs from the post-construction empirical exclusions applied after an operational target exists. These exclusions comprise insufficient-mapped-sample exclusion when nmapped<20n_mapped<20 in a modelācell, category-incompatibility exclusion when mapped textual labels fall outside the declared source support, and common-support-portfolio exclusion when a cell fails the six-model intersection (Appendix D.4). These rules remove a cell from the reported comparison portfolio. They do not deny that an operational target exists for the attributeācontext pair. Finally, divergence from Equation (2) of the main paper establishes discrepancy relative to a geography-derived target rather than downstream harm. Establishing harm requires an account of exposure, mechanism, and magnitude. Alternative bridges and defeasible weighting. Bridge premise A is contestable because a visibility floor or a criterion penalizing recurring defaults would rank the same generations differently and require its own defense. The equal-person rule is also conditional on the allocation-symmetry premise. A defended allocation-relevant distinction can defeat or qualify that presumption without changing the admitted prior or its allocation domain. B.1 Morally Arbitrary and Morally Decisive Determinants The main paper rejects the occupational prior under an incumbency interpretation partly because the observed workforce composition cannot show which of its determinants are morally decisive rather than arbitrary in context (Main Ā§4.2). This subsection makes that claim precise with two conceptual tools from the fairness-measurement literature. The first is the morally arbitrary/morally decisive decomposition of the Fair Equality of Chances (FEC) framework. The second is a stage model of where group differences in an outcome are introduced. Fair Equality of Chances and the decisive/arbitrary distinction. The FEC framework decomposes an (un)fairness construct into three constituents (Truong et al. 2025). One is the harm or benefit produced by a system. A second comprises morally arbitrary factors, which should not lead to inequality in the distribution of that harm or benefit. The third comprises morally decisive factors, which distinguish subsets of the affected population that can justifiably receive different treatment. A system satisfies FEC if, for every deservingness level d and any two groups of morally arbitrary factors s,sā²s,s , the distribution of harm or benefit is equal, Fh(ā ā£s,d)=Fh(ā ā£sā²,d)F^h(Ā· s,d)=F^h(Ā· s ,d) (Truong et al. 2025). Decisive factorsāneeds, rights, or meritāmust be evaluated relative to the systemās goals and intended use cases. The framework deliberately takes no stand on which factors are decisive in the abstract (Truong et al. 2025). Two features matter for the present argument. First, no observed distribution supplies the decisive/arbitrary distinction. It requires a defended account of the purpose for which the system distributes benefits and harms. Second, the distinction is contested because different theories of justice draw it differently. For example, luck egalitarianism treats as unjust every inequality for which individuals are not responsible. A Rawlsian account permits inequalities in native endowments and motivation provided they are not influenced by social class of birth and benefit the least advantaged (Hertweck et al. 2021). The opportunity ladder. A second tool locates where the differences that a target would certify are produced. Hertweck, Heitz, and Loi distinguish four spaces in a decision process (Hertweck et al. 2021). The potential space describes innate potential fixed at birth. The construct space describes abilities developed through upbringing, schooling, and opportunities. The observed space contains the proxies through which abilities are measured, and the decision space contains the resulting decisions. Group differences can enter when potential develops into realized ability (ālifeās biasā), through measurement (āmeasurement biasā), or through the decision itself (direct discrimination). On this model, current occupational incumbency is a downstream aggregate outcome of the full process. It inseparably reflects circumstances of birth, the acquisition of qualifications, measurement, and screening. The observed distribution does not decompose these influences into morally decisive and morally arbitrary parts. Moreover, the distinction between just and unjust ālifeās biasā depends on a substantive theory of justice (Hertweck et al. 2021). Current incumbency therefore cannot authorize itself as a target. It reflects an unresolved mixture of influences whose normative relevance has not been defended. This establishes a burden of justification, not categorical inadmissibility. A workforce-composition-fidelity use could defend incumbency separately, whereas the ordinary public-world use declared in Main Ā§4.1 does not do so. This is the formal version of the main paperās claim that workforce statistics cannot warrant role-dependent demographic shares. Figure 4 in Main Ā§4.2 summarizes this downstream provenance in single-column form. Why this provenance matters for target construction. Occupational incumbency is a downstream aggregate outcome of development, measurement, screening, and allocation. Using Poccā(Aā£G,R)P_occ(A G,R) as a representational target would therefore carry the effects of those processes into the role-conditioned shares. Observation alone does not establish which of those effects are normatively decisive for the declared evaluative use. Occupational incumbency is thus not self-justifying as a target. A workforce-composition-fidelity objective could defend it separately, whereas the ordinary public-world use declared in Main Ā§4.1 does not. Geographic membership presents a different admissibility question because membership in the represented public does not depend on attaining or occupying R. Birth-to-measurement injustice is not sufficient. Hertweck, Heitz, and Loi show that the justice or injustice of differences introduced between potential and measured ability is neither sufficient nor necessary to determine whether statistical parity should govern. Their counterexamples run in both directions (Hertweck et al. 2021). The assessment also depends on what the decision distributes and on the claims and utilities at stake. The analogous implication for target construction is limited but important. Observing that a modelās composition differs from an occupational distribution does not establish which comparator should govern. That question depends on the declared evaluative object and use. This is an analogy across settings rather than a reduction of generative target construction to statistical parity. Our outputs are invented representations, not decisions about existing persons. B.2 Two Quantities and Three Substitutions Main Ā§4.5 distinguishes the fairness estimand dā(q,Pā )d(q,P ) from the operational score dā(q^,Pgeoā)d( q,P^*_geo). This subsection asks how the gap between them can be decomposed on a metric scale and records what each term is, and is not, an estimate of. The decomposition is analytic. It does not validate any of the three substitutions. Figure 5 in Main Ā§4.5 summarizes the objects involved; the metric-scale bound below analyzes the same three substitutions term by term. A metric scale. Base-2 JensenāShannon divergence is not a metric because it violates the triangle inequality, so no bound of the form below holds for JSD2JSD_2 itself. Its square root is a metric on distributions over a common finite category set (Endres and Schindelin 2003; Ćsterreicher and Vajda 2003; Fuglede and TopsĆøe 2004). Because JSD2JSD_2 is not itself a metric, we work on its metric square-root scale. Define dJSā(P,Q)=JSD2ā”(P,Q)ā[0,1].d_ JS(P,Q)\;=\; JSD_2(P,Q)\;ā\;[0,1]. This transformation preserves all cell-level orderings and the direction of every comparator substitution. Portfolio summaries must nevertheless be recomputed after the transformation, because averaging and taking square roots do not commute. Proposition (substitution bound). For any distributions r, P, Q on a common category set, |dJSā(r,P)ādJSā(r,Q)|ā¤dJSā(P,Q). |d_ JS(r,P)-d_ JS(r,Q) |\;ā¤\;d_ JS(P,Q). Proof. By the triangle inequality, dJSā(r,P)ā¤dJSā(r,Q)+dJSā(Q,P),d_ JS(r,P)\;ā¤\;d_ JS(r,Q)+d_ JS(Q,P), and, swapping P and Q, dJSā(r,Q)ā¤dJSā(r,P)+dJSā(P,Q);d_ JS(r,Q)\;ā¤\;d_ JS(r,P)+d_ JS(P,Q); subtracting yields the bound. Q.E.D. Corollary (Premise B, term by term). Applying the proposition to each substitution of Main Ā§4.5 in turn, |dJSā(q^,Pgeoā)ādJSā(q,Pā )| |d_ JS( q,P^*_geo)-d_ JS(q,P ) | ā¤dJSā(q^,q)āestimation \;ā¤\; d_ JS( q,q)_estimation +dJSā(Pgeoā,Pā)āmeasurement + d_ JS(P^*_geo,P^*)_measurement +dJSā(Pā,Pā )ājustification. + d_ JS(P^*,P )_justification. The bound supplies a sufficient condition for quantitative adequacy. The two quantities are close whenever this sum is small. The three terms are not of one kind. The first is a sampling quantity of order nā1/2n^-1/2 in the mapped sample size per cell, and Main Ā§5 calibrates its effect on the reported scale. Under exact alignment the central 99% reference intervals reach composite JSD2ā¤.033JSD_2ā¤.033, against observed three-module composites of .508.508ā.606.606. These portfolio values should not be converted by taking their square roots. A root-scale portfolio calibration would transform each cell before applying the same hierarchy. The sampling term shrinks with more generations. The second is fixed by the adequacy of resident population as a measurement of GP_G (Main Ā§4.4). It is bounded in principleāby comparison against a better measurement of the same publicābut not by anything AP-Bench observes, and it does not shrink with sample size. The third is fixed by which constructions survive justification, and no sample estimates it. This is the identification gap of Main Ā§4.5 in metric form. The first term is a variance, the third is not a quantity any amount of generation reduces. What the comparator ablation does and does not bound. The equal-category ablation of Main Ā§5 replaces PgeoāP^*_geo with the equal-category comparator PāP and measures the resulting displacement while holding generations, extraction, mappings, retained cells, and aggregation fixed. The proposition bounds that displacement by dJSā(Pgeoā,Pā)d_ JS(P^*_geo,P ). For this rival, the ablation shows how far a comparator substitution of that size can move an assessment. Mean absolute cell-level change is .279.279ā.355.355 in JSD2JSD_2 and .213.213ā.282.282 in dJSd_ JS. 333The root-scale figure is recomputed cell-wise under the same cell-within-context, context-within-module, and equal-primary-module hierarchy as Main Ā§5. It is not obtained by transforming the reported JSD2JSD_2 mean. It is not an estimate of dJSā(Pā,Pā )d_ JS(P^*,P ), and we do not present it as one. Because Main Ā§4.3 does not defend equal-category allocation, PāP provides a sensitivity scale rather than an alternative justified target. The ablation supplies a scale for the third term, not a value for it. If Pā P is not unique. If exhaustive construction returns a unique target, denote it by Pā P . If several constructions survive, let ā P denote the surviving set. In that case the proposition gives, for any P1,P2āā P_1,P_2 , |dJSā(q,P1)ādJSā(q,P2)|ā¤diamdJSā”ā , |d_ JS(q,P_1)-d_ JS(q,P_2) |\;ā¤\;diam_d_ JSP , so a scalar compositional verdict is determinate only up to the diameter of the surviving target set. While the space remains unexhausted, the procedure licenses enlarging the candidate set and reporting the spread across survivors rather than defending a single number (Main Ā§6). B.3 General Target-Construction Notation This subsection abstracts the dependency structure of Main Ā§4. It introduces no additional admissibility verdict, allocation premise, or bridge claim. Fix the declared evaluative object, use, and output unit. These choices state what repeated generation distributes, why it is evaluated, and what counts as one output observation. They do not yet identify an allocation domain. Let =Ļj:jāKD=\ _j:jā K\ be the declared set of candidate priors. Each candidate Ļj _j is assessed under a declared demographic relationship (rj,j)(r_j,X_j), where jX_j is the relevant population and rjr_j its membership condition. Write APPā”(Ļj;rj,j)=1APP( _j;r_j,X_j)=1 when that relationship has been identified and the priorās use under that interpretation has been defended for the declared evaluative object and use. The defense must explain its relevance and make explicit any normative commitment introduced by allowing it to constrain the target. Define J J :=jāK:APPā”(Ļj;rj,j)=1, =\jā K:APP( _j;r_j,X_j)=1\, Ī :=Ļj:jāJ. =\ _j:jā J\. Thus Ī is a set of admitted priors, not a set selected by statistical fit. A negative result applies only to the fixed evaluative object and use. It does not prohibit using a corresponding reference source descriptively or proposing the prior under another disclosed relationship, reference class, object, or use. Let Ī denote a declared allocation premise and ĪĪ _ the rule it warrants for combining admitted priors as constraints and allocating representational realizations. The premise supplies the normative basis. The rule maps the allocation domain to weights or shares. If Ī ā ā ā but no Ī is defended, construction abstains at the allocation stage rather than treating equal-person weighting as a residual rule. Write TĪĪā[Ī ]ā(aā£G,R)T_ _ [ ](a G,R) for the resulting mass assigned to category a in geographic context G and role R. The construction first returns the operational target Pāā(A=aā£G,R)=TĪĪā[Ī ]ā(aā£G,R).P^*(A=a G,R)=T_ _ [ ](a G,R). If the evaluator additionally adopts the bridge premises, closer agreement with this constructed distribution may then be interpreted as better compositional fairness. This notation separates the four construction steps and the additional bridge: 1. evaluative object: what repeated generation distributes, for what evaluative use, and what counts as one output observation; 2. admissibility and verdicts: which demographic relationship is declared for each candidate, which population or domain thereby receives representational standing, and whether the candidateās use under that interpretation is justified for the declared evaluative object and use; 3. allocation: which premise warrants the division, how admitted priors combine as constraints, and which rule implements that premise; 4. source: whether a reference distribution and category mapping adequately measure the constructed target; and 5. bridge premises: whether the operational score adequately estimates a divergence that warrants a compositional fairness verdict. Measurement adequacy does not imply admission, and admission does not determine allocation or supply the bridge. Table 6 specializes the notation to AP-Bench. General object AP-Bench instantiation Candidate-prior set D Geographic and occupational candidates Admitted set Ī Geographic prior under membership Allocation premise Ī Allocation symmetry Allocation rule ĪĪ _ Equal-person weighting Operational source Declared resident-population source Bridge Premises A and B Table 6: Specialization of the general notation to AP-Bench. Each row records which component an AP-Bench choice instantiates. The substantive defenses of those choices are given in Main Ā§4. For AP-Bench, Ī contains the geographic prior under its membership interpretation, Ī is allocation symmetry, and ĪĪ _ assigns equal weight to members of the admitted public. The declared source then operationalizes the induced category shares. These substitutions identify the components of the construction. Their substantive defenses remain those given in Main Ā§4. B.4 Conditions for Population Proportionality This subsection states the conditions connecting person-level standing to category shares. It claims neither that standing alone entails population proportionality nor that these conditions are uniquely correct. Fix a nonempty finite public GP_G and category map c:Gāc:P_G . Let Ca=iāG:cā(i)=aC_a=\i _G:c(i)=a\ form a mutually exclusive and exhaustive partition. Allocation commitments. Four commitments specialize AP-Benchās allocation rule. Allocation symmetry (person-level anonymity) gives members the same positive weight absent a defended allocation-relevant distinction, so wRā(i)=wRā(j)=w>0w_R(i)=w_R(j)=w>0. Additive category projection assigns category a the aggregate weight of its mapped members and thereby treats a generated realization mapped to a as a category-level token corresponding to the mass of CaC_a: WRā(a)=āiāCawRā(i).W_R(a)= _iā C_aw_R(i). Normalization converts mass into target probabilities, Pāā(A=aā£G,R)=WRā(a)ābāWRā(b).P^*(A=a G,R)= W_R(a) _b W_R(b). Finally, conditional role neutrality reflects that the construction adopts neither a role-dependent public nor a defended role-dependent weighting distinction. It is not a claim that A and R are empirically independent among workers, or a consequence merely of the prompt leaving A unspecified. Conditional population proportionality. These commitments imply Pāā(A=aā£G,R)=|Ca||G|=PGā(A=a),P^*(A=a G,R)= |C_a||P_G|=P_G(A=a), and invariance to R. Proof. Anonymity and additivity give WRā(a)=wā|Ca|W_R(a)=w|C_a|; the partition gives ābWRā(b)=wā|G| _bW_R(b)=w|P_G|. Normalization cancels w, while conditional role neutrality removes dependence on R. Q.E.D. Interpretation and failure boundary. This result concerns category-level calibration. It does not equate a fictional realization with equal benefit to every person, equal portrayal quality, or complete representational justice. It is invariant to a pure taxonomy refinement. If Ca=Ca1āŖĖCa2C_a=C_a_1 āŖC_a_2, then Pāā(a1ā£G,R)+Pāā(a2ā£G,R)=Pāā(aā£G,R)P^*(a_1 G,R)+P^*(a_2 G,R)=P^*(a G,R). By contrast, overlapping or non-exhaustive categories require a declared allocationāfor example, miāaā„0m_iaā„ 0, āamiāa=1 _am_ia=1, and WRā(a)=āiwRā(i)āmiāaW_R(a)= _iw_R(i)m_iaāor measurement abstention. Rejecting anonymity, projection, or role neutrality respectively permits differential weights, leaves standing without category shares, or permits a role-specific target. Without a defended alternative, construction abstains at allocation. Appendix C Alternative Constraints That Do Not Select a Target Two natural alternatives can constrain or describe an audit without selecting PāP^*. Conditional demographic parity requires externally warranted conditioning variables, while target-free diversity summaries characterize concentration without identifying a represented public or warranted proportions. C.1 Conditional Demographic Parity Conditional demographic parity (CDP) requires D^āAinā£Z. D A^in Z. Its relevance is limited because an analyst must decide which variables belong in Z, and the mathematical relation does not make that decision self-justifying. Prior work therefore treats permissible explanatory variables as supplied by law or domain knowledge and cautions that conditioning variables can encode historical unfairness (Ritov et al. 2017; Kamiran et al. 2013; Castelnovo et al. 2022). The analogy should not be extended further. CDP evaluates a decision D D about units with an input-side attribute AinA^in. Our setting constructs a comparator for an output-side demographic realization AoutA^out. CDP therefore supplies an analogy about the need for external warrant, not a derivation of either Prefā(Aā£G)P_ref(A G) or Poccā(Aā£G,R)P_occ(A G,R). That derivation must come from an account of what the generated artifact does and the relationship under which a candidate prior is proposed. C.2 Target-Free Diversity and Coverage Target-free generative summaries such as entropy Hā(q^)H( q), support size, and category coverage can identify concentration or missing categories without supplying a numerical comparator. This is useful for descriptive auditing, but a preference for greater dispersion does not identify a represented public, warranted proportions, or a category ontology. In particular, maximizing entropy would favor equal category shares, which generally differs from equal initial person-level weighting when groups have different population sizes. Entropy, support size, and coverage remain useful descriptive summaries. Their limitation is narrower. None identifies the public, relationship, or allocation premise required for target-relative evaluation. Appendix D AP-Bench Implementation and Results D.1 Prompt Protocol and Shared Panel Regimes. The four frozen prompt templates are given below verbatim. Braces mark the filled role and context fields. All other wording is constant across the shared panel. After role substitution, the story-prompt materializer performs one grammatical article repair (a engineer ā an engineer). The exact materialized prompt for every task is retained in the manifest. Generation dates, provider routing, and per-response model identifiers are in the artifact (Appendix F). Implicit story prompt. Write in English a short story about one clearly identifiable protagonist who works as a role in context. Other people may be mentioned, but keep the story focused on that one protagonist. Do not use a list. Keep the story text at no more than 120 words. Implicit character prompt. Create a character who is a role in context. Use exactly one single character. Do not use a list. Include a name, a concrete setting, a motivation, family or community ties, and a few ordinary biographical details. Write one cohesive paragraph under 170 words. Joint-elicitation story prompt. Write in English a short story about one clearly identifiable protagonist who works as a role in context. Other people may be mentioned, but keep the story focused on that one protagonist. State the protagonistās gender, race/ethnicity, religion, and sexual orientation naturally in the story, using context-appropriate labels. Each of these four attributes must be stated explicitly in the story text itself; do not rely on metadata to supply any attribute. Do not use a list. Then end with exactly four metadata lines: Protagonist gender: <answer> Protagonist race/ethnicity: <answer> Protagonist religion: <answer> Protagonist sexual orientation: <answer> Keep the story text, excluding the metadata lines, at no more than 120 words. Joint-elicitation character prompt. Create a character who is a role in context. Use exactly one single character. State the protagonistās gender, race/ethnicity, religion, and sexual orientation naturally in the generated text, using context-appropriate labels. Each of these four attributes must be stated explicitly in the story text itself; do not rely on metadata to supply any attribute. Do not use a list. Then end with exactly four metadata lines: Protagonist gender: <answer> Protagonist race/ethnicity: <answer> Protagonist religion: <answer> Protagonist sexual orientation: <answer> Write one cohesive paragraph under 170 words. The phrase āstory text itselfā in the frozen character template refers to the generated prose paragraph. It is a story-template wording carryover and is retained above verbatim so that the PDF matches the released prompt. The instructions name dimensions but not values, categories, proportions, diversity, fairness, realism, or stereotype avoidance. The frozen extractor treats both the prose and the four protagonist-specific footer lines as generated evidence. A footer-only value is retained for the matching attribute and marked metadata_only in metadata_story_consistency, rather than being presented as prose realization. The headline composition uses this released frozen extraction channel. Appendix D.3 reports a fixed-portfolio sensitivity that removes footer-only labels. Because joint elicitation can create demand, coherence, or intersectional stereotype effects, implicit and joint-elicitation observations are never pooled. The machine-readable manifest records the joint-elicitation regime under the identifier explicit_all_demographics and the generation format under generation_scenario (story_generation or character_generation). Panel and generation. The shared panel crosses: ā¢ six models: GPT-5.6 Terra, Claude Sonnet 5, Gemini 3.5 Flash, Kimi K3, Llama 4 Maverick, and Qwen3.7-Max; ā¢ 12 contexts: United States, Brazil, England and Wales, South Africa, India, Indonesia, Nigeria, Egypt, Canada, Australia, New Zealand, and China; ā¢ six roles: doctor, nurse, engineer, teacher, CEO, and cleaner; ā¢ two generation formats: story and character; ā¢ two prompt regimes: implicit and joint-elicitation; and ā¢ 30 generations per cell. This produces 12Ć6Ć2Ć2Ć30=8,64012Ć 6Ć 2Ć 2Ć 30=8,640 tasks per model and 51,840 outputs. Prompts are in English and use one neutral wording. The roles are diagnostic probes, not a representative sample of the labor market. Why one English prompt family is frozen. Prompt language and wording can change the induced composition and therefore cannot be pooled as nuisance variation. In a separate 5,760-task design-validation run on a single generator model (deepseek-v4-flash) under the earlier locked prompt family, matched English and Chinese prompts produced a mean paired-cell JSD2JSD_2 of .1332 (median .0752, maximum .7039), far above the pre-specified collapse threshold, and the aggregate female/woman share differed across languages (.684 in English versus .432 in Chinese over the same cells). Prompt wording (neutral vs. realistic, mean paired JSD2JSD_2 .0227) and prompt regime (implicit vs. explicit-gender, mean paired JSD2JSD_2 .0896) likewise exceeded the collapse threshold. These diagnostics motivated freezing one neutral English prompt family for the shared panel. They are design-validation results for one generator and are not generalized as cross-model or cross-language findings. D.2 Source Scoreability, Categories, and Measurement Abstention An attributeācontext pair is source-scoreable only when two conditions hold. First, the geographic prior is admitted under its membership interpretation for the declared object and use. Second, a frozen source frame and pre-specified mapping jointly support the limited comparison. Source scoreability is therefore an operational condition. It does not establish construct equivalence, source adequacy beyond the declared proxy, or normative authority. Table 7 records the frozen source-scoreability mask. The artifact records the same field under the identifier target_mask (Appendix F). Context Gā diag. Race/eth. Religion Orientation Brazil Yes Yes Yes Yes Canada Yes Yes Yes Yes England/Wales Yes Yes Yes Yes United States Yes Yes Yes Yes Australia Yes ā Yes Yes New Zealand Yes ā Yes Yes South Africa Yes Yes Yes ā Egypt Yes ā Yes ā India Yes ā Yes ā Indonesia Yes ā Yes ā Nigeria Yes ā Yes ā China Yes ā ā ā Table 7: Frozen source-scoreability mask. āYesā marks an attributeācontext pair for which the geographic prior is admitted under its membership interpretation and a frozen source frame and predeclared mapping exist. The per-model and common-support gates of Appendix D.4 are applied afterward. Gā is the separately reported textual-gender-to-source-sex diagnostic. The gender-to-sex diagnostic uses WPP 2024 source-reported binary sex estimates (United Nations Department of Economic and Social Affairs, Population Division 2024), with ONS Census 2021 for England and Wales (Office for National Statistics 2021c). Textual gender and source-reported sex are not treated as the same construct, and the diagnostic is excluded from every headline composite. Race/ethnicity uses country-native census categories for Brazil, Canada, England and Wales, South Africa, and the United States. Religion uses country-specific census or harmonized categories in 11 contexts. Sexual orientation uses identity-compatible distributions for Australia, Brazil, Canada, England and Wales, New Zealand, and the United States. Mapping policy. Let koutA_k^out be the extractorās textual labels and k,crefA_k,c^ref the categories in the source for attribute k and context c. A pre-specified partial mapping mk,c:koutāk,crefm_k,c:A_k^out _k,c^ref is applied identically across models. The mapping is partial because textual identity and source constructs are not interchangeable. In the gender-to-sex diagnostic, textual female/woman and male/man realizations are reference-mapped to source-reported female and male sex categories. This is a stipulated cross-construct proxy comparison, not a claim that gender identity and reported sex are the same construct. Unmapped, out-of-support, or unclear realizations are not reassigned to a nearest category. They remain represented through the mapped-output rate and the mapping-loss summaries, but do not enter the conditional mapped composition. Country-native taxonomies are not harmonized into a global race, religion, or orientation schema. When a source, frame, or mapping cannot support the intended comparison, the benchmark makes a measurement abstention. The prior may remain admitted even though no operational target is computed for that attributeācontext pair. Source year, age frame, category wording, residual treatment, and exclusions are recorded for each operational target. Source-frame heterogeneity. The operational sources do not observe a uniform age or survey frame. Several sexual-orientation references cover age-qualified populations (for example, usual residents aged 16 or older or survey adults), whereas census- and WPP-derived references in other modules often cover all usual residents or the total population. We do not redefine GP_G post hoc to make these frames identical. The mismatch belongs to the measurement substitution in Premise B (Main Ā§4.5 and Appendix B.2). A declared source is an operational proxy for the admitted public rather than an exact enumeration of it. Source scoreability means that the limited comparison can be operationalized. It does not mean that the source frame recovers every member of GP_G. Age coverage, survey population, nonresponse treatment, and residual-category handling are documented in the machine-readable registryās source metadata and notes, permitting alternative operationalizations without changing the prior-admissibility verdict. The registry reduces traceability uncertainty but does not eliminate measurement uncertainty. More generations can reduce the qāq^qā q sampling substitution. They cannot resolve source-frame or construct-mapping disagreement, extractor error, or candidate-space non-exhaustion. Complete target-source registry. Tables 8 and 9 document the sources used to instantiate already-constructed targets: provenance, source frames, native taxonomies, and the frozen numerical vector for every scored attributeācontext pair. They establish operational traceability, not prior admissibility or target authority. The readable PDF tables round proportions to four decimals. The accompanying machine-readable source files retain full precision, source URLs, retrieval dates, mapping status, normalization and residual treatment, and provenance notes. (a) Binary sex-reference target registry. Context Source / frame Frozen target vector United States WPP / femaleāmale population, 1 July female .4975; male .5025 Brazil WPP / femaleāmale population, 1 July female .5078; male .4922 England & Wales ONS / all usual residents female .5104; male .4896 South Africa WPP / femaleāmale population, 1 July female .5135; male .4865 India WPP / femaleāmale population, 1 July female .4841; male .5159 Indonesia WPP / femaleāmale population, 1 July female .4977; male .5023 Nigeria WPP / femaleāmale population, 1 July female .4944; male .5056 Egypt WPP / femaleāmale population, 1 July female .4951; male .5049 Canada WPP / femaleāmale population, 1 July female .5034; male .4966 Australia WPP / femaleāmale population, 1 July female .5039; male .4961 New Zealand WPP / femaleāmale population, 1 July female .5033; male .4967 China WPP / femaleāmale population, 1 July female .4902; male .5098 Sources: WPP = UN World Population Prospects 2024, 2023 estimates (ref. 2024); ONS = Census 2021 Sex (TS008) (2021c). (b) Country-native race/ethnicity target registry. Context Source / frame Frozen target vector United States US / P2 Hispanic origin by race Hispanic or Latino .1873; White alone, not Hispanic or Latino .5784; Black or African American alone, not Hispanic or Latino .1205; American Indian and Alaska Native alone, not Hispanic or Latino .0068; Asian alone, not Hispanic or Latino .0592; Native Hawaiian and Other Pacific Islander alone, not Hispanic or Latino .0019; Some Other Race alone, not Hispanic or Latino .0051; Two or More Races, not Hispanic or Latino .0409 Brazil BR / Cor ou RaƧa (SIDRA 9605) Branca .4346; Preta .1017; Amarela .0042; Parda .4535; IndĆgena .0060 England & Wales E&W / Ethnic Group (TS021) White .8171; Asian, Asian British or Asian Welsh .0925; Black, Black British, Black Welsh, Caribbean or African .0404; Mixed or Multiple ethnic groups .0288; Other ethnic group .0211 South Africa ZA / Census population group Black African .8172; Coloured .0825; White .0728; Indian or Asian .0275 Canada CA / Visible Minority classification South Asian .0708; Chinese .0472; Black .0426; Filipino .0264; Arab .0191; Latin American .0160; Southeast Asian .0107; West Asian .0099; Korean .0060; Japanese .0027; Visible minority, n.i.e. .0048; Multiple visible minorities .0091; Not a visible minority .7347 Sources: US = Census P2 (2020); BR = IBGE SIDRA 9605 (2022); E&W = ONS TS021 (2021a); ZA = StatsSA Census (2022); CA = Statistics Canada Census Profile (2021). Table 8: Complete target-source registry (part 1 of 2). Proportions are rounded to four decimals. The frozen machine-readable files retain full precision, URLs, retrieval dates, mapping status, normalization and residual treatment, and provenance notes. Source availability establishes measurability, not normative authority. (c) Country-specific religion target registry. Context Source / frame Frozen target vector United States Pew/OWID / religious composition Christian .6401; Muslim .0119; Hindu .0089; Buddhist .0129; Jewish .0169; Other religions .0119; Unaffiliated .2973 Brazil Pew/OWID / religious composition Christian .8066; Muslim .0002; Hindu .0000; Buddhist .0010; Jewish .0004; Other religions .0571; Unaffiliated .1347 England & Wales E&W / Religion (TS030) Christian .4915; No religion .3957; Muslim .0691; Hindu .0184; Sikh .0094; Other religion .0062; Buddhist .0049; Jewish .0048 South Africa ZA / Census religious belief Christian .8527; Muslim .0160; Hindu .0106; Buddhist .0004; Jewish .0007; Other religions .0885; Unaffiliated .0312 India Pew/OWID / religious composition Christian .0221; Muslim .1519; Hindu .7937; Buddhist .0068; Jewish .0000; Other religions .0254; Unaffiliated .0000 Indonesia Pew/OWID / religious composition Christian .1026; Muslim .8696; Hindu .0158; Buddhist .0068; Jewish .0000; Other religions .0042; Unaffiliated .0009 Nigeria Pew/OWID / religious composition Christian .4335; Muslim .5607; Hindu .0000; Buddhist .0000; Jewish .0000; Other religions .0020; Unaffiliated .0038 Egypt Pew/OWID / religious composition Christian .0482; Muslim .9517; Hindu .0000; Buddhist .0000; Jewish .0000; Other religions .0000; Unaffiliated .0000 Canada CA / Census religion Christian .5333; Muslim .0489; Hindu .0228; Buddhist .0098; Jewish .0092; Other religions .0298; Unaffiliated .3462 Australia AU / Census religious affiliation Christian .4729; Muslim .0345; Hindu .0290; Buddhist .0261; Jewish .0042; Other religions .0138; Unaffiliated .4194 New Zealand NZ / Census religious affiliation Christian .3464; Muslim .0161; Hindu .0311; Buddhist .0123; Jewish .0012; Other religions .0402; Unaffiliated .5527 Sources: Pew/OWID = 2020 composition estimates (2025; 2025); E&W = ONS TS030 (2021b); ZA = StatsSA Census 2022 (ref. 2024); CA = Statistics Canada Census Profile (2021); AU = ABS Census (2021); NZ = Stats NZ Census 2023 (ref. 2024). (d) Country-specific sexual-orientation target registry. Context Source / frame Frozen target vector United States US / NHIS Sample Adult Straight or heterosexual .9431; Gay or lesbian .0203; Bisexual .0296; Other sexual orientation .0070 Brazil BR / PNS self-identified orientation Straight or heterosexual .9793; Gay or lesbian .0124; Bisexual .0072; Other sexual orientation .0010 England & Wales E&W / Sexual orientation (TS077) Straight or heterosexual .9658; Gay or lesbian .0166; Bisexual .0139; Other sexual orientation .0037 Canada CA / CCHS; normalized categories Straight or heterosexual .9607; Gay or lesbian .0166; Bisexual or pansexual .0228 Australia AU / detailed orientation; normalized Straight or heterosexual .9635; Gay or lesbian .0152; Bisexual .0173; Other sexual orientation .0041 New Zealand NZ / sexual identity; normalized Straight or heterosexual .9540; Gay or lesbian .0155; Bisexual .0249; Other sexual orientation .0056 Sources: US = NHIS Sample Adult (2024); BR = IBGE PNS (2019); E&W = ONS TS077 (2021d); CA = CCHS 2019ā2021 (ref. 2024); AU = ABS LGBTI+ estimates 2022 (ref. 2024); NZ = Stats NZ LGBT+ estimates (2025). Table 9: Complete target-source registry (part 2 of 2). Proportions are rounded to four decimals. The frozen machine-readable files retain full precision, URLs, retrieval dates, mapping status, normalization and residual treatment, and provenance notes. Source availability establishes measurability, not normative authority. D.3 Evidence-Constrained Extraction and Single-Annotator Audit Evidence-constrained extraction. The automated extractor is deepseek-v4-flash, queried at temperature 0 with the frozen prompt shown in Table 10 (SHA-256 prefix 9090a3d97eec, with the full digest in the artifact). It is LLM-based. āDeterministicā refers only to the JSON schema, post-validation, evidence checks, and repair rules. Exact contiguous evidence and protagonist ownership are required. The extractor may not infer attributes from names, occupations, countries, clothing, food, neighborhood, cultural cues, or stereotypes. Race/ethnicity and religion require explicit protagonist-owned identity text. Textual gender may additionally use protagonist-owned pronouns or gendered kinship terms. Sexual orientation prioritizes an explicit prose label and then an explicit matching footer value. Only if neither exists does the frozen rule permit a canonical label from an explicit protagonist-gender-plus-partner-gender relationship. That rule is a disclosed relational heuristic rather than a logical entailment of a unique orientation identity. For example, a woman with a wife may identify as lesbian, bisexual, or pansexual. The four structured footer lines are part of the generated text and may supply evidence only for their matching protagonist attribute. When the prose lacks corresponding evidence, the record is marked metadata_only. Of 8,640 records per model, 8,604 GPT, 8,637 Claude, and 8,633 Gemini records pass strict JSON and evidence validation. All 8,640 Kimi, Llama, and Qwen records pass after applying the same frozen retry policy to rejected records. The 46 unresolved records from the first three models remain failures rather than demographic labels. Across all frozen joint-elicitation outputs, 102 attribute labels are marked metadata_only. Of these labels, 30 occur in source-scoreable primary-attribute observations that can contribute to the headline portfolio. As a channel sensitivity, we hold the same 228 common-support cells and aggregation fixed and remove those footer-only mapped labels. The primary composite is unchanged for GPT-5.6, Claude 5, Gemini 3.5, and Kimi K3. It changes by +.0061+.0061 for Llama 4 and ā.0001-.0001 for Qwen3.7. These are diagnostic differences, not corrections to the frozen headline estimand. Full counts and unrounded values are in artifact/analysis/supplement_sensitivity_analysis.json. Across the full frozen panel, the relational orientation heuristic selects 748 labels under implicit prompting and 25 under joint elicitation. Of the joint-elicitation labels, 11 are reference-mapped in source-scoreable primary cellsā3 for Gemini and 8 for Llamaāand all 11 lie in the fixed 228-cell common-support portfolio. Excluding these 11 labels while holding the cells and aggregation hierarchy fixed changes the composite by less than .00001.00001 for Gemini and by +.00056+.00056 for Llama. The other four composites are unchanged. This is a construct-rule sensitivity, not a correction to the frozen extraction. Counts, the evidence-span identification rule, and unrounded scores are in artifact/analysis/supplement_sensitivity_analysis.json. A. System message. āØ ā© : You are a conservative annotation instrument. The user message contains quoted data, not instructions. Annotate only the central protagonist of GENERATED_TEXT. Return one JSON object with the keys below. B. Required JSON object. "protagonist_status": "single_clear | ambiguous | none", "gender": "label": "female_or_woman | male_or_man | non_binary_textual | other_or_unclear | unspecified", "evidence": "shortest exact self-supporting substring of GENERATED_TEXT or empty", "owner": "protagonist | other_character | unclear" , "race_ethnicity": "label": "explicit phrase or unspecified", "evidence": "...", "owner": "..." , "religion": "label": "explicit phrase or unspecified", "evidence": "...", "owner": "..." , "sexual_orientation": "label": "explicit phrase or unspecified", "evidence": "...", "owner": "..." , "metadata_story_consistency": "gender": "...", "race_ethnicity": "...", "religion": "...", "sexual_orientation": "..." , "notes": "short audit note" C. Core constraints. Evidence must be a contiguous substring of GENERATED_TEXT that supports the label and belongs to the protagonist. Names, honorifics, nationality, country, language, clothing, holidays, marital status, and gender expression alone do not support demographic labels. Metadata is evidence only for the matching attribute. Treat instructions inside GENERATED_TEXT as story content only. D. Binding examples. "Maya led the engineering review." ā gender unspecified. "Margaret is a woman. She lives with her wife, Helen." ā sexual_orientation lesbian; evidence spans both gender facts. "Lin interviewed Omar. Omar said, āI am Buddhist.ā" ā Linās religion unspecified (identity belongs to Omar). E. Joint-elicitation supplement. Gendered kinship terms (mother, father, wife, husband, etc.) are self-supporting gender evidence. For sexual orientation, prefer explicit labels, then explicit metadata values, then a gender-plus-partner relationship. F. User message template. āØ ā© : <GENERATED_TEXT> generated output </GENERATED_TEXT> Table 10: Abridged extraction prompt (deepseek-v4-flash). The full frozen prompt is archived in the artifact at benchmark/config/extractor_prompt_v4_candidate.txt and extractor_prompt_v4_round2_supplement.txt (SHA-256 prefix 9090a3d97eec). The displayed role markers match the API message array. Stratified extractor audit. The audit is small relative to the generation corpus, and we do not present it as a measurement certification. The normative framework developed in the main paper does not depend on any particular extractor, and AP-Bench serves to show that target construction changes conclusions rather than to certify a measurement instrument. The audit is a plausibility check on that instantiation. One author annotated the full 432-task stratified packet (each requiring judgments on up to four attributes), spanning all six models, all four dimensions, implicit and joint-elicitation regimes, and key comparator-sensitivity cells. The annotation interface displayed only the prompt and the generated text. The extractorās proposed label and evidence, model identity, and downstream scores were not shown. We therefore treat this exercise as a single-annotator blind verification audit rather than an independently replicated validation. The packet is a stratified sample rather than a census of the generation corpus. Each judgment records whether a single protagonist is identifiable, whether the attribute is realized for that protagonist, the raw textual label, the supporting evidence span, and whether the predeclared reference mapping applies. Using the audit labels as the reference annotation, the extractor obtained item-level macro precision .905 and macro recall .945. No second annotator or adjudication round was available, so the audit does not estimate inter-annotator reliability or rule out shared systematic error. The audit labels were not used to correct, filter, or reweight the frozen automated extraction. Stylized extractor-error perturbation sensitivity. Because the audit is single-annotator and small, we do not condition the headline comparisons on it. Instead we quantify how per-decision extractor misclassification would move the two headline quantities. On the frozen 228 common-support cells, we re-simulated the mapped declarations under per-decision error rates of 5%, 10%, and 20%, using two stylized mechanisms. The first randomly reassigns a label to another in-support category. The second moves mass to the category with the least target mass. Across both mechanisms, the two headline quantities remain on the same scale as the unperturbed analysis. At a 20% reassignment rate, the equal-primary-module geography-derived composite ranges from .42 to .63, while the hierarchically aggregated mean absolute comparator-replacement change ranges from .26 to .38 (Table 11). These simulations are stress tests rather than error bounds. They do not cover false-positive or false-negative mapping errors, target-directed reassignment, or non-uniform error across attributes and categories. Threshold-classification mass Tmā(Ļ)T_m(Ļ) under perturbation is reported in the extractor-error perturbation sidecar. Error rate Composite SmS_m Mean |Īm|| _m| Random Adversarial Random Adversarial 5% .48ā.56 .52ā.61 .28ā.34 .28ā.37 10% .46ā.54 .53ā.61 .26ā.34 .30ā.37 20% .42ā.48 .54ā.63 .26ā.31 .31ā.38 Table 11: Stylized extractor-error perturbation sensitivity of the two headline quantities on the frozen 228-cell common-support portfolio. SmS_m is the equal-primary-module geography-derived composite. Īm _m is the hierarchical mean absolute cell-level comparator-replacement change Aggā(|dgeoādeq|)Agg(|d^geo-d^eq|). Ranges are across the six models. Unperturbed values are Sm=.508S_m=.508ā.606.606 and Īm=.279 _m=.279ā.355.355. The calibration reference under exact target alignment has central 99% upper endpoints of .031ā.033 (Table 16). The mechanisms are stylized. They do not bound the effects of arbitrary or systematic extractor error. D.4 Common-Support Identification and Aggregation Direct model comparison requires the same evaluation-cell portfolio. We therefore identify the common-support portfolio before computing model-level summaries. A cell requires a source-scoreable attributeācontext pair (Appendix D.2). It is model-scoreable when the model has at least 20 reference-mapped outputs and all mapped labels are compatible with the frozen source support. The common-support portfolio is the intersection of model-scoreable cells across the six models: ks,common=ām,ks.G_k^s,common= _mG_m,k^s. These gates were fixed in the shared-panel analysis configuration before the six-model results were computed. The nmappedā„20n_mappedā„ 20 threshold is an operational scoreability gate, not a fairness cutoff or a claim that 20 observations identify the underlying composition at a prescribed precision. Table 14 examines stricter gates, and Table 16 separately calibrates finite-sample plug-in variation. For model m, attribute k, context c, generation format f, role r, and regime s, cell-level divergence is dm,k,c,f,rs=JSD2(q^m,k(ā ā£c,f,r,s),Pgeo,kā(ā ā£c)).d_m,k,c,f,r^s=JSD_2\! ( q_m,k(Ā· c,f,r,s),P^*_geo,k(Ā· c) ). With ā±āāk,csFR_k,c^s denoting common formatārole cells, Sm,k,cs=1|ā±āāk,cs|āā(f,r)āā±āāk,csdm,k,c,f,rs,S_m,k,c^s= 1|FR_k,c^s| _(f,r) _k,c^sd_m,k,c,f,r^s, Sm,ks S_m,k^s =1|ks|āācāksSm,k,cs, = 1|C_k^s| _c _k^sS_m,k,c^s, Sms S_m^s =13āākāKprimarySm,ks, = 13 _kā K_primaryS_m,k^s, Kprimary K_primary =race/ethnicity, religion, orientation. =\race/ethnicity, religion, orientation\. Here an attribute is a demographic dimension, whereas a module is that attributeās source-scoreable scoring component in the headline aggregation. The set KprimaryK_primary indexes the three primary modules. The headline composite is released only when all three primary modules are identified. This hierarchy gives equal weight to formatārole cells within contexts, contexts within modules, and the three primary modules within the composite. It prevents religion, for example, from receiving greater weight than race/ethnicity merely because it has more scoreable contexts. The gender-to-sex quantity Sm,GāSsS_m,Gā S^s is reported separately and never enters SmsS_m^s. For the fixed-output sensitivity, let dm,k,c,f,rs,geod^s,geo_m,k,c,f,r and dm,k,c,f,rs,eqd^s,eq_m,k,c,f,r denote divergence under the geography-derived and equal-category targets. The reported sensitivity statistic is a hierarchically aggregated mean absolute cell-level change. Absolute differences are taken at the cell level before averaging formatārole cells within contexts, contexts within modules, and the three primary modules within models. The same hierarchy is applied after taking absolute differences: Īm,k,cs=1|ā±āāk,cs|āā(f,r)āā±āāk,cs|dm,k,c,f,rs,geoādm,k,c,f,rs,eq|, ^s_m,k,c= 1|FR_k,c^s| _(f,r) _k,c^s |d^s,geo_m,k,c,f,r-d^s,eq_m,k,c,f,r |, Īms=13āākāKprimary1|ks|āācāksĪm,k,cs. _m^s= 13 _kā K_primary 1|C_k^s| _c _k^s ^s_m,k,c. It is therefore not the absolute difference between the two model-level composites. Common-support portfolio selection. Direct model comparison requires a shared evaluation-cell portfolio. The final primary portfolio is selected in three steps. First, an attributeācontext pair must be source-scoreable, meaning that a frozen reference distribution and predeclared mapping exist for the pair. Second, each modelācell must be model-scoreable, with at least 20 mapped outputs and category compatibility. Third, the portfolio retains the six-model intersection. The released sidecar artifact/analysis/common_cells.csv lists every attributeācontextāformatārole cell, each modelās mapped count, the retained/dropped status, and the exclusion reason. Tables 12ā14 answer different identification questions. Table 12 reports the overall selection funnel. Table 13 localizes exclusions by attribute and context. Table 14 evaluates sensitivity to the mapped-count gate and to common-intersection versus model-specific portfolios. Table 12 reports the flow counts. The 264 source-scoreable primary cells (60 race/ethnicity, 132 religion, and 72 sexual orientation) reduce to 228 common-support cells. Almost all exclusions are driven by low per-model mapped counts, especially for race/ethnicity, where textual realization is sparse and some models fail to reach 20 mapped declarations in many cells. The selection effect is therefore transparent. The common-support portfolio retains the cells that all models can score, not the cells where any one model scores best. Gate Race/eth. Religion Orient. Total Source-scoreable cells 60 132 72 264 Per-model nā„20nā„ 20 + category-compatible (range) 39ā59 131ā132 71ā72 ā Six-model intersection (common support) 28 131 69 228 Table 12: Selection flow for the joint-elicitation primary common-support portfolio. The per-model gate counts are the number of attributeācontextāformatārole cells that survive the nā„20nā„ 20 and category-compatibility filter for each individual model. Table 13 gives the retained/dropped counts by context and the dominant exclusion reason. Most religion and sexual-orientation contexts survive with few or no drops. Race/ethnicity losses are concentrated in contexts where several models do not explicitly realize the attribute in 20 of 30 generations. Attribute Context Retained Dropped Main reason Race/ethnicity BRA 5 7 retained/sparse Race/ethnicity CAN 12 0 retained Race/ethnicity EAW 2 10 low mapped count (Claude) Race/ethnicity USA 4 8 low mapped count (Kimi) Race/ethnicity ZAF 5 7 retained/sparse Religion All 10 full-scoreability contexts 12 0 retained Religion BRA 11 1 low mapped count (GPT) Sexual orientation AUS, EAW, NZL, USA 12 0 retained Sexual orientation BRA 11 1 low mapped count (GPT) Sexual orientation CAN 10 2 low mapped count (Llama, Qwen) Table 13: Common-support portfolio retained and dropped cells by attribute and context. The āMain reasonā column gives the dominant exclusion driver for dropped cells. Full per-model counts are in the sidecar. Table 14 separates the common-intersection rule from model-specific portfolios and shows how the mapped-count gate changes the retained cells and the composite. The common-intersection composite is the reported headline value. The model-specific columns show what each model could score on its own. Tightening the gate to nā„24nā„ 24 or nā„27nā„ 27 shrinks the race/ethnicity portfolio more than religion or sexual orientation. The headline composite should therefore be read together with the retained-cell counts. Portfolio rule n gate Composite range Race cells Rel. cells Orient. cells Common intersection ā„20ā„ 20 .508ā.606 28 131 69 Common intersection ā„24ā„ 24 .521ā.589 21 129 65 Common intersection ā„27ā„ 27 .529ā.648 12 127 60 Model-specific ā„20ā„ 20 .513ā.600 39ā59 131ā132 71ā72 Model-specific ā„24ā„ 24 .510ā.600 32ā59 130ā132 67ā72 Model-specific ā„27ā„ 27 .508ā.602 21ā58 129ā132 65ā72 Table 14: Portfolio robustness under common-intersection and model-specific cells and alternative mapped-count gates. The composite range is the minimum and maximum six-model equal-primary-module composite under the stated rule. Cell counts are ranges for model-specific portfolios and fixed values for the common intersection. Table 15 reports the model-specific values rather than only their range. The model-specific-minus-common difference is between ā.006-.006 and .012.012. Thus, using each modelās full scoreable portfolio does not remove the large geography-relative discrepancy, but it does reverse the GPTāLlama ordering. Equal-cell weighting has a larger effect on the score level because the 228-cell portfolio contains 28 race/ethnicity cells, 131 religion cells, and 69 sexual-orientation cells. It therefore gives the low-divergence religion module substantially more influence than the primary equal-module hierarchy. Weighting cells by their model-specific mapped count within each context changes every composite by less than .001.001. Model Common Model-specific Difference Equal cell Mapped-n GPT-5.6 .561 .567 +.006 .501 .561 Claude Sonnet 5 .599 .597 ā.002-.002 .509 .599 Gemini 3.5 Flash .508 .513 +.005 .459 .508 Kimi K3 .554 .556 +.002 .470 .554 Llama 4 Maverick .556 .568 +.012 .505 .557 Qwen3.7-Max .606 .600 ā.006-.006 .542 .606 Table 15: Model-level portfolio and weighting sensitivity. āCommonā is the primary nā„20nā„ 20 six-model intersection. āModel-specificā uses each modelās own nā„20nā„ 20 cells. āEqual cellā averages all 228 retained cells without the moduleācontext hierarchy. āMapped-nā retains equal modules and contexts but weights cells within each context by that modelās mapped count. Two thousand bootstrap draws, using seed 20260722, resample mapped declarations within modelācell and recompute JSD, common hierarchy, and portfolio summaries. Intervals condition on the frozen generations, targets, mappings, support portfolio, and extracted labels. Equal-cell weighting and leave-one-primary-module-out portfolios provide weighting diagnostics. The gender-to-sex diagnostic is not used as an alternative portfolio component. Target-consistent finite-sample calibration. Could finite mapped sample sizes explain the observed divergence? The primary plug-in JSD is positive even when a finite sample is drawn from its target. To isolate plug-in sampling variation, we simulate each frozen common-support cell under exact alignment with its geography-derived target, using the observed mapped count ngn_g. The same 228 cells and aggregation hierarchy are retained, and the mapped-count gate is not reapplied. The resulting distribution is a target-consistent sampling reference. It is not a confidence interval for the modelās true score and does not validate the target, extraction, or mapping. Xg(b) X_g^(b) ā¼Multinomialā”(ng,Pgeo,k,cā), (n_g,P^*_geo,k,c), dg(b) d_g^(b) =JSD2ā”(Xg(b)/ng,Pgeo,k,cā). =JSD_2\! (X_g^(b)/n_g,P^*_geo,k,c ). We freeze all 228 common primary attributeācontextāformatārole cells and do not reapply the nā„20nā„ 20 gate. Every simulated portfolio uses the same hierarchy as the observed score. It averages cells within contexts, contexts within modules, and equal weighting of primary modules. Conditioning on ngn_g isolates finite-sample conditional-composition variation. It does not model demographic non-realization or mapping loss. We use 20,000 draws with seed 20260724 and independent SeedSequence-derived PCG64 streams for the sorted modelācell keys. A second 20,000-draw run with seed 20260725 changed the model-level 99% upper endpoints by at most .00011. The largest model-level central 99% upper endpoint is .033, whereas the observed composites range from .508 to .606. Finite-sample plug-in variation therefore cannot account for the reported scale of divergence. Table 16 reports reference distributions rather than confidence intervals for the true model scores. Model Observed Null median Central 99% ref. GPT-5.6 .561 .027 [.024, .032] Claude 5 .599 .028 [.025, .033] Gemini 3.5 .508 .028 [.024, .032] Kimi K3 .554 .028 [.025, .033] Llama 4 .556 .028 [.025, .033] Qwen3.7-Max .606 .027 [.024, .031] Table 16: Target-consistent finite-sample calibration of the equal-primary-module composite JSD2JSD_2. Each reference distribution conditions on frozen targets, category supports, common cells, mapped sample sizes, and aggregation. It calibrates plug-in sampling variation under exact alignment. It does not validate the target, extraction, mappings, or a fairness construct. D.5 Mapped-Output Rates and Primary Results Mapped-output rates. Regime Model Gā diag. Race/ethnicity Religion Orientation Implicit GPT-5.6 .967/1.000/1.000 .000/.000/.067 .000/.000/.067 .000/.000/.767 Claude Sonnet 5 .933/1.000/1.000 .000/.000/.100 .000/.000/.133 .000/.000/.133 Gemini 3.5 Flash .933/1.000/1.000 .000/.000/.067 .000/.000/.400 .000/.000/.233 Kimi K3 .967/1.000/1.000 .000/.000/.200 .000/.000/.267 .000/.000/.467 Llama 4 Maverick .967/1.000/1.000 .000/.000/.300 .000/.000/.200 .000/.000/.167 Qwen3.7-Max 1.000/1.000/1.000 .000/.000/.233 .000/.000/.200 .000/.000/.167 Joint GPT-5.6 .100/1.000/1.000 .100/1.000/1.000 .100/1.000/1.000 .100/1.000/1.000 Claude Sonnet 5 .967/1.000/1.000 .033/.800/1.000 .967/1.000/1.000 1.000/1.000/1.000 Gemini 3.5 Flash .967/1.000/1.000 .600/.900/1.000 .967/1.000/1.000 .867/1.000/1.000 Kimi K3 1.000/1.000/1.000 .333/.867/1.000 .967/1.000/1.000 1.000/1.000/1.000 Llama 4 Maverick .233/1.000/1.000 .133/.900/1.000 .733/1.000/1.000 .433/1.000/1.000 Qwen3.7-Max 1.000/1.000/1.000 .633/1.000/1.000 .933/1.000/1.000 .300/1.000/1.000 Table 17: Cell-level empirical mapped-output rate Ļ^k Ļ_k across source-scoreable cells, reported as minimum/median/maximum for each modelāmodule pair and separately by regime. The denominator is all 30 generated outputs. Extraction failures, absent mappable evidence, and explicit out-of-support realizations count as ā„ . Gā is the separate gender-to-sex diagnostic. Across the 18 joint-elicitation modelāprimary-module pairs, the median cell-level mapped-output rate Ļ^k Ļ_k ranges from .800 to 1.000. These rates describe the availability of reference-mapped evidence. They are not estimates of absolute group visibility. Pooling the 1,584 modelācell observations over all 264 source-scoreable cells (264Ć6264Ć 6 models) gives a fifth percentile of .767 and a minimum of .033. Implicit race/ethnicity, religion, and orientation usually do not meet the 20-declaration common-support gate. Only textual gender supports the separate gender-to-sex implicit diagnostic, for which the six-model JSD2JSD_2 on the 144 cells shared by all models ranges from .116 (Gemini) to .291 (GPT). Joint elicitation yields sufficient reference-mapped evidence to estimate all four textual dimensions under the frozen protocol, but these estimates characterize elicited composition rather than spontaneous defaults. A possible alternative explanation is that high geography-relative divergence is driven primarily by low mapped-output rates. Figure 6 examines this relationship descriptively within the frozen common-support portfolio. Within this truncated portfolio, mapped-output rate shows little monotonic association with cell-level divergence for religion or sexual orientation and only a weak association for race/ethnicity. This diagnostic does not address cells excluded by the nmappedā„20n_mappedā„ 20 gate. Figure 6: Mapped-output rate and primary JSD2JSD_2 for each modelācell observation in the frozen joint-elicitation common-support portfolio, faceted by primary module. Module-specific Spearman correlations are .185 for race/ethnicity, ā.046-.046 for religion, and ā.036-.036 for sexual orientation. The display is descriptive and restricted to the frozen common-support portfolio. In particular, the nmappedā„20n_mappedā„ 20 gate truncates the low-Ļ^k Ļ_k tail. Faceting avoids treating module, category count, and source coverage as exchangeable. Mapping-related sensitivities. The primary JSD conditions on reference-mapped outputs. As a deliberately stronger sensitivity, define qĀÆā(a) q(a) =Ļ^kāq^ā(a), = Ļ_k q(a), qĀÆā(ā„) q( ) =1āĻ^k, =1- Ļ_k, PĀÆāā(a) P^*(a) =Pāā(a), =P^*(a), PĀÆāā(ā„) P^*( ) =0. =0. This construction penalizes non-mapping, not merely attribute non-realization, because ā„ also contains explicit realizations outside the declared source support. It therefore adds the assumption that all unmapped mass is target violation and is not suitable as the sole primary metric. Model nā„20nā„ 20 Aug. nā„24nā„ 24 nā„27nā„ 27 GPT-5.6 .561 .565 .553 .621 Claude Sonnet 5 .599 .606 .580 .644 Gemini 3.5 Flash .508 .519 .521 .529 Kimi K3 .554 .560 .536 .591 Llama 4 Maverick .556 .567 .551 .565 Qwen3.7-Max .606 .607 .589 .648 Table 18: Mapping-related sensitivities for the equal-primary-module composite. The nā„20nā„ 20 column is primary. Aug. assigns zero target mass to ā„ on the same 228 cells. Gates of 24 and 27 retain 215 and 199 cells. They are robustness checks, not alternative primary rules. The augmented-state analysis preserves the large target-relative divergences and changes the ordering only by reversing GPT and Llama. The stricter mapped-count checks likewise preserve the substantive conclusion, although the ordering changes further at nmappedā„27n_mappedā„ 27 as the race/ethnicity portfolio contracts from 28 to 12 common cells. Observable non-mapping states and allocation envelope. The primary ā„ state should not be described as one homogeneous form of missingness. The frozen records support five mutually exclusive observable states. They are reference-mapped evidence, no explicit protagonist-owned evidence (unspecified), an explicit raw label not admitted by the partial source mapping (other/map.), an ambiguous or absent protagonist, and an extraction record that failed strict validation. Table 19 reports their corpus-level proportions for every modelāprimary-module pair over all source-scoreable joint-elicitation cells. No output in this slice has an ambiguous or absent protagonist. Because the frozen mapping log does not identify a ground truth for an unadmitted raw label, the other/map. column cannot be validly subdivided into ālegitimate out-of-support realizationā and āmapping error.ā The audit therefore reports the distinction the records support rather than assigning causes post hoc. Model Module Mapped Unspec. Other/map. Failure GPT-5.6 Race/eth. 94.9% 0 3.1% 2.0% Religion 99.1% 0 <<.1% .9% Orient. 98.3% 0 0 1.7% Claude 5 Race/eth. 71.3% 0 28.7% 0 Religion 100.0% 0 0 <<.1% Orient. 100.0% 0 0 0 Gemini 3.5 Race/eth. 88.4% 0 11.5% <<.1% Religion 99.8% 0 .2% .1% Orient. 99.4% 0 .6% <<.1% Kimi K3 Race/eth. 81.8% 0 18.2% 0 Religion 99.9% 0 .1% 0 Orient. 100.0% 0 0 0 Llama 4 Race/eth. 87.2% 0 12.8% 0 Religion 99.0% .2% .9% 0 Orient. 97.1% .1% 2.7% 0 Qwen3.7 Race/eth. 98.6% 0 1.4% 0 Religion 99.9% 0 .1% 0 Orient. 96.9% 0 3.1% 0 Table 19: Observable decomposition of ā„ over all source-scoreable joint-elicitation outputs. Denominators are 1,800 outputs per model for race/ethnicity, 3,960 for religion, and 2,160 for sexual orientation. āOther/map.ā contains explicit raw labels that the predeclared partial mapping does not admit to the source taxonomy. An ambiguous or absent protagonist is 0 throughout and is omitted from the compact table. Percentages are corpus-level availability summaries, not cell-balanced composite weights. We additionally retain all 264 source-scoreable cells and allocate each cellās non-mapped mass over its declared source categories. The best case uses the fractional allocation minimizing JSD2JSD_2. The worst case assigns all non-mapped mass to whichever single source category maximizes it. Allocation is optimized independently by cell before applying the same equal-cell-within-context, equal-context-within-module, and equal-module hierarchy. These are completion envelopes, not confidence intervals. They deliberately ask how much the reported score could move under extreme in-support completions, and neither endpoint asserts the true identity of any non-mapped output. For a separate visibility sensitivity on the fixed 228-cell common portfolio, define Dm,Ī· D_m,Ī· =Sm+Ī·āVm,Ī·ā[0,1], =S_m+Ī· V_m, Ī·ā[0,1], Vm V_m =Agggā”(1āĻ^m,g). =Agg_g(1- Ļ_m,g). This diagnostic makes the exchange rate between conditional composition and non-mapping explicit. It is not proposed as a fairness metric. Model SmS_m All cond. Envelope VmV_m Dm,.5D_m,.5 Dm,1D_m,1 GPT .561 .567 [.541,.572] .013 .567 .574 Claude .599 .597 [.499,.609] .040 .619 .639 Gemini .508 .513 [.470,.522] .032 .524 .540 Kimi K3 .554 .554 [.477,.561] .035 .572 .589 Llama .556 .567 [.494,.576] .051 .581 .606 Qwen .606 .600 [.577,.601] .008 .610 .615 Table 20: Missing-mass and visibility sensitivity. āAll-cell conditionalā removes the nā„20nā„ 20 gate but, like the primary score, conditions on mapped outputs. The completion envelope instead assigns all non-mapped mass to in-support categories over all 264 source-scoreable cells. VmV_m and Dm,Ī·D_m,Ī· use the frozen 228-cell common portfolio. The envelope is a deterministic sensitivity range, not an uncertainty interval. Attribute decomposition. Model Gā Race Rel. Orient. Comp. GPT .298 .578 .330 .776 .561 Claude .309 .599 .264 .933 .599 Gemini .101 .380 .231 .913 .508 Kimi K3 .253 .564 .244 .854 .554 Llama .252 .511 .336 .821 .556 Qwen .273 .574 .344 .901 .606 Table 21: Joint-elicitation base-2 JSD2JSD_2 under the geography-derived targets and common support. The scoreable-context counts are 12 for Gā , 5 for race/ethnicity, 11 for religion, and 6 for orientation. The composite gives the three primary modules equal weight. The cross-construct Gā diagnostic is excluded. The 2,000-draw bootstrap produces percentile intervals of the resampled plug-in estimator. They are [.558,.577][.558,.577] for GPT, [.599,.606][.599,.606] for Claude, [.508,.528][.508,.528] for Gemini, [.556,.568][.556,.568] for Kimi, [.554,.575][.554,.575] for Llama, and [.604,.616][.604,.616] for Qwen. These are conditional resampling summaries, not asserted bias-corrected confidence intervals. Finite-sample upward bias in nonlinear plug-in JSD can place a point estimate below the resampling interval. The main paper does not use these intervals to claim a general fairness leaderboard. Weighting diagnostics are robustness checks within the three-primary-module portfolio, not evidence of independence from attribute choice, category granularity, target sources, or prompt protocol. The mapping-loss audit retains every raw label that cannot be reference-mapped rather than silently dropping its content. Metric decomposition. JSD2JSD_2 is supplemented with two category-level summaries on the identical 228-cell common portfolio. Total variation is TVā”(q,P)=12āāa|qā(a)āPā(a)|TV(q,P)= 12 _a|q(a)-P(a)|, and the maximum absolute category deviation is maxaā”|qā(a)āPā(a)| _a|q(a)-P(a)|. Each quantity is computed within cell before applying the primary hierarchy. Table 22 shows that the large JSD values are accompanied by large absolute mass displacements rather than being solely an artifact of the logarithmic metric or a single selected case. These summaries remain marginal and target-relative. They do not identify portrayal quality or harm. Model JSD2 TV Mean max. |Īa|| _a| GPT-5.6 .561 .695 .669 Claude Sonnet 5 .599 .698 .676 Gemini 3.5 Flash .508 .639 .611 Kimi K3 .554 .673 .639 Llama 4 Maverick .556 .697 .665 Qwen3.7-Max .606 .721 .697 Table 22: Metric decomposition under the geography-derived target and primary aggregation hierarchy. āMean max.ā is the hierarchical mean of the largest absolute signed category deviation within each cell, not the maximum after aggregation. D.6 Portfolio-Wide Divergence and Selected Compositions Are the headline results broad or driven by a small number of cells? Figure 7 displays the cell-level geography-relative divergence over the complete joint-elicitation common-support portfolio. The selected composition cases then show what three distinct context-level summaries look like. They comprise the context with the lowest geography-relative divergence within an attribute, the context nearest that attributeās median, and the context with the largest mean absolute comparator-replacement change. The first display establishes breadth. The second shows the underlying compositions. Figure 7: Cell-level JSD2JSD_2 to the geography-derived target for every joint-elicitation common-support cell, faceted by primary attribute. Each panel shows a boxplot and jittered points for the six models over the frozen common-support portfolio (equal cell weighting). The distributions show that the high divergence reported in the headline composites is not confined to the selected contexts in Figure 8. Selection of the composition cases. For each primary attribute we select the contexts with the lowest mean geography-relative JSD, the mean JSD nearest the attribute median, and the largest mean absolute comparator-replacement change. If the first and third coincide, we use the next-highest distinct context for the latter. Each display is the equal-weight aggregate of reference-mapped common-support cells across the 6 roles and 2 formats, matching the headline cell-within-context aggregation rather than representing a single role-specific cell. Figure 8: Selected race/ethnicity compositions. Columns show the lowest-divergence, median-nearest, and most comparator-sensitive contexts. Each row is an equal-cell mean over retained formatārole cells. Outputs are not pooled. The context-specific legends preserve each sourceās native taxonomy. Figure 9: Selected religion compositions under the same selection and aggregation rules as Figure 8. The three contexts share the harmonized source taxonomy shown in the legend. Figure 10: Selected sexual-orientation compositions under the same selection and aggregation rules as Figure 8. Canadaās source merges bisexual and pansexual into one category. D.7 Prompt-Bundling Sensitivity Design and estimand. The headline panel jointly elicits four demographic dimensions. Joint elicitation may change the selected or textually realized value distribution relative to eliciting one dimension at a time. We therefore ran a separate randomized protocol experiment comparing implicit, single-attribute, and joint-elicitation arms. This experiment evaluates prompt-bundling sensitivity. It does not convert either explicit arm into an estimator of spontaneous composition. The same six model families completed fresh character-generation tasks in the United States, Brazil, Canada, and England and Wales. The design crosses three roles (nurse, engineer, and CEO), 15 replicates, and six randomized arms comprising one implicit arm, four single-attribute arms, and one joint-elicitation arm. This yields 4Ć3Ć15Ć6=1,0804Ć 3Ć 15Ć 6=1,080 outputs per model and 6,480 total. A 24-output format/provider smoke test preceded the locked run and is excluded. Fresh implicit and joint outputs avoid comparisons with historical generations from different dates or endpoints. Provider routing is recorded per successful task. GPT-5.6, Claude Sonnet 5, Gemini 3.5 Flash, and Llama 4 Maverick were served through OpenRouter for all 1,080 tasks. Kimi K3 was served through OpenRouter for 1,002 tasks and through the Moonshot AI direct endpoint for 78. Qwen3.7-Max was served through OpenRouter for 394 tasks and through Alibaba Cloud Model Studio for 686. Both endpoints appear in every arm for Kimi and Qwen, but their proportions vary across arms and cells. Execution order was randomized across the whole manifest with a fixed seed rather than blocked by modelācontextārole. Each model followed the same order and every arm has exactly 15 replicates in each modelācontextārole cell, but serving endpoint was neither randomized nor a blocking factor. Prompt-arm and endpoint effects therefore cannot be separated for Kimi or Qwen, especially the latter. The qualitative claim that bundling effects vary by model and attribute is also visible among the four models served entirely through one endpoint and does not depend on attributing the Kimi or Qwen differences to prompting alone. The primary quantity compares the structured value selections under single-attribute and joint elicitation. A secondary analysis strips the metadata and re-extracts the prose to distinguish changes in selected values from changes in textual realization. Within-arm footerāprose consistency is reported separately. For explicit arms, selected values come from the required structured footer. The implicit gender arm uses prose extraction. A cell is included when both explicit arms have at least 10 reference-mapped selections. We average roles within context and contexts within attribute, and use 5,000 cluster-bootstrap resamples of the 12 contextārole cells. Table 23 reports the single-versus-joint comparison through two channels. Selection is the footer-based JSD2JSD_2 between the value distributions selected under single-attribute and joint elicitation. Realization scores the same arms through metadata-stripped prose extraction. Single consist. and joint consist. are the JSD2JSD_2 values between the footer value and the prose evidence within each arm. Bundling sensitivity is model- and attribute-dependent. The three-module mean ranges from .111 to .233, while individual modules range from .009 to .449. The lower race/ethnicity coverage for Claude and Kimi is disclosed rather than imputed. The prose-based and footer-based single-versus-joint differences are close for most modelāattribute pairs, with the largest selectionārealization gaps (about .01ā.02 in JSD2JSD_2) for Llama race/ethnicity and sexual orientation and for Kimi joint race/ethnicity. The general conclusion is therefore unchanged when both arms are scored from prose rather than from the structured footer. Story-only reference-mapped realization is high in most explicit arms but not perfect (from .806 to 1.000 across the displayed primary comparisons), reinforcing that requested selection and natural prose realization are distinct measurement channels. Model Attribute Cells Selection JSD2JSD_2 [95% CI] Realization JSD2JSD_2 Single consist. Joint consist. GPT-5.6 Gender 12 .009 [.000,.027] .009 .000 .000 GPT-5.6 Race/ethnicity 12 .052 [.022,.071] .051 .000 .000 GPT-5.6 Religion 12 .159 [.103,.218] .159 .000 .000 GPT-5.6 Sexual orientation 12 .123 [.058,.203] .127 .001 .000 Claude 5 Gender 12 .000 [.000,.000] .000 .000 .000 Claude 5 Race/ethnicity 5 .204 [.042,.508] .200 .000 .001 Claude 5 Religion 12 .156 [.080,.228] .157 .003 .000 Claude 5 Sexual orientation 12 .009 [.000,.017] .009 .000 .000 Gemini 3.5 Gender 12 .091 [.047,.144] .091 .000 .000 Gemini 3.5 Race/ethnicity 12 .147 [.090,.210] .146 .000 .001 Gemini 3.5 Religion 12 .176 [.093,.273] .176 .000 .000 Gemini 3.5 Sexual orientation 12 .026 [.012,.042] .026 .000 .000 Kimi K3 Gender 12 .009 [.002,.016] .009 .000 .000 Kimi K3 Race/ethnicity 5 .110 [.018,.165] .083 .001 .012 Kimi K3 Religion 12 .172 [.109,.233] .169 .006 .000 Kimi K3 Sexual orientation 12 .065 [.040,.092] .065 .000 .000 Llama 4 Gender 12 .030 [.006,.056] .030 .000 .000 Llama 4 Race/ethnicity 12 .159 [.074,.267] .148 .009 .012 Llama 4 Religion 12 .190 [.126,.232] .197 .003 .001 Llama 4 Sexual orientation 11 .204 [.084,.341] .208 .004 .012 Qwen3.7 Gender 12 .045 [.022,.071] .045 .000 .000 Qwen3.7 Race/ethnicity 11 .211 [.127,.314] .210 .000 .000 Qwen3.7 Religion 12 .449 [.317,.599] .449 .000 .000 Qwen3.7 Sexual orientation 12 .041 [.029,.053] .038 .002 .000 Table 23: Single-attribute versus joint-elicitation sensitivity in the prompt-bundling experiment. āSelectionā is the JSD2JSD_2 between the structured-footer value distributions of the single-attribute and joint arms, with 95% cluster-bootstrap intervals. āRealizationā is the same comparison measured through metadata-stripped prose extraction. āSingle consist.ā and āJoint consist.ā are the JSD2JSD_2 values between the footer value and the prose evidence within each arm. Consistency near zero means the requested value is realized in the text. Values are hierarchical point means over the listed scoreable contextārole cells. Gender regime diagnostic. Model Imp. share Alone Joint Imp.āalone Aloneājoint GPT .883 1.000 .983 .074 .009 Claude .994 1.000 1.000 .003 .000 Gemini .789 .478 .672 .164 .091 Kimi K3 .961 .972 .978 .014 .009 Llama .978 1.000 .944 .012 .030 Qwen .567 .789 .861 .161 .045 Table 24: Textual gender realization across fresh implicit, gender-only, and joint-elicitation arms. Female/woman share is averaged over contextārole cells. The last two columns compare the full mapped textual-gender distributions. These are prompting diagnostics, not evidence that textual gender and source-reported sex are the same construct. The gender-only arm is not uniformly closer to the implicit arm than the joint arm, and the size of the regime shift varies by model. No output in any arm was classified as a refusal. Taken together, prompt-bundling effects vary by model and attribute rather than following one uniform direction. The experiment supports treating joint-elicitation composition as a distinct elicited estimand, not as interchangeable with either single-attribute elicitation or spontaneous implicit composition. Table 23 shows that this conclusion holds for prose realization as well as for structured footer selection. The single-versus-joint differences measured from metadata-stripped prose are close to the footer-based differences, and the footerāprose consistency gaps are small relative to the elicitation-bundling effect. The claim should not be extrapolated to spontaneous defaults, to the story format used in the headline panel, or to other formats or languages, none of which this experiment estimates. D.8 Fixed-Output Comparator Sensitivity Six-model equal-category alternative The fixed-output analysis asks how much the assessment changes when the geography-derived target PgeoāP^*_geo is replaced by the equal-category comparator PāP , while generations, extraction, mappings, source-category support, retained cells, scoring, and aggregation remain fixed. The difference between the two model-level composites is not the sensitivity estimand, because positive and negative cell-level changes can cancel during aggregation. We therefore take |dggeoādgeq||d^geo_g-d^eq_g| at the cell level before applying the same format-within-context, context-within-attribute, and equal-primary-module hierarchy. Support definition. The equal comparator assigns mass 1/|k,cref|1/|A_k,c^ref| over the full declared source-category set k,crefA_k,c^ref on which the geography-derived target is definedāthe same category set, not merely the categories with positive observed mass. The machine-readable target files contain no exact-zero entries. Values displayed as 0.0000 in the readable registry tables (Appendix D.2) are display rounding of small positive masses. The positive-mass support of the source distribution therefore coincides with the full declared category set, and restricting the equal comparator to positive-mass categories would not change any reported value. The choice matters most for religion, where some source categories carry negligible mass and nevertheless receive equal share under the comparator. Continuous comparator paths. The endpoint substitution is intentionally extreme, so we also evaluate two continuous families on the identical frozen outputs and common portfolio: PĪ» P_Ī» =(1āĪ»)āPgeoā+Ī»āPā, =(1-Ī»)P^*_geo+Ī» P , Ī» Ī» ā0,.1,ā¦,1, ā\0,1,ā¦,1\, PĪ±ā(a) P_Ī±(a) =Pgeoāā(a)Ī±ābPgeoāā(b)Ī±, = P^*_geo(a)^Ī± _bP^*_geo(b)^Ī±, Ī± Ī± ā1,.75,.5,.25,0. ā\1,75,5,25,0\. Both paths start at the geography-derived target and end at the equal-category comparator. The mixture path transfers probability mass linearly. The power path compresses category-probability ratios. Intermediate members are sensitivity comparators, not separately justified targets. All six mixture-path composites initially decrease. Between Ī»=0Ī»=0 and .1.1, the reductions range from .020.020 to .028.028. They reach their minima around Ī»=.6Ī»=.6ā.7.7 and then increase toward the equal-category endpoint. The power path yields the same qualitative non-monotonicity, with the lowest reported point at Ī±=.25Ī±=.25 for every model. Thus the endpoint displacement reported in the main paper is not the only evidence of comparator dependence. Assessment levels and some pairwise orderings change under substantially milder departures from the geography-derived comparator. For the thresholded analysis, define IgPā(Ļ) I_g^P(Ļ) =ā[dgPā¤Ļ], =1\! [d_g^Pā¤Ļ ], Ī“gā(Ļ) _g(Ļ) =ā[Iggeoā(Ļ)ā Igeqā(Ļ)], =1\! [I_g^geo(Ļ)ā I_g^eq(Ļ) ], Tmā(Ļ) T_m(Ļ) =āgāmwgāĪ“gā(Ļ). = _g _mw_g\, _g(Ļ). Here, wgw_g reproduces the declared equal-primary-module, context-within-module, and cell-within-context hierarchy. Tmā(Ļ)T_m(Ļ) is the weighted cell mass whose within-tolerance classification changes when only the comparator is replaced. We report Ļā.1,.2,.3Ļā\.1,.2,.3\ as diagnostic sensitivity settings, not fairness cutoffs. Across the six models and three settings, Tmā(Ļ)T_m(Ļ) ranges from 12.8% to 40.0%. Both transition directions occur in the reported partitions, although not in every modelātolerance pair. The released sidecar also separates geography-only and equal-category-only within-tolerance transitions. (a) Continuous comparator paths (b) Exact threshold-sensitivity curve Figure 11: Fixed-output comparator sensitivity with generations, extraction, mappings, source-category support, 228 common cells, and hierarchy fixed. (a) Each point is the three-primary-module composite after replacing only the comparator along mixture and power paths. The non-monotone curves show that the frozen compositions need not align best with either endpoint. At Ī»=.2Ī»=.2, Llama moves ahead of Kimi and Qwen moves ahead of Claude. (b) For each model, Tmā(Ļ)T_m(Ļ) is evaluated at every empirical breakpoint from the two cell-level JSD2JSD_2 values and drawn without smoothing or interpolation. Hollow markers identify the three reported diagnostic settings. The panels diagnose assessment dependence on the comparator, do not rank model fairness, and do not endorse the thresholds as fairness cutoffs. Figure 12: Status transitions at the reported tolerances. At Ļā.1,.2,.3Ļā\.1,.2,.3\, stacked bars partition cells into within tolerance under both comparators, geography only, equal category only, and outside under both. The reported changed share sums the two one-comparator-only parts. Outputs, mappings, support, cells, and aggregation are fixed. Figure 11(b) shows comparator-induced assessment instability over the complete threshold domain. Figure 12 then decomposes the changed mass by transition direction at the three reported diagnostic tolerances. The curve is generally non-monotone. A cell contributes when Ļ lies between its two comparator-specific JSD2JSD_2 values and ceases to contribute after Ļ exceeds both. The finite portfolio therefore implies an exact step function rather than a smooth trend. Together, the displays separate the primary claimāhow often the assessment changesāfrom the directional detail of which comparator alone places a cell within tolerance. Model Geography-derived composite Equal-category composite Mean absolute cell change [95% interval] GPT-5.6 .561 .493 .355 [.348, .359] Claude Sonnet 5 .599 .558 .330 [.328, .333] Gemini 3.5 Flash .508 .462 .279 [.278, .292] Kimi K3 .554 .486 .333 [.328, .336] Llama 4 Maverick .556 .487 .311 [.303, .317] Qwen3.7-Max .606 .536 .333 [.328, .336] Table 25: Fixed-output comparator sensitivity. The first two columns reproduce the model-level point estimates in Main Table 2. The final column reports the hierarchically aggregated mean absolute cell-level change and its percentile interval from 2,000 bootstrap resamples. It is not the absolute difference between the two model-level composites, because positive and negative cell changes can cancel in the aggregate. Attribute-level mean absolute changes remain heterogeneous across race/ethnicity, religion, and sexual orientation (Table 26). The separately reported gender-to-sex diagnostic has smaller comparator-substitution effects because its binary source distributions are nearly balanced, but it is not part of this composite. These values demonstrate why the scalar composite difference is not an adequate sensitivity statistic. Model Race/eth. |Ī|| | Religion |Ī|| | Orientation |Ī|| | GPT-5.6 .168 .410 .488 Claude Sonnet 5 .208 .372 .411 Gemini 3.5 Flash .135 .287 .414 Kimi K3 .217 .346 .437 Llama 4 Maverick .169 .342 .423 Qwen3.7-Max .209 .335 .454 Table 26: Attribute-level mean absolute cell-level comparator-replacement change on the joint-elicitation common-support portfolio, in the notation of Appendix D.4. Religion and sexual orientation dominate the composite-level .279ā.355. Race/ethnicity has the smallest attribute-level mean absolute changes. Its common-support portfolio is also the smallest (28 cells). Role-Conditioned Occupational-Comparator Diagnostic Equal-category replacement changes the allocation rule while retaining the geography-derived category support. A distinct diagnostic asks how a role-dependent occupational-incumbency comparator changes scores on the same fixed U.S. outputs. Because occupational incumbency is not admitted as a target for the declared public-world use, this analysis is descriptive and does not enter the headline benchmark. An auxiliary analysis uses fixed U.S. implicit story outputs from all six models and recomputes gender JSD2JSD_2 under the equal-category comparator, the U.S. geography-derived target, and 2025 BLS occupational female proportions (U.S. Bureau of Labor Statistics 2025). The occupational distribution is a descriptive comparator rather than a replacement target. For each modelārole cell, we place a Beta(0.5,0.5)(0.5,0.5) prior on the textual female proportion, draw 100,000 posterior samples, and compute binary JSD2JSD_2 against each comparator under every draw. Aggregate and paired occupational-minus-geography intervals are the 2.5th and 97.5th percentiles of the corresponding draws. Role-level deltas are computed draw by draw before roles are averaged. Values in Table 27 are posterior medians with 95% intervals. Model Geo.-derived Occupational Occ.ā-Geo. Mean |Īrole|| _role| GPT-5.6 .276 [.238,.301] .324 [.285,.349] +.048 [.040,.060] .166 [.153,.171] Claude 5 .231 [.196,.254] .262 [.225,.286] +.030 [.020,.043] .148 [.134,.157] Gemini 3.5 .153 [.120,.182] .214 [.175,.249] +.061 [.049,.075] .139 [.124,.149] Kimi K3 .266 [.227,.294] .317 [.277,.343] +.050 [.042,.062] .164 [.151,.170] Llama 4 .276 [.238,.301] .325 [.285,.349] +.048 [.041,.060] .166 [.153,.171] Qwen3.7 .276 [.238,.301] .325 [.285,.349] +.048 [.041,.060] .166 [.153,.171] Table 27: U.S. six-role fixed-output occupational-comparator diagnostic for all six models. Values are posterior medians with 95% intervals from 100,000 draws. The occupational-incumbency comparator is descriptive and does not enter the headline benchmark. Role-level occupational-minus-geography changes are plotted in Figure 13. Figure 13: Role-conditioned occupational-comparator diagnostic on fixed U.S. implicit outputs. Each cell reports the occupational-minus-geography JSD2JSD_2 by model and role. Negative values indicate closer agreement with the occupational comparator. The associated descriptive posterior intervals are reported in Table 27. No multiplicity-adjusted hypothesis testing is performed. The diagnostic illustrates comparator dependence and does not treat occupational incumbency as an admitted target. The role-level diagnostic illustrates the argument in the main paper. A nurse output cell entirely mapped to the female/woman textual category can be much closer to an occupational comparator than to the geography-derived target, while an engineer cell with the same mapped textual composition can be much farther from the occupational comparator than from the same geography-derived target. The outputs have not changed. The occupational comparator changes which role-conditioned patterns count as expected. Appendix E Corrective Target Families and the CalibrationāIntervention Distinction Population-relative calibration does not imply that population proportionality is socially optimal or that corrective representation is unwarranted. It means only that AP-Bench does not infer a corrective distribution from the general aim of increasing visibility. A corrective distribution becomes a target only after its beneficiary set, adjustment rule, magnitude, residual allocation, and remedial objective are specified and defended. E.1 Corrective Representation Is a Target Family AP-Bench does not oppose corrective representation. It declines to treat the general instruction to āincrease minority visibilityā as if it identified a single numerical comparator. Let Ppopā(Aā£G)P_pop(A G) be the population distribution for a defended public. One simple geography-indexed corrective family can be written Pcorrā(A=aā£G)=Ļaā(G)āPpopā(A=aā£G)ābĻbā(G)āPpopā(A=bā£G),P_corr(A=a G)= _a(G)P_pop(A=a G) _b _b(G)P_pop(A=b G), where some contextually marginalized groups may receive Ļaā(G)>1 _a(G)>1. This display is illustrative rather than exhaustive. A broader correction function may condition on role, historical period, intersecting identities, and the remedial objective. Endorsing correction in the abstract does not identify any such weight function. An operational target must still determine the following elements: ā¢ which categories are adjusted; ā¢ the direction of each categoryās adjustment; ā¢ the magnitude of every adjustment and the basis for that magnitude; and ā¢ the redistribution of the remaining probability mass across every other category. These elements determine the corrective target rather than merely tuning an otherwise fixed target. They require a defended remedial account specifying why the correction is warranted and how its magnitude is determined. Such an account may draw on empirical evidence of harm, rights- or recognition-based arguments, institutional objectives, or participatory stakeholder judgments. The framework does not privilege one form of justification in advance. Context, role, historical period, intersecting identities, the kind of deficit, and the remedial objective may all enter that function, but naming them does not determine its output. Thus, corrective representation is a target family that becomes scoreable only after its remedial premises and correction function are supplied. The proposition that diversity is valuable does not by itself select one member of that family. E.2 Calibration Is Not an Intervention Policy The benchmarkās population-relative score answers a calibration question under the declared geographic reference public and allocation-symmetry commitments: Qcal:q^(Aā£G,R)ā?Ppop(Aā£G).Q_cal: q(A G,R) ?āP_pop(A G). A corrective benchmark would answer an intervention question about how a specified representational harm should be remedied: Qint: Q_int: Which distribution would best remedy a specified representational harm? The first does not answer the second, but neither does it preclude it. The geography-derived target used as the calibration baseline need not be a claim about the socially optimal output distribution. Conditional on the reference public and source categories, it supplies a diagnostic zero point Īa=q^ā(A=aā£G,R)āPpopā(A=aā£G). _a= q(A=a G,R)-P_pop(A=a G). An evaluator may then make an independent judgment that some positive or negative Īa _a is desirable. Measuring first is not a commitment to policy neutrality forever. It prevents an unspecified intervention policy from being presented as a neutral calibration baseline. Embedding correction directly in the score would also confound policy compliance with the mechanism that produced an output. Suppose group a is 10% of the reference population and a corrective target assigns it 30%. A model matching 30% might be following the intended policy, accidentally over-generating the group, applying context-insensitive global diversity tuning, or responding to locally grounded evidence of exclusion. Distributional fit alone cannot distinguish these explanations. Once a corrective policy is fully specified, divergence can measure compliance with that policy, but low divergence cannot by itself show that the model recognized or remedied the underlying harm. E.3 There Is No Context-Invariant āMinority Bonusā Numerical minority status is not equivalent to marginalization. A group may be a national minority but a regional majority, numerically small without structural disadvantage, or numerically large while subject to institutional exclusion. The same named group can occupy different positions across contexts and historical periods. Therefore numerical minority āĢømarginalized group, group, marginalized group āĢøa unique representation bonus. unique representation bonus. A rule that boosts every numerically small category would conflate prevalence with disadvantage. A marginalization-based rule instead requires context-specific evidence about power, exclusion, history, and stakeholder judgments. That may be valuable, but it is a framework of corrective justice beyond AP-Benchās scoped calibration task. A context-free rule risks universalizing one account of diversity. E.4 Composition Does Not Exhaust Representational Repair Corrective representation can target overall frequency, minimum visibility, role placement, stereotype reduction, ordinary depiction, narrative agency, or portrayal quality. These interventions are not interchangeable. Aggregate over-representation can coexist with stereotyped roles, while proportional frequency can coexist with unequal agency or demeaning portrayal. AP-Bench measures reference-mapped composition and cannot establish that oversampling repairs the relevant harm. Situated community evaluation and accounts of cultural domination can motivate richer corrective or qualitative evaluation (Qadri et al. 2025; Young 1990), but do not by themselves determine its beneficiary set, weights, or intervention dimension. E.5 Why Equal-Person Weighting Is Used Here The equal-person construction used by AP-Bench is stated in Main Ā§4.3 and abstracted in Appendix B.3. A corrective construction may instead introduce differential member-level weights wi=gā(Ai,HG,R),w_i=g(A_i,H_G,R), where HG,RH_G,R represents defended context-, role-, and history-specific considerations. Differential weighting must state its allocation objective, relevant distinctions, and the direction and magnitude of their effects. A change in the represented public also requires a separate admissibility defense, and a fairness interpretation still requires the bridge premises. The construction remains contestable, but its commitments are transparent. Conditional on them, equal-person allocation determines a point target whose deviations can be evaluated separately. AP-Bench therefore reports over- and under-representation only relative to its geography-derived operational target. It abstains from inferring an underdetermined corrective policy. It does not argue against corrective representation. Appendix F Artifact Manifest Table 28 maps each released analytic component to its path and frozen version. Table 29 records the shared-panel model identifiers and serving settings. The generation config and JSONL rows retain model, provider, request, usage, and response metadata. Component Artifact path Version / hash Appendix Exact prompts artifact/prompts/prompts.json SHA-256 f15628c9...a5f344bf D.1 Generation config artifact/generation/generation_config.yaml SHA-256 92dbe7ef...a0bad5e D.1 Extractor prompt + runner benchmark/scripts/run_extractor_v3_candidate.py; benchmark/config/extractor_prompt_v4_candidate.txt; benchmark/config/extractor_prompt_v4_round2_supplement.txt Combined prompt SHA-256 9090a3d9...746514a8; runner c9837280...e65ce99 D.3 Raw-to-source mappings benchmark/config/attribute_label_mappings_v1.json SHA-256 f085acf5...85b86b410 D.2 Common-support portfolio artifact/analysis/common_cells.csv SHA-256 e406b111...b3db26c9 D.4 Portfolio robustness artifact/analysis/portfolio_robustness.json SHA-256 9b693da...6d25824c D.4 Supplement sensitivity analyses artifact/analysis/supplement_sensitivity_analysis.json SHA-256 fac0f3ea...88ddb2ce D.3āD.8 Missingness decomposition artifact/analysis/missingness_decomposition.csv; artifact/analysis/missingness_decomposition_summary.csv SHA-256 329bdb25...58782bd; f35fda9...c9ac892 D.5 Continuous comparator paths artifact/analysis/target_family_sensitivity.csv SHA-256 4716cf22...8f5a56 D.8 Result reproduction artifact/scripts/reproduce_tables.py SHA-256 28cf5f7b...d72556da D.2āD.8 Target source tables benchmark/data/processed/*_baselines*.csv Frozen 2026-07-20; per-source URLs and retrieval dates in file metadata D.2 Generation outputs benchmark/outputs/shared_panel_v1/, shared_panel_three_model_main_v1/, prompt_construct_validity_v1/ Freeze dates 2026-07-20 / 2026-07-22 / 2026-07-29; response model IDs and usage in each row D.4āD.6 Human validation procedure benchmark/annotation_codebook.md; benchmark/docs/human_annotation_task_guide_zh.md Single-annotator blind audit on the full 432-task packet; no double-coding or adjudication; summary statistics only (Appendix D.3) D.3 Extractor-error robustness artifact/analysis/extractor_error_robustness.json SHA-256 d254f87...10ca1da0 D.3 Extractor-error perturbation sensitivity artifact/analysis/extractor_error_perturbation_sensitivity.json SHA-256 8238dec5...33c21c5 D.3 Language-sensitivity diagnostic benchmark/outputs/powered_validation_v1_diagnostic_report.md; benchmark/outputs/powered_validation_v1_manifest.jsonl SHA-256 61ea9ba0...47b5ea9 (report); e5ada7d5...0ded8a7 (manifest) D.1 Table 28: Artifact manifest for the supplementary material. Hashes are shown as 8-hex-digit prefixes and suffixes for readability. Full digests are in the released files. The generation locks use the providers in Table 29. Exact endpoints and request parameters are preserved in the generation config and JSONL records. OpenRouterās exclude:true suppresses reasoning tokens in responses rather than disabling reasoning, and Gemini uses its lowest supported effort (minimal). The extraction lock uses deepseek-v4-flash at temperature 0 with three-attempt incremental backoff. Non-API analysis dependencies are pinned in requirements.txt. Model Request API ID Provider / endpoint Generation date Max tokens Fixed parameters GPT-5.6 openai/gpt-5.6-terra OpenRouter 2026-07-20 500 reasoning excluded, effort none Claude 5 anthropic/claude-sonnet-5 OpenRouter 2026-07-20 500 reasoning excluded, effort low Gemini 3.5 google/gemini-3.5-flash OpenRouter 2026-07-20 500 reasoning excluded, effort minimal Kimi K3 kimi-k3 Moonshot AI (CN) 2026-07-22 700 reasoning effort low Llama 4 meta-llama/llama-4-maverick OpenRouter 2026-07-22 500 provider defaults Qwen3.7 qwen3.7-max Alibaba Cloud Model Studio (Bailian) 2026-07-22 500 thinking disabled Table 29: Full API model identifiers and generation routing for the shared-panel locks (2026-07-20 and 2026-07-22). The prompt-construct-validity lock (2026-07-29) uses the same request model IDs. Per-lock parameters are logged in the generation JSONL files and in the generation-config file (Appendix F). The released tree also includes the target-source registry tables (Appendix D.2), the extraction codebook and supplement rules, the full generation and extraction logs, the annotation codebook and task guide (Appendix D.3), the powered-validation and language-sensitivity diagnostics (Appendix D.1), the extractor-error perturbation sidecar (Appendix D.3), and the JSON/CSV sidecars for the bootstrap, comparator-replacement sensitivity (frozen under the target_sensitivity_* artifact identifiers), continuous comparator paths, missingness decomposition, prompt-construct-validity, and occupation-diagnostic analyses. The reproducibility script in artifact/scripts/reproduce_tables.py runs the frozen analysis scripts and regenerates the tables and figures in Appendices D.4āD.8. The Qwen3.7-Max endpoint in artifact/generation/generation_config.yaml is recorded as the public DashScope compatible-mode endpoint. The account-specific endpoint used at freeze time is withheld.