Paper deep dive
Evaluating the Diversity of AI-Generated Content with Diversity Profiles
Xiuyuan Hu, Xuege Hou, Guoqing Liu, Yang Zhao, Jieran Li, Dongbiao Sun, José Miguel Hernández-Lobato, Hao Zhang, Xue Liu
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%
Last extracted: 8/19/2026, 5:24:42 AM
Summary
The paper critiques the use of single scalar scores for evaluating diversity in AI-generated content, arguing that such metrics are ambiguous and often contradictory due to differing inductive biases and parameter sensitivities. It proposes 'diversity profiles' as a solution: curve-valued, condition-aware summaries that evaluate parameterized diversity families (e.g., Energy, Circles, Vendi score, Magnitude) across a range of thresholds, scales, or orders. This approach reveals resolution-dependent trade-offs and provides a more robust, transparent framework for comparing generative models.
Entities (10)
Relation Signals (8)
Hao Zhang → affiliatedwith → Tsinghua University
confidence 95% · Corresponding author: Hao Zhang. Affiliation: Department of Electronic Engineering, Tsinghua University
Diversity Profiles → proposessolutionto → Ambiguity of Scalar Diversity Metrics
confidence 95% · To address these issues, we propose diversity profiles: curve-valued, condition-aware summaries... Overall, diversity profiles provide a more transparent and resolution-aware framework
Hao Zhang → affiliatedwith → University of Cambridge
confidence 90% · Affiliation: Department of Engineering, University of Cambridge
Vendi score → instantiates → Diversity Profiles
confidence 90% · We instantiate profiles for several representative metric families, including... Vendi score...
Magnitude Metric → instantiates → Diversity Profiles
confidence 90% · We instantiate profiles for several representative metric families, including... Magnitude...
Circles Metric → instantiates → Diversity Profiles
confidence 90% · We instantiate profiles for several representative metric families, including... Circles...
Energy Metric → instantiates → Diversity Profiles
confidence 90% · We instantiate profiles for several representative metric families, including Energy... and demonstrate their practical use
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Diversity is a fundamental criterion for evaluating generative artificial intelligence (AI) systems, yet its measurement remains inherently ambiguous. Existing approaches typically represent generated samples in an embedding space, compute pairwise distances or similarities, and aggregate them into a single scalar score. Such scalar summaries are convenient, but they often encode different inductive biases and may yield contradictory rankings of the same sample sets. In this paper, we argue that diversity evaluation for AI-generated content is intrinsically under-specified when reduced to a single number. We first review representative diversity metrics, and then diagnose their limitations from two complementary perspectives: an axiomatic analysis showing that no representative scalar metric satisfies all desirable properties simultaneously, and an empirical analysis showing that high-dimensional representation spaces can induce concentrated, modality-dependent distance distributions. To address these issues, we propose diversity profiles: curve-valued, condition-aware summaries that evaluate a parameterized diversity family across a range of thresholds, scales, exponents, or orders under a specified representation and distance or kernel function. Diversity profiles reveal whether a comparison is robust across resolutions or instead depends on an arbitrary parameter choice. We instantiate profiles for several representative metric families and demonstrate their practical use in generative AI evaluation. Overall, diversity profiles provide a more transparent and resolution-aware framework for comparing the diversity of AI-generated content.
Tags
Links
- Source: https://arxiv.org/abs/2608.17731v1
- Canonical: https://arxiv.org/abs/2608.17731v1
Trouble viewing inline? Open PDF directly →
Full Text
52,870 characters extracted from source content.
Expand or collapse full text
Evaluating the Diversity of AI-Generated Content with Diversity Profiles Xiuyuan Hu Affiliation: Department of Electronic Engineering, Tsinghua University, MBZUAI, Xuege Hou Guoqing Liu Affiliation: Microsoft Research AI for Science Yang Zhao Jieran Li Dongbiao Sun José Miguel Hernández-Lobato, Hao Zhang , Xue Liu Thanks: Corresponding author: Hao Zhang. Affiliation: Department of Electronic Engineering, Tsinghua University, MBZUAI, Affiliation: Department of Engineering, University of Cambridge Affiliation: McGill University, Mila - Quebec AI Institutehuxy22@mails.tsinghua.edu.cn, haozhang@tsinghua.edu.cn Abstract Diversity is a fundamental criterion for evaluating generative artificial intelligence (AI) systems, yet its measurement remains inherently ambiguous. Existing approaches typically represent generated samples in an embedding space, compute pairwise distances or similarities, and aggregate them into a single scalar score. Such scalar summaries are convenient, but they often encode different inductive biases and may yield contradictory rankings of the same sample sets. In this paper, we argue that diversity evaluation for AI-generated content is intrinsically under-specified when reduced to a single number. We first review representative diversity metrics, and then diagnose their limitations from two complementary perspectives: an axiomatic analysis showing that no representative scalar metric satisfies all desirable properties simultaneously, and an empirical analysis showing that high-dimensional representation spaces can induce concentrated, modality-dependent distance distributions. To address these issues, we propose diversity profiles: curve-valued, condition-aware summaries that evaluate a parameterized diversity family across a range of thresholds, scales, exponents, or orders under a specified representation and distance or kernel function. Diversity profiles reveal whether a comparison is robust across resolutions or instead depends on an arbitrary parameter choice. We instantiate profiles for several representative metric families and demonstrate their practical use in generative AI evaluation. Overall, diversity profiles provide a more transparent and resolution-aware framework for comparing the diversity of AI-generated content. 1 Introduction Diversity has long been a central concept in the natural sciences. In ecology, it is studied under the name biodiversity, where researchers seek to quantify not only how many species are present in a community, but also how evenly individuals are distributed among them and how distinct the species are from one another 15. Classical diversity indices such as Shannon entropy 26, Simpson’s index 27, and Hill numbers 11 have therefore played a central role in comparing biological communities. A key lesson from this literature is that diversity is not a single primitive notion: richness, evenness, rarity, and dissimilarity describe related but distinct aspects of a population 16. In the era of generative artificial intelligence (AI), diversity evaluation has become an increasingly important and challenging problem. Generative models are expected not only to produce high-quality samples, but also to avoid mode collapse, excessive repetition, and overly narrow coverage of the target domain 29. This issue arises across modalities, including images, natural language, graphs, and molecules. In natural language generation, for example, diversity may refer to variation in topics, reasoning paths, lexical choices, syntactic forms, or semantic meanings. These notions operate at different resolutions and are often induced by different representations, making it difficult to summarize diversity by a single universal scalar 24. A common strategy in recent work is to embed generated samples into a representation space, compute pairwise distances or similarities, and then aggregate the resulting matrix into one diversity score. Representative metrics include average pairwise distance 5, energy-based scores 30, threshold-based packing metrics such as Circles 33, similarity-spectrum methods such as the Vendi score 8; 23, and metric-space magnitude 20. These metrics are useful and often interpretable, but they encode different inductive biases. As a result, different metrics can rank the same two generated sets in opposite ways. This ambiguity is not merely a matter of implementation. We argue that scalar diversity evaluation is intrinsically under-specified. First, widely used diversity metrics satisfy different subsets of desirable axioms, such as size monotonicity, invariance to duplicates, monotonicity with respect to pairwise distances, and continuity. No representative scalar metric satisfies all of these properties simultaneously in its natural domain. Second, many modern diversity metrics contain a scale, threshold, exponent, or order parameter. Different choices of this parameter may lead to different conclusions even within the same metric family. Third, generative AI evaluations are typically performed in high-dimensional representation spaces, where pairwise distances may concentrate and where the meaningful range of scales depends strongly on the embedding model, modality, and distance function. (a) Circles profile (b) Vendi score profile (c) Magnitude profile Figure 1: Diversity profiles of a minimal one-dimensional example. Set A=1,2,3A=\1,2,3\, set B=0,4B=\0,4\, and distance is measured by absolute difference. Sweeping the profile parameter of three representative diversity metrics reveals resolution-dependent comparisons, illustrating how a single scalar diversity score can obscure important trade-offs. Figure 1 illustrates this issue in a minimal example. Richness prefers A, because A contains three distinct elements while B contains two. Average distance prefers B, because the two elements of B are farther apart. Parameterized metrics further reveal that the comparison can depend on the chosen resolution: the Circles, Vendi score, and Magnitude curves may cross as their threshold, order, or scale parameter varies. Thus, reporting a single number can hide important trade-offs and may allow arbitrary metric or parameter choices to determine the claimed conclusion. To address this problem, we propose to evaluate the diversity of AI-generated content using diversity profiles. Instead of introducing another scalar metric, a diversity profile reports the behavior of a parameterized diversity family across a range of meaningful parameter values. The resulting curve provides a condition-aware summary of diversity under a specified representation, distance or similarity function, metric family, and parameter domain. Diversity profiles are intuitive to interpret: when one curve dominates another across the full parameter domain, the diversity comparison is robust to the choice of resolution; when curves cross, the crossing directly reveals a scale-dependent trade-off that would be obscured by a single scalar score. Diversity profiles also make it possible to compare generated sample sets not only across resolutions within a fixed metric family, but also across different diversity metric families. Since different metrics emphasize different aspects of diversity, jointly inspecting their profiles helps distinguish conclusions that are metric-family-specific from those that are robust across multiple notions of diversity. Computationally, the additional cost of constructing profiles is modest, making the approach practical for routine generative AI evaluation. Our contributions are as follows: • We provide a comprehensive review of representative diversity metrics for AI-generated content, and diagnose limitations of diversity evaluation with scalar metrics through both an axiomatic analysis and the geometry of high-dimensional representation spaces. • We introduce diversity profiles as curve-valued, condition-aware summaries that compare generated sample sets across thresholds, scales, exponents, or orders, rather than at a single arbitrary parameter value. • We instantiate diversity profiles for several representative metric families, including Energy, Circles, Vendi score, and Magnitude, and show how profile comparisons can be used both within a metric family across resolutions and across metric families to obtain more robust diversity assessments. We also discuss their profile-level properties, intuitive interpretation, and computational practicality for generative AI evaluation. Overall, diversity profiles shift the goal of diversity evaluation from selecting a single supposedly best scalar metric to characterizing how diversity comparisons behave across resolutions and across metric families. This perspective makes diversity evaluation more transparent, intuitive, less sensitive to arbitrary hyperparameter choices, and better aligned with the multi-faceted nature of diversity in generative AI. 2 Existing Diversity Metrics for AI-Generated Content Diversity is a central evaluation criterion for generative AI systems across modalities such as images, text, graphs, and molecules. A common approach is to first represent each generated item in an embedding or feature space, compute pairwise distances between the resulting representations, and then summarize the resulting matrix by a scalar score. We refer to this broad family as distance-based diversity metrics. Since the embedding model and the distance function determine the geometry being measured, such metrics should be interpreted as representation-dependent summaries of diversity. Definition 1 (Distance-based diversity metric). Let X=x1,…,xnX=\x_1,…,x_n\ denote a finite collection, or multiset, of generated items. Let d be a nonnegative pairwise distance (dissimilarity) defined on the representation space, and let D∈ℝ≥0n×nD _≥ 0^n× n be the corresponding distance matrix with entries Dij=d(xi,xj).D_ij=d(x_i,x_j). A distance-based diversity metric is a permutation-invariant functional μn:n→ℝ,μn(D)=μn(PDP⊤) _n:D_n , _n(D)= _n(PDP ) (1) for any permutation matrix P, where nD_n denotes the admissible set of pairwise distance matrices. Such metrics quantify diversity using only pairwise relations among the elements of X. We review several representative examples below. Definition 2 (Average distance 5). For n≥2n≥ 2, the average pairwise distance (AvgDist) is μAvgDist(D):=1n(n−1)∑i≠jDij. _AvgDist(D):= 1n(n-1) _i≠ jD_ij. (2) This metric, also commonly referred to as internal diversity, is simple, interpretable, and widely used across generative modeling applications. Definition 3 (Energy 30). For s>0s>0, the energy-based diversity score is μEnergy(D;s):=−1n(n−1)∑i≠j1Dijs. _Energy(D;s):=- 1n(n-1) _i≠ j 1D_ij^s. (3) The exponent s controls the penalty assigned to small pairwise distances. This functional is inspired by the potential energy of repulsive particles: configurations with very close pairs receive large penalties. The score is well defined only when Dij>0D_ij>0 for all i≠ji≠ j; in practice, implementations may add a small ε>0 >0 to avoid singularities. Definition 4 (Circles 33). For a threshold τ≥0τ≥ 0, define μCircles(D,τ):=maxS⊆X|S|,s.t.Dij>τ,∀i≠j such that xi,xj∈S. _Circles(D;τ):= _S X|S|,s.t. D_ij>τ, ∀\,i≠ j such that x_i,x_j∈ S. (4) This metric measures the largest subset of generated items whose elements are mutually separated by more than τ. When d is a metric, it coincides with the packing number 31. Definition 5 (Vendi score 8; 23). The Vendi score is similarity-based. Let K∈ℝn×nK ^n× n be a symmetric positive semidefinite similarity matrix with normalized diagonal entries, e.g., Kii=1K_i=1, obtained either directly from a similarity function or indirectly from D through a kernel transformation. Let λ1,…,λn _1,…, _n denote the eigenvalues of K/nK/n, so that λi≥0 _i≥ 0 and ∑iλi=1 _i _i=1. For order q>0q>0 and q≠1q≠ 1, the order-q Vendi score is μVendi(K,q):=(∑i=1nλiq)11−q. _Vendi(K;q):= ( _i=1^n _i^q ) 11-q. (5) The original Vendi score is obtained in the limit q→1q→ 1: μVendi(K;1):=exp(−∑i=1nλilogλi), _Vendi(K;1):= (- _i=1^n _i _i ), (6) with the convention 0log0=00 0=0. Thus, the Vendi score is the exponential of the Shannon entropy when q=1q=1 and of the Rényi entropy for q≠1q≠ 1. The order-22 case is closely related to Rényi kernel entropy 14, and Fourier-feature approximations have been proposed to scale related kernel-entropy computations 22. Definition 6 (Magnitude 20). Let Zt(D)∈ℝn×nZ_t(D) ^n× n be the similarity matrix [Zt(D)]ij=exp(−t⋅Dij),t>0.[Z_t(D)]_ij= (-t· D_ij), t>0. If Zt(D)Z_t(D) is nonsingular, the magnitude at scale t is μMag(D,t):=⊤Zt(D)−1=∑i,j[Zt(D)−1]ij. _Mag(D;t):=1 Z_t(D)^-11= _i,j[Z_t(D)^-1]_ij. (7) This construction is the finite-space version of magnitude in metric geometry 17 and can be interpreted as an effective size of the metric space at scale t. Other metrics. The above list is not exhaustive. Other recent distance-based proposals include Hamiltonian diversity 13, NovelSum 35, and additional axiomatic constructions 21. Beyond distance-based metrics, diversity is also quantified by count-based metrics. A representative example is Richness, defined as the number of unique elements in a batch. Domain-specific variants include counting unique words or n-grams in natural language generation and unique molecular scaffolds in cheminformatics. These metrics are robust and easy to interpret, but they do not capture graded distances among distinct generated items. 3 Diagnosis of Existing Metrics 3.1 An Axiomatic Analysis A useful way to evaluate diversity metrics is through axioms: one specifies desirable properties of a diversity measure and then checks which metrics satisfy them. This perspective appears in several recent studies, although the exact axioms differ across papers 2; 18; 21. Here we summarize four desiderata that are particularly relevant for evaluating generated samples. The notation follows Section 2, and we write μn _n when the sample size matters. Axiom 1 (Size Monotonicity). Adding a new element should not decrease diversity. Formally, if D′∈n+1D _n+1 extends D∈nD _n by adding one row and column corresponding to a new element xn+1x_n+1, then μn+1(D′)≥μn(D). _n+1(D )≥ _n(D). (8) Axiom 2 (Twin Property). Adding a duplicate element should not change diversity. If the added element is a duplicate of some existing element xix_i, meaning that its distances to all existing elements match those of xix_i and Dn+1,i′=0D _n+1,i=0, then μn+1(D′)=μn(D). _n+1(D )= _n(D). (9) This property prevents repeated samples from artificially increasing the diversity score. Axiom 3 (Distance Monotonicity). For two admissible distance matrices D,D′∈nD,D _n of the same size, if Dij′≥Dij,∀i≠j,D _ij≥ D_ij, ∀\,i≠ j, then μn(D′)≥μn(D). _n(D )≥ _n(D). (10) This axiom states that increasing pairwise separations should not reduce measured diversity. Axiom 4 (Continuity). The metric should vary continuously under small perturbations of the pairwise distances. For example, under the Frobenius norm, D(m)→D⇒μn(D(m))→μn(D).D^(m)→ D _n(D^(m))→ _n(D). (11) Table 1: Axiomatic analysis of representative diversity metrics. Symbols: ✓ = satisfies, ✗ = violates, – = the metric is not distance-based. Diversity Metric A1 Size Mono. A2 Twin A3 Dist. Mono. A4 Cont. Richness ✓ ✓ – – AvgDist ✗ ✗ ✓ ✓ Energy (s) ✗ ✗ ✓ ✓ Circles (τ) ✓ ✓ ✓ ✗ Vendi score (q) ✗ ✗ ✗ ✓ Magnitude (t) ✓ ✗ ✗ ✓ Table 1 summarizes the behavior of the representative metrics, with proofs in Appendix A. No single metric in this list satisfies all four axioms in its natural domain. These incompatibilities suggest that a single scalar score may not provide a fully reliable description of diversity in all settings. 3.2 High-dimensional Representation Spaces A second challenge arises from the geometry of high-dimensional representation spaces. High-dimensional spaces exhibit behaviors that differ sharply from low-dimensional intuition, a collection of phenomena often referred to as the curse of dimensionality 4. One particularly relevant effect is distance concentration: as dimension grows, pairwise distances among random points can become nearly indistinguishable 6; 3. A common asymptotic formulation is the following. Let PdP_d be a sequence of distributions on ℝdR^d, and let x1,…,xn∼Pdx_1,…,x_n P_d be i.i.d. samples for fixed n. Let distmax(d)dist_ (d) and distmin(d)dist_ (d) denote the maximum and minimum pairwise distances among these samples. Under standard concentration conditions on the pairwise distance random variable, the relative contrast satisfies distmax(d)−distmin(d)distmin(d)→d→∞0. dist_ (d)-dist_ (d)dist_ (d) [d→∞]p0. (12) Equivalently, the nearest and farthest pairwise distances become similar in relative terms. This phenomenon weakens distance-based notions such as nearest neighbors, density, locality, and separation, which underlie many scalar diversity metrics 1; 36. (a) Images (b) Text (c) Molecules Figure 2: Empirical distributions of pairwise distances in three generative AI domains. In generative AI, high dimensionality is not merely a theoretical concern. Common deep representations often have hundreds or thousands of dimensions before any downstream distance is computed. To illustrate this issue, Figure 2 reports empirical distributions of pairwise distances in three representative domains: images, natural language text, and molecular structures. The observed concentration across these domains is consistent with high-dimensional representation effects under the chosen embeddings and distance functions. At the same time, the location and shape of the concentrated distributions differ substantially across modalities and distance definitions. These observations sharpen the parameter-selection problem for diversity metrics: when pairwise distances occupy only a narrow empirical range, large regions of the parameter space may become saturated or uninformative, making any single threshold, scale, exponent, or order intrinsically fragile and representation-dependent. This motivates a more comprehensive, condition-aware view of diversity, rather than reliance on a single absolute score. 4 Diversity Profiles 4.1 Motivation for Diversity Profiles Sections 3.1 and 3.2 show that diversity evaluation for generated content is inherently multi-faceted. From a theoretical perspective, no scalar metric considered in Section 2 satisfies all four desiderata in Table 1: size monotonicity, twin property, distance monotonicity, and continuity. Hence, a single scalar score cannot simultaneously capture all desirable aspects of diversity. Moreover, even within a fixed metric family, the conclusion may depend on the choice of a scale, threshold, or order parameter. As illustrated in Figure 1, two sample sets can be ranked differently by the same diversity family under different hyperparameter values. A closely related idea has a long history in ecology, where diversity profiles are used to compare biological communities across the full range of Hill-number orders rather than reporting a single diversity index 19; 16. In that setting, the order parameter determines the sensitivity of the diversity measure to rare species: small orders emphasize richness and rare types, whereas large orders emphasize dominant types and evenness among common species. This perspective is especially useful when no single order is universally appropriate. Remark 1. Hill numbers, Rényi entropy, Shannon entropy, and the Vendi score are closely connected. In particular, Hill numbers are exponentials of Rényi entropies, with Shannon entropy recovered in the limit as the order tends to one. The Vendi score applies the same effective-number principle to the spectrum of a normalized similarity matrix. Thus, diversity profiles can be naturally generalized to the Vendi score with an order parameter. From a practical perspective, diversity evaluation is condition-specific. A distance-based score depends not only on the generated samples, but also on the representation, distance function, and parameter domain. This dependence becomes especially pronounced in high-dimensional embedding spaces, where pairwise distances often concentrate and where the concentration location and spread vary across modalities, embedding models, and distance functions, as shown in Section 3.2. Consequently, a fixed numerical threshold or scale has no universal meaning: it may be too small to distinguish local structure in one representation, too large to avoid degeneracy in another, or sensitive to small changes in conditions. Parameter selection is therefore part of the evaluation problem itself. Diversity profiles can address this by replacing a single parameter choice with a curve over an empirically meaningful range. This motivates two essential components of a diversity profile. First, the curve is important because it reports the behavior of a metric family over a domain of scales, thresholds, or orders, rather than committing to one hyperparameter value. Second, the condition is important because the curve is only interpretable relative to the chosen representation, distance, and parameter domain. In this sense, a diversity profile is a condition-aware summary that exposes how diversity comparisons change across resolutions under a specified evaluation setting. 4.2 Definition and Properties of Diversity Profiles Let X=x1,…,xnX=\x_1,…,x_n\ be a finite multiset of generated samples. A representation map ϕφ sends each sample to a feature space, and a distance function d induces the pairwise distance matrix Dij=d(ϕ(xi),ϕ(xj)).D_ij=d(φ(x_i),φ(x_j)). For similarity-based metrics such as the Vendi score, we analogously use a positive semidefinite similarity matrix K obtained either directly from a similarity function or from D through a fixed kernel transformation. Definition 7 (Diversity profile). A diversity profile for generated content is specified by a tuple =(ϕ,d,μ,Θ),P=(φ,d,μ, ), where ϕφ is the representation, d is the distance function, μ is a parameterized family of diversity functionals, and Θ is the admissible set of scale, threshold, or order parameters. For a sample set X, the associated profile is the function PX(θ)=μθ(DX),θ∈Θ,P_X^P(θ)= _θ(D_X), θ∈ , (13) or PX(θ)=μθ(KX)P_X^P(θ)= _θ(K_X) for similarity-based families. Thus, a diversity profile is not a new scalar metric, but a curve-valued summary of how a metric family behaves across resolutions. Richness and Average distance have no intrinsic controlling hyperparameter, so they can be regarded as degenerate, scale-rigid profiles. In contrast, Energy, Circles, Vendi score, and Magnitude naturally define nontrivial profiles. Table 2 summarizes the main profile-level properties of these four families. All four profiles are permutation-invariant because they depend only on the pairwise distance or similarity matrix, not on the ordering of samples. Their behavior with respect to the profile parameter, however, differs substantially. Table 2: Profile-level properties of representative diversity families. Metric family Parameter Monotonicity in parameter Continuity Energy s>0s>0 case-dependent continuous Circles τ≥0τ≥ 0 nonincreasing stepwise Vendi score q>0q>0 nonincreasing continuous Magnitude t>0t>0 typically nondecreasing continuous Energy profile. The exponent s controls the penalty assigned to small distances. The profile is continuous in s whenever all pairwise distances are strictly positive, while its monotonicity depends on the values of distances (compared to 11). Circles profile. The threshold τ specifies the minimum separation required between selected samples. As τ increases, the feasibility constraint becomes stricter, so the profile is nonincreasing. It is an integer-valued step function whose jumps occur at observed pairwise distances. Thus, Circles is particularly interpretable as a resolution-dependent packing number: small thresholds reveal near-duplicate behavior, while large thresholds measure coverage by well-separated representatives. Vendi score profile. The profile is continuous in the order q, including near q=1q=1. It is nonincreasing in q: small q values are sensitive to low-mass spectral components and therefore capture rare directions of variation, whereas large q values emphasize dominant components and measure whether diversity is concentrated in only a few modes. Magnitude profile. The scale t controls the resolution at which points are distinguished. In standard finite metric settings, the profile is continuous and nondecreasing in t: small t makes most points highly similar, so the space is viewed coarsely; large t makes only very close points similar, so the space is viewed at a finer resolution. 4.3 Practical Usage in Generative AI Figure 3 gives an example of diversity profiles for two real natural-language sample sets. We use question-answer pairs from the 2WikiMultiHopQA dataset 12 and embed them with the Qwen3-8B model 34, which produces 40964096-dimensional dense representations. Each set contains 5050 randomly sampled items. Each curve is evaluated at more than 100100 parameter values, and computing each profile takes less than one second on a standard CPU once the pairwise distance or similarity matrix has been constructed. This suggests that diversity profiles are computationally practical for routine generative AI evaluation. Additional examples of diversity profiles across evaluation settings are provided in Appendix C. Figure 3: Diversity profiles of two real natural-language sample sets. The interpretation of a profile comparison depends on whether the curves exhibit dominance or crossing. If one set has a higher profile value than another set for all θ∈Θθ∈ , then the diversity ordering is robust to the choice of hyperparameter within that metric family. Such uniform dominance provides stronger evidence than a single scalar comparison, because the conclusion does not depend on an arbitrary scale, threshold, or order. If the curves cross, then there is no unconditional diversity ordering between the two sets under the chosen profile. Instead, the crossing identifies a scale-dependent trade-off. For Energy, superiority at small s mainly reflects larger average pairwise separation under weak sensitivity to close pairs, whereas superiority at large s indicates fewer extremely close pairs, since the inverse-power penalty becomes dominated by the smallest distances. For Circles, a set with a higher value at small τ contains more nonduplicate or locally distinct samples, whereas a higher value at large τ indicates better coverage by mutually well-separated samples. For Vendi score, superiority at small q suggests more rare spectral directions, while superiority at large q suggests a more even distribution among dominant modes. For Magnitude, differences at small or moderate t reflect coarse-scale separation, while differences at larger t reflect finer-scale resolution among nearby samples. In practice, we recommend choosing Θ according to the empirical distance or similarity distribution. For threshold profiles such as Circles, τ can be swept over distance quantiles rather than over an arbitrary linear interval. For kernel-based Vendi score profiles and scale-based Magnitude profiles, the parameter can be chosen so that the induced similarities span a nondegenerate domain between nearly identical and clearly separated samples. Different diversity metric families may also yield contradictory comparisons. For example, in Figure 3, the Energy profile indicates that set A is more diverse, while Magnitude favors set B; the Circles profile exhibits a crossing pattern, and the Vendi score profile shows negligible separation between the two curves. This discrepancy reflects the fact that different metric families emphasize different aspects of diversity, such as close-pair repulsion, packing at a given threshold, spectral effective rank, or scale-dependent effective size. Therefore, we recommend reporting diversity profiles from multiple metric families when possible. Consistent superiority across several families provides substantially stronger evidence of higher diversity than dominance under a single metric family alone. 5 Conclusion and Discussion In this paper, we study the problem of diversity evaluation for AI-generated content from both theoretical and practical perspectives. We first review representative distance-based diversity metrics, and show that these scalar metrics encode different inductive biases. Through an axiomatic analysis, we observe that none of the representative scalar metrics we analyze satisfies all four desiderata simultaneously. Through an empirical analysis of high-dimensional representation spaces, we further show that pairwise distances can concentrate in a modality- and representation-dependent manner, making any single parameter intrinsically fragile. Motivated by these observations, we propose diversity profiles: curve-valued, condition-aware summaries that evaluate a parameterized diversity family over a meaningful parameter domain under a specified representation and distance function. Diversity profiles reveal whether a diversity comparison is robust across resolutions or instead depends on a particular parameter choice, and reporting profiles from multiple metric families provides a more comprehensive view of diversity than relying on a single scalar score. Several directions remain open. First, the metric families used to construct diversity profiles are themselves not fully satisfactory from an axiomatic perspective. Although diversity profiles reduce the dependence on a single arbitrary parameter and the use of multiple metric families can exploit their complementarity, a deeper theoretical understanding of the relationships among diversity metrics, axioms, and profile-level properties is still needed. Second, diversity evaluation for generative AI may benefit from more systematic subset-level analysis. In ecology, α diversity describes diversity within subcommunities, β diversity describes variation among subcommunities, and γ diversity describes diversity of the overall metacommunity, with classical decompositions such as γ=α×βγ=α×β 32. Analogous decompositions could also be useful for generative AI evaluation, which may help distinguish local repetition from global coverage and may provide more informative diagnostics for model comparison. Limitations. First, this work focuses on diversity evaluation rather than the joint evaluation of quality and diversity. In generative AI, these two dimensions are tightly coupled: a system can appear diverse by generating low-quality or off-distribution samples, while a high-quality system may still suffer from mode collapse or limited coverage 24. Developing evaluation protocols that jointly characterize fidelity, utility, and diversity remains an important challenge. Second, diversity profiles are condition-dependent. Their interpretation depends on the embedding representation, distance or similarity function, metric family, and parameter domain. Although this condition-dependence is made explicit by the profile formulation, practical deployment in specific domains still requires more detailed guidelines for choosing representations, defining meaningful parameter domains, and interpreting profile dominance or crossing patterns. Broader impacts. Moving from scalar diversity metrics to diversity profiles encourages more transparent, resolution-aware, and less hyperparameter-dependent evaluation of generative AI systems. This can help researchers and practitioners detect mode collapse, excessive repetition, narrow coverage, and metric-specific conclusions that would be hidden by a single score. References [1] C. C. Aggarwal, A. Hinneburg, and D. A. Keim (2001) On the surprising behavior of distance metrics in high dimensional space. In International conference on database theory, p. 420–434. Cited by: §3.2. [2] E. Amigó, D. Spina, and J. Carrillo-de-Albornoz (2018) An axiomatic analysis of diversity evaluation metrics: introducing the rank-biased utility metric. In The 41st international ACM SIGIR conference on research & development in information retrieval, Cited by: §3.1. [3] F. Angiulli (2018) On the behavior of intrinsically high-dimensional spaces: distances, direct and reverse nearest neighbors, and hubness. Journal of Machine Learning Research 18 (170), p. 1–60. Cited by: §3.2. [4] R. E. Bellman (1961) Adaptive control processes: a guided tour. Princeton University Press. Cited by: §3.2. [5] M. Benhenda (2017) ChemGAN challenge for drug discovery: can ai reproduce natural chemical diversity?. arXiv preprint arXiv:1708.08227. Cited by: §1, Definition 2. [6] K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft (1999) When is “nearest neighbor” meaningful?. In International Conference on Database Theory (ICDT), Cited by: §3.2. [7] J. Deng, W. Dong, R. Socher, L. Li, K. Li, and L. Fei-Fei (2009) Imagenet: a large-scale hierarchical image database. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Cited by: Appendix B. [8] D. Friedman and A. B. Dieng (2023) The vendi score: a diversity evaluation metric for machine learning. Transactions on Machine Learning Research. Cited by: §1, Definition 5. [9] A. Gaulton, L. J. Bellis, A. P. Bento, J. Chambers, M. Davies, A. Hersey, Y. Light, S. McGlinchey, D. Michalovich, B. Al-Lazikani, et al. (2012) ChEMBL: a large-scale bioactivity database for drug discovery. Nucleic acids research 40 (D1), p. D1100–D1107. Cited by: Appendix B. [10] K. He, X. Zhang, S. Ren, and J. Sun (2016) Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Cited by: Appendix B. [11] M. O. Hill (1973) Diversity and evenness: a unifying notation and its consequences. Ecology 54 (2), p. 427–432. Cited by: §1. [12] X. Ho, A. Duong Nguyen, S. Sugawara, and A. Aizawa (2020) Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps. In The 28th International Conference on Computational Linguistics, Cited by: Appendix B, §4.3. [13] X. Hu, G. Liu, Q. Yao, Y. Zhao, and H. Zhang (2024) Hamiltonian diversity: effectively measuring molecular diversity by shortest hamiltonian circuits. Journal of Cheminformatics 16 (1), p. 94. Cited by: §2. [14] M. Jalali, C. T. Li, and F. Farnia (2023) An information-theoretic evaluation of generative models in learning multi-modal distributions. In Annual Conference on Neural Information Processing Systems (NeurIPS), Cited by: Definition 5. [15] L. Jost (2006) Entropy and diversity. Oikos 113 (2), p. 363–375. Cited by: §1. [16] T. Leinster and C. A. Cobbold (2012) Measuring diversity: the importance of species similarity. Ecology 93 (3), p. 477–489. Cited by: §1, §4.1. [17] T. Leinster (2013) The magnitude of metric spaces. Documenta Mathematica 18, p. 857–905. Cited by: Definition 6. [18] T. Leinster (2021) Entropy and diversity: the axiomatic approach. Cambridge university press. Cited by: §3.1. [19] C. E. Lewis, B. F. Swindel, and G. W. Tanner (1988) Species diversity and diversity profiles: concept, measurement, and application to timber and range management. Journal of Range Management 41 (6), p. 466–469. Cited by: §4.1. [20] K. Limbeck, R. Andreeva, R. Sarkar, and B. Rieck (2024) Metric space magnitude for evaluating the diversity of latent representations. In Annual Conference on Neural Information Processing Systems (NeurIPS), Cited by: §1, Definition 6. [21] M. Mironov and L. Prokhorenkova (2025) Measuring diversity: axioms and challenges. In Forty-second International Conference on Machine Learning (ICML), Cited by: §2, §3.1. [22] A. Ospanov, J. Zhang, M. Jalali, X. Cao, A. Bogdanov, and F. Farnia (2024) Towards a scalable reference-free evaluation of generative models. In Annual Conference on Neural Information Processing Systems (NeurIPS), Cited by: Definition 5. [23] A. P. Pasarkar and A. B. Dieng (2024) Cousins of the vendi score: a family of similarity-based diversity metrics for science and machine learning. In International Conference on Artificial Intelligence and Statistics (AISTATS), Cited by: §1, Definition 5. [24] O. Räisä, B. van Breugel, and M. van der Schaar (2025) Position: all current generative fidelity and diversity metrics are flawed. In International Conference on Machine Learning (ICML) Position Paper Track, Cited by: §1, §5. [25] D. Rogers and M. Hahn (2010) Extended-connectivity fingerprints. Journal of chemical information and modeling 50 (5), p. 742–754. Cited by: Appendix B. [26] C. E. Shannon (1948) A mathematical theory of communication. The Bell system technical journal 27 (3), p. 379–423. Cited by: §1. [27] E. H. Simpson (1949) Measurement of diversity. nature 163 (4148), p. 688–688. Cited by: §1. [28] T. T. Tanimoto (1958) An elementary mathematical theory of classification and prediction. IBM Internal Report. Cited by: Appendix B. [29] G. Tevet and J. Berant (2021) Evaluating the evaluation of diversity in natural language generation. In The 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL), Cited by: §1. [30] F. Velikonivtsev, M. Mironov, and L. Prokhorenkova (2024) Challenges of generating structurally diverse graphs. In Annual Conference on Neural Information Processing Systems (NeurIPS), Cited by: §1, Definition 3. [31] R. Vershynin (2018) High-dimensional probability: an introduction with applications in data science. Vol. 47, Cambridge university press. Cited by: Definition 4. [32] R. H. Whittaker (1960) Vegetation of the siskiyou mountains, oregon and california. Ecological monographs 30 (3), p. 279–338. Cited by: §5. [33] Y. Xie, Z. Xu, J. Ma, and Q. Mei (2023) How much space has been explored? measuring the chemical space covered by databases and machine-generated molecules. In International Conference on Learning Representations (ICLR), Cited by: §1, Definition 4. [34] A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. (2025) Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: Appendix B, §4.3. [35] Y. Yang, Y. Nan, J. Ye, S. Dou, X. Wang, S. Li, H. Lv, T. Gui, Q. Zhang, and X. Huang (2025) Measuring data diversity for instruction tuning: a systematic analysis and a reliable metric. In Annual Meeting of the Association for Computational Linguistics (ACL), Cited by: §2. [36] A. Zimek, E. Schubert, and H. Kriegel (2012) A survey on unsupervised outlier detection in high-dimensional numerical data. Statistical Analysis and Data Mining: The ASA Data Science Journal 5 (5), p. 363–387. Cited by: §3.2. Appendix A Proofs of Table 1 We provide proofs and counterexamples for the axiomatic summary in Table 1. Throughout, all distance matrices are symmetric with zero diagonal. A ✓ means that the property holds on the natural domain of the corresponding metric. A ✗ means that either the property fails, or the functional is not well defined on the configurations required by the axiom (for example, exact duplicates for singularity-based functionals). Richness. Richness is the number of distinct elements. Adding an element can either create a new equivalence class or join an existing one, so richness satisfies size monotonicity. Adding an exact duplicate joins an existing equivalence class, so the twin property also holds. Average pairwise distance. For n≥2n≥ 2, μAvgDist(D)=1n(n−1)∑i≠jDij. _AvgDist(D)= 1n(n-1) _i≠ jD_ij. Distance monotonicity follows immediately from linearity: if Dij′≥DijD _ij≥ D_ij for all i≠ji≠ j, then μAvgDist(D′)−μAvgDist(D)=1n(n−1)∑i≠j(Dij′−Dij)≥0. _AvgDist(D )- _AvgDist(D)= 1n(n-1) _i≠ j(D _ij-D_ij)≥ 0. Continuity also follows from linearity. Size monotonicity fails. Consider two points with distance 11: D=(0110),μAvgDist(D)=1.D= pmatrix0&1\\ 1&0 pmatrix, _AvgDist(D)=1. Add a duplicate of the first point: D′=(010101010).D = pmatrix0&1&0\\ 1&0&1\\ 0&1&0 pmatrix. Then μAvgDist(D′)=2(1+0+1)3⋅2=23<1. _AvgDist(D )= 2(1+0+1)3· 2= 23<1. Thus A1 fails. The same example shows that the twin property fails, since adding a duplicate changes the score from 11 to 2/32/3. Energy. For fixed s>0s>0, μEnergy(D;s)=−1n(n−1)∑i≠j1Dijs, _Energy(D;s)=- 1n(n-1) _i≠ j 1D_ij^s, on the domain where all off-diagonal distances are strictly positive. Distance monotonicity holds on this domain. If Dij′≥Dij>0D _ij≥ D_ij>0, then 1(Dij′)s≤1Dijs, 1(D _ij)^s≤ 1D_ij^s, and therefore μEnergy(D′,s)≥μEnergy(D,s). _Energy(D ;s)≥ _Energy(D;s). Continuity follows because x↦−x−sx -x^-s is continuous on (0,∞)(0,∞), and the score is a finite average of such terms. Size monotonicity fails. Take three points on the real line: x1=0x_1=0, x2=1x_2=1, and add x3=εx_3= , where 0<ε<10< <1. For the original two-point set, μEnergy(D,s)=−1. _Energy(D;s)=-1. For the three-point set, μEnergy(D′,s)=−13(1+ε−s+(1−ε)−s), _Energy(D ;s)=- 13 (1+ ^-s+(1- )^-s ), which is smaller than −1-1 for sufficiently small ε . Hence A1 fails. The twin property also fails in the natural sense that exact duplicates are not in the finite domain of the functional: adding a duplicate creates a zero off-diagonal distance, making Dij−sD_ij^-s singular. Thus the score is not a well-defined real-valued functional on multisets with twins. In ε -regularized implementations, the duplicate contributes a large negative penalty and therefore changes the score. Circles. For fixed τ≥0τ≥ 0, μCircles(D;τ)=maxS⊆X|S|:Dij>τ for all distinct xi,xj∈S. _Circles(D;τ)= _S X \|S|:D_ij>τ for all distinct x_i,x_j∈ S \. Size monotonicity holds because, after adding a new point, every feasible subset of the original set remains feasible. Hence the maximum cannot decrease. The twin property holds. Suppose the added point xn+1x_n+1 is a duplicate of xix_i. Since Di,n+1′=0≤τD _i,n+1=0≤τ, no feasible subset can contain both xix_i and xn+1x_n+1. Moreover, any feasible subset containing xn+1x_n+1 but not xix_i can replace xn+1x_n+1 by xix_i, because the duplicate has the same distances to all other points. Therefore the maximum feasible cardinality is unchanged. Distance monotonicity holds. If Dij′≥DijD _ij≥ D_ij for all i≠ji≠ j, then any subset satisfying Dij>τD_ij>τ also satisfies Dij′>τD _ij>τ. Thus the family of feasible subsets can only grow, and μCircles(D′,τ)≥μCircles(D,τ). _Circles(D ;τ)≥ _Circles(D;τ). Continuity fails because the functional is thresholded and integer-valued. For n=2n=2 and τ=1τ=1, let D(m)=(01+1/m1+1/m0),D=(0110).D^(m)= pmatrix0&1+1/m\\ 1+1/m&0 pmatrix, D= pmatrix0&1\\ 1&0 pmatrix. Then D(m)→D^(m)→ D, but μCircles(D(m),τ)=2 _Circles(D^(m);τ)=2 for all m, whereas μCircles(D,τ)=1 _Circles(D;τ)=1, because the constraint is strict: D12>τD_12>τ. Vendi score. Let K⪰0K 0 have diagonal entries Kii=1K_i=1, and let λ1,…,λn _1,…, _n be the eigenvalues of K/nK/n. For q>0q>0, q≠1q≠ 1, μVendi(K,q)=(∑i=1nλiq)1/(1−q), _Vendi(K;q)= ( _i=1^n _i^q )^1/(1-q), with the Shannon limit at q=1q=1. Continuity holds because the eigenvalues of a symmetric matrix are continuous functions of the matrix entries, and the maps (λi)i↦(∑iλiq)1/(1−q)and(λi)i↦exp(−∑iλilogλi)( _i)_i ( _i _i^q )^1/(1-q) ( _i)_i (- _i _i _i ) are continuous on the probability simplex, with the convention 0log0=00 0=0. Size monotonicity fails. For two orthogonal items, K=I2,K=I_2, the normalized eigenvalues are (1/2,1/2)(1/2,1/2), so μVendi(K,q)=2 _Vendi(K;q)=2 for all q>0q>0. Add a duplicate of the first item: K′=(101010101).K = pmatrix1&0&1\\ 0&1&0\\ 1&0&1 pmatrix. The eigenvalues of K′/3K /3 are (2/3,1/3,0)(2/3,1/3,0). Hence μVendi(K′,q)=[(2/3)q+(1/3)q]1/(1−q)<2 _Vendi(K ;q)= [(2/3)^q+(1/3)^q ]^1/(1-q)<2 for q≠1q≠ 1, and the same strict inequality holds at q=1q=1 by the Shannon limit. Thus adding an element can decrease the score. The same example also shows that the twin property fails, since the added element is an exact duplicate but the score changes. Distance monotonicity is not guaranteed for the Vendi family. To give an explicit counterexample, take q=1/2q=1/2 and define distances by Dij=1−KijD_ij=1-K_ij. Let K=(10.80.40.810.30.40.31),K′=(10.80.350.8100.3501).K= pmatrix1&0.8&0.4\\ 0.8&1&0.3\\ 0.4&0.3&1 pmatrix, K = pmatrix1&0.8&0.35\\ 0.8&1&0\\ 0.35&0&1 pmatrix. Both matrices are positive semidefinite, and Kij′≤KijK _ij≤ K_ij for all i≠ji≠ j, so the associated distances satisfy Dij′≥DijD _ij≥ D_ij. However, μVendi(K,1/2)≈2.5093,μVendi(K′,1/2)≈2.4747. _Vendi(K;1/2)≈ 2.5093, _Vendi(K ;1/2)≈ 2.4747. Thus increasing dissimilarities can decrease the Vendi score. Magnitude. For fixed t>0t>0, let Zt(D)ij=exp(−tDij),μMag(D,t)=⊤Zt(D)−1.Z_t(D)_ij= (-tD_ij), _Mag(D;t)=1 Z_t(D)^-11. Continuity holds on the domain where Zt(D)Z_t(D) is nonsingular, since D↦Zt(D)D Z_t(D) is continuous and matrix inversion is continuous on the open set of nonsingular matrices. Size monotonicity holds under the standard positive-definite assumption. Let Z be the similarity matrix for the original set and suppose the enlarged matrix has the block form Z′=(Zzz⊤1),Z = pmatrixZ&z\\ z &1 pmatrix, with Z′≻0Z 0. Let w=Z−1w=Z^-11 and let s=1−z⊤Z−1z.s=1-z Z^-1z. Since Z′≻0Z 0, the Schur complement satisfies s>0s>0. The block inverse formula gives ⊤(Z′)−1=⊤Z−1+(1−z⊤w)2s≥⊤Z−1.1 (Z )^-11=1 Z^-11+ (1-z w)^2s 1 Z^-11. Therefore magnitude satisfies size monotonicity on this positive-definite domain. The twin property fails as a real-valued property on multisets because adding an exact duplicate makes two rows and columns of Zt(D)Z_t(D) identical. Hence Zt(D)Z_t(D) becomes singular, so the inverse-based magnitude is not defined. Distance monotonicity fails. Let t=1t=1, and define two similarity matrices Z=(10.10.30.110.90.30.91),Z′=(10.10.10.110.90.10.91).Z= pmatrix1&0.1&0.3\\ 0.1&1&0.9\\ 0.3&0.9&1 pmatrix, Z = pmatrix1&0.1&0.1\\ 0.1&1&0.9\\ 0.1&0.9&1 pmatrix. Both matrices are positive definite. Let Dij=−logZijD_ij=- Z_ij and Dij′=−logZij′D _ij=- Z _ij. Since Zij′≤ZijZ _ij≤ Z_ij for all i≠ji≠ j, we have Dij′≥DijD _ij≥ D_ij. However, μMag(D,1)=⊤Z−1=158=1.875, _Mag(D;1)=1 Z^-11= 158=1.875, whereas μMag(D′,1)=⊤(Z′)−1=17594≈1.8617. _Mag(D ;1)=1 (Z )^-11= 17594≈ 1.8617. Thus increasing pairwise distances can reduce magnitude. Remark on the assumptions for magnitude. The proof of size monotonicity above uses positive definiteness of the enlarged similarity matrix. If Definition 6 only assumes nonsingularity, size monotonicity is not guaranteed. Thus the A1 ✓ for magnitude should be read as holding under the positive-definite finite-metric/kernel setting, not under mere nonsingularity. Appendix B Details of Figure 2 For each domain in Figure 2, we randomly sample data instances from commonly-used datasets, compute their representations using a standard feature extractor, and estimate the empirical distribution from 100,000100,000 randomly sampled pairwise distances. The goal of this experiment is to illustrate that commonly used high-dimensional representations in different modalities often lead to strongly concentrated pairwise distance distributions. Images. Images are commonly represented by deep neural networks trained for image recognition. We randomly sample RGB images from ImageNet (research-only access terms) [7] and extract features using a ResNet-50 encoder (TorchVision, BSD-3-Clause; pretrained weights subject to ImageNet access terms) [10]. Specifically, each image is mapped to a 20482048-dimensional feature vector from the penultimate representation layer. We then compute pairwise cosine distances between these image embeddings. Cosine distance between deep image features is widely used in image retrieval, clustering, and diversity evaluation. As shown in Figure 2(a), the resulting distance distribution is sharply concentrated. Natural language text. For natural language, modern large language models provide high-dimensional semantic embeddings that are widely used in similarity search, retrieval-augmented generation, and text evaluation. We use question-answer pairs from the 2WikiMultiHopQA dataset (Apache-2.0) [12] and embed them with the Qwen3-8B model (Apache-2.0) [34], which produces 40964096-dimensional dense representations. Pairwise dissimilarity is measured by cosine distance. Figure 2(b) shows that the empirical distance distribution for textual embeddings is also strongly concentrated. Molecular structures. In cheminformatics, molecular diversity is often assessed using handcrafted molecular fingerprints rather than neural embeddings. We represent molecules sampled from the ChEMBL database (C BY-SA 3.0) [9] using extended-connectivity fingerprints (ECFP; computed with RDKit, BSD-3-Clause) [25], a widely used binary representation that encodes local molecular substructures. We use fixed-length 20482048-dimensional fingerprints and compute pairwise Tanimoto distances [28], a standard dissimilarity measure for molecular fingerprints. As illustrated in Figure 2(c), the resulting molecular distances also exhibit strong concentration. This suggests that high-dimensional distance concentration arises not only in learned neural embeddings, but also in classical sparse or binary representations. Overall, Figure 2 demonstrates that distance concentration is a recurring empirical phenomenon across modalities, representation types, and distance functions, and the precise location and shape of the distributions depend on the domain and representation. Appendix C More Examples of Diversity Profiles In addition to the natural-language example in Figure 3, we provide two further real examples of diversity profiles on different data modalities: images (Figure 4) and molecular structures (Figure 5). For each modality, we use the same data source, representation, and distance function as described in Appendix B. Each of sets A and B consists of 50 data items sampled uniformly at random. Figure 4: Diversity profiles of two real image sample sets. Figure 5: Diversity profiles of two real molecular sample sets.