Paper deep dive
Why GPT-Style Models Do Not Directly Transfer to Symbolic Music: Compression in the Wrong Coordinate System
Yi Wang
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 93%
Last extracted: 8/22/2026, 1:57:13 AM
Summary
The paper argues that GPT-style models fail to transfer directly to symbolic music not due to architecture, but due to ineffective tokenization. It introduces the Effectiveness-Losslessness Framework, which defines tokenization as constructing a coordinate system that is predictively effective (exposing stable regularities via decoupling and denesting) and relationally lossless (preserving contextual freedom). The authors propose a 'coordinate-aware note' token and validate that this approach improves predictive compressibility compared to fixed relational projections or simple sequence compaction.
Entities (11)
Relation Signals (9)
Effectiveness-Losslessness Framework â defines â Relational Losslessness Principle
confidence 95% · The Relational Losslessness Principle defines the TokenâState Boundary
Effectiveness-Losslessness Framework â defines â Predictive Effectiveness Principle
confidence 95% · We formulate the EffectivenessâLosslessness Framework... The Predictive Effectiveness Principle defines the FactâToken Boundary
GPT-Style Models â doesnottransferdirectlyto â Symbolic Music
confidence 95% · These results reveal why GPT-style models do not transfer directly across modalities: architectures transfer, but tokenization interfaces do not.
Predictive Effectiveness Principle â establishes â Fact-Token Boundary
confidence 92% · The Predictive Effectiveness Principle defines the FactâToken Boundary
Relational Losslessness Principle â establishes â Token-State Boundary
confidence 92% · The Relational Losslessness Principle defines the TokenâState Boundary
Coordinate-Aware Note â improves â Predictive Compressibility
confidence 90% · Effective coordinate construction improves predictive compressibility
Coordinate-Aware Note â isdefinedby â Effectiveness-Losslessness Framework
confidence 90% · This naturally derives the coordinate-aware note as a principled musical token... from the framework
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:GPT-style models achieve strong performance by representing language with finite vocabularies of reusable discrete tokens. This success has motivated symbolic music tokenizations to treat recurring musical structures, such as chords, motifs, and phrases, as reusable units analogous to linguistic tokens. However, tokenization derives its advantage not from reusable combinations alone, but from compression: effective compression requires coordinates in which recurring regularities form stable and predictable conditional distributions. The key problem is therefore not to find larger musical combinations, but to discover the coordinate system in which musical facts become predictively compressible. We formulate the Effectiveness--Losslessness Framework and define tokenization as the construction of a predictively effective and relationally lossless coordinate system. The Predictive Effectiveness Principle defines the Fact--Token Boundary: decoupling and denesting construct coordinate interfaces that expose predictive regularities. The Relational Losslessness Principle defines the Token--State Boundary: tokenization stops before context-dependent relations are fixed, leaving their computation to model states. Controlled symbolic-music experiments validate these boundaries. Effective coordinate construction improves predictive compressibility, while fixed relational projections constrain contextual modeling. Sequence compaction alone does not guarantee predictive compression, while preserving contextual freedom allows higher-order musical organization to emerge without explicit structural labels. These results reveal why GPT-style models do not transfer directly across modalities: architectures transfer, but tokenization interfaces do not. Tokenization must discover effective representations while preserving the relational freedom from which contextual structure can emerge.
Tags
Links
- Source: https://arxiv.org/abs/2608.18025v1
- Canonical: https://arxiv.org/abs/2608.18025v1
Trouble viewing inline? Open PDF directly â
Full Text
57,037 characters extracted from source content.
Expand or collapse full text
Why GPT-Style Models Do Not Directly Transfer to Symbolic Music: Compression in the Wrong Coordinate System Yi Wang Affiliation: Department of Electronic Engineering, Tsinghua University Email: yiwang24@mails.tsinghua.edu.cn Abstract GPT-style models achieve strong performance by representing language with finite vocabularies of reusable discrete tokens. This success has motivated symbolic music tokenizations to treat recurring musical structures, such as chords, motifs, and phrases, as reusable units analogous to linguistic tokens. However, tokenization derives its advantage not from reusable combination alone, but from compression, and effective compression requires coordinates in which recurring regularities form stable and efficiently predictable distributions. The key problem is therefore not to find larger musical combinations, but to discover the coordinate system in which musical facts become predictively compressible. From this perspective, we formulate the EffectivenessâLosslessness Framework and define tokenization as the construction of a coordinate system, in which observable facts can be represented effectively without losing the relational freedom required for contextual computation. The Predictive Effectiveness Principle defines the FactâToken Boundary: decoupling and denesting construct coordinate interfaces that expose stable objective regularities. The Relational Losslessness Principle defines the TokenâState Boundary: tokenization must stop before context-dependent relations are fixed in advance, leaving their computation to model states. Controlled symbolic-music experiments validate these boundaries. Effective coordinate construction improves predictive compressibility, while fixed relational projections constrain contextual modeling. Sequence compaction alone does not guarantee predictive compressibility, while preserving contextual freedom allows higher-order musical organization to emerge without explicit structural labels. These results reveal why GPT-style models do not transfer directly across modalities: architectures transfer, but tokenization interfaces do not. The fundamental challenge of tokenization is to discover effective representations that expose a domainâs observable regularities while preserving the relational freedom from which contextual structure can emerge. 1 Introduction 1.1 From Language Tokens to Musical Structure GPT-style models have achieved remarkable success in large part by representing language with a finite vocabulary of reusable discrete tokens 20; 1. These tokens provide a compact interface between raw sequences and contextual modeling: a finite set of units can be recombined across contexts to represent an effectively unbounded range of words, sentences, and higher-order structures. This compositional reuse is widely viewed as a key reason why token-based sequence modeling scales effectively. Symbolic music appears to invite the same treatment. It consists of discrete note events and exhibits repetition, hierarchy, long-range dependency, and reuse. Chords, motifs, phrases, and sections therefore appear analogous to linguistic tokens. Existing symbolic-music tokenizations transfer this intuition at different granularities through event streams, compound tokens, regular time-step representations, and learned segment vocabularies 8; 10; 22; 16; 9; 17. These approaches treat recurring musical combinations as candidate reusable units, assuming that larger or more structured units may provide a better interface for sequence modeling. 1.2 Compression in the Wrong Coordinate System The intuition that larger reusable units are inherently more compressive confuses a coding mechanism with the source of compression. Tokenization does not become predictively compressive merely because multiple observations are grouped into a single symbol. Compression emerges when the representation places observable facts in coordinates where their recurring regularities form stable and efficiently predictable conditional distributions for a bounded model. This distinction reveals a deeper ambiguity in what constitutes a token. A token is not defined only by how observations are grouped, but by where representation should begin and where contextual structure should remain unresolved. The fundamental task of tokenization is therefore to construct the coordinate system in which musical facts become predictively compressible. This motivates the two boundaries that define our framework. 1.3 Contributions 1. We reveal a missing principle in direct GPT transfer: tokenization gains predictive advantage not from reusable combinations alone, but from constructing coordinates in which observable regularities become predictable. 2. We formulate the EffectivenessâLosslessness Framework, which defines where tokenization should begin and end. The Predictive Effectiveness Principle establishes the FactâToken Boundary: decoupling and denesting construct coordinate interfaces that exposes stable objective regularities. The Relational Losslessness Principle establishes the TokenâState Boundary: contextual relations whose meanings depend on surrounding context remain for model-state computation rather than being fixed by the tokenizer. 3. Applying the framework to symbolic music, we construct a coordinate-aware musical representation through coordinate decoupling and denesting, and determine its stopping point through relational losslessness. This naturally derives the coordinate-aware note as a principled musical token: a carrier of observable musical information that is predictively effective and relationally lossless, rather than a predefined semantic combination. 4. We validate the framework through controlled symbolic-music experiments, including matched coordinate interventions, fixed relational projections, combination-coding controls and independent-corpus replication. The results validate the predicted boundary behaviors: effective coordinate construction improves predictive compressibility, while fixed relational projections constrain contextual modeling. Sequence compaction alone does not guarantee predictive compressibility. Moreover, higher-order musical organization is observed to emerge in model outputs without explicit structural supervision. 2 The EffectivenessâLosslessness Framework 2.1 Tokenization as Effective and Lossless Coordinate Construction Let xâx be an observable instance and let R(x)=z1:TââR(x)=z_1:T ^* be its coordinate representation. The representation maps observable facts into a model-accessible coordinate space. The encoding may change coordinates, granularity, vocabulary, and sequence structure, but it must preserve the observable distinctions required by the declared modeling scope. Losslessness alone does not determine an effective representation. Preserving the observable scope is necessary, but predictive improvement emerges only when the coordinate system exposes recurring regularities as stable and efficiently predictable conditional distributions for a bounded model. Under this predictive-compression view, tokenization is the construction of an effective coordinate system in which observable facts become predictively compressible. The full compression pipeline consists of three separable operations. Coordinate construction determines the representation space and produces coordinate carriers in which observable facts expose learnable objective regularities. Carrier coding determines how these coordinate carriers are serialized, grouped, or combined within the representation. State formation performs contextual, generally non-invertible predictive compression over the preserved representation. The tokenization process constructs the representation interface, while contextual abstraction belongs to the state. Representations with the same observable scope can induce very different conditional predictive structures. For a bounded predictive model family Q, we measure the predictive code length induced by R as â(R)=infqâ[âât=1Tlog2q(ztâŁz<t)].L_Q(R)= _q E\! [- _t=1^T _2q(z_t z_<t) ]. (1) An effective representation is therefore not defined by a shorter sequence or a smaller vocabulary alone. It places observable information into coordinates from which the specified contextual model can achieve a shorter predictive code. This criterion measures how effectively the representation exposes source regularities to a bounded predictive model. This definition separates two complementary roles. Effectiveness determines how observable facts are transformed into effective coordinate carriers. Relational losslessness determines where representation-side compression should stop, preserving the contextual degrees of freedom required for contextual states. 2.2 Effectiveness Defines the FactâToken Boundary The Predictive Effectiveness Principle determines which observable facts and deterministic relations should enter the token interface. They should be expressed in a coordinate system that exposes stable regularities and reduces the predictive code length achievable by the bounded predictive model family. Its representation-side operation is predictive effectiveness: eliminating avoidable representational complexity by exposing reusable objective regularities as stable conditional structure. Functional effectiveness does not remove information, but transforms the coordinate interface so that the same observable facts induce more predictable conditional structures for the bounded predictive model. Decoupling. Suppose an observable fact contains physically distinct factors A and B. In a coupled representation, an objective regularity may require ÎŽ=GâĄ(FAâ(A),FBâ(B),FAâBâ(A,B)),ÎŽ=G(F_A(A),F_B(B),F_AB(A,B)), (2) where FAâBF_AB is induced by the representation rather than by the underlying regularity. Decoupling removes this artificial interaction: GâĄ(FA,FB,FAâB)â¶GâĄ(FA,FB),G(F_A,F_B,F_AB) G(F_A,F_B), (3) without assuming that A and B are statistically independent. Genuine dependencies remain available to the model. Decoupling only removes the need to rediscover the same regularities from a representation with unnecessary coupling. Denesting. Even after decoupling, known transformations may remain hidden inside learned computation: ÎŽ=GΞâ(FA,Ξâ(fâĄ(A)),FB,Ξâ(gâĄ(B))).ÎŽ=G_Ξ(F_A,Ξ(f(A)),F_B,Ξ(g(B))). (4) When f and g are objective and reversible, the interface can expose them directly rather than requiring learned computation to rediscover them. Equivalent regularities that would otherwise appear across different transformed instances are aligned in one coordinate interface. A bounded model can reuse one conditional structure instead of relearning many transformed cases. The FactâToken Boundary therefore concerns what information enters the coordinate interface, rather than how that information is subsequently coded. Carrier coding and reversible combinations remain possible after this boundary is established, but they cannot replace the coordinate construction that makes predictive compression possible. 2.3 Losslessness Defines the TokenâState Boundary The Relational Losslessness Principle determines where tokenization must stop. It requires preserving the relational degrees of freedom from which contextual interpretations can be computed. Tokenization may abstract observable facts through a chosen coordinate system, but it must not remove contextual relational alternatives by fixing their identities in advance. A contextual relation may take the form Ïiâj=fâĄ(xi,xj,C), _ij=f(x_i,x_j,C), (5) where C denotes surrounding context. Assigning a fixed relation in the representation replaces the contextual family fâĄ(xi,xj,C):Cââcontext-dependent family \f(x_i,x_j,C):C \_context-dependent family with a single mapping gâĄ(xi,xj)âfixed relation. g(x_i,x_j)_fixed relation. Such a replacement crosses the TokenâState Boundary: it converts a context-dependent relation that should be resolved by contextual computation into a token-level identity fixed before context is available. The observable coordinates may remain recoverable within the declared scope, yet alternative relational organizations have already been removed from contextual computation. Relational losslessness therefore requires tokenization to preserve the contextual degrees of freedom from which relations can be determined. A relation may enter the token interface only when it is a deterministic consequence of preserved observations. Otherwise, tokenization fixes a context-dependent relation as a representation identity and removes alternative interpretations that should remain available to contextual states. 2.4 The Token as a Predictively Effective Coordinate Carrier Together, the two principles therefore define the token as follows: A token is a predictively effective coordinate carrier for observable information. It exposes stable objective regularities while preserving the contextual degrees of freedom required to determine relations. The complete framework is observable factsâFactâTokencoordinate constructiontokensâTokenâStatecontextual computationcontextual states. observable facts [Fact--Token]coordinate constructiontokens [Token--State]contextual computationcontextual states. (6) A GPT-style predictor operates on the coordinate representation produced by the tokenizer: xâz1:TâFΞhtâPΞ(zt+1|z<t).x Rz_1:T F_Ξh_tâ P_Ξ(z_t+1|z_<t). The tokenizer constructs the predictively effective coordinate interface, while the contextual state performs non-invertible predictive compression over the preserved representation. The separation between coordinate construction and contextual compression is therefore a division of responsibility between tokenizer and model state. 3 From the Two Boundaries to a Coordinate-Aware Music Model The framework becomes a sequence of design decisions for symbolic music. We first define the observable score-level facts represented by the interface. Predictive Effectiveness then constructs a coordinate interface in which these facts expose stable predictive regularities. Finally, Relational Losslessness determines which contextual musical relations should remain unresolved until state-side computation. 3.1 Observable Scope and Event Definition We define the observable score-level event as ni=(ti,oi,pi,di),n_i=(t_i,o_i,p_i,d_i), (7) where tit_i denotes event type, oio_i onset, pip_i pitch, and did_i duration. For REST events, onset and duration define the silent interval. Performance-level and implementation-level attributes, including velocity, instrumentation, controllers, articulation, expressive timing, timbre, and low-level MIDI organization, are outside the semantic event scope. Every modeled field remains explicitly represented within the declared event scope. All non-drum notes enter one unsegregated event stream. No melody, bass, harmony, accompaniment, instrument-part, or voice partition is provided in advance. 3.2 FactâToken Design: Constructing Musical Coordinates 3.2.1 Decoupling Event Content from Musical Position The first predictive-effectiveness operation is to decouple event content from musical position. Type, pitch, and duration describe event content, whereas onset specifies event position: qi=(ti,pi,di),ni=(qi,oi).q_i=(t_i,p_i,d_i), n_i=(q_i,o_i). (8) This is a representational decoupling, not an independence assumption. Dependencies between content and position remain available to the predictor, but they are no longer encoded as a single joint identity. Onset specifies position, whereas duration specifies persistence and therefore belongs to event content. Event i occupies Si=[oi,oi+di).S_i=[o_i,o_i+d_i). (9) Simultaneity follows from shared onset and overlap from interval intersection. These deterministic relations remain recoverable from the preserved event coordinates without requiring pre-defined structural identities. Events are serialized by onset and then ascending pitch. This ordering is a causal convention rather than a musical interpretation. Equal-onset notes remain distinct events with the same onset coordinate. 3.2.2 Denesting Musical Time and Pitch Coordinates After decoupling event content from position, denesting makes known deterministic transformations explicit rather than requiring the model to rediscover them. Musical Time. Generic token index is not musical time: simultaneous notes receive different indices, adjacent notes may share one onset, and metrically related events may be separated by arbitrary serialization distance. We therefore derive musical time directly from onset: Ïi=ÏâĄ(oi). _i=Ï(o_i). The temporal coordinate transforms serialization-dependent time into a musically structured coordinate space. Periodic and relative temporal regularities become explicit rather than remaining hidden in sequence order. The coordinate contains directed bar progress together with periodic within-beat, beat-within-bar, bar, four-bar, and sixteen-bar phases. Pairwise attention bias B(h)â(Ïi,Ïj)B^(h)( _i, _j) uses signed onset displacement, within-bar displacement, signed beat distance, and signed bar distance. These coordinates expose temporal regularities without assigning higher-level musical identities, which remain available for contextual computation. Pitch Operations. Pitch operations must be distinguished by whether they merely change coordinates, remove reversible redundancy, or impose contextual relations: decomposition,canonicalization,fixed relational projection.decomposition, , relational projection. (10) Pitch-class/register decomposition is bijective, piâ(ci,ri)p_i (c_i,r_i). It exposes pitch periodicity through the pitch-class coordinate and separates register, but it does not represent broader contextual relations among pitch events. It is therefore an invertible reparameterization rather than a guaranteed improvement in predictive compressibility. Canonicalization exploits a reversible global redundancy in pitch representation. In tonal music, many musical relations are organized relative to a reference pitch center rather than absolute pitch values. A global transposition changes this reference while preserving the relative pitch configuration. We therefore separate the transposition coordinate from the canonical pitch representation: p~i=piâs,R(n1:N)=(s,z~1:N),pi=p~i+s. p_i=p_i-s, R(n_1:N)=(s, z_1:N), p_i= p_i+s. (11) The shift remains available for exact reconstruction but is removed as a predictive nuisance. Canonicalization aligns transposed realizations in a common coordinate frame without providing tonic, mode, scale degree, key, or harmonic-function labels. Fixed chromatic or circle-of-fifths projections are fundamentally different. They replace categorical pitch identity with a predetermined geometry of proximity, converting the contextual relation family ÏâĄ(ci,cj,C):Câ\Ï(c_i,c_j,C):C \ into a fixed relation gâĄ(ci,cj).g(c_i,c_j). Such a projection commits to a relation before the model has access to the context required to determine it. 3.3 TokenâState Design: Contextual Musical Relations The TokenâState Boundary determines which musical interpretations must remain context-dependent. The coordinate interface preserves observable evidence, while contextual states resolve interpretations whose identities depend on surrounding context. Chord identity, motif membership, phrase structure, melodyâaccompaniment organization, voice identity, and tonal function are therefore not fixed by the tokenizer. They remain available as contextual interpretations over shared event evidence. The tokenizer preserves the evidence from which such structures can be inferred rather than committing to their contextual interpretation. The contextual state hi=FΞâ(râ€i,B)h_i=F_Ξ(r_†i,B) (12) performs task-directed, non-invertible predictive compression over that evidence. The unsegregated stream is essential to the emergence claim. Because melodic, harmonic, accompaniment, and voice roles are not provided by tracks or token types, any such organization must emerge from shared event evidence and contextual computation. 3.4 Coordinate-Aware Architecture and Exact-Event Prediction The two boundaries determine the musical token from complementary directions. The FactâToken Boundary requires the token to preserve observable facts through a predictively effective coordinate interface. The TokenâState Boundary requires context-dependent musical interpretations to remain available to contextual states. The resulting musical token is therefore a coordinate-aware note that effectively encodes declared musical coordinates while leaving higher-order organization to the model state. Formally, the coordinate-aware musical token is zi=(qi,Ïi),qi=(ti,p~i,di),Ïi=ÏâĄ(oi).z_i=(q_i, _i), q_i=(t_i, p_i,d_i), _i=Ï(o_i). (13) The pitch coordinate p~i p_i optionally applies reversible canonicalization, while Ïi _i explicitly represents musical position. unsegregated Note/REST stream coordinate-aware token causal Transformer contextual state exact-event decoder Figure 1: Coordinate-aware architecture. Effective coordinate carriers feed a causal Transformer; contextual states compress residual predictive uncertainty before exact-event decoding. The coordinate-aware representation separates event content and musical time, which are embedded and processed by a causal Transformer. Deterministic temporal relations enter attention through coordinate-derived biases. The decoder predicts the next exact event through the chain-rule order Typeâ â â . This ordering is computational rather than semantic. Predicted onset displacements and optional canonical pitch are decoded back to the original observable coordinates. Additionally, the coordinate-aware note is the basic token unit in our model. Larger reversible combinations remain possible within this framework when they preserve the declared coordinate representation and improve predictive compressibility. 4 Related Work Tokenization and predictive compression. Recent work formalizes tokenization as a representation mapping independent of a particular vocabulary 5. Information-theoretic and language-model analyses show that tokenization quality depends on coding efficiency and predictive behavior rather than token count alone 23; 19. Finite-context analyses further show that different lossless representations can induce different predictive losses under bounded models 18; 12. Serialization and combination. Symbolic-music tokenizers and GPT-style music systems explore event serialization, temporal notation, compound representations, and sequence merging 8; 10; 17; 22; 3; 6; 14. These approaches adopt or optimize how representations are serialized or combined. We distinguish such coding operations from coordinate construction and evaluate them under a common predictive code-length criterion. Abstraction and contextual computation. Hierarchical representations and learned segment codes introduce abstraction into music models 9; 21. Temporal layout and tokenization choices also influence modeling behavior 16; 2. We instead separate deterministic coordinate operations from contextual abstraction to determine which structures are represented and which emerge in model states. Music-specific coordinate priors. Symbolic-music models encode pitch, onset, and temporal structure through various coordinate choices 7; 11. Time and duration tokenizations have also been directly compared 4. We place these coordinate choices within the proposed boundary framework and test which operations improve predictive code length under a fixed learner. 5 Experiments and Discussion 5.1 Protocol and Evaluation All matched comparisons preserve the learner, observable event space, and within-family training budget while changing only the representation interface. Each uses three preregistered seeds, validation-only model selection, and one sealed test. The bounded learner serves as a controlled probe of representation quality rather than a scaling benchmark. The primary metric is predictive code length in bits per original observable event. Pop-K provides the main mechanistic study, while ComMU tests directional transfer under a separate matched within-corpus protocol. Full protocols and integrity checks appear in appendix A. 5.2 FactâToken Boundary: Coordinate Construction Musical-time coordinates. The temporal family progressively removes the nesting of musical time inside serialization history. A uses generic token position, B introduces absolute onset, C replaces sequence position with directed multi-scale unary time, and D adds deterministic pairwise temporal relations. Figure 2: Matched representation operations. Error bars show SD over three seeds. Aâ â â improves monotonically on validation and test. D lowers clean-test predictive code length by 42.73%42.73\% relative to A, with all seeds agreeing (figure 2a). These coordinates progressively expose temporal regularities hidden by serialization order. The A/D comparison is independently replicated on ComMU (13) under a matched within-corpus budget, supporting the direction of the temporal-coordinate effect. Pitch coordinate operations. The pitch family separates reparameterization, canonicalization, and fixed relational projection. H bijectively rewrites absolute pitch as pitch class and register but shows no demonstrated gain (figure 2b). Invertible reparameterization alone does not guarantee a more predictive coordinate system. F/G tests reversible canonicalization on identical shifted scores. G removes the known shift before prediction and retains it only for exact reconstruction. It reduces predictive code length by 39.57%39.57\% relative to F, with every seed agreeing (figure 2c), without supplying tonal labels. 5.3 Coordinate Construction versus Carrier Coding J and K test whether shorter serialization alone explains the coordinate-aware result. J is an event-preserving REMI-like serialization, while K applies reversible BPE without adding Dâs temporal coordinates. Predictive code length is normalized by the same observable-event count. Figure 3: Carrier and context controls. K shortens Jâs serialization by 71.07%71.07\% yet requires 14.00%14.00\% more predictive bits, whereas D reduces code length by 25.15%25.15\% relative to J (figure 3a). Shorter token sequences therefore do not imply shorter predictive codes. Combination coding shortens serialization but does not substitute for coordinate construction. 5.4 TokenâState Boundary: Contextual Computation Fixed relational projection. E and I replace categorical pitch-class identity with fixed chromatic and fifths geometries. Both increase predictive code length (figure 2b). Unlike deterministic temporal coordinates, these geometries impose pitch relations before contextual computation and constrain relations that should remain available to the state. Context utilization. The representation experiments determine what information reaches the state, while context intervention tests whether it is used. In the fixed-target intervention, Full provides complete context, while Left, Right, and Shuffled remove context or disrupt contentâtime binding. Removing either context increases code length by about 0.270.27 bits/event, while shuffling identical content increases it by 0.6690.669 bits/event (figure 3b). Prediction therefore depends on ordered contentâtime relations rather than context quantity alone. 5.5 Musical Organization without Structural Tokens We examine whether higher-level musical organization can emerge when structural identities are not fixed in the token interface. No melody, bass, accompaniment, harmony, motif, chord, or voice labels enter the unsegregated stream. Figure 4: Generated continuation from a shared prefix, showing recurring local patterns, variation, chordal texture, and longer-range recurrence. The inspected continuation exhibits recurring patterns, variation, chordal texture, and longer-range recurrence (figure 4). This provides qualitative existence evidence that contextual organization can emerge without explicit structural tokens. 5.6 Scope and Limitations The claims are bounded to the tested representations, a constrained model envelope, and the evaluated symbolic-music setting. Predictive code length is model-relative rather than a global coding optimum or a measure of musical quality. The experiments do not establish explicit semantic decomposition inside the model or characterize scaling behavior beyond the tested setting. 6 Conclusion This work reframes tokenization as a coordinate construction problem rather than a search for larger or more reusable symbols. The EffectivenessâLosslessness Framework formalizes this view through two complementary boundaries: The FactâToken Boundary determines which observable information and deterministic regularities should enter the representation. The TokenâState Boundary determines which relations must remain available for contextual computation. Together, these principles define a token as a predictively effective coordinate carrier: a representation that transforms observable facts into predictive coordinates while preserving the contextual degrees of freedom required to determine relations. Symbolic music validates this framework. Musical-coordinate denesting and reversible canonicalization improve predictive compressibility, while uninformative reparameterization and fixed relational projections do not. Sequence compaction alone is insufficient, and preserving contextual freedom allows higher-order organization to emerge. Beyond the specific application, the framework suggests a broader interpretation of contextual models. Once observable facts and deterministic regularities are represented through effective coordinates, contextual states can be viewed as learned compressors of the remaining relational uncertainty that is difficult to specify explicitly. This interpretation is not tied to a particular architecture. In this view, Transformer-based models represent one effective mechanism for approximating such contextual compression. AI Use Statement Generative AI systems, including OpenAI Codex/ChatGPT and Google Gemini, were used as research-assistance tools for conceptual brainstorming and critical discussion, code drafting and refactoring, experiment orchestration, literature discovery, figure and table preparation, and editorial revision. AI outputs were not treated as scientific evidence. The human authors retained final control over the research questions, experimental protocols, data inclusion, interpretations, and claims; verified the cited sources, implementations, and reported results; and take full responsibility for the submission. Formal results were produced through the frozen deterministic protocols and auditable receipts reported in the paper rather than from unverified model-generated values. Reproducibility Statement Reproducibility is addressed in section 5 and appendices A, I and G. These sections specify the lineage-aware split, exact prediction target, representation arms, shared model and optimization envelope, preregistered seeds, checkpoint rule, factor-level evaluation, tokenizer controls, and generation provenance. The reported protocol, source-tree, split-manifest, and selected-checkpoint hashes bind each result to its frozen implementation and data lineage. Test data were unavailable to training and checkpoint selection; held-out results were computed once after checkpoint lock. Ethics and Data Statement The experiments use Pop-K (15), distributed by its creators under a Creative Commons AttributionâNonCommercial license, solely for non-commercial research. We attribute the dataset and make no claim of ownership over its source compositions. The dataset record notes that some augmented segments may remain similar to source material; accordingly, source continuations are included only for scholarly comparison, and the selection, provenance, and literal event overlap of the qualitative examples are disclosed in appendix G. No human-subject study or listener data collection was conducted: author listening was used only to select the explicitly marked qualitative examples and is not reported as a human evaluation. Any public release of data-derived artifacts will follow the applicable license and attribution requirements. References Brown et al. (2020) T. B. Brown, B. Mann, N. Ryder, et al. Language models are few-shot learners. Advances in Neural Information Processing Systems 33. Cited by: §1.1. Chen et al. (2026) J. Chen, M. Chen, J. Mao, L. Chen, S. Zhang, M. Chen, R. Wu, L. Fan, W. Li, M. Gao, H. Zhang, Z. Li, H. Zhao, Y. Wang, and R. Huang Agogic: performance-timed music tokens for LLM-native text-to-symbolic-music generation. arXiv preprint arXiv:2608.03999. External Links: Document Cited by: §4. Fradet et al. (2023a) N. Fradet, N. Gutowski, F. Chhel, and J. Briot Byte pair encoding for symbolic music. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, p. 2001â2020. External Links: Document, Link Cited by: §4. Fradet et al. (2023b) N. Fradet, N. Gutowski, F. Chhel, and J. Briot Impact of time and note duration tokenizations on deep learning symbolic music modeling. In Proceedings of the 24th International Society for Music Information Retrieval Conference, External Links: Link Cited by: §4. Gastaldi et al. (2025) J. L. Gastaldi, J. Terilla, L. Malagutti, B. DuSell, T. Vieira, and R. Cotterell The foundations of tokenization: statistical and computational concerns. In The Thirteenth International Conference on Learning Representations, External Links: Link Cited by: §4. Geerlings and Meroño-Peñuela (2020) C. Geerlings and A. Meroño-Peñuela Interacting with GPT-2 to generate controlled and believable musical sequences in ABC notation. In Proceedings of the 1st Workshop on NLP for Music and Audio, p. 49â53. External Links: Link Cited by: §4. Guo et al. (2023) Z. Guo, J. Kang, and D. Herremans A domain-knowledge-inspired music embedding space and a novel attention mechanism for symbolic music modeling. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37, p. 5070â5077. External Links: Document Cited by: §4. Huang et al. (2018) C. A. Huang, A. Vaswani, J. Uszkoreit, N. Shazeer, C. Hawthorne, A. M. Dai, M. D. Hoffman, and D. Eck Music transformer: generating music with long-term structure. arXiv preprint arXiv:1809.04281. Cited by: §1.1, §4. Huang et al. (2025) J. Huang, Z. Novack, P. Long, Y. Hou, K. Chen, T. Berg-Kirkpatrick, and J. McAuley MuseTok: symbolic music tokenization for generation and semantic understanding. arXiv preprint arXiv:2510.16273. External Links: Document Cited by: §1.1, §4. Huang and Yang (2020) Y. Huang and Y. Yang Pop music transformer: beat-based modeling and generation of expressive pop piano compositions. In Proceedings of the 28th ACM International Conference on Multimedia, Cited by: §1.1, §4. Inaba et al. (2024) T. Inaba, K. Yoshii, and E. Nakamura On the importance of time and pitch relativity for transformer-based symbolic music generation. In 2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, External Links: Document Cited by: §4. Jafari Fesharaki et al. (2026) A. Jafari Fesharaki, M. Rami, and A. Tchamkerten Effective context in transformers: an analysis of fragmentation and tokenization. arXiv preprint arXiv:2605.13485. External Links: Document Cited by: §4. Lee et al. (2022) H. Lee, T. Kim, H. Kang, M. Ki, H. Hwang, K. Park, S. Han, and S. J. Kim ComMU: dataset for combinatorial music generation. In Advances in Neural Information Processing Systems: Datasets and Benchmarks Track, External Links: Link Cited by: §5.2. Pasquier et al. (2025) P. Pasquier, J. Ens, N. Fradet, P. Triana, D. Rizzotti, J. Rolland, and M. Safi MIDI-GPT: a controllable generative model for computer-assisted multitrack music composition. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, p. 1474â1482. External Links: Document Cited by: §4. Patchbanks (2025) Patchbanks Pop-k: a large-scale augmented symbolic pop-music dataset. Note: Zenodo External Links: Document, Link Cited by: Ethics and Data Statement. Qian et al. (2026) L. Qian, H. Gu, J. Zhao, and Z. Wang BEAT: tokenizing and generating symbolic music by uniform temporal steps. arXiv preprint arXiv:2604.19532. External Links: Document Cited by: §1.1, §4. Qu et al. (2025) X. Qu, Y. Bai, Y. Ma, et al. MuPT: a generative symbolic music pretrained transformer. In International Conference on Learning Representations, External Links: Link Cited by: §1.1, §4. Rajaraman et al. (2024) N. Rajaraman, J. Jiao, and K. Ramchandran An analysis of tokenization: transformers under markov data. In Advances in Neural Information Processing Systems, Vol. 37. External Links: Document, Link Cited by: §4. Schmidt et al. (2024) C. W. Schmidt, V. Reddy, H. Zhang, A. Alameddine, O. Uzan, Y. Pinter, and C. Tanner Tokenization is more than compression. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, p. 678â702. External Links: Document, Link Cited by: §4. Vaswani et al. (2017) A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin Attention is all you need. In Advances in Neural Information Processing Systems, Cited by: §1.1. Yu et al. (2022) B. Yu, P. Lu, R. Wang, W. Hu, X. Tan, W. Ye, S. Zhang, T. Qin, and T. Liu Museformer: transformer with fine- and coarse-grained attention for music generation. arXiv preprint arXiv:2210.10349. Cited by: §4. Zeng et al. (2021) M. Zeng, X. Tan, R. Wang, Z. Ju, T. Qin, and T. Liu MusicBERT: symbolic music understanding with large-scale pre-training. arXiv preprint arXiv:2106.05630. Cited by: §1.1, §4. Zouhar et al. (2023) V. Zouhar, C. Meister, J. Gastaldi, L. Du, M. Sachan, and R. Cotterell Tokenization and the noiseless channel. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), p. 5184â5207. External Links: Document, Link Cited by: §4. Appendix A Frozen Protocol Summary Table 1: Shared formal training envelope. Item Frozen value Dataset popk_clean_v1; lineage-aware train/validation/test manifests Rows 303,767 train; 1,024 validation; 1,024 sealed held-out test Carrier and target exact Note/REST event stream with a separate termination target; Typeâ â â Backbone 16 Transformer layers, width 64, 4 heads, FFN 128, dropout 0 Parameter envelope 817,107 parameters in the shared implementation envelope; inactive representation paths remain instantiated but frozen, so effective trainable parameter counts may differ slightly across interfaces Context complete manifest song, capped at 32 bars / 2,048 note tokens; no random note or bar crop Seeds 20260814, 20260815, 20260816 Budget five target-equivalent epochs; 106,803,335 exact-event exposures Optimization AdamW; 3Ă10â43Ă 10^-4 to 3Ă10â53Ă 10^-5 cosine schedule with warmup; batch size 128 songs Selection minimum micro validation bits per exact event; ties resolved in favor of the earliest exposure Test firewall test data disabled and unloaded during training and checkpoint selection; one evaluation after checkpoint lock The AâE, FâG, and HâI families each have frozen protocol, source-tree, and manifest hashes in the repository receipts. The model envelope is shared within each family. Effective trainable parameter counts vary only because inactive representation paths remain instantiated but frozen. Appendix B Full AâI Arm Table Table 2: All formal representation arms. AâE and HâI use the original observed distribution, whereas FâG use a separately shifted distribution. Absolute scores are compared only within the matched families defined in the main text. Family Arm Active interface Validation Held-out test Time baseline A raw pitch identity; generic sequence position 3.149228±0.0054083.149228± 0.005408 3.166764±0.0070733.166764± 0.007073 Time coordinate B A + learned absolute onset/bar lookup 2.331136±0.0539902.331136± 0.053990 2.330793±0.0443142.330793± 0.044314 Time coordinate C raw pitch; unary ordered and multi-scale metric time replacing generic/absolute position 2.059991±0.0522252.059991± 0.052225 2.048483±0.0604242.048483± 0.060424 Time coordinate D C + pairwise onset, meter, bar, and beat relations 1.817177±0.0109811.817177± 0.010981 1.813576±0.0207221.813576± 0.020722 Fixed pitch geometry E D time; chromatic-circle phase + absolute register replacing categorical pitch-class identity 1.898178±0.0083411.898178± 0.008341 1.890478±0.0125831.890478± 0.012583 Canonicalization F known shift s retained; Transformer predicts shifted absolute pitch 2.978696±0.0297432.978696± 0.029743 3.001370±0.0285353.001370± 0.028535 Canonicalization G known shift s retained; Transformer predicts canonical pitch; deterministic inverse restores physical pitch 1.817194±0.0152341.817194± 0.015234 1.813795±0.0175741.813795± 0.017574 Pitch interface H learned categorical absolute pitch class + learned absolute register; D time 1.827137±0.0037701.827137± 0.003770 1.821900±0.0088271.821900± 0.008827 Fixed pitch geometry I fixed circle-of-fifths phase + learned absolute register; D time 2.054166±0.0305502.054166± 0.030550 2.042477±0.0251042.042477± 0.025104 F and G use the same deterministic legal semitone shift in [â5,+6][-5,+6] for each sample, epoch, and seed. In both arms, the shift s is known and retained as part of the complete encoded example. F presents shifted absolute pitch to the Transformer. G canonicalizes pitch according to p~i=piâs, p_i=p_i-s, (14) predicts p~i p_i, and restores physical pitch through pi=p~i+s.p_i= p_i+s. (15) The shift is retained for deterministic reconstruction but is not supplied to the Transformer as a predictive feature. G refers only to the final tokenizer-side canonicalization arm. An abandoned legacy implementation that supplied reference information inside the model is excluded from all results and claims. Appendix C Full Paired Factor Decomposition Table 3: Held-out paired changes in bits per exact event. Negative values favor the left arm. Rows reconstruct the total change up to floating-point error. Comparison Total Type Time Pitch Duration Bâ-A â0.835971-0.835971 â0.014702-0.014702 â0.079796-0.079796 â0.481745-0.481745 â0.259728-0.259728 Câ-B â0.282310-0.282310 â0.000094-0.000094 â0.015767-0.015767 â0.177615-0.177615 â0.088835-0.088835 Dâ-C â0.234907-0.234907 â0.000438-0.000438 â0.015093-0.015093 â0.164500-0.164500 â0.054876-0.054876 Dâ-A â1.353188-1.353188 â0.015234-0.015234 â0.110656-0.110656 â0.823860-0.823860 â0.403439-0.403439 Hâ-D +0.008324+0.008324 â0.000196-0.000196 â0.002951-0.002951 +0.006471+0.006471 +0.004999+0.004999 Eâ-H +0.068578+0.068578 +0.000086+0.000086 +0.001960+0.001960 +0.054141+0.054141 +0.012392+0.012392 Iâ-H +0.220577+0.220577 +0.000278+0.000278 +0.006718+0.006718 +0.170510+0.170510 +0.043071+0.043071 Iâ-E +0.151999+0.151999 +0.000192+0.000192 +0.004759+0.004759 +0.116369+0.116369 +0.030679+0.030679 Eâ-D +0.076902+0.076902 â0.000110-0.000110 â0.000991-0.000991 +0.060612+0.060612 +0.017391+0.017391 Iâ-D +0.228901+0.228901 +0.000082+0.000082 +0.003768+0.003768 +0.176981+0.176981 +0.048070+0.048070 Gâ-F â1.187575-1.187575 â0.000257-0.000257 +0.001387+0.001387 â0.880078-0.880078 â0.308627-0.308627 Appendix D Split and Test Integrity The Pop-K split is constructed at the source-lineage level rather than by cache order. Samples connected by original identity, exact content, or transposition-invariant duplicate evidence are assigned to the same split. Model selection reads validation data only; the test manifest is disabled during training. All reported test values use the frozen validation-selected checkpoints. For AâE and FâG, final evaluation opened the sealed manifest once after checkpoint selection. In H/I, the initial process opened the manifest once and constructed an immutable 1,024-song / 70,981-token tensor cache, then failed while loading a frozen D/E comparison dependency. The resumed process verified every cache hash, reused the same six H/I checkpoint hashes, did not reopen the manifest or source MIDI files, and performed no training, tuning, or reselection. This was an infrastructure resume rather than a second scientific test invocation. Appendix E Representation Details All modeled non-drum notes are placed in a single unsegregated event stream. No melody, bass, harmony, accompaniment, instrument-part, or voice partition is supplied to the model. Notes sharing an onset remain separate observable events and are serialized by ascending MIDI pitch. There is no cardinality head, pitch-set decoder, onset-group identity, melody extraction, chord label, or voice label. For events without pitch, including REST events, a fixed type-specific tie-breaking convention is used. Serialization order is deterministic but does not imply performance order, melodic priority, voice membership, or semantic importance. Duration remains an exactly recoverable attribute of each Note or REST event rather than an active-note state reconstructed from later transitions. The decoder order is TypeâTimeâPitchâDuration. Typeâ Timeâ Pitchâ Duration. (16) This is a chain-rule factorization of the exact-event distribution rather than a semantic ranking of musical attributes. C, D, E, H, and I use directed bar progress together with within-beat, beat-within-bar, bar, four-bar, and sixteen-bar unary phases. The directed component disambiguates repeated periodic phases, so the joint musical-time coordinate uniquely determines the supported score onset: Ïi=ÏâĄ(oi),Ïâ1â(Ïi)=oi. _i=Ï(o_i), Ï^-1( _i)=o_i. (17) The unary interface is therefore an invertible coordinate transformation that preserves the supported score onset. D, E, H, and I additionally use signed onset displacement, within-bar displacement, signed bar distance, and signed beat distance as deterministic attention biases. These pairwise quantities are computed from preserved musical-time coordinates and do not assign chord, motif, phrase, or voice identity. D uses raw MIDI-pitch identity. H uses categorical pitch class ci=pimod12c_i=p_i 12 (18) together with categorical absolute register ri=âpi12â.r_i= p_i12 . (19) The pair (ci,ri)(c_i,r_i) bijectively determines the supported absolute pitch. E replaces categorical pitch-class identity with the chromatic phase Îłchrâ(pi)=[sinâĄ(2âÏâ(pimod12)12),cosâĄ(2âÏâ(pimod12)12)] _chr(p_i)= [ \! ( 2Ï(p_i 12)12 ), \! ( 2Ï(p_i 12)12 ) ] (20) and retains absolute register. I uses the same phase construction after mapping pitch class to the circle-of-fifths index fi=(7â(pimod12))mod12,f_i= (7(p_i 12) ) 12, (21) giving Îłfifâ(pi)=[sinâĄ(2âÏâfi12),cosâĄ(2âÏâfi12)]. _fif(p_i)= [ \! ( 2Ï f_i12 ), \! ( 2Ï f_i12 ) ]. (22) F and G use identical deterministically shifted physical examples. The known shift s is retained as part of the complete encoding in both arms. F presents shifted absolute pitch to the Transformer and predicts the shifted target. G applies tokenizer-side canonicalization, p~i=piâs, p_i=p_i-s, (23) predicts canonical pitch, and applies evaluator-side reconstruction, pi=p~i+s.p_i= p_i+s. (24) The shift is used for deterministic encoding and reconstruction but is not supplied to the Transformer as a predictive feature. No tonic, mode, key, scale-degree, or tonal-function label enters G. Appendix F Secondary Context Evidence An earlier relation probe, separate from AâI, tests whether a candidate four-bar target belongs between left and right context. On 6,112 windows from 99 held-out POP909 songs, full-context accuracy was 75.93%75.93\%, compared with 48.87%48.87\% for the target-only condition. Replacing left or right context reduced accuracy by 11.42 and 12.37 percentage points, respectively, while replacing both reduced accuracy to 50.87%50.87\% (figure 5). Because this probe uses an earlier composition-level representation, it is supporting evidence for contextual dependence rather than part of the primary tokenization result. It is not pooled numerically with the main fixed-target intervention and is not used to support any representation ranking. Figure 5: Secondary context-relation probe. Replacing either side degrades compatibility prediction; replacing both approaches the target-only control. Appendix G Generation Provenance and Source Continuations The two showcase cases were selected by human listening from one documented ten-case batch generated by the coordinate-aware note-centered causal checkpoint. They are not AâI prevalence estimates. Event Jaccard is the intersection over union of exact (onset relative to continuation start,MIDI pitch,duration in ticks)(onset relative to continuation start,MIDI pitch,duration in ticks) triples. It measures literal event overlap rather than musical quality. Table 4: Showcase generation receipts. Case A Case B Song ID popk_304614 popk_305540 Checkpoint epoch 4.000 epoch 4.000 Prefix / generated 4 / 4 bars 4 / 4 bars Generated notes 49 46 Generated onsets 28 32 Polyphonic onset rate 17.9% 43.8% Maximum notes/onset 7 2 Event Jaccard vs. source 25.8% 50.8% Sampling temperature 0.85, top-p 0.92, top-k 24 Figure 6: Case A model continuation. The upper system is the shared four-bar prefix; the lower system is generated. Red boxes and blue labels are manual musical annotations, not model inputs. Figure 7: Case A source continuation for exact visual comparison. Figure 8: Case B source continuation for exact visual comparison. The checkpoint SHA-256 is 946287c1997125c39edf0f1969880f8fc78d854849459fc952c8dc5b0381f6b. Both examples end when the model emits its separate termination symbol. The annotated scores, source continuations, MIDI files, and WAV files are distributed under docs/demos/m4l-popk/. Appendix H Evidence Boundaries âą The formal evidence covers one lineage-safe Pop-K task, a small fixed model envelope, three seeds, and five target-equivalent epochs. Held-out negative log-likelihood is a model-relative predictive code-length metric, not a global coding optimum, perceptual-quality measure, or human-preference score. âą Hâ-D was not designed as an equivalence or non-inferiority test. Its near-zero mean difference is descriptive, and one held-out seed reverses direction. The supported conclusion is that H demonstrates no measurable predictive-code-length gain over D. âą E and I replace categorical pitch-class identity with the tested fixed continuous topologies and change effective active parameter counts. Their degradation rejects these particular replacements, not all forms of pitch geometry, learned contextual geometry, or auxiliary geometric features that preserve categorical identity. âą F/G assumes a known deterministic global shift retained in the complete encoding. G does not infer tonic, mode, key, scale degree, tonal function, or a reference frame. F/G is evaluated on a separately shifted observed distribution and is not formally ranked against D. âą Pairwise temporal bias establishes predictive utility for deterministic temporal relations. It does not by itself establish phrase, section, cadence, motif, voice, or full-song structural understanding. âą The frameworkâs ârelationally losslessâ criterion refers to preserving context-dependent relational alternatives for state-side computation. Exact reconstruction of the modeled Note/REST event fields and correct sequence termination are separate engineering properties of the event carrier. Neither statement implies byte-for-byte recovery of raw MIDI files, controller data, instrumentation, timbre, articulation, expressive micro-timing, or acoustic performance. âą The fixed-target context intervention establishes sensitivity to ordered contentâtime binding. It does not identify a unique, human-readable chord, motif, phrase, or voice variable inside the contextual state. âą The two generation cases were selected after listening to ten candidates. They demonstrate inspectable existence rather than population frequency, unbiased musical-quality estimates, or causal attribution to a particular hidden semantic variable. Appendix I Tokenizer Controls and Context Intervention Table 5: Frozen tokenizer controls. Predictive bits are summed over every emitted target and normalized by the common prediction-target count: the exact Note/REST events plus one separate termination target per sequence. The termination symbol is an autoregressive coding device, not an observable musical event. Values are mean ± sample SD over three preregistered seeds. Interface tokens/event validation bits/event test bits/event J: REMI-like 3.680 2.40630±0.017772.40630± 0.01777 2.42301±0.019512.42301± 0.01951 K: J + reversible BPE 1.065 2.79320±0.017462.79320± 0.01746 2.76234±0.025122.76234± 0.02512 D: coordinate-aware 1.000 1.81718±0.010981.81718± 0.01098 1.81358±0.020721.81358± 0.02072 Table 6: Fixed-target context intervention. These values belong to a separate context experiment and are not pooled with the matched representation arms. Condition bits/event change from Full Full 3.53943.5394 â Left 3.80833.8083 +0.2689+0.2689 Right 3.81173.8117 +0.2723+0.2723 Shuffled 4.20844.2084 +0.6690+0.6690 J uses an event-preserving REMI-like stream with Bar, exact Position, pitch/Rest, and duration symbols. K applies train-only reversible BPE to that stream without adding Dâs multi-scale time coordinates or pairwise temporal relations. D retains one coordinate-aware token representation per original event. The J/K/D comparison is matched in data, split, seeds, model core, original-event-equivalent budget, and validation-only checkpoint selection. Appendix J Independent-Corpus A/D Replication The independent replication uses 9,299 ComMU songs in 4/4, split into 8,652 train, 323 validation, and 324 sealed-test songs. Scores retain their original C-major/A-minor normalization; no second transposition is applied. A and D use the same normalized pitch representation and differ only in their musical-time interface. They otherwise share targets, model envelope, decoder, optimizer, batch construction, context policy, three preregistered seeds, five target-equivalent epochs, and the validation-only checkpoint rule within this corpus. The ComMU budget is not asserted to equal Pop-K exposure. Table 7: Frozen ComMU 4/4 A/D replication. Values are bits per exact original event; summary rows report mean ± sample SD over three preregistered seeds. Lower is better. Arm/seed validation clean test test Dâ-A A: raw sequence 12.07563±0.1378112.07563± 0.13781 11.85514±0.1374811.85514± 0.13748 â D: relational time 11.91015±0.1483011.91015± 0.14830 11.74812±0.1736311.74812± 0.17363 â0.10701-0.10701 20260814 â A: 11.88487; D: 11.85843 â0.02644-0.02644 20260815 â A: 11.70522; D: 11.54798 â0.15723-0.15723 20260816 â A: 11.97532; D: 11.83796 â0.13736-0.13736 All three paired seeds favor D on validation and sealed test. Test was read once after validation-selected checkpoints were frozen, and the launch gate passed for all six runs. Exact and transposition-invariant families do not cross splits. Because all six final curves still improve from epoch 4.5 to epoch 5, the result establishes directional replication under a matched budget, not convergence or a ComMU capability limit. On clean test, D primarily improves Type and Time, leaves Duration nearly unchanged, and slightly worsens Pitch. Because the A/D intervention holds pitch encoding fixed, this Pitch difference is an indirect cross-factor effect rather than evidence for or against pitch-coordinate construction. The replication therefore supports the direction of the total temporal-interface effect, not universal improvement of every factor head.