Paper deep dive
ChronoScribe: Semantic-Numerical Specialization for Instruction-Driven Time Series Forecasting
Yuchen Jiao, Miao Zhang, Yuxuan Liu, Chengxi Li
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Recent advances in instruction-driven time series forecasting highlight a fundamental tension: systems must simultaneously master natural-language instruction following and precise numerical prediction. Current approaches often force a compromise. Large language models (LLMs) can interpret unstructured requests but may be inaccurate when asked to produce forecast values directly, whereas time series foundation models (TSFMs) provide numerical forecasts but typically require structured inputs specifying the target series, context window, and horizon. We present ChronoScribe, which applies semantic-numerical specialization to this workflow. A LoRA-adapted LLM proposes an execution path and context length; deterministic rules resolve the executable configuration. On the specialist path, a frozen TSFM produces quantile trajectories for the task-specified horizon. Deterministic trajectory summaries condition the response, while the LLM neither generates nor revises predicted values. We evaluate a Qwen3.5-9B--Chronos-2 implementation across 23 evaluation dimensions and 30 public datasets against eleven proprietary direct LLMs and three open TSFMs. ChronoScribe has the lowest error on sMAPE, MASE, WAPE, RMSE, and MAE among all evaluated systems, including fixed-context controls. Across these metrics, even the lowest direct-LLM error remains 2.0--2.7 times the corresponding ChronoScribe error. At the system level, ChronoScribe achieves a Task-Level Score (TLS) of 65.5, 10.6 points above the strongest direct-LLM baseline. The results support ChronoScribe's division of labor, in which the LLM handles interpretation, configuration, and communication while the TSFM handles numerical forecasting.
Tags
Links
- Source: https://arxiv.org/abs/2610.16345v1
- Canonical: https://arxiv.org/abs/2610.16345v1
Trouble viewing inline? Open PDF directly ā
Full Text
46,044 characters extracted from source content.
Expand or collapse full text
ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting Yuchen Jiao Miao Zhang Yuxuan Liu Chengxi Li Abstract Recent advances in instruction-driven time series forecasting highlight a fundamental tension: systems must simultaneously master natural-language instruction following and precise numerical prediction. Current approaches often force a compromise. Large language models (LLMs) can interpret unstructured requests but may be inaccurate when asked to produce forecast values directly, whereas time series foundation models (TSFMs) provide numerical forecasts but typically require structured inputs specifying the target series, context window, and horizon. We present ChronoScribe, which applies semanticānumerical specialization to this workflow. A LoRA-adapted LLM proposes an execution path and context length; deterministic rules resolve the executable configuration. On the specialist path, a frozen TSFM produces quantile trajectories for the task-specified horizon. Deterministic trajectory summaries condition the response, while the LLM neither generates nor revises predicted values. We evaluate a Qwen3.5-9BāChronos-2 implementation across 23 evaluation dimensions and 30 public datasets against eleven proprietary direct LLMs and three open TSFMs. ChronoScribe has the lowest error on sMAPE, MASE, WAPE, RMSE, and MAE among all evaluated systems, including fixed-context controls. Across these metrics, even the lowest direct-LLM error remains 2.02.0ā2.7Ć2.7Ć the corresponding ChronoScribe error. At the system level, ChronoScribe achieves a Task-Level Score (TLS) of 65.565.5, 10.610.6 points above the strongest direct-LLM baseline. The results support ChronoScribeās division of labor, in which the LLM handles interpretation, configuration, and communication while the TSFM handles numerical forecasting. Beijing University of Posts and Telecommunications https://github.com/Thekigs/ChronoScribe Introduction Time series forecasting is commonly formulated as the task of estimating future values from an observed history over a specified horizon. In practice, users may use natural language to request a forecast together with a trend summary or uncertainty statement. A request such as āforecast demand for the coming week and summarize the trend and uncertaintyā requires a system to interpret the request, configure and run a forecaster, and report the result. Large language models (LLMs) and time series foundation models (TSFMs) can support this workflow, but they are suited to different parts of it. TSFMs support zero-shot and probabilistic forecasting through large-scale pretraining (Ansari et al. 2025), but generally expect a structured interface that specifies the target series, horizon, and context window. LLMs can interpret open-ended instructions and produce natural-language responses, yet their training objectives do not directly optimize scale fidelity or temporal forecast accuracy (Gruver et al. 2023; Jin et al. 2024). Using a language model for both request interpretation and trajectory generation combines tasks with different modeling requirements. The resulting design problem is to let an LLM configure a numerical specialist without directly generating or revising the forecast trajectory. Some prior approaches use language models to generate or represent time series; others use textual context to steer or revise forecasts (Gruver et al. 2023; Jin et al. 2024; Wang et al. 2025; Zhao et al. 2025; Liao et al. 2026). We focus on the interface between the two model classes. Such an interface must translate an open-ended request into a valid specialist call and communicate the result without becoming a second source of predicted values. Numerical provenance therefore depends on keeping the directive, specialist output, and response distinct. Separating these stages makes numerical provenance easier to trace and failures easier to diagnose. A direct LLM must preserve scale, units, and long-range temporal structure while composing a fluent answer. A fixed-context specialist avoids direct language-model forecasting but cannot adapt its history length to individual requests. Figure 1 contrasts direct LLMs, fixed TSFMs, and ChronoScribe. Allowing the language model to generate or revise forecast values would obscure their source. A typed interface therefore exposes the proposal, executable configuration, specialist output, and final response as separate artifacts. Figure 1: Direct LLMs, fixed TSFMs, and ChronoScribe. We call this division of responsibility semanticānumerical specialization. The LLM handles request interpretation, specialist configuration, and communication, whereas the TSFM alone generates forecast values. ChronoScribe implements this principle with a LoRA-adapted language model that emits a typed directive. The directive proposes a direct language path or a specialist path and, in the latter case, a context length. Deterministic rules parse and normalize the proposal or apply a fallback; raw language-model output is not executed directly. The task, rather than the directive, supplies the forecast horizon. A frozen TSFM then produces quantile trajectories from the selected history. Deterministic functions derive numerical summaries, a direction label, and uncertainty intervals from these trajectories. The adapted language model uses this evidence to compose the response without generating or revising the trajectory. Our evaluation spans 23 dimensions in forecasting, temporal reasoning, instruction following, uncertainty, and efficiency, using 30 public datasets. We compare ChronoScribe with eleven proprietary direct LLMs, three open TSFMs, fixed-context controls, and component ablations. ChronoScribe has the lowest sMAPE, MASE, WAPE, RMSE, and MAE among all evaluated systems, including fixed-context controls. Across these metrics, the lowest direct-LLM error remains 2.02.0ā2.7Ć2.7Ć the corresponding ChronoScribe error. Its predefined Task-Level Score (TLS), a weighted aggregate of the five capability groups, is 65.565.5, 10.610.6 points above the strongest direct-LLM baseline. The controller returns a parseable directive with the protocol-defined route for 95.9%95.9\% of requests. In a rule-based audit of 100 specialist-path responses, 87.4%87.4\% of 230 claims agree with deterministic forecast evidence, and 89 responses pass every applicable check. This work contributes (i) ChronoScribe, a framework for semanticānumerical specialization that assigns request interpretation and evidence-based communication to an adapted LLM while reserving trajectory generation for a frozen TSFM; (i) typed execution and forecast-evidence interfaces that allow raw directives, executable configurations, specialist forecasts, and evidence-conditioned responses to be inspected separately; and (i) a 23-dimension evaluation across 30 public datasets against eleven proprietary direct LLMs, three open TSFMs, fixed-context controls, and component ablations, together with audits of directive reliability and forecast-claim grounding. Related Work Transformer forecasters such as Informer, PatchTST, iTransformer, and TimesNet use sparse attention, patching, inverted tokenization, or multi-scale representations for long-horizon prediction (Zhou et al. 2021; Nie et al. 2023; Liu et al. 2024b; Wu et al. 2023). Time series foundation models, including Chronos, Chronos-2, TimesFM, Moirai, Timer, and MOMENT, are pretrained on heterogeneous series for zero-shot or transfer forecasting (Ansari et al. 2024; Ansari et al. 2025; Das et al. 2024; Woo et al. 2024; Liu et al. 2024c; Goswami et al. 2024). At inference, these models operate on a selected series with a specified context window and horizon rather than on an open-ended request. Several approaches incorporate pretrained language models into numerical forecasting. LLMTime serializes observations as text-like tokens and generates continuations directly. GPT4TS, TEMPO, UniTime, Time-LLM, TimeCMA, and CALF use fine-tuning, prompting, reprogramming, or cross-modal alignment to adapt language models or their representations (Gruver et al. 2023; Zhou et al. 2023; Cao et al. 2024; Liu et al. 2024a; Jin et al. 2024; Liu et al. 2025a; Liu et al. 2025b). M3Time, T3Time, and ExoTimer incorporate multimodal, multiscale, or exogenous information (Jia et al. 2026; Chowdhury et al. 2026; Wu et al. 2026). In these systems, language-model generation or representations contribute to the numerical forecast. ChronoScribe assigns request interpretation, specialist configuration, and response composition to the LLM, while the frozen TSFM alone produces the trajectory. Tool use offers a precedent for separating language interpretation from external execution (Schick et al. 2023; Yao et al. 2023). ChronoSteer converts textual events into revision instructions that steer a TSFM (Wang et al. 2025). TimeSeriesScientist assigns data diagnosis, model selection, forecasting, and reporting to specialized agents (Zhao et al. 2025). Last-mile forecasting agents retrieve contextual evidence and apply explicit revision actions to a forecasting backbone (Liao et al. 2026). In ChronoScribe, the LLM proposes whether and how to invoke a frozen specialist and communicates deterministic summaries of its output; it does not revise the specialist trajectory. Established forecasting evaluations focus on numerical outputs, using point-error metrics and proper scoring rules (Makridakis et al. 2020; Hyndman and Koehler 2006; Gneiting and Raftery 2007). GIFT-Eval broadens zero-shot TSFM evaluation across datasets, domains, frequencies, and forecast lengths (Aksu et al. 2024). These evaluations do not test request interpretation or whether a language response is supported by forecast evidence. Our protocol retains the raw forecasting metrics and adds request interpretation, instruction compliance, uncertainty communication, and execution cost. Problem Formulation Instruction-driven Forecasting Setting Let q denote a natural-language request and X1:T=(1,ā¦,T)X_1:T=(x_1,ā¦,x_T) the available history, where tāādx_t ^d; setting d=1d=1 gives the univariate case. Each task also supplies Ļ=(HĻ,jā)Ļ=(H_Ļ,j ), comprising the forecast horizon HĻH_Ļ and target index jāj , with jā=1j =1 for a univariate series. Given (q,X1:T,Ļ)(q,X_1:T,Ļ), the system decides whether to invoke a specialist and, if so, how much history to pass to it. The evaluation therefore holds the horizon fixed and measures routing and context configuration rather than autonomous horizon inference. A request may additionally specify trend, uncertainty, or response-format requirements. Forecast Specification and Evidence Construction We separate the language modelās raw directive from the executable configuration. Define the target history as X1:T(jā)=(x1,jā,ā¦,xT,jā)X^(j )_1:T=(x_1,j ,ā¦,x_T,j ). Its deterministic representation Ļ(X1:T(jā))Ļ(X^(j )_1:T) contains the history length, summary statistics, a linear-trend estimate, a uniformly subsampled trajectory, and recent observations. Let aXā0,1a_Xā\0,1\ indicate whether this history satisfies the specialistās preprocessing requirements. The directive proposes a path and context length; it also repeats the supplied horizon for schema compliance. The latter field does not determine the executable horizon: s s =ĪØĪø(q,Ļ(X(jā)1:T),Ļ), = _Īø\! (q,Ļ(X^(j )_1:T),Ļ ), (1) (u,C) (u,C) =Ī(s^;q,X(jā)1:T,Ļ),H=HĻ. = \! ( s;q,X^(j )_1:T,Ļ ), H=H_Ļ. The specialist runs only when the resolved action selects it and the target history is admissible: Y=FĻ(X(jā)TāC+1:T;H),u=1āandāaX=1,ā ,otherwise,Y= casesF_Ļ\! (X^(j )_T-C+1:T;H ),&u=1\ and\ a_X=1,\\ ,&otherwise, cases (2) When Yā ā Yā , the deterministic map e=gā”(Y)e=g(Y) formats the forecast into an evidence record, and the language model samples rā¼pĪø(ā ā£q,e)r p_Īø(Ā· q,e). When Y=ā Y= , the language model instead samples rā¼pĪø(ā ā£q)r p_Īø(Ā· q). Here, s s is the JSON-formatted directive, and (u,C)ā(u,C) is the resolved action. The variable uā0,1uā\0,1\ selects the path, while Cāā+C _+ is clipped to the admissible range for the available history and forecaster. The deterministic operator Ī parses and normalizes s s or applies a fallback if parsing fails. The repeated horizon field is audited for compliance, but HĻH_Ļ always determines execution. Only the frozen forecaster FĻF_Ļ generates future values; the language model produces either an evidence-conditioned response or a direct response. Forecast-grounded Response Generation For each forecast-claim type kā=num,dir,unck =\num,dir,unc\, let Claimskā(r)Claims_k(r) denote the numerical, directional, or uncertainty claims expressed in the specialist-path response r, and let Derivablekā(e)Derivable_k(e) denote the corresponding statements supported by the forecast evidence. We call a response forecast-grounded when Claimskā(r)āDerivablekā(e),ākā.Claims_k(r) _k(e), ā k . (3) Equation (3) is the traceability test used in our audit, not a constraint enforced at runtime. Grounding does not require the response to reproduce the complete trajectory; it requires every forecast-related claim to be supported by a deterministic transformation of the specialist output. The test measures agreement with specialist-derived evidence, not forecast accuracy or calibration. It is applied only to the specialist path because a direct language response has no forecast evidence. ChronoScribe Framework Overview ChronoScribe supports a direct language path and a specialist path. Figure 2 outlines this workflow. Every request first passes through the adapted language model, which emits a structured directive that deterministic rules resolve into a typed action. On the direct path, the model answers without invoking the forecaster. On the specialist path, a frozen forecaster receives the selected history window, and deterministic functions convert its quantile trajectories into an evidence record for the response. The same adapted language model emits the directive and composes the final response; the forecaster remains fixed. Figure 2: Typed-directive workflow with deterministic evidence. Routing and Forecast Specification The language component produces the raw directive s s in Eq. (1). The parser P maps it to z~=ā”(s^) z=P( s), with z~=ā„ z= denoting failure. If parsing succeeds, Ī applies the normalizer ā”(z~,T,Ļ)N( z;T,Ļ), which casts fields to their required types and clips C to the admissible range. If parsing fails, Ī instead applies the deterministic fallback ā¬(q,X1:T(jā),Ļ)B(q,X^(j )_1:T,Ļ), which uses a predefined route and context policy. Both cases return the same typed action (u,C)(u,C); raw language-model output is never executed directly. A specialist action is executed only when the historical observations also pass the validity check aXa_X. Parsing failures are counted as controller failures even if the fallback allows the request to complete. The resolved action controls only the route and the history suffix supplied to the specialist. It cannot change the externally specified horizon HĻH_Ļ or the specialist parameters ĻĻ; FĻF_Ļ produces all forecast values. Specialist Forecasting, Evidence, and Response On the specialist path, ChronoScribe extracts the selected history window of the target variable, X(C,jā)=X(jā)TāC+1:TX^(C,j )=X^(j )_T-C+1:T. In our implementation, the frozen specialist receives this subsequence and returns quantile trajectories over H future steps: Y Y =FĻā(X(C,jā),H)āā||ĆH, =F_Ļ\! (X^(C,j );H ) ^|A|Ć H, (4) Yα,h Y_α,h =x^T+h,jā(α),αā,hā1,ā¦,H. = x_T+h,j ^(α), α , hā\1,ā¦,H\. The symbol ĻĻ denotes the frozen specialist parameters, A is the set of quantile levels, and Yα,hY_α,h is the α-quantile prediction for the target variable at step h. Our Chronos-2 instantiation uses =0.1,0.5,0.9A=\0.1,0.5,0.9\, corresponding to P10, P50, and P90. The forecaster receives the task-specified univariate subsequence. The framework requires the specialist to accept the selected history and horizon and return at least a point forecast. Probabilistic output is needed only to construct uncertainty evidence. The deterministic map g converts the quantile trajectories into the fixed evidence record e=gā”(Y)=(enum,edir,eunc,eaux).e=g(Y)= (e_num,e_dir,e_unc,e_aux ). The component enume_num stores the initial, final, mean, minimum, and maximum P50 values together with relative change. The component edire_dir records a trend label derived using fixed thresholds, and eunce_unc stores interval information from P10 and P90. The optional eauxe_aux holds task-specific summaries such as peak properties; eaux=ā e_aux= when none is required. The grounding analysis covers numerical, directional, and uncertainty claims; auxiliary claims are outside its scope. For multivariate inputs, every summary refers to the task-specified target variable. Quantile-ordering checks, direction thresholds, and peak-detection rules are fixed before evaluation and documented in the supplementary protocol. The adapted language model generates a response conditioned on the original request and the evidence record. Figure 3 gives a specialist-path example. Because the response remains free-form text, separating the language model from trajectory generation does not by itself guarantee Eq. (3); the grounding audit checks each forecast-related claim against the evidence. Figure 3: End-to-end specialist-path example. Language Model Adaptation We train the language component on two interface tasks. A directive-generation record uses a request, history representation, and task constraints as input and a structured directive containing the route and context length as its target. A response-generation record uses a request and forecast evidence as input and an evidence-supported response as its target. Both tasks update a single LoRA adapter (Hu et al. 2022); the resulting model produces both directives and evidence-conditioned responses. Let ci=(qi,Ļi,Ļi)c_i=(q_i, _i, _i) denote a directive input, where Ļi _i is the deterministic history representation defined above. Let z=(ci,zi)i=1nzD_z=\(c_i,z_i)\_i=1^n_z denote the directive-generation examples and r=((qj,ej),rj)j=1nrD_r=\ ((q_j,e_j),r_j )\_j=1^n_r the evidence-to-response examples. We combine them as =zāŖrD=D_z _r and optimize only the LoRA parameters Īø using the target-token-averaged autoregressive objective āSFT(Īø)=ā1Nā(a,b)āāt=1|b|logpĪø(btā£a,b<t),L_SFT(Īø)=- 1N _(a,b) _t=1^|b| p_Īø (b_t a,b_<t ), (5) where (a,b)=(ci,zi)(a,b)=(c_i,z_i) for directive-generation examples and (a,b)=((qj,ej),rj)(a,b)=((q_j,e_j),r_j) for evidence-to-response examples. The normalization factor N=ā(a,b)ā|b|N= _(a,b) |b| is the total number of supervised target tokens. Prompt and padding tokens are masked from the loss. The adapter is trained only for directive and response generation; future numerical trajectories never appear as language-model targets. The adaptation records use public time series datasets that are disjoint from the 30 evaluation datasets. No evaluation series, windows, or future targets are used during training. The supplementary material documents the source datasets, split rules, prompt templates, transformation procedures, and output schemas used to construct the records. LoRA is applied to all attention and MLP projection layers with rank 6464, scaling parameter 128128, and dropout 0.050.05. Training uses AdamW for two epochs with an effective batch size of 3232, a learning rate of 2Ć10ā42Ć 10^-4, weight decay 0.010.01, and a 5%5\% linear warmup followed by cosine decay. The random seed is 4242. The base Qwen3.5-9B model and the Chronos-2 forecaster remain frozen throughout training. Experiments Experimental Setup and Evaluation Our evaluation covers request interpretation, forecast execution, and response generation. The suite comprises 23 evaluation dimensions divided into five groups, with ten forecasting, six temporal-reasoning, five instruction-following, one uncertainty, and one efficiency dimension. The forecasting dimensions measure point accuracy, direction, peak behavior, cross-domain transfer, robustness, and horizon degradation. The remaining dimensions evaluate temporal judgments, instruction compliance, probabilistic communication, and inference cost. The benchmark pool contains 8,120 source instances drawn from 30 public datasets in 14 families spanning energy, transportation, weather, finance, healthcare, retail, and monitoring. Primary comparisons use a fixed manifest of 460 records, with 20 records per dimension selected once with seed 2026. Each record contains a request q and an observed history X1:TX_1:T; the future segment XāT+1:T+HX _T+1:T+H is reserved for scoring. Every system receives the same request, history, and output requirements. All benchmark prompts use Simplified Chinese; cross-lingual transfer is outside the present evaluation. Dataset provenance, preprocessing, templates, and scoring rules are provided in the supplementary material. We report task-specific metrics before computing aggregate scores. The five primary point-error metrics are sMAPE, MASE, WAPE, RMSE, and MAE; directional and peak-oriented measures serve as additional forecasting diagnostics. Uncertainty is evaluated with interval coverage, calibration error, quantile-based criteria, and the continuous ranked probability score (CRPS). Temporal reasoning and instruction following are scored using task correctness, request interpretation, format validity, and required-field completeness. Efficiency is measured by latency, memory, throughput, and token consumption. Missing required outputs count as failures rather than being imputed. For the paired sMAPE comparison in the main results, we form a 95%95\% confidence interval from 1,000 dimension-level bootstrap replicates. For a bounded higher-is-better metric mā[0,1]mā[0,1], the score is 100ām100m. A lower-is-better metric is scored with the clipped linear map 100āmaxā”(0,1ām/bm)100 (0,1-m/b_m); an unbounded higher-is-better metric uses 100āminā”(1,maxā”(0,m/bm))100 (1, (0,m/b_m)). A reference bound bmb_m is fixed for each metric before systems are compared. Boolean criteria receive 100100 for success and 00 for failure. Each dimension score combines its applicable submetrics using fixed weights. The supplementary protocol lists every raw metric, reference bound, intra-dimension weight, direction of preference, and group assignment. After mapping each evaluation dimension to [0,100][0,100], we average the dimension scores within each group without additional weighting. Let SFS_F, SRS_R, SIS_I, SUS_U, and SES_E denote the resulting forecasting, temporal-reasoning, instruction-following, uncertainty, and efficiency group scores. The Task-Level Score (TLS) is TLS=0.60āSF+0.15āSR+0.15āSI+0.05āSU+0.05āSE.TLS=0.60S_F+0.15S_R+0.15S_I+0.05S_U+0.05S_E. (6) We fix the weights in Eq. (6) before comparing systems. Numerical forecasting receives 60%60\% because it is the benchmarkās central task. Temporal reasoning and instruction following each receive 15%15\%; uncertainty communication and efficiency each receive 5%5\%. TLS is the primary system-level metric, while raw metrics and group scores retain capability-level detail. A higher TLS does not indicate better performance in every group. In the sensitivity analysis, we vary the forecasting weight from 0.400.40 to 0.800.80 and allocate the remainder to reasoning, instruction following, uncertainty, and efficiency in the fixed ratio 3:3:1:13:3:1:1. Setting wF=0.60w_F=0.60 recovers the primary weights. Our implementation pairs a LoRA-adapted Qwen3.5-9B language component (Qwen Team 2026) with a frozen Chronos-2 forecaster. The comparisons include eleven proprietary direct LLMs, three open TSFMs (TimesFM, Moirai, and MOMENT), fixed-context controls, and component ablations. Each direct LLM receives the same request and history and must return the requested forecast or forecast-related response without access to Chronos-2 or the evidence module. API baselines use temperature 00 where supported, a maximum output budget of 8,192 tokens, and a 300-second timeout. Five fixed-context controls retain the language and specialist components but replace the proposed context length with a fixed global Cā64,128,256,512,1024Cā\64,128,256,512,1024\. The w/o LoRA variant keeps the two-path framework and substitutes the unadapted language model. The w/o Chronos-2 variant removes the specialist and forecasts directly with the language model. The C2-only variant runs Chronos-2 with C=512C=512 but omits language-guided routing, configuration, and response generation. These are comparisons between system variants, not estimates of additive component effects. All systems are evaluated on the same records, with future targets reserved for scoring. The same parsers and scoring rules process every systemās output. Model identifiers, prompts, inference settings, and access dates are listed in the supplementary material. Each system is evaluated three times on the fixed manifest. The bootstrap interval reported below resamples dimensions rather than repeated runs. Reproducibility Training and local inference use an NVIDIA A800. The artifact contains code, the fixed evaluation manifest, and reference configurations for adaptation and reported variants. The supplement specifies hardware/software details, data provenance and splits, prompts, transformations, output schemas, and evidence-verification rules. Main Results ChronoScribe achieves the lowest error on each of the five primary point-error metrics (sMAPE, MASE, WAPE, RMSE, and MAE) among all evaluated systems, including the fixed-context controls. Table 2 reports the raw errors. Across these metrics, the lowest direct-LLM error remains 2.02.0ā2.7Ć2.7Ć the corresponding ChronoScribe error. This range represents relative reductions of approximately 5050ā63%63\%. Figure 4 shows these gains. Relative to GPT-5.5 (OpenAI 2026), the best direct-LLM baseline on aggregate sMAPE, ChronoScribe lowers the metric from 50.85%50.85\% to 25.51%25.51\%. The 95%95\% dimension-level bootstrap CI for this reduction is [17.4,35.2][17.4,35.2] percentage points. Figure 4: Per-metric gains over the best direct LLM. Using unrounded scores, ChronoScribe attains a TLS of 65.565.5, 10.610.6 points above Gemini-3.1-Flash (Google 2026) (TLS 55.055.0). Table 1 reports the system scores; Figure 5 profiles the five groups. Table 1: System scores; column maxima are bold. Model TLS F R I U E ChronoScribe 65.5 73.7 36.2 59.0 71.2 69.7 Direct LLMs Gemini-3.1 Flash 55.0 51.8 52.1 53.8 75.7 84.9 GPT-5.5 51.7 51.5 43.5 49.8 73.6 62.3 GPT-5.6-Sol 50.9 49.1 45.5 49.3 73.5 71.3 DeepSeek-V4 Flash 50.3 46.0 43.5 65.8 65.7 61.1 Grok-4.3 50.3 49.4 40.2 49.7 73.5 69.2 GPT-5.4 50.3 46.5 43.3 53.7 74.9 81.2 Claude Sonnet-5 50.0 47.6 46.1 48.2 70.9 75.8 MiniMax-M3 50.0 51.8 40.2 44.7 62.5 61.6 GLM-5.2 49.3 47.9 47.8 48.6 69.6 51.9 DeepSeek-V4 Pro 47.3 40.0 44.4 64.7 68.9 70.1 Claude Opus-4.8 46.2 41.1 40.3 50.9 72.3 84.6 TSFMs TimesFM 49.1 44.3 26.8 63.9 82.9 95.1 Moirai 47.3 41.2 26.9 64.1 82.1 96.7 MOMENT 47.2 41.1 26.8 64.1 80.3 96.8 Figure 5: Group scores: ChronoScribe vs. direct LLMs. Table 2: Point-forecast errors; column minima are bold. Model sMAPE MASE RMSE WAPE MAE ChronoScribe 25.5 4.20 1.77 24.4 1.13 Direct LLMs Gemini-3.1 Flash 62.4 24.23 6.14 102.1 4.36 GPT-5.5 50.9 14.81 3.70 60.3 2.87 GPT-5.6-Sol 57.3 14.35 3.93 68.0 3.51 DeepSeek-V4 Flash 62.7 13.80 4.46 70.3 3.62 Grok-4.3 64.2 16.28 5.14 82.9 3.77 GPT-5.4 63.4 15.68 4.13 74.9 3.48 Claude Sonnet-5 65.0 15.01 4.53 72.6 3.80 MiniMax-M3 57.5 13.20 4.62 60.6 3.52 GLM-5.2 62.1 11.43 4.38 66.2 3.51 DeepSeek-V4 Pro 66.7 15.29 4.28 73.2 3.68 Claude Opus-4.8 66.2 16.54 5.86 92.7 6.00 TSFMs TimesFM 69.7 16.12 8.54 105.0 7.59 Moirai 78.0 16.78 9.16 113.1 8.12 MOMENT 77.2 16.70 8.88 116.0 7.85 The raw error ratios and the TLS margin summarize performance on different scales. Point-error ratios are computed directly from the original metrics. TLS instead maps heterogeneous metrics to [0,100][0,100] using fixed reference bounds, averages dimension scores within each group, and applies the predefined 60/15/15/5/560/15/15/5/5 weights. This process converts multiplicative forecasting-error gaps into bounded additive score differences, which are further attenuated by the 0.600.60 forecasting weight. A 10.610.6-point TLS lead is therefore compatible with the 2.02.0ā2.7Ć2.7Ć raw error ratios: it summarizes the complete workflow rather than forecasting accuracy alone. ChronoScribe ranks first at every tested forecasting weight from 0.400.40 to 0.800.80. Figure 6 shows normalized scores across 23 dimensions; darker cells indicate higher scores. Its margin over the runner-up grows from 4.94.9 points at wF=0.40w_F=0.40 to 10.610.6 points at the primary weight of 0.600.60 and 15.515.5 points at 0.800.80. Figure 6: Normalized scores across 23 dimensions. Analysis TLS falls from 65.565.5 to 51.751.7 without LoRA adaptation and to 25.525.5 without Chronos-2. Figure 7 shows the component ablations. The LoRA ablation changes both the directive and response interfaces, so its effect cannot be attributed to context selection alone. Removing Chronos-2 requires the language model to forecast directly; the resulting drop shows that direct language-model forecasting is not an adequate substitute for the numerical specialist in this setting. C2-only reaches a TLS of 35.335.3. Because it omits language-side routing and communication, we treat it as an incomplete-workflow control rather than an estimate of the controllerās additive contribution. Figure 7: TLS decomposition under component ablations. The controller returns a parseable directive with the protocol-defined route for 95.9%95.9\% of requests. On forecasting requests, its horizon field matches the supplied horizon in every case. Because the horizon is fixed by the task, this result measures constraint compliance rather than autonomous horizon inference. We also audit 100 randomly sampled specialist-path responses using a rule-based verifier. Across 230 extracted claims, agreement with deterministic forecast evidence is 87.4%87.4\%, and 89 responses pass every applicable check. Agreement ranges from 79.6%79.6\% for numerical values under a 15%15\% relative-error tolerance to 92.1%92.1\% for directional claims. This audit measures evidence traceability, not forecast accuracy or calibration; the supplementary material provides the complete verification rules. Discussion and Limitations ChronoScribe makes numerical provenance auditable, but the specialist path adds orchestration and an extra LLM call; latency depends on horizon, response length, and backend. We evaluate one LLMāforecaster pairing, Simplified Chinese prompts, and benchmark instruction families, limiting generalization. Although adaptation and evaluation data are disjoint, Chronos-2 was pretrained on public and synthetic corpora, so exposure to individual evaluation series cannot be ruled out (Ansari et al. 2025). Evidence conditioning improves traceability but cannot guarantee grounded decoding. Lower numerical-claim agreement motivates constrained rendering or verifier-based revision for high-stakes use. Conclusion ChronoScribe applies semanticānumerical specialization to instruction-driven time series forecasting. An adapted LLM interprets requests and proposes structured directives, which deterministic rules convert to executable settings. The frozen TSFM alone produces numerical trajectories; deterministic summaries ground the final response. Across 23 dimensions and 30 public datasets, ChronoScribe achieves the lowest error on all five primary point-error metrics, including fixed-context controls, while the best direct LLM remains 2.02.0ā2.7Ć2.7Ć worse on each. Its TLS of 65.565.5 exceeds the strongest of eleven proprietary direct-LLM baselines by 10.610.6 points. Routing and grounding audits indicate that the directive and response interfaces perform reliably in most cases. The design retains a single source for forecast values while using the LLM for interpretation, configuration, and communication. References Abdulaal et al. (2021) A. Abdulaal, Z. Liu, and T. Lancewicki Practical approach to asynchronous multivariate time series anomaly detection and localization. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, p. 2485ā2494. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Aksu et al. (2024) T. Aksu, G. Woo, J. Liu, X. Liu, C. Liu, S. Savarese, C. Xiong, and D. Sahoo GIFT-Eval: a benchmark for general time series forecasting model evaluation. arXiv preprint arXiv:2410.10393. Cited by: Related Work. Ansari et al. (2025) A. F. Ansari, O. Shchur, J. Küken, A. Auer, B. Han, P. Mercado, S. S. Rangapuram, H. Shen, L. Stella, X. Zhang, M. Goswami, S. Kapoor, D. C. Maddix, P. Guerron, T. Hu, J. Yin, N. Erickson, P. M. Desai, H. Wang, H. Rangwala, G. Karypis, Y. Wang, and M. Bohlke-Schneider Chronos-2: from univariate to universal forecasting. arXiv preprint arXiv:2510.15821. Cited by: Introduction, Related Work, Discussion and Limitations. Ansari et al. (2024) A. F. Ansari, L. Stella, C. Turkmen, X. Zhang, P. Mercado, H. Shen, O. Shchur, S. S. Rangapuram, S. Pineda Arango, S. Kapoor, J. Zschiegner, D. C. Maddix, H. Wang, M. W. Mahoney, K. Torkkola, A. G. Wilson, M. Bohlke-Schneider, and Y. Wang Chronos: learning the language of time series. Transactions on Machine Learning Research. External Links: 2403.07815 Cited by: Related Work. Bagnall et al. (2018) A. Bagnall, H. A. Dau, J. Lines, M. Flynn, J. Large, A. Bostrom, P. Southam, and E. Keogh The UEA multivariate time series classification archive, 2018. arXiv preprint arXiv:1811.00075. Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Cao et al. (2024) D. Cao, F. Jia, S. O. Arik, T. Pfister, Y. Zheng, W. Ye, and Y. Liu TEMPO: prompt-based generative pre-trained transformer for time series forecasting. In International Conference on Learning Representations (ICLR), Cited by: Related Work. Chowdhury et al. (2026) A. M. Chowdhury, R. Akter, and S. H. Arib T3Time: tri-modal time series forecasting via adaptive multi-head alignment and residual fusion. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 20597ā20605. External Links: Document Cited by: Related Work. Das et al. (2024) A. Das, W. Kong, R. Sen, and Y. Zhou A decoder-only foundation model for time-series forecasting. In Proceedings of the 41st International Conference on Machine Learning (ICML), p. 10148ā10167. External Links: 2310.10688 Cited by: Related Work. Dau et al. (2019) H. A. Dau, A. Bagnall, K. Kamgar, C. M. Yeh, Y. Zhu, S. Gharghabi, C. A. Ratanamahatana, and E. Keogh The UCR time series archive. IEEE/CAA Journal of Automatica Sinica 6 (6), p. 1293ā1305. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Dempster et al. (2025) A. Dempster, N. M. Foumani, C. W. Tan, L. Miller, A. Mishra, M. Salehi, C. Pelletier, D. F. Schmidt, and G. I. Webb MONSTER: monash scalable time series evaluation repository. Transactions on Machine Learning Research. External Links: Link Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Gneiting and Raftery (2007) T. Gneiting and A. E. Raftery Strictly proper scoring rules, prediction, and estimation. Journal of the American Statistical Association 102 (477), p. 359ā378. External Links: Document Cited by: Related Work. Google (2026) Google Gemini API Release Notes. Note: https://ai.google.dev/gemini-api/docs/changelogAccessed: 2026-07-20 Cited by: Main Results. Goswami et al. (2024) M. Goswami, K. Szafer, A. Choudhry, Y. Cai, S. Li, and A. Dubrawski MOMENT: a family of open time-series foundation models. In Proceedings of the 41st International Conference on Machine Learning (ICML), p. 16115ā16152. External Links: 2402.03885 Cited by: Related Work. Gruver et al. (2023) N. Gruver, M. Finzi, S. Qiu, and A. G. Wilson Large language models are zero-shot time series forecasters. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 36. External Links: 2310.07820 Cited by: Introduction, Introduction, Related Work. Hu et al. (2022) E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen LoRA: low-rank adaptation of large language models. In International Conference on Learning Representations (ICLR), External Links: 2106.09685 Cited by: Language Model Adaptation. Hundman et al. (2018) K. Hundman, V. Constantinou, C. Laporte, I. Colwell, and T. Soderstrom Detecting spacecraft anomalies using LSTMs and nonparametric dynamic thresholding. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p. 387ā395. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Hyndman and Koehler (2006) R. J. Hyndman and A. B. Koehler Another look at measures of forecast accuracy. International Journal of Forecasting 22 (4), p. 679ā688. Cited by: Related Work. Jia et al. (2026) S. Jia, B. Song, C. Ye, and C. Yuan M3Time: LLM-enhanced multi-modal, multi-scale, and multi-frequency multivariate time series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 22265ā22273. External Links: Document Cited by: Related Work. Jin et al. (2024) M. Jin, S. Wang, L. Ma, Z. Chu, J. Y. Zhang, X. Shi, P. Chen, Y. Liang, Y. Li, S. Pan, and Q. Wen Time-LLM: time series forecasting by reprogramming large language models. In International Conference on Learning Representations (ICLR), External Links: 2310.01728 Cited by: Introduction, Introduction, Related Work. Laptev et al. (2015) N. Laptev, S. Amizadeh, and Y. Billawala S5: a labeled anomaly detection dataset, version 1.0 (16m). Note: Yahoo Research Webscope External Links: Link Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Lavin and Ahmad (2015) A. Lavin and S. Ahmad Evaluating real-time anomaly detection algorithmsāthe numenta anomaly benchmark. In Proceedings of the 2015 IEEE 14th International Conference on Machine Learning and Applications, p. 38ā44. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Liao et al. (2026) Y. Liao, Z. Wang, Q. Nie, and Z. Zhang Bridging the last mile of time series forecasting with LLM agents. arXiv preprint arXiv:2606.02497. Cited by: Introduction, Related Work. Liu et al. (2025a) C. Liu, Q. Xu, H. Miao, S. Yang, L. Zhang, C. Long, Z. Li, and R. Zhao TimeCMA: towards LLM-empowered multivariate time series forecasting via cross-modality alignment. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, p. 18780ā18788. External Links: Document Cited by: Related Work. Liu et al. (2025b) P. Liu, H. Guo, T. Dai, N. Li, J. Bao, X. Ren, Y. Jiang, and S. Xia CALF: aligning LLMs for time series forecasting via cross-modal fine-tuning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 39, p. 18915ā18923. External Links: Document Cited by: Related Work. Liu et al. (2024a) X. Liu, J. Hu, Y. Li, S. Diao, Y. Liang, B. Hooi, and R. Zimmermann UniTime: a language-empowered unified model for cross-domain time series forecasting. In Proceedings of the ACM Web Conference (W), p. 4095ā4106. Cited by: Related Work. Liu et al. (2024b) Y. Liu, T. Hu, H. Zhang, H. Wu, S. Wang, L. Ma, and M. Long ITransformer: inverted transformers are effective for time series forecasting. In International Conference on Learning Representations (ICLR), Cited by: Related Work. Liu et al. (2024c) Y. Liu, H. Zhang, C. Li, X. Huang, J. Wang, and M. Long Timer: generative pre-trained transformers are large time series models. In Proceedings of the 41st International Conference on Machine Learning (ICML), Proceedings of Machine Learning Research, Vol. 235, p. 32369ā32399. Cited by: Related Work. Makridakis et al. (2020) S. Makridakis, E. Spiliotis, and V. Assimakopoulos The M4 competition: 100,000 time series and 61 forecasting methods. International Journal of Forecasting 36 (1), p. 54ā74. Cited by: Related Work. Makridakis et al. (2022) S. Makridakis, E. Spiliotis, and V. Assimakopoulos M5 accuracy competition: results, findings, and conclusions. International Journal of Forecasting 38 (4), p. 1346ā1364. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Mathur and Tippenhauer (2016) A. P. Mathur and N. O. Tippenhauer SWaT: a water treatment testbed for research and training on ICS security. In 2016 International Workshop on Cyber-physical Systems for Smart Water Networks, p. 31ā36. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Nie et al. (2023) Y. Nie, N. H. Nguyen, P. Sinthong, and J. Kalagnanam A time series is worth 64 words: long-term forecasting with transformers. In International Conference on Learning Representations (ICLR), Cited by: Related Work. OpenAI (2026) OpenAI GPT-5.5 Model. Note: https://developers.openai.com/api/docs/models/gpt-5.5Accessed: 2026-07-20 Cited by: Main Results. Qwen Team (2026) Qwen Team Qwen3.5: towards native multimodal agents. Note: https://qwen.ai/blog?id=qwen3.5Accessed: 2026-07-20 Cited by: Experimental Setup and Evaluation. Schick et al. (2023) T. Schick, J. Dwivedi-Yu, R. DessƬ, R. Raileanu, M. Lomeli, E. Hambro, L. Zettlemoyer, N. Cancedda, and T. Scialom Toolformer: language models can teach themselves to use tools. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 36. Cited by: Related Work. Su et al. (2019) Y. Su, Y. Zhao, C. Niu, R. Liu, W. Sun, and D. Pei Robust anomaly detection for multivariate time series through stochastic recurrent neural network. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, p. 2828ā2837. External Links: Document Cited by: ChronoScribe: SemanticāNumerical Specialization for Instruction-Driven Time Series Forecasting. Wang et al. (2025) C. Wang, Q. Qi, Z. Rao, L. Pan, J. Wang, and J. Liao ChronoSteer: bridging large language model and time series foundation model via synthetic data. arXiv preprint arXiv:2505.10083. Cited by: Introduction, Related Work. Woo et al. (2024) G. Woo, C. Liu, A. Kumar, C. Xiong, S. Savarese, and D. Sahoo Unified training of universal time series forecasting transformers. In Proceedings of the 41st International Conference on Machine Learning (ICML), p. 53140ā53164. External Links: 2402.02592 Cited by: Related Work. Wu et al. (2023) H. Wu, T. Hu, Y. Liu, H. Zhou, J. Wang, and M. Long TimesNet: temporal 2D-variation modeling for general time series analysis. In International Conference on Learning Representations (ICLR), Cited by: Related Work. Wu et al. (2026) L. Wu, X. Wang, C. Ge, R. Chu, and L. Wang ExoTimer: leveraging large language models for time series forecasting with exogenous variables. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 40, p. 26956ā26964. External Links: Document Cited by: Related Work. Yao et al. (2023) S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao ReAct: synergizing reasoning and acting in language models. In International Conference on Learning Representations (ICLR), Cited by: Related Work. Zhao et al. (2025) H. Zhao, X. Zhang, J. Wei, Y. Xu, Y. He, S. Sun, and C. You TimeSeriesScientist: a general-purpose AI agent for time series analysis. arXiv preprint arXiv:2510.01538. Cited by: Introduction, Related Work. Zhou et al. (2021) H. Zhou, S. Zhang, J. Peng, S. Zhang, J. Li, H. Xiong, and W. Zhang Informer: beyond efficient transformer for long sequence time-series forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35, p. 11106ā11115. Cited by: Related Work. Zhou et al. (2023) T. Zhou, P. Niu, X. Wang, L. Sun, and R. Jin One fits all: power general time series analysis by pretrained LM. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 36. Cited by: Related Work. 29, 21, 16, 35, 1, 30, 20, 5, 9, 10