Paper deep dive
Hybrid Reasoning Agents
Jiaru Zou, Yunzhe Qi, Sirui Chen, Federico Bianchi, Shang Zhu, Pan Lu, Jingrui He, James Zou
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:How can we build an agent that thinks beyond human language, yet still acts through it in the external environment? Modern LLM agents still reason and interact through text, while latent reasoning offers an efficient internal medium but lacks native tool access and reasoning transparency. We bridge these two directions with Hybrid Reasoning Agents (HybridAgents), which dynamically navigate between latent reasoning and text-based interaction throughout a unified generation process. Architecturally, a lightweight HybridLink enables seamless transitions between text and latent modes, while the agent's continuous working memory preserves lossless hybrid context across multiple turns. These designs preserve tool-integrated agentic capabilities while making latent thoughts directly inspectable. Building on this architecture, we further develop dedicated post-training algorithms for hybrid reasoning: HybridSFT stabilizes tool-integrated hybrid generation by teaching the backbone to coordinate with HybridLink, then HybridRL scales reasoning by learning when to think in latent space and when to act through text. We evaluate HybridAgent at 3 model scales across 11 benchmarks covering mathematics, science, medicine, search, and agentic reasoning. Compared with frontier LLM Agents and agentic frameworks spanning both text-based and latent methods, HybridAgent consistently improves performance by 10.4%, while delivering 35.5%-54.7% token reduction, 1.8x-2.6x faster inference, and 2.7x-3.7x cost savings. Code and data are available at this https URL.
Tags
Links
- Source: https://arxiv.org/abs/2610.18861v1
- Canonical: https://arxiv.org/abs/2610.18861v1
Trouble viewing inline? Open PDF directly โ
Full Text
138,386 characters extracted from source content.
Expand or collapse full text
Hybrid Reasoning Agents Jiaru Zou 1,2*โ , Yunzhe Qi 3,4โ , Sirui Chen 3โ , Federico Bianchi 2 , Shang Zhu 2 , Pan Lu 1 , Jingrui He 3 , James Zou 1,2 1 Stanford University 2 Together AI 3 UIUC 4 Meta * Project Lead โ Core Contributor A B S T R A C T How can we build an agent that thinks beyond human language, yet still acts through it in the external environment? Modern LLM agents still reason and interact through text, while latent reasoning offers an efficient internal medium but lacks native tool access and reasoning transparency. We bridge these two directions with Hybrid Reasoning Agents (HybridAgents), which dynamically navigate between latent reasoning and text-based interaction throughout a unified generation process. Architecturally, a lightweight HybridLink enables seamless transitions between text and latent modes, while the agentโs continuous working memory preserves lossless hybrid context across multiple turns. These designs preserve tool-integrated agentic capabilities while making latent thoughts directly inspectable. Building on this architecture, we further develop dedicated post-training algorithms for hybrid reasoning: HybridSFT stabilizes tool-integrated hybrid generation by teaching the backbone to coordinate with HybridLink, then HybridRL scales reasoning by learning when to think in latent space and when to act through text. We evaluate HybridAgent at 3 model scales across 11 benchmarks covering mathematics, science, medicine, search, and agentic reasoning. Compared with frontier LLM Agents and agentic frameworks spanning both text-based and latent methods, HybridAgent consistently improves performance by 10.4%, while delivering 35.5%โ54.7% token reduction, 1.8รโ2.6ร faster inference, and 2.7รโ3.7ร cost savings. Code: https://github.com/togethercomputer/HybridAgent Correspondence: jiaru@stanford.edu, jamesz@stanford.edu + โh Linear W ! GELU Linear W " Residual Connection Next-step Emb Last-layer State h HybridAgent HybridLink e ... Last-layer hidden states h x 1 x 2 x t ... Input Contexts LM head y t+1 <latent> h Text ModeLatent ModeText Mode HybridAgent $ + Token Emb ... Token Emb ... ... ... ... ... e h LM head y t+m ... Token Emb ... ... e h h </latent> ... ... ... Next-position inputs Latent Reasoning HybridLink ... (Fast & Inspectable) ... ... ... EnterExit Figure 1|HybridAgent Architecture Overview. Left: A HybridLink maps last-layer hidden states back into the input embedding space, letting the agent enter latent mode for recurrent, fast, inspectable inner thinking and return to text mode for tool calls and external monitoring. Right: HybridAgent performs hybrid reasoning that thinks in latent space and acts through text within a single generation process. Building on this architecture, HybridAgent (i) achieves multi-turn hybrid generation by carrying the entire hybrid context through its own working memory (Section 3), and (i) can be converted from any standard pre-trained LLM through a dedicated post-training pipeline (Section 4). arXiv:2610.18861v1 [cs.CL] 13 Oct 2026 Hybrid Reasoning Agents 1. Introduction Frontier intelligence no longer scales through the modelโs reasoning alone, but depends increasingly on its ability to interact with the external world (Kwa et al., 2026; Sun et al., 2026; Team, 2026). To solve a hard problem, an LLM agent must reach beyond the model itself by continually invoking specialized tools, observing feedback from the environment, and adapting its next move (Feng et al., 2026; Qu et al., 2025; Silver and Sutton, 2025). Beneath this expanding repertoire of agent harnesses lies a single lingua franca: text, the common medium of both the agentโs autoregressive generation and its environment interaction (Sumers et al., 2024; Zhang et al., 2026b). All intermediate reasoning trajectories are generated token by token as text before the agent can act on the environment. A separate line of work on latent reasoning points in a different direction (Chen et al., 2025; Zhu et al., 2025b). By unfolding computation directly in continuous hidden space, latent models bypass the need to decode and verbalize every intermediate step, providing more efficient internal reasoning within the modelโs โown language" (Hao et al., 2024; Wang et al., 2025; Yu et al., 2026). However, todayโs latent reasoners remain largely sealed behind the model boundary. Unlike decoded text, continuous latent vectors (i) lack native pathways for tool invocation across multi-turn agentic reasoning (Chang et al., 2026), and (i) do not readily expose human-interpretable semantics, leaving them difficult to supervise during training (Chen et al., 2026) and to audit or debug at inference (Korbak et al., 2025). These constraints keep latent reasoning models from operating as capable agents in their own right. Taken together, agentic interaction and efficient inner reasoning have so far required a different medium each, leaving the two lines of work apart in the development of next-generation agents. We believe this division can be closed by building a new type of agent that combines both strengths to think beyond text while still acting through it. We call this unified design HybridAgent, one that dynamically navigates between latent reasoning and text-based interaction within a single generation. Building such an agent is hard, since it needs to handle both dense continuous vectors and sparse discrete tokens as hybrid inputs, and determine when to transition between text and latent modes to balance agentic actions and reasoning efficiency. To offset the hardness, we first revisit the model architecture and extend its autoregressive generation interface to support hybrid inputs. At the heart of this design is HybridLink, a lightweight residual adapter that bridges latent thoughts from the last- layer hidden space back into the input embedding space and enables sequence-wise recurrence within latent mode. Then, we realize multi-turn hybrid generation through the agentโs own working memory, carrying complete hybrid trajectories of text, latent thoughts, and tool observations across turns. Surprisingly, we find that HybridAgent can render its thoughts in latent mode as human-readable pseudo-text, making latent reasoning transparent and directly inspectable rather than opaque. To further unlock the potential of hybrid reasoning, we equip HybridAgent with dedicated post- training algorithms. HybridSFT first stabilizes tool-integrated hybrid generation through activation and self-conditioned training, which adapts the backbone to reason over latent thoughts produced by its own HybridLink, enabling reliable coordination between the two components and closing the train- inference mismatch. Then, HybridRL scales agentic reasoning capabilities by training HybridAgent to adaptively balance latent reasoning and text-based interaction. To realize this, we enable policy optimization over hybrid trajectories through hybrid policy factorization and exact rollout replay. We provide theoretical grounding for HybridAgent through complementary analyses of multi-turn context continuation and hybrid policy optimization. From an architectural standpoint, we show that continuous working memory losslessly preserves the entire hybrid context across different turns. From a learning perspective, the hybrid policy factorization and exact latent-context replay in HybridRL provide a well-founded basis for policy updates over complete hybrid trajectories. Empirically, we evaluate HybridAgent on 11 benchmarks spanning mathematics, science, medicine, 2 Hybrid Reasoning Agents knowledge-intensive search, and challenging agentic reasoning. We instantiate and train HybridAgent with Qwen3-Base models (Yang et al., 2025a) across 4B, 8B, and 14B scales. Compared with frontier LLM agents and agentic frameworks spanning both text-based and latent reasoning, HybridAgent achieves an average performance improvement of 10.4% and exhibits strong test-time scalability. In terms of efficiency, HybridAgent reduces token usage by 35.5%โ54.7%, delivers 1.8รโ2.6รinference speedup, and lowers computational cost by 2.7รโ3.7ร. Additional in-depth analyses of training dynamics, reasoning auditability, and agentic tool-use reliability reveal a clear division of labor between the two reasoning modes: HybridAgent shifts more internal reasoning into semantically rich and interpretable latent thoughts, while reserving text for external inspection and tool interaction. 2. Preliminary Hybrid Generation in LLMs. We consider an LLM agentํ ํ built upon a standard Transformer parameterized byํ. To enable hybrid generation, the agent operates autoregressively in two modes: (i)text, which performs explicit generation in the token space, and (i)latent, which performs implicit generation in the continuous representation space. Formally, given an input contextํฅwith corresponding input embeddingsํธ=[ํ 1 , . . . , ํ ํก ] โโ ํกรํ โ , the agent computes the last-layer hidden state โ ํก through a forward pass, and the hybrid input representation for the next step ํก+ 1 is: ํ ํก+1 = ( Emb(ํฆ ํก+1 ), ํฆ ํก+1 โผ Softmax(ํ out โ ํก ), if text mode, โ ํก ,if latent mode, (1) whereํ out is the vocabulary projection matrix,Emb(ยท)is the token embedding function, andโ ํก is directly reused as the next latent input in standard latent reasoning (Cheng and Van Durme, 2024; Coda-Forno et al., 2025; Hao et al., 2024). The next hidden state of ํ ํ is then computed as: โ ํก+1 = ํ ํ ([ํธ โคํก ; ํ ํก+1 ]). (2) Throughout inference, the hybrid agent dynamically switches between the two generation modes, producing a hybrid trajectory that balances the modelโs inner reasoning with external interaction. Tool-Integrated Agentic Reasoning. A hybrid agent can leverage its text mode to interact with external environments. Similar to standard LLM agents, the hybrid agent generates a tool call as a sequence of text, invokes the corresponding tool (e.g., Python, Search), and receives the resulting observations. A complete single-turn hybrid reasoning trajectory ํ can be represented as: [text] โจlatentโฉ ยท [text] [tool_call] [tool_response] Tool Execution Model-Side Hybrid ReasoningEnvironment-Side Interaction (3) where[ยท]andโจยทโฉdenote text chunks and latent vectors, respectively. The whole trace is then appended as input for the next generation turn, and the process continues until a final text answer is produced. 3. Building a Hybrid Reasoning Agent We introduce HybridAgent, a hybrid framework that dynamically navigates between explicit text and continuous latent reasoning within a single unified generation process. As illustrated in Figure 1, the architecture preserves an LLM agentโs autoregressive generation and tool-calling interfaces while accommodating both text and latent inputs. Below, we first present the hybrid interface for seamless text-latent mode transition (Section 3.1), followed by multi-turn hybrid generation (Section 3.2). 3 Hybrid Reasoning Agents Figure 2|Interpretable Latent Mode in HybridAgent. All latent steps can be expressed as readable pseudo-text carrying their semantics for external inspection. Left: Quantitatively, latent thoughts are highly readable and context-specific (see Appendix F). Right: Qualitatively, latent pseudo-text stays semantically aligned with surrounding text reasoning and tool calls. (โStepsโ counts forward passes). 3.1. Hybrid Mode Interface Existing latent reasoning models typically feed the last-layer hidden stateโ ํก directly back as the next-step inputํ ํก+1 . This design is not well suited to hybrid generation, as substitutingโ ํก for a token embedding creates a representation mismatch with the pretrained input space, making transitions between continuous latent states and discrete tokens difficult. To support both latent and text modes in a shared input interface, we add a lightweight adapter HybridLink to work alongside the backbone. HybridLink as a Bridge. An LLM agentโs last-layer hidden states naturally encode the semantics of its current generation, so the HybridLinkRis designed to carry this information from the hidden representation space back into the input embedding space. Formally, given any last-layer hidden state โ ํก , HybridLink simulates its corresponding next-step input embedding as: ํ ํก+1 =R(โ ํก )= โ ํก + ํ 2 ํ ( ํ 1 โ ํก ) , (4) whereํ 1 ,ํ 2 are standard linear projections,ํis an activation function (e.g., GELU). As the residual connection largely preserves the original semantics ofโ ํก , HybridLink only needs to align the distribu- tional difference rather than learn the entire projection from scratch. Accordingly, the link module is lightweight, with approximately 2ํ 2 โ parameters (e.g.,โผ10M parameters for a 4B LLM). Dynamic Text-Latent Mode Transition. Next, we describe how HybridAgent transitions between text and latent modes during generation, together with the entry and exit decisions for each mode. In text mode, HybridAgent behaves exactly as a standard LLM, sampling the next token from the vocabulary at each step. The process continues until the agent generates one special token<latent>, which serves as the entry anchor for the latent mode. For the next forward pass, the agent uses HybridLink for latent reasoning in place of the LM head and token embedding layer. In latent mode, each stepโs last-layer hidden state is passed through HybridLink via Eq. 4, allowing HybridAgent to continue its generation flow entirely in latent space without token decoding and re-embedding. This sequence-wise recurrent computation over continuous representations extends the agentโs effective reasoning depth, enabling more expressive internal reasoning. The latent reasoning span terminates when the semantics of the last-layer hidden stateโ ํก align with the exit anchor 4 Hybrid Reasoning Agents Input 1st turn ฯ (1) 2nd turn ฯ (2) Final turn ฯ (n) x[text]...[tool call][tool response]... ... [Answer] ...... ... Initialize Append KV โณ (0) โณ (1) โณ (2) โณ (nโ1) Working Memory of (KV pairs accumulate at every position, across all layers) โจlatentโฉ Reuse Append KV โณ (n) ... Reuse Figure 3|Multi-Turn Hybrid Generation over HybridAgentโs Own Working Memory. HybridAgent accumulates key-value (KV) entries from text, latent thoughts, and tool observations in continuous working memory, directly reusing and updating it across turns to preserve the full hybrid context. </latent>. Specifically, at any latent step ํก, the latent mode closes by satisfying the condition: arg max ํฃโV cos R(โ ํก ), Emb(ํฃ) = </latent>.(5) HybridAgent then returns to its text mode, and this transition continues during generation. At each step, the agent adaptively decides whether to remain in its current mode or switch, allowing the length and frequency of text and latent spans to emerge dynamically rather than follow preset configurations. Interpretable Latent Mode. During hybrid generation, a useful property of HybridAgent is that its latent mode remains decoding-free yet directly interpretable. To inspect any latent reasoning span, one can easily recover its semantics by mapping each latent step produced by HybridLink to its nearest token embedding, as in Eq. 5. We illustrate this interpretability property clearly in Figure 2. 3.2. Multi-Turn Hybrid Generation over Working Memory In standard LLM agents, each turnโs generated content and tool outputs are appended to the textual context and re-encoded as the next turnโs input prefix. Hybrid trajectories, however, interleave text tokens with latent vectors and canโt be reconstructed through conventional tokenization alone. Instead, HybridAgent carries the complete context across turns through its continuous working memory. Cross-Turn Working Memory. Recall that a single-turn hybrid trajectoryํin Eq. 3 consists of model-generated text, latent thoughts, and external tool interactions. During input construction, all contents are mapped into the same input space through either the input embedding layer or HybridLink. This shared space allows the Transformer to process all three components uniformly and collect their KV entries throughout generation. We leverage these accumulated KV entries as the HybridAgentโs continuous working memory to achieve multi-turn hybrid generation. As illustrated in Figure 3, HybridAgent first initializes its working memoryMfrom the input context ํฅ and then accumulates the KV entries generated throughout the first-turn trajectory ํ (1) , i.e., M (0) = ํพ โค|ํฅ| , ํ โค|ํฅ| , M (1) =M (0) โ ํพ โคํก ,ํ โคํก , ํก= 1, . . . ,|ํ (1) |. (6) Here,M (1) preserves the complete first-turn hybrid context in positional order across all Transformer layers. For each subsequent turn, the agent directly resumes generation from the current working memory and updates it by appending newly generated KV entries at each step. This process continues across the sequence of hybrid trajectoriesํ (1) , ํ (2) , . . . , ํ (ํ) until the final answer is produced. We further provide a formal justification for this continuation process in Appendix A. Overall, multi-turn hybrid generation proceeds over one continuous working memory flow, preserving the complete hybrid context across turns without requiring intermediate token-space reconstruction. 5 Hybrid Reasoning Agents TokenTokenEmb(โ )Emb(โ )TokenToken Shared backbone Text Mode Groundtruth Latent Mode GroundtruthText Mode Groundtruth โ(h)โ(h)โ(h) Shared backbone Hybrid Data Pass 1 (Teacher forced) Pass 2 (Self-conditioned) One step ahead CECERegressionRegression ... CE Target Loss HybridLink HybridLinkHybridLink ... ... ... ... ... Same Token Same Token Same Token ... Figure 4|Self-Conditioned HybridSFT. A teacher-forced first pass produces next-step latent inputs via HybridLink. A second pass replaces ground-truth latent embeddings Emb(ยท)with the predictions R(โ)and jointly trains the backbone and HybridLink using CE at text and regression at latent positions. 4. Learning to Perform Hybrid Reasoning With the overall framework in place, we now turn to training. As HybridAgent leaves the backbone architecture intact, no pre-training from scratch is required. Instead, we adapt the standard agentic post-training pipeline of supervised fine-tuning and reinforcement learning to the hybrid setting. The two training stages serve complementary roles: SFT teaches the agent to coordinate with HybridLink and instantiate reliable tool use for stable hybrid generation (Section 4.1), while RL further scales reasoning by learning when to think in latent space and when to act through text (Section 4.2). 4.1. Stabilize Generation via Hybrid Supervised Fine-tuning As a first step toward stabilizing hybrid reasoning in HybridAgent, we design the entire HybridSFT stage through a hybrid data curation pipeline and a staged training procedure. Hybrid Data Recipe. To curate high-quality training data, we filter existing text-based agentic SFT datasets from multiple sources and convert them into hybrid trajectories through automatic annotation. We assign reasoning steps to latent mode based on both LLM Expertsโ judgments and target modelsโ own prediction entropy, while retaining a small set of key steps for tool interactions and external debugging/auditing in text mode (see Appendix E for data curation details). Format and HybridLink Activation. As a warm start, we adapt the backbone to the hybrid data format and initialize the HybridLink. For format activation, we perform standard text SFT to teach the backbone when to enter and exit latent mode by emitting the two special anchor tokens. We then freeze the backbone and train HybridLink to align last-layer hidden states at latent positions with their target input embeddings. For a training instance (ํฅ, ํฆ) โ D SFT , the activation objectives are: L Backbone = CE ํ ํ (ํฅ), ํฆ , L HybridLink = ํ cos 1โ cos R(โ lat ), Emb(ํฆ lat ) + ํ mse R(โ lat )โ Emb(ํฆ lat ) 2 2 , (7) whereโ lat is the last-layer hidden states at latent positions,ํฆ lat is the corresponding ground-truth text tokens, and ํ cos , ํ mse balance directional and magnitude alignment, respectively. Self-Conditioned HybridSFT. The activation provides a well-aligned initialization, but the backbone has not yet learned to reason over latent thoughts produced by its own HybridLink (see Appendix B.1 for details on this train-inference mismatch). We therefore adopt a two-pass self-conditioned training scheme as illustrated in Figure 4. In the first pass, HybridAgent is teacher-forced on the ground-truth hybrid sequence. HybridLink maps the generated last-layer hidden states at latent positions one step ahead to form latent inputs for the next pass. In the second pass, HybridAgent processes the same 6 Hybrid Reasoning Agents Algorithm 1 Hybrid Reinforcement Learning (HybridRL) Input: Agent ํ ํ (SFT initialized in Section 4.1), HybridLinkR, task setD RL , group size ํบ, ํ 1: for each training step do 2: Sample ํฅ โผD RL ; Collectํ ํ ํบ ํ=1 โ ํ ํ (ํฅ)โฒ Hybrid Policy Rollout 3: Record ํ ํ with latent ํง ํ =R(ํป ํ ) (Eq. 4), text ํฆ ํ , and tool observations ํ ํ 4: Compute rewards ํ ํ (Eq. 11) and group-normalized advantages ํด ํ 5: Replay ํ ํ with (ํง ํ , ํฆ ํ , ํ ํ ) to obtain ํ ํ (ํฆ ํ,ํก | ํ ํ,<ํก )โฒ Exact Rollout Replay 6: Compute ํ ํ,ํก via Eq. 9 and Eq. 10โฒ Hybrid Policy Factorization 7: Update ํโ ํโ ํโ ํ L RL (standard RL objective)โฒ Hybrid Policy Update 8: end for sequence but replaces the ground-truth latent embeddings with its own latent inputs. We jointly supervise text and latent positions on the second pass as: L HybridSFT =L Backbone +L HybridLink ,(8) where the CE lossL Backbone and regression lossL HybridLink are applied only at text and latent positions, respectively. Overall, HybridSFT trains the agent to coordinate its backbone with HybridLink for coherent reasoning across text and latent modes, supporting stable hybrid generation at inference. 4.2. Scale Reasoning via Hybrid Reinforcement Learning A HybridAgent cannot straightforwardly adopt popular RL algorithms such as PPO (Schulman et al., 2017) or GRPO (Shao et al., 2024), as they assume every generated position carries a token-level likelihood. Specifically, at each position ํก, standard RL computes the per-token importance ratio as: ํ ํก = ํ ํ ํฆ ํก | ํฆ <ํก ํ ํ old ํฆ ํก | ํฆ <ํก , (9) whereํ ํ , ํ ํ old denote the current and rollout policies. At latent positions, however, HybridAgent generates continuous vectors rather than sampled tokens, leaving no token-level likelihood. Thus, the importance ratio ํ ํก is undefined. We address this incompatibility with two simple components. Hybrid Policy Factorization. Recall that, in a hybrid trajectory, latent thoughts are computed entirely in the continuous latent space through HybridLink, and tool responses are the masked observations from the environment. Thus, policy sampling during rollout is confined to model-generated text positions. To justify why policy optimization needs only to operate over these sampled positions, we formalize the hybrid policy factorization below with detailed theoretical analyses. Proposition 4.1 (Hybrid Policy Factorization). Letํbe a hybrid trajectory generated by the policy ํ ํ (induced by ํ ํ ) with fixed HybridLinkR. Then the hybrid policy factorizes as: ํ ํ (ํ | ํฅ)= ร ํกโT ํ ํ ํฆ ํก | ํฅ, ํ <ํก , (10) whereT is the set of sampled text positions of trajectory ํ. The proof and additional theoretical justifications are provided in Appendix C. Proposition 4.1 shows that likelihood-ratio updates over sampled text positions are sufficient to optimize the full hybrid trajectory, making the importance ratio in Eq. 9 well-defined for the HybridAgent policy. 7 Hybrid Reasoning Agents Policy Update via Exact Rollout Replay. Policy optimization generally involves rebuilding a differen- tiable computation graph for the rollouts. Applying this to HybridAgent further requires recomputing sampled text-token likelihoods conditioned on the same preceding latent thoughts used during rollout. We satisfy this requirement via exact latent-context replay. During hybrid rollout, we record latent thoughts alongside sampled text tokens and tool observations. During policy updates, we replay the full hybrid trajectory in embedding space with a single differentiable forward pass, keeping the recorded latent inputs unchanged while recomputing the sampled likelihoods in Eq. 10. Algorithm 1 outlines the full HybridRL training procedure. We keep the HybridLink fixed to preserve deterministic latent transitions. For the reward design, we simply formulate it as: ํ(ํ)= ํ correct + ํ format + ํ tool ,(11) whereํ correct measures answer correctness,ํ format penalizes invalid formatting, andํ tool encourages multi-tool use. We impose no explicit reward for mode usage, allowing HybridAgent to adaptively balance text and latent generation and discover effective hybrid reasoning strategies during RL. 5. Empirical Evaluations Tasks and Datasets. We conduct comprehensive evaluations of HybridAgent on 11 benchmarks across various domains: (i) Mathematical Reasoning, including AIME 25 (math ai, 2025), AIME 26 (MathArena, 2026), and MATH500 (HuggingFaceH4, 2023); (i) Knowledge-Intensive Reasoning, including GPQA-Diamond (Rein et al., 2023), MedQA (Yang et al., 2024), and MuSiQue (Trivedi et al., 2022); and (i) Agentic Reasoning, including General AI Assistants (GAIA) (Mialon et al., 2024), Humanityโs Last Exam (HLE) (Center for AI Safety et al., 2026), WebWalker (Wu et al., 2025), SealQA (Pham et al., 2026), and DeepSearchQA (DSQA) (Gupta et al., 2026). We adopt the standard evaluation metric for each dataset. Additional benchmark details are in Appendix H.1. Baselines. For baseline comparisons, we evaluate HybridAgent against (i) Text-based Agentic Methods, covering standard text SFT (with tools) and multi-turn tool-integrated RL methods such as GRPO (Shao et al., 2024) and ARPO (Dong et al., 2025b); (i) Latent Reasoning Methods, including SoftThinking (Zhang et al., 2025), Coconut (Hao et al., 2024), and SoftCoT (Xu et al., 2025b); (i) Frontier LLM Agents, including GPT-5.6-Luna (OpenAI, 2026), Kimi-K3 (Team, 2026), GLM-5.3-Flash (GLM-5-Team et al., 2026), DeepSeek-V4.1-Flash (DeepSeek-AI, 2026), QwQ-32B (Team, 2025); and (iv) Agentic Frameworks, including ReAct (Yao et al., 2023), Search-o1 (Li et al., 2025a), and WebThinker (Li et al., 2025b). Additional baseline details are provided in Appendix H.2. Models and Training Setups. We instantiate HybridAgent with Qwen3-Base backbones (Yang et al., 2025a) at three scales of 4B, 8B, and 14B. We then apply HybridSFT with 54K hybrid trajectories curated through our automatic annotation pipeline, followed by HybridRL with 12K deep reasoning examples (Yu et al., 2025) and 1K agentic search examples (Dong et al., 2025b). During RL, we set rollout batches of 512 trajectories (64ร 8), followed by one optimization pass over 8 minibatches. Implementation Details. HybridAgent interacts with external environments primarily through two types of tools: a Python interpreter within sandbox environments and a live search engine (e.g., Tavily). We cap tool usage at 10 calls per trajectory and retrieve the top 10 snippets for each search query. As current serving engines do not support multi-turn hybrid generation, we extend the training and inference infrastructure to enable text, latent, and tool-calling transitions and persistent KV working- memory transfer. RL rollouts use a sampling temperature of 1.0, and evaluation uses temperature 0.6, top-p 0.95, and top-k 20. We conduct experiments on H100 GPUs using five independent seeds. Additional training/inference details and hyperparameter setups are provided in Appendix H.3. 8 Hybrid Reasoning Agents Table 1|Main Results of HybridAgent over Agentic Reasoning Tasks. We report GAIA and WebWalker by difficulty level, HLE by category (NS/CE/SF), SealQA on the Seal-0 (โS-0") and Seal- Hard (โHard") splits, and DSQA by full-correct rate (โAcc.") and F1 score. Across 5 independent runs, the average standard deviations of HybridAgent areยฑ0.014 in accuracy, with a corresponding 95% CI ofยฑ0.017. At 8B and 14B scales, HybridAgent consistently outperforms advanced LLM agents, agentic frameworks, and matched text and latent baselines. Best performance ishighlighted. Method GAIAWebWalkerHLESealQADSQA Lv.1 Lv.2 Lv.3 Avg.Easy Med. Hard Avg.NS CE SF Avg.S-0 HardAcc. F1 Frontier LLM Agents QwQ-32B30.9 6.5 5.2 18.97.5 2.1 4.6 4.311.5 7.3 5.2 9.61.8 10.611.3 23.9 GLM-5.3-Flash38.5 28.8 8.3 30.18.9 8.3 9.9 9.013.3 14.7 16.8 14.29.0 22.016.0 38.5 DeepSeekV4.1-Flash 43.6 42.3 16.7 39.822.2 16.7 12.7 16.528.5 25.3 30.5 28.414.4 33.519.3 38.6 Kimi-K346.2 42.3 25.0 41.7 11.1 11.9 7.0 10.029.4 32.0 37.9 31.411.7 28.021.7 46.0 GPT-5.6-Luna48.7 32.7 25.0 37.915.6 8.3 11.3 11.030.9 25.3 25.3 29.011.7 29.123.3 49.4 Agentic Frameworks Search-o146.2 23.1 0.0 29.111.1 21.4 16.9 17.56.4 4.0 10.5 6.83.6 11.812.3 25.3 WebThinker48.7 26.9 8.3 33.013.3 23.8 18.3 19.57.0 4.0 9.5 7.04.5 12.611.7 24.7 ReAct48.7 25.0 8.3 32.011.1 20.2 12.7 15.55.8 5.3 10.5 6.67.2 15.014.6 32.3 8B-level Latent & Text Methods Qwen3-8B (thinking) 28.1 15.4 16.7 20.40.0 2.4 2.8 2.03.9 2.7 8.4 4.62.7 5.93.3 14.6 Coconut7.7 1.9 0.0 3.90.0 1.2 0.0 0.51.5 0.0 1.1 1.20.0 1.61.7 6.1 SoftThinking23.1 9.6 8.3 14.60.0 1.2 1.4 1.03.6 2.7 6.3 4.00.0 3.92.3 11.2 GRPO48.7 25.0 8.3 32.028.9 32.1 28.230.07.94.0 10.5 7.815.3 23.617.3 33.8 ARPO53.9 32.716.738.831.135.728.232.07.3 6.715.88.818.926.018.037.2 HybridAgent (8B)51.344.225.043.748.945.235.242.514.28.020.014.422.535.820.040.7 14B-level Latent & Text Methods Qwen3-14B (thinking) 33.3 13.5 0.0 19.4 6.7 2.4 4.2 4.05.5 6.7 11.6 6.83.6 7.94.0 15.1 Coconut10.3 5.8 0.0 6.82.2 2.4 1.4 2.03.9 4.0 5.3 4.20.0 2.82.0 7.5 SoftThinking23.1 11.5 8.3 15.5 6.7 3.6 7.0 5.53.9 5.3 9.5 5.22.7 6.35.7 15.4 GRPO51.3 34.6 0.0 36.935.6 42.9 35.2 38.57.9 6.7 12.6 8.617.124.418.643.9 ARPO56.4 40.416.743.740.044.136.640.510.310.713.710.017.122.816.3 38.2 HybridAgent (14B) 53.855.833.352.448.952.446.549.516.113.317.916.024.337.821.746.8 Figure 5|Scalability of HybridAgent at Test-time. We evaluate pass@k (4,8,16,32,64) performance on 100 hard math and science questions and compare with text agents trained with GRPO. 5.1. Scaling Performance via Hybrid Reasoning Main Results. Tables 1 and 2 report the overall performance of HybridAgent across 11 benchmarks spanning math, science, medicine, and knowledge search domains. On challenging agentic reasoning benchmarks, HybridAgent delivers competitive performance over larger frontier LLM agents and spe- cialized tool-use frameworks, with HybridAgent (14B) improving over the strongest agentic baseline 9 Hybrid Reasoning Agents Table 2|Main Results of HybridAgent on Math and Knowledge-Intensive Search. We evaluate performance across both SFT and RL stages. Small-size benchmarks like AIME25/26 are reported on avg@16 accuracy. Across all tasks, HybridAgent yields an average std. ofยฑ0.031 (math) andยฑ0.018 (search), with corresponding 95% CI ofยฑ0.038 andยฑ0.022. Under the same training budgets and model setups, HybridSFT and HybridRL improve both text-based and latent reasoning methods. MethodAIME25 AIME26 MATH500 GPQA-D MedQA MuSiQue Qwen3-8B-Base Coconut13.19.651.426.861.714.0 SoftCoT16.517.963.628.962.019.5 Standard Text SFT30.028.378.232.369.723.5 HybridAgent (SFT) 30.829.278.431.870.026.5 GRPO36.339.482.043.974.327.5 ARPO37.1 41.582.846.574.728.5 HybridAgent (RL)39.243.384.648.075.332.0 Qwen3-14B-Base Coconut16.315.261.229.365.317.5 SoftCoT22.723.874.036.467.720.0 Standard Text SFT30.831.783.843.978.028.0 HybridAgent (SFT) 32.531.784.245.578.729.5 GRPO40.842.587.452.581.032.0 ARPO42.143.387.054.080.331.5 HybridAgent (RL)43.345.888.255.181.734.5 2.2 x fewer tokens 2.9 x fewer tokens 3.1 x fewer tokens Figure 6|Efficient Hybrid Generation of HybridAgent across Model Scales. HybridAgent reduces both text-token usage and total generation steps compared with matched text-based LLM agents. by an average of 17.4%. In addition, under matched model sizes and training budgets, HybridSFT and HybridRL demonstrate consistent training effectiveness and improve over corresponding text/latent baselines by 18.5% at the SFT stage and 10.4% at the RL stage. Together, HybridAgent combines the strengths of text-based agentic tool use with faster and more expressive latent reasoning, allowing the agent to interact externally while achieving deeper thinking depth internally. Scaling Hybrid Reasoning at Test Time. To further examine the test-time scalability of our hybrid reasoning paradigm, we increase inference compute budgets through additional sampling and evaluate pass@k performance. Figure 5 shows that HybridAgent exhibits a clear upward trend as sampling 10 Hybrid Reasoning Agents increases across all model scales, while benefiting more from increased test-time compute than agents with text-only RL. Additional 4B-scale experiments and case studies are in Appendix G and J. 5.2. Efficiency Advantage on Hybrid Generation 2.1 x faster inference Figure 7|Inference time speedup of Hy- bridAgent across all model scales. Beyond performance effectiveness, a key architectural advantage of HybridAgent is that latent mode enables ef- ficient generation without costly explicit token decoding. We evaluate this property empirically along three comple- mentary dimensions: (i) token throughput, (i) wall-clock inference time, and (i) actual computation cost. As shown in Figures 6 and 7, HybridAgent adaptively balances its hybrid reasoning across text and latent modes by using 2.7รfewer text tokens, reducing total generation steps by up to 54%, and achieving 2.1รfaster inference than text-based baselines. Together with the cost analyses in Table 9 (see Appendix G.2), HybridAgent generates more concise and refined reasoning trajectories, reducing inference overhead and cost. 6. In-depth Analyses RoadMap. We further analyze HybridAgent from 3 complementary perspectives to assess the method design and better understand its hybrid reasoning behavior. (i) Training Dynamics: We study how self-conditioning in HybridSFT improves reasoning performance (Table 3) and latent interpretability (Figure 8), and how HybridRL shifts more reasoning into latent mode while strengthening tool interaction (Figure 9). (i) Latent-Mode: We intervene on latent content, ordering, and reasoning depth to examine HybridAgentโs causal reliance on latent thoughts (Table 5), and ablate HybridLink architectures to assess the benefits of residual alignment (Table 6). (i) Text-Mode: We evaluate text- based agentic tool use (Figure 10) and auditability of HybridAgent (Table 7) to verify that text-mode supports reliable environment interaction and remains informative for external monitoring/debugging. 6.1. Training Dynamics on HybridSFT and HybridRL MethodAIME25 AIME26 MATH500 Coconut16.315.261.2 Standard Text SFT30.831.783.8 Qwen3-14B-Base4.93.047.0 + Format Activation20.619.862.4 + HybridLink Activation23.822.573.8 + Self-Condition (HybridSFT) 32.531.784.2 00.20.40.60.81 Readability 1ร 3ร 10ร 30ร 100ร Context Specificity random noise exact token Meaningful Region n = 200 Self-Condition (HybridSFT) HybridLink Activation Format Activation Coconut /mean Table 3 and Figure 8|Effectiveness and Interpretability of Self-Conditioned HybridSFT. Left: We compare successive HybridSFT stages with latent and text training baselines using the same Qwen3-14B-Base backbone. Right: We evaluate the readability and context-specificity across 200 downstream questions, showing how self-conditioning improves latent transparency. Self-Conditioning Enables Effective and Interpretable HybridSFT. To understand why self- conditioned training is necessary for HybridAgent during SFT, we compare HybridSFT against variants with only format and HybridLink activations as well as latent SFT baselines like Coconut, from both performance and interpretability perspectives. As shown in Table 3, although all SFT 11 Hybrid Reasoning Agents variants improve the original shared Qwen3-14B-Base backbone, activation alone remains insufficient. Self-conditioned supervision further improves performance by an average of 30.5% over HybridLink activation, bringing HybridSFT to parity with standard text SFT across all three math benchmarks. We further probe the semantics of the latent thoughts produced by each method over 200 questions spanning all downstream domains. Figure 8 reveals a clear progression, where HybridLink activation first makes latent contents more interpretable, and the additional self-conditioned training sharpens the latent readability and semantic informativeness. We then take a closer look to examine individual test instances through detailed case studies in Appendix J. Specifically, methods with low faithfulness and specificity generally produce largely unreadable artifacts of the embedding geometry, whereas the complete HybridSFT yields clear and semantically coherent latent readouts. Overall, these analyses reveal that self-conditioned training is essential to HybridSFT for making the latent reasoning traces in HybridAgent fully transparent and directly interpretable. Figure 9|Training Dynamics of HybridRL. As training progresses, HybridAgent shifts more gen- eration from text to latent mode while increasing reward and tool use. These trends reflect how HybridAgent adaptively learns to allocate its reasoning and tool calling efforts across the two modes. Training Dynamics of HybridRL. We analyze HybridAgentโs training behaviors to examine how it dynamically shifts and allocates reasoning effort across text/latent modes under HybridRL. In Figure 9, as the training step increases, our 14B agent progressively allocates more generation to latent mode while simultaneously strengthening its tool-invocation capability. Through training, HybridAgent adaptively learns to better utilize its two modes, shifting more reasoning into faster latent thinking while selectively exposing only key steps for external auditing and tool use through the text interface. Table 4 | Ablation on HybridRL rewards. Reward Design MATH500 GAIA WebWalker HybridRL (8B)84.6 43.742.5 w/o ํ correct 79.235.937.5 w/o ํ format 80.640.740.5 w/o ํ tool 84.238.841.0 Reward Shaping in HybridRL. We ablate each reward component in Eq. 11 using HybridAgent (8B), remov- ing one term at a time under otherwise identical setups. In Table 4, all three components provide complemen- tary supervision. Excludingํ correct causes the largest overall degradation, reducing performance by 6.4%- 17.8%, while removingํ format consistently lowers per- formance by 4.7%-6.9%. The benefit ofํ tool is most pronounced on agentic benchmarks such as GAIA and WebWalker. Since the reward is granted only to trajectories that invoke both Python and search tools, removingํ tool has a minor effect on MATH500, where Python alone is typically sufficient, but reduces GAIA and WebWalker by 11.2% and 3.5%. Overall, each reward component provides complementary supervision for answer correctness, format structure, and effective multi-tool use. 6.2. Causal Reliance and HybridLink Design in Latent Mode Does HybridAgent Causally Rely on its Latent Mode Thoughts? To examine whether latent thoughts are functionally used during hybrid reasoning, we intervene on the latent vectors generated 12 Hybrid Reasoning Agents Table 5|Causal Interventions on HybridAgent Latent Mode. We report MATH500 accuracy (%) for 8B and 14B scales under different interventions on latent-mode thoughts generated by HybridAgent. Performance drops substantially when latent semantics or structure are disrupted, indicating that HybridAgent causally relies on semantically meaningful latent-mode thoughts. Here,ํฃdenotes the original latent vector andํฃ โฒ denotes the intervened counterpart. The relative perturbation strengthํ is computed as โฅํฃ โฒ โ ํฃโฅ/โฅํฃโฅ, averaged over latent steps, where ํ= 0 means no intervention. Latent-Mode Intervention Setup DescriptionStrength ํ 8B-Scale 14B-Scale Noise Perturbation Gaussian Noise (ํ= 0.5) Add perturbation with random noise of magnitude 0.5โฅํฃโฅ before latent feedback. 0.572.675.0 Gaussian Noise (ํ= 2.0) Add perturbation with random noise of magnitude 2.0โฅํฃโฅ before latent feedback. 2.066.470.2 Latent Replacement Random-token Replacement Replace ํฃ with a uniformly sampled token embedding, rescaled to โฅํฃโฅ. 1.641.244.6 Cross-problem Replacement Replace each latent span with the corresponding latents from a different partner problem. 1.444.848.6 Mean-latent Replacement Replace every ํฃ with the mean latent vector from the original HybridAgent trajectories. 1.053.658.4 Nearest-token Replacement Replace ํฃ with its nearest token embedding, rescaled to โฅํฃโฅ. 0.282.687.2 Latent Permutation Within-block Permutation Randomly permute latent vectors within each block; Preserve content but disrupt order. 0.873.276.4 Latent Computation Restriction One-step Only for Latent Span Force each latent span to terminate after one generation step. โ72.275.0 Block Latent-Mode Entry Prevent entry into latent mode, forcing the agent to reason entirely in text. โ80.478.8 HybridAgent (ours) No intervention; the agent feeds back its own generated latent vectorํฃat every latent step. 0.084.688.2 by 8B and 14B HybridAgent on the MATH500 downstream task. We perturb their content, ordering, and reasoning duration through 4 different types of controlled interventions, including (i) noise perturbation, (i) latent replacement, (i) latent permutation, and (iv) latent computation restriction. Table 5 details the intervention setups and reports performance under each scenario. As shown in the table, disrupting latent thoughts consistently degrades performance across both scales. Specifically, cross-problem and random-token replacement reduce accuracy by 44.9-47.0% and 49.4-51.3%, while disrupting their ordering or restricting each latent span to one step leads to 13.4-15.0% degradation. Notably, cross-problem replacement causes substantially greater degradation than even stronger Gaussian perturbations, suggesting that performance depends on the semantic content of latent thoughts rather than perturbation magnitude alone. These analysis results on causal interventions indicate that HybridAgent functionally relies on the semantics, ordering, and sufficient reasoning depth of its latent thoughts during hybrid reasoning. HybridLink Design. We next validate the effectiveness of HybridLink and its residual connection by 13 Hybrid Reasoning Agents 8B14B 85 90 95 100 97.5 93.1 98.3 90.8 Execute Success 99.7% HybridAgent Text Agent(GRPO) 20406080 SealQA DSQA MuSiQue MedQA 36.925.6 20.918.1 33.230.2 79.677.9 HybridAgent Text Agent(GRPO) 8B14B 0 10 20 30 40 34.7 33.2 40.8 37.9 HybridAgent Text Agent(GRPO) Valid Tool-Call RateAccuracy Conditioned on Tool UseUseful Tool-Call Rate acc. (%) (%)(%) Figure 10|Agentic Tool-Use Analysis on HybridAgent. Left: Valid tool-call rate across 8B and 14B scales; "Execute Success" measures error-free execution among valid tool calls. Middle: Final-answer accuracy on questions where the agent performs at least one tool call. Right: Useful tool-call rate, measuring the fraction of tool calls whose execution results contain the final answer. comparing our adopted 2-layer residual design against 4 alternative architectures: (i) direct hidden- state reuse (i.e.,ํ ํก+1 =โ ํก ) without learned alignment, (i) 1-layer projection, (i) 1-layer projection with residual connection, and (iv) 2-layer projection without residual connection. We end-to-end train each HybridLink variant with the 14B backbone under the same setup and evaluate across tasks. Table 6|Effectiveness of HybridLink. We compare accuracy across alternative architectural designs. HybridLink DesignMATH500 MedQA MuSiQue Identity (No Alignment)71.473.724.5 1-Layer83.679.728.5 1-Layer+Res.86.480.331.0 2-Layer85.881.031.5 2-Layer+Res. (ours)88.281.734.5 As shown in Table 6, the full two-layer resid- ual design of HybridLink yields consistent gains across all three downstream benchmarks, with the residual branch benefiting both one- and two-layer projection networks. Specifically, in- corporating the residual connection contributes an average improvement of 4.3% across differ- ent layer depths. This observed trend aligns with our design motivation in Section 3.1, where the residual connection preserves the se- mantics of input last-layer hidden states while the learned projection aligns these representa- tions with the input embedding space. Together, these two components make HybridLink a more effective and stable interface for hybrid training and generation. 6.3. Tool Use and Reasoning Auditability in Text Mode Does HybridAgent Text-Mode Preserve Agentic Tool Use? In Figure 10, we analyze agentic tool- calling capabilities by comparing HybridAgent with normal LLM agents trained on GRPO, examining whether hybrid reasoning preserves reliable external interactions through its text mode. Across 8B and 14B scales, HybridAgent achieves higher valid tool-call rates while matching the 99.7% execution success of valid calls, showing that hybrid reasoning preserves a reliable text-mode tool interface. More importantly, the gains extend beyond call validity, as HybridAgent improves final-answer accuracy by 2.2%-44.1% on questions where tools are invoked. The 4.5%-7.7% higher useful tool-call rate further indicates that HybridAgent not only invokes tools correctly, but also retrieves evidence that more directly contributes to solving the task. These findings suggest that HybridAgent preserves the reliable and effective agentic tool use of standard LLM agents through its text mode, while exposing fewer text tokens with interleaved latent reasoning. Does HybridAgent Text-Mode Preserve External Auditability? A natural question of hybrid 14 Hybrid Reasoning Agents Table 7|Monitorability and Debuggability through HybridAgent Text-Mode. We compare Hy- bridAgent with matched same-size text agents to examine whether its exposed text remains sufficient for external monitoring, debugging, correction, and rationale-based inspection under hybrid reasoning. All comparisons are evaluated using paired bootstrap 95% confidence intervals. MetricMeasurement 8B Scale14B Scale HybridAgent Text Agent HybridAgent Text Agent Text-Mode tokens per instance302596284497 Latent-Mode steps per instance170โ183โ Visible Trace Key reasoning steps per 100 visible tokensโ0.720.570.860.67 Weak-monitor AUROC (MATH500)โ0.8400.7720.8600.818 Monitoring Strong-monitor AUROC (all tasks)โ0.9610.9350.9890.990 First error correctly localized (%)โ99.294.298.1100.0 Error diagnosis matches reference (%)โ97.693.597.296.3 Debugging Useful corrective hint / Answer leakage (%)โ/โ97.6 / 0.898.7 / 0.0100.0 / 0.998.2 / 0.9 CorrectionFix-rate gain from targeted hint vs. generic retry (ฮ)โ+9.1+3.4+5.4+3.5 SufficiencyAnswer-agreement gain from visible text only (ฮ)โ+0.25+0.17+0.30+0.28 reasoning is whether shifting computation into latent mode might potentially compromise the external auditability provided by text. To examine this, we evaluate HybridAgent against matched text agents on MATH500 and AIME25/26, covering 560 problems under identical setups. For each question, an external observer sees only the exposed text steps, tool calls, and tool outputs, while latent spans remain hidden behind their boundary markers. We evaluate four complementary dimensions following commonly adopted evaluation protocols. โขMonitoring: Measure whether a blind external monitor can predict rollout correctness from the input problem and visible trace generated by each agent, following Baker et al. (2025). We report AUROC using GPT-4o-mini (Hurst et al., 2024) as a weak monitor, which relies primarily on the visible trace rather than solving the problem independently, and GPT-5.6-Luna (OpenAI, 2026) as a strong monitor with more powerful task-solving capability. โข Debugging: Following first-error localization (Zheng et al., 2025a), a judge model (GPT-5.6-Luna) is deployed to identify the first erroneous visible step from a failed rollout and produces a corrective hint, with the diagnosis verified against the reference ground-truth solution. โขCorrection: Each failed problem is re-attempted using the corrective hint generated during debug- ging, and compared against a generic correctness-only feedback baseline (Huang et al., 2024) that simply tells the agent its previous answer was incorrect and asks it to retry. โขRationale Sufficiency: Following sufficiency evaluation in DeYoung et al. (2020), a weak reader (GPT-4o-mini) predicts the agentโs own answer from the exposed text steps alone after removing the final answer, measuring whether the visible trace retains sufficient decision-relevant information. As shown in Table 7, HybridAgent exposes 43%-49% fewer text-mode tokens while performing 170-183 reasoning steps in latent mode, yet the visible trace contains 26%-28% more key reasoning steps per 100 tokens. This reduction preserves external monitorability, with AUROC remaining within 0.022 of matched text agents across both weak and strong monitors. The exposed text also remains debuggable, localizing the first error in 98%-99% of failed rollouts and yielding reference-consistent diagnoses in 97%-98% of cases with below 1% answer leakage. Moreover, text-derived corrective hints produce significant fix-rate gains of 5.4 and 9.1 points at 14B and 8B, while rationale sufficiency remains comparable to or higher than text agents. As shown by the analyses above, HybridAgent uses its text mode to maintain a compact yet informative textual interface for external monitoring, debugging, and correction. This provides an important safeguard for agent generation, facilitating human auditing and intervention while preserving efficient internal reasoning. 15 Hybrid Reasoning Agents 7. Related Work Latent Reasoning Beyond Text. Recent works have explored applying intermediate reasoning beyond discrete language tokens into continuous hidden spaces (Hao et al., 2024; Yu et al., 2026; Zhu et al., 2025a), allowing models to perform internal computation without explicitly verbalizing every reasoning step (Geiping et al., 2026; Shen et al., 2026; Zhu et al., 2025b). Existing approaches broadly realize this idea by inputting last-layer hidden states (Saunshi et al., 2025; Tack et al., 2026), compressing textual chains of thought into latent representations (Cheng and Van Durme, 2024; Zhang et al., 2026a), or directly optimizing continuous reasoning trajectories (Chen et al., 2024; Tan et al., 2026). These methods improve reasoning efficiency and depth but make direct inspection and external interaction difficult (Chen et al., 2026; Korbak et al., 2025). HybridAgent builds on this direction by integrating directly inspectable latent reasoning as a native built-in mode within the agentic generation process, while preserving direct text-based auditing and tool interaction. Agentic Reasoning and Tool Use. Frontier LLM agents (DeepSeek-AI, 2026; GLM-5-Team et al., 2026; Team, 2026) extend reasoning beyond static generation by interacting with external environments through tools (Qu et al., 2025; Shen, 2024), such as search engines (Jin et al., 2025; Zheng et al., 2025b), code interpreters (Bianchi et al., 2026; Feng et al., 2026), and APIs (Patil et al., 2025; Qin et al., 2024). A growing line of work further improves these capabilities through post-training over multi-turn tool-use trajectories (Dong et al., 2025a; Qian et al., 2025), enabling agents to plan, act, observe, and revise their reasoning (Li et al., 2025c; Su et al., 2025). Despite this progress, existing agentic frameworks remain text-centric for both model-side reasoning and environment-side interaction, incurring large generation overhead from verbalizing every intermediate step (Cuadron et al., 2025; Xu et al., 2025a). HybridAgent decouples these roles by interleaving continuous thoughts for internal reasoning and retaining text only where explicit interaction and monitoring are required. We discuss additional related work and its relation to HybridAgent in Appendix D. 8. Discussion and Future Directions Implications for Frontier Agent Safety and Secure Deployment. Frontier labs (e.g., OpenAI, Anthropic) provide API-based access to reasoning models while hiding the chain-of-thought from customers to protect intellectual property and limit information leakage, yet Panfilov et al. (2026) show that the encrypted traces returned to clients can be replayed into a sibling model and transcribed verbatim. HybridAgent places proprietary reasoning on a different footing. Latent thoughts exist only as backbone hidden states that are readable solely through the provider-owned HybridLink (Section 3), so no text exists to leak. The same property aids monitoring. Because the latent trace is held by the provider rather than the client, providers can assess the safety of reasoning and actions over the full readout, including the portion users never see, while the agent benefits from faster inner thinking. Text mode is then reserved for what users legitimately need, such as tool calls, key decisions, and the final answer, preserving an auditable trace without exposing the full reasoning. Future Directions on Hybrid Agent Harness and Efficient Post-Training. Future work can build a new type of agent harness around HybridAgent, where latent working memory is a first-class component. Context management can then operate on KV entries directly, workflows can schedule steps by mode, keeping tool calls and human-facing checkpoints in text while routine computation stays latent, and one agentโs hybrid trajectory can serve as its message to another. Hybrid generation can also make post-training more efficient. Because latent thoughts remain auditable during rollout, an external critic can assign step-level credit to latent spans, branch promising trajectories, or terminate ones whose latent reasoning has already gone wrong, before any text or tool call is produced. 16 Hybrid Reasoning Agents 9. Conclusion We introduce HybridAgent, a unified hybrid reasoning framework that combines efficient latent reasoning with text-based inspection and tool interaction. HybridAgent enables multi-turn hybrid generation through both architectural designs and dedicated post-training algorithms on SFT and RL stages. Across 11 benchmarks and 3 model scales, HybridAgent achieves strong performance against advanced LLM agents and agentic frameworks spanning text-based and latent reasoning methods, while substantially reducing inference time, token usage, and computational cost. Overall, HybridA- gent provides a scalable and efficient framework for next-generation agents that can reason beyond human language while retaining agentic interaction in environments and external inspectability. Acknowledgments The authors thank the members of the Zou Lab and the iDEA-iSAIL Lab for helpful discussions and feedback. Jiaru also thanks Jiuding Sun, Weiyan Shi, Martijn Bartelds, Yongchan Kwon, and many others in the Stanford NLP Group and the Together Agent Team for their support and discussions. References B. Baker, J. Huizinga, L. Gao, Z. Dou, M. Y. Guan, A. Madry, W. Zaremba, J. Pachocki, and D. Farhi. Monitoring reasoning models for misbehavior and the risks of promoting obfuscation, 2025. URL https://arxiv.org/abs/2503.11926. S. Bengio, O. Vinyals, N. Jaitly, and N. Shazeer. Scheduled sampling for sequence prediction with recurrent neural networks. Advances in neural information processing systems, 28, 2015. F. Bianchi, Y. Kwon, A. Pappu, and J. Zou. Harnessing the collective intelligence of ai agents in the wild for new discoveries, 2026. URL https://arxiv.org/abs/2606.10402. M. Bigverdi, Z. Luo, C.-Y. Hsieh, E. Shen, D. Chen, L. G. Shapiro, and R. Krishna. Perception tokens enhance visual reasoning in multimodal language models, 2024. URLhttps://arxiv.org/abs/ 2412.03548. L. Brito and C. Baquero. When latent agents lie: Kv-cache integrity in multi-agent llm collaboration, 2026. URL https://arxiv.org/abs/2606.28958. Center for AI Safety, Scale AI, and HLE Contributors Consortium. A benchmark of expert-level academic questions to assess AI capabilities. Nature, 649:1139โ1146, 2026. doi: 10.1038/ s41586-025-09962-4. URL https://arxiv.org/abs/2501.14249. S. Chang, T. Bai, X. Zhang, Q. Ma, Q. Liu, Z. Liao, Y. Miao, and L. Niu. Unlocking the black box of latent reasoning: An interpretability-guided approach to intervention. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 34019โ34032, 2026. H. Chen, Y. Feng, Z. Liu, W. Yao, A. Prabhakar, S. Heinecke, R. Ho, P. Mui, S. Savarese, C. Xiong, et al. Language models are hidden reasoners: Unlocking latent reasoning capabilities via self-rewarding. arXiv preprint arXiv:2411.04282, 2024. X. Chen, A. Zhao, H. Xia, X. Lu, H. Wang, Y. Chen, W. Zhang, J. Wang, W. Li, and X. Shen. Reasoning beyond language: A comprehensive survey on latent chain-of-thought reasoning. arXiv preprint arXiv:2505.16782, 2025. 17 Hybrid Reasoning Agents X. Chen, C. T. Leong, G. Wenjin, J. Wang, W. Li, and X. Shen. What makes effective supervision in latent chain-of-thought: An information-theoretic analysis. In Forty-third International Conference on Machine Learning, 2026. URL https://openreview.net/forum?id=x21YkF1UfR. J. Cheng and B. Van Durme. Compressed chain of thought: Efficient reasoning through dense representations. arXiv preprint arXiv:2412.13171, 2024. J. Coda-Forno, Z. Zhao, Q. Zhang, D. Tamboli, W. Li, X. Fan, L. Zhang, E. Schulz, and H.-P. Tseng. Ex- ploring system 1 and 2 communication for latent reasoning in llms. arXiv preprint arXiv:2510.00494, 2025. A. Cuadron, D. Li, W. Ma, X. Wang, Y. Wang, S. Zhuang, S. Liu, L. G. Schroeder, T. Xia, H. Mao, et al. The danger of overthinking: Examining the reasoning-action dilemma in agentic tasks. arXiv preprint arXiv:2502.08235, 2025. L. Dai, L. Xiang, and K. Yang. A token/kv-cache communication media selection and resource allocation strategy for multi-agent collaboration. Science China Information Sciences, 69(10):200306, 2026. DeepSeek-AI. Deepseek-v4.1-flash: Pushing the limits of kv cache compression, 2026. J. DeYoung, S. Jain, N. F. Rajani, E. Lehman, C. Xiong, R. Socher, and B. C. Wallace. ERASER: A benchmark to evaluate rationalized NLP models. In D. Jurafsky, J. Chai, N. Schluter, and J. Tetreault, editors, Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 4443โ4458, Online, July 2020. Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.408. URL https://aclanthology.org/2020.acl-main.408/. G. Dong, Y. Chen, X. Li, J. Jin, H. Qian, Y. Zhu, H. Mao, G. Zhou, Z. Dou, and J. Wen. Tool-star: Empowering llm-brained multi-tool reasoner via reinforcement learning. CoRR, abs/2505.16410, 2025a. doi: 10.48550/ARXIV.2505.16410. URLhttps://doi.org/10.48550/arXiv.2505. 16410. G. Dong, H. Mao, K. Ma, L. Bao, Y. Chen, Z. Wang, Z. Chen, J. Du, H. Wang, F. Zhang, et al. Agentic reinforced policy optimization. arXiv preprint arXiv:2507.19849, 2025b. J. Feng, S. Huang, X. Qu, G. Zhang, Y. Qin, B. Zhong, C. Jiang, J. Chi, and W. Zhong. Retool: Reinforcement learning for strategic tool use in LLMs. In The Fourteenth International Conference on Learning Representations, 2026. URL https://openreview.net/forum?id=tRk1nofSmz. R. Fu and G. Luo. Selar: Selective latent reasoning in large language models. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7073โ7087, 2026. J. Geiping, S. McLeish, N. Jain, J. Kirchenbauer, S. Singh, B. Bartoldson, B. Kailkhura, A. Bhatele, and T. Goldstein. Scaling up test-time compute with latent reasoning: A recurrent depth approach. Advances in Neural Information Processing Systems, 38:41340โ41391, 2026. I. Gim, G. Chen, S.-s. Lee, N. Sarda, A. Khandelwal, and L. Zhong. Prompt cache: Modular attention reuse for low-latency inference. Proceedings of Machine Learning and Systems, 6:325โ338, 2024. GLM-5-Team et al. GLM-5: from vibe coding to agentic engineering, 2026. URLhttps://arxiv. org/abs/2602.15763. N. Gupta, R. Chatterjee, L. Haas, C. Tao, A. Wang, C. Liu, H. Oiwa, E. Gribovskaya, J. Ackermann, J. Blitzer, S. Goldshtein, and D. Das. Deepsearchqa: Bridging the comprehensiveness gap for deep research agents, 2026. URL https://arxiv.org/abs/2601.20975. 18 Hybrid Reasoning Agents S. Hao, S. Sukhbaatar, D. Su, X. Li, Z. Hu, J. Weston, and Y. Tian. Training large language models to reason in a continuous latent space. arXiv preprint arXiv:2412.06769, 2024. J. Hu, W. Huang, W. Wang, H. Wang, tiancheng hu, zhang qin, H. Feng, X. Chen, Y. Shan, and T. Xie. EPIC: Efficient position-independent caching for serving large language models. In Forty-second International Conference on Machine Learning, 2025. URLhttps://openreview.net/forum? id=qjd3ZUiHRT. J. Huang, X. Chen, S. Mishra, H. S. Zheng, A. W. Yu, X. Song, and D. Zhou. Large language models cannot self-correct reasoning yet. In The Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=IkmD3fKBPQ. HuggingFaceH4. Math-500 dataset.https://huggingface.co/datasets/HuggingFaceH4/ MATH-500, 2023. A. Hurst, A. Lerer, A. P. Goucher, A. Perelman, A. Ramesh, A. Clark, A. Ostrow, A. Welihinda, A. Hayes, A. Radford, et al. Gpt-4o system card. arXiv preprint arXiv:2410.21276, 2024. B. Jin, H. Zeng, Z. Yue, J. Yoon, S. Arik, D. Wang, H. Zamani, and J. Han. Search-r1: Training llms to reason and leverage search engines with reinforcement learning. arXiv preprint arXiv:2503.09516, 2025. J. Juravsky, B. Brown, R. S. Ehrlich, D. Y. Fu, C. Re, and A. Mirhoseini. Hydragen: High-throughput LLM inference with shared prefixes. In Workshop on Efficient Systems for Foundation Models I @ ICML2024, 2024. URL https://openreview.net/forum?id=Ye3ia34Fpp. T. Korbak, M. Balesni, E. Barnes, Y. Bengio, J. Benton, J. Bloom, M. Chen, A. Cooney, A. Dafoe, A. Dragan, et al. Chain of thought monitorability: A new and fragile opportunity for ai safety. arXiv preprint arXiv:2507.11473, 2025. T. Kwa, B. West, J. Becker, A. Deng, K. Garcia, M. Hasin, S. Jawhar, M. Kinniment, N. Rush, S. Von Arx, et al. Measuring ai ability to complete long software tasks. Advances in Neural Information Processing Systems, 38:92213โ92266, 2026. W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. Gonzalez, H. Zhang, and I. Stoica. Efficient memory management for large language model serving with pagedattention. In Proceedings of the 29th symposium on operating systems principles, pages 611โ626, 2023. X. Li, G. Dong, J. Jin, Y. Zhang, Y. Zhou, Y. Zhu, P. Zhang, and Z. Dou. Search-o1: Agentic search- enhanced large reasoning models. In C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng, editors, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 5420โ5438, Suzhou, China, Nov. 2025a. Association for Computational Linguistics. ISBN 979-8-89176-332-6. doi: 10.18653/v1/2025.emnlp-main.276. URLhttps://aclanthology. org/2025.emnlp-main.276/. X. Li, J. Jin, G. Dong, H. Qian, Y. Wu, J.-R. Wen, Y. Zhu, and Z. Dou. Webthinker: Empowering large reasoning models with deep research capability. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025b. URLhttps://openreview.net/forum?id= 7LKKHBAMzH. Z. Li, H. Zhang, S. Han, S. Liu, J. Xie, Y. Zhang, Y. Choi, J. Zou, and P. Lu. In-the-flow agentic system optimization for effective planning and tool use. arXiv preprint arXiv:2510.05592, 2025c. Y. Liu. Beyond tokens: a unified framework for latent communication in llm-based multi-agent systems, 2026. URL https://arxiv.org/abs/2606.05711. 19 Hybrid Reasoning Agents F. Lv, L. Wang, R. Hong, Y. Du, X. Wu, T. Gao, G. Zhou, and C. Zhang. Beyond tokens: Dynamic latent reasoning via semantic residual refinement. In S. Koenig, C. Jenkins, and M. E. Taylor, editors, Fortieth AAAI Conference on Artificial Intelligence, Thirty-Eighth Conference on Innovative Applications of Artificial Intelligence, Sixteenth Symposium on Educational Advances in Artificial Intelligence, AAAI 2026, Singapore, January 20-27, 2026, pages 32383โ32391. AAAI Press, 2026. doi: 10.1609/AAAI.V40I38.40513. URL https://doi.org/10.1609/aaai.v40i38.40513. D. Ma, Y. Wang, and T. Lan. Block-attention for efficient prefilling. In The Thirteenth International Conference on Learning Representations, 2025. URLhttps://openreview.net/forum?id= 7zNYY1E2fq. math ai. AIME 2025 dataset. https://huggingface.co/datasets/math-ai/aime25, 2025. MathArena. Aime 2026 dataset.https://huggingface.co/datasets/MathArena/aime_ 2026, 2026. G. Mialon, C. Fourrier, T. Wolf, Y. LeCun, and T. Scialom. GAIA: a benchmark for general AI assistants. In The Twelfth International Conference on Learning Representations, 2024. URLhttps: //openreview.net/forum?id=fibxvahvs3. X. Mou, S. Wang, Z. Li, Y. He, and Z. Wei. Hylat: Efficient multi-agent communication via hybrid latent-text protocol. arXiv preprint arXiv:2605.25421, 2026. A. Ning, Y.-L. Kuo, and G. Gomes. Learning when to stop: Adaptive latent reasoning via reinforcement learning. arXiv preprint arXiv:2511.21581, 2025. OpenAI. GPT-5.6 Luna. OpenAI API model documentation, 2026. URLhttps://developers. openai.com/api/docs/models/gpt-5.6-luna. Accessed: 2026-09-16. A. Panfilov, D. Schmotz, I. Shumailov, L. Beurer-Kellner, J. Schaeffer, A. Prabhu, J. Geiping, and M. Andriushchenko. Stealing reasoning traces from proprietary llm apis, 2026. URLhttps: //arxiv.org/abs/2608.09867. S. G. Patil, H. Mao, F. Yan, C. C.-J. Ji, V. Suresh, I. Stoica, and J. E. Gonzalez. The berkeley function calling leaderboard (BFCL): From tool use to agentic evaluation of large language models. In Forty-second International Conference on Machine Learning, 2025. URLhttps://openreview. net/forum?id=2GmDdhBdDk. T. Pham, N. P. Nguyen, P. Zunjare, W. Chen, Y.-M. Tseng, and T. Vu. SealQA: Raising the bar for reasoning in search-augmented language models. In The Fourteenth International Conference on Learning Representations, 2026. URL https://openreview.net/forum?id=zWb7ueH16c. C. Qian, E. C. Acikgoz, Q. He, H. WANG, X. Chen, D. Hakkani-Tรผr, G. Tur, and H. Ji. ToolRL: Reward is all tool learning needs. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025. URL https://openreview.net/forum?id=eOLdGbXT6t. Y. Qin, S. Liang, Y. Ye, K. Zhu, L. Yan, Y. Lu, Y. Lin, X. Cong, X. Tang, B. Qian, S. Zhao, L. Hong, R. Tian, R. Xie, J. Zhou, M. Gerstein, dahai li, Z. Liu, and M. Sun. ToolLLM: Facilitating large language models to master 16000+ real-world APIs. In The Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=dHng2O0Jjr. C. Qu, S. Dai, X. Wei, H. Cai, S. Wang, D. Yin, J. Xu, and J.-r. Wen. Tool learning with large language models: a survey. Frontiers of Computer Science, 19(8), Jan. 2025. ISSN 2095-2236. doi: 10.1007/s11704-024-40678-2. URL http://dx.doi.org/10.1007/s11704-024-40678-2. 20 Hybrid Reasoning Agents M. Ranzato, S. Chopra, M. Auli, and W. Zaremba. Sequence level training with recurrent neural networks. arXiv preprint arXiv:1511.06732, 2015. D. Rein, B. L. Hou, A. C. Stickland, J. Petty, R. Y. Pang, J. Dirani, J. Michael, and S. R. Bowman. Gpqa: A graduate-level google-proof q&a benchmark, 2023. URLhttps://arxiv.org/abs/ 2311.12022. N. Saunshi, N. Dikkala, Z. Li, S. Kumar, and S. J Reddi. Reasoning with latent thoughts: On the power of looped transformers. In International Conference on Learning Representations, volume 2025, pages 14855โ14881, 2025. J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017. Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. K. Li, Y. Wu, and D. Guo. Deepseekmath: Pushing the limits of mathematical reasoning in open language models, 2024. URL https://arxiv.org/abs/2402.03300. X. Shen, Y. Wang, Y. Zhou, X. Shi, P. Zhao, Y. Wang, and J. Gu. Efficient reasoning with hidden thinking. In Forty-third International Conference on Machine Learning, 2026. URLhttps:// openreview.net/forum?id=Hn81xuLaXY. Z. Shen. Llm with tools: A survey, 2024. URL https://arxiv.org/abs/2409.18807. G. Sheng, C. Zhang, Z. Ye, X. Wu, W. Zhang, R. Zhang, Y. Peng, H. Lin, and C. Wu. Hybridflow: A flexible and efficient rlhf framework. In Proceedings of the Twentieth European Conference on Computer Systems, pages 1279โ1297, 2025. D. Shi, A. Asi, K. Li, X. Yuan, L. Pan, W. Lee, and W. Xiao. Swireasoning: Switch-thinking in latent and explicit for pareto-superior reasoning LLMs. In The Fourteenth International Conference on Learning Representations, 2026. URL https://openreview.net/forum?id=t33kMzEAg8. D. Silver and R. S. Sutton. Welcome to the era of experience. Google AI, 1(11):6, 2025. H. Su, S. Diao, X. Lu, M. Liu, J. Xu, X. Dong, Y. Fu, P. Belcak, H. Ye, H. Yin, Y. Dong, E. Bakhturina, T. Yu, Y. Choi, J. Kautz, and P. Molchanov. Toolorchestra: Elevating intelligence via efficient model and tool orchestration, 2025. URL https://arxiv.org/abs/2511.21689. T. Sumers, S. Yao, K. R. Narasimhan, and T. L. Griffiths. Cognitive architectures for language agents. Transactions on Machine Learning Research, 2024. ISSN 2835-8856. URLhttps://openreview. net/forum?id=1i6ZCvflQJ. Survey Certification, Featured Certification. Y. Sun, X. Han, W. Zhang, Y. Pang, T. Wang, Y. Cao, Y. Huang, C. Duroiu, H. Zhang, J. Lin, et al. Agentsโ last exam. arXiv preprint arXiv:2606.05405, 2026. J. Tack, J. Lanchantin, J. Dwivedi-Yu, A. Cohen, I. Kulikov, J. Lan, S. Hao, Y. Tian, J. E. Weston, and X. Li. Llm pretraining with continuous concepts. In International Conference on Learning Representations, volume 2026, pages 54214โ54231, 2026. W. Tan, J. Li, J. Ju, Z. Luo, R. Song, and J. Luan. Think silently, think fast: Dynamic latent compression of llm reasoning chains. Advances in Neural Information Processing Systems, 38:4646โ4668, 2026. Y. Tang, W. Su, Y. Zhou, Y. Liu, M. Zhang, S. Ma, and Q. Ai. Augmenting multi-agent communication with state delta trajectory. In C. Christodoulopoulos, T. Chakraborty, C. Rose, and V. Peng, editors, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 21 Hybrid Reasoning Agents 10219โ10240, Suzhou, China, Nov. 2025. Association for Computational Linguistics. ISBN 979- 8-89176-332-6. doi: 10.18653/v1/2025.emnlp-main.518. URLhttps://aclanthology.org/ 2025.emnlp-main.518/. K. Team. Kimi K3: open frontier intelligence. CoRR, abs/2607.24653, 2026. doi: 10.48550/ARXIV. 2607.24653. URL https://doi.org/10.48550/arXiv.2607.24653. Q. Team. Qwq-32b: Embracing the power of reinforcement learning, March 2025. URLhttps: //qwenlm.github.io/blog/qwq-32b/. H. Trivedi, N. Balasubramanian, T. Khot, and A. Sabharwal. MuSiQue: Multihop questions via single-hop question composition. Transactions of the Association for Computational Linguistics, 2022. Q. Wang, Y. Shi, Y. Wang, Y. Zhang, P. Wan, K. Gai, X. Ying, and Y. Wang. Monet: Reasoning in latent visual space beyond images and language. arXiv preprint arXiv:2511.21395, 2025. J. Wu, W. Yin, Y. Jiang, Z. Wang, Z. Xi, R. Fang, L. Zhang, Y. He, D. Zhou, P. Xie, and F. Huang. WebWalker: Benchmarking LLMs in web traversal. In W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar, editors, Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10290โ10305, Vienna, Austria, July 2025. Association for Computational Linguistics. ISBN 979-8-89176-251-0. doi: 10.18653/v1/2025.acl-long.508. URL https://aclanthology.org/2025.acl-long.508/. S. Xu, W. Xie, L. Zhao, and P. He. Chain of draft: Thinking faster by writing less, 2025a. URL https://arxiv.org/abs/2502.18600. X. Xu, T. Yu, X. Chen, H. Wang, J. McAuley, and S. Mitra. Thinkrouter: Efficient reasoning via routing thinking between latent and discrete spaces. arXiv preprint arXiv:2602.11683, 2026. Y. Xu, X. Guo, Z. Zeng, and C. Miao. SoftCoT: Soft chain-of-thought for efficient reasoning with LLMs. In W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar, editors, Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 23336โ23351, Vienna, Austria, July 2025b. Association for Computational Linguistics. ISBN 979-8- 89176-251-0. doi: 10.18653/v1/2025.acl-long.1137. URLhttps://aclanthology.org/2025. acl-long.1137/. A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388, 2025a. H. Yang, H. Chen, H. Guo, Y. Chen, C.-S. Lin, S. Hu, J. Hu, X. Wu, and X. Wang. Llm-medqa: Enhancing medical question answering through case studies in large language models. arXiv preprint arXiv:2501.05464, 2024. J. Yang, B. Hou, W. Wei, Y. Bao, and S. Chang. KVLink: Accelerating large language models via efficient KV cache reuse. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025b. URL https://openreview.net/forum?id=oDcAGSXZZP. J. Yang, C. Chen, S. Wu, Y. Liu, Y. Fan, L. Li, S. Lai, C. Qin, and Z. Guo. Demystifying hidden-state recurrence: Switchable latent reasoning with on-policy reinforcement learning. arXiv preprint arXiv:2606.13106, 2026. S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. R. Narasimhan, and Y. Cao. React: Synergizing reasoning and acting in language models. In The Eleventh International Conference on Learning Representations, 2023. URL https://openreview.net/forum?id=WE_vluYUL-X. 22 Hybrid Reasoning Agents L. Ye, Z. Tao, Y. Huang, and Y. Li. ChunkAttention: Efficient self-attention with prefix-aware KV cache and two-phase partition. In L.-W. Ku, A. Martins, and V. Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 11608โ11620, Bangkok, Thailand, Aug. 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024.acl-long.623. URL https://aclanthology.org/2024.acl-long.623/. X. Ye, Y. Mao, J. Zhang, Y. Liu, L. Hao, F. Wu, Z. Li, Y. Liao, Z. Wang, Z. Liu, Z. Yin, L. Yuan, P. Torr, H. Sun, xiangxiang Zeng, M. Wang, L. Cong, S. Gao, and X. Tang. Latentchem: From textual cot to latent thinking in chemical reasoning. In Workshop on Latent & Implicit Thinking โ Going Beyond CoT Reasoning, 2026. URL https://openreview.net/forum?id=ToCIS6xUwF. Q. Yu, Z. Zhang, R. Zhu, Y. Yuan, X. Zuo, Y. Yue, W. Dai, T. Fan, G. Liu, J. Liu, L. Liu, X. Liu, H. Lin, et al. DAPO: An open-source LLM reinforcement learning system at scale. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025. URLhttps://openreview. net/forum?id=2a36EMSSTp. X. Yu, Z. Chen, Y. He, T. Fu, G. Dong, C. Yang, C. Xu, Y. Ma, X. Hu, Z. Cao, et al. The latent space: Foundation, evolution, mechanism, ability, and outlook. arXiv preprint arXiv:2604.02029, 2026. Z. Yue, B. Jin, H. Zeng, H. Zhuang, Z. Qin, J. Yoon, L. Shang, J. Han, and D. Wang. Hybrid latent reasoning via reinforcement learning. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, 2025. URL https://openreview.net/forum?id=LjtgTpWH71. G. Zhang, M. Fu, and S. Yan. Memgen: Weaving generative latent memory for self-evolving agents. In International Conference on Learning Representations, volume 2026, pages 22555โ22588, 2026a. J. Zhang, S. Hu, C. Lu, R. Lange, and J. Clune. Darwin gรถdel machine: open-ended evolution of self-improving agents. In International Conference on Learning Representations, volume 2026, pages 104223โ104294, 2026b. Z. Zhang, X. He, W. Yan, A. Shen, C. Zhao, and X. E. Wang. Soft thinking: Unlocking the reasoning potential of LLMs in continuous concept space. In The Thirty-ninth Annual Conference on Neural In- formation Processing Systems, 2025. URLhttps://openreview.net/forum?id=ByQdHPGKgU. C. Zheng, Z. Zhang, B. Zhang, R. Lin, K. Lu, B. Yu, D. Liu, J. Zhou, and J. Lin. Processbench: Identifying process errors in mathematical reasoning. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1009โ1024, 2025a. L. Zheng, L. Yin, Z. Xie, C. Sun, J. Huang, C. H. Yu, S. Cao, C. Kozyrakis, I. Stoica, J. E. Gonzalez, C. Barrett, and Y. Sheng. SGLang: Efficient execution of structured language model programs. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024. URL https://openreview.net/forum?id=VqkAKQibpq. Y. Zheng, D. Fu, X. Hu, X. Cai, L. Ye, P. Lu, and P. Liu. Deepresearcher: Scaling deep research via reinforcement learning in real-world environments. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 414โ431, 2025b. H. Zhu, S. Hao, Z. Hu, J. Jiao, S. Russell, and Y. Tian. Reasoning by superposition: A theoretical perspective on chain of continuous thought. In ICML 2025 Workshop on Methods and Opportunities at Small Scale, 2025a. URL https://openreview.net/forum?id=1cD9iO5Isv. R.-J. Zhu, T. Peng, T. Cheng, X. Qu, J. Huang, D. Zhu, H. Wang, K. Xue, X. Zhang, Y. Shan, et al. A survey on latent reasoning. arXiv preprint arXiv:2507.06203, 2025b. 23 Hybrid Reasoning Agents Table of Contents A Multi-turn Continuation over Working Memory25 B Design and Analyses of Hybrid Supervised Fine-tuning27 B.1 Why Self-Conditioned Training? . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27 B.2 Learning When to Enter and Exit Latent Mode . . . . . . . . . . . . . . . . . . . . . . 28 C Theoretical Analyses of Hybrid Reinforcement Learning29 C.1 Formulation of Hybrid Policy Factorization . . . . . . . . . . . . . . . . . . . . . . . . 29 C.2 Hybrid Policy Optimization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29 D Extended Related Work32 E Hybrid Data Curation33 F Latent Interpretability Evaluation (Figures 2 and 8)34 G Additional Experiments35 G.1 Experiments on 4B-Scale HybridAgent . . . . . . . . . . . . . . . . . . . . . . . . . . 35 G.2 Cost Analyses on HybridAgent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 H Experiment Setups36 H.1 Benchmark and Evaluation Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36 H.2 Baseline Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 H.3 Implementation Details . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38 I Prompt Template41 J Case Study of HybridAgent43 24 Hybrid Reasoning Agents Appendix A. Multi-turn Continuation over Working Memory Following our notation in Section 2, denote the input sequenceํธ โคํก =[ํ 1 , . . . , ํ ํก ]and working memory M ํก =[ํพ โคํก ,ํ โคํก ] at step ํก, where ํพ and ํ collect the keys and values across all layers. Theorem A.1 (Lossless Multi-Turn Working Memory). Given the multi-turn generation process in Section 3.2, consider the fixed HybridAgentํ ํ and HybridLinkRunder consistent inference settings. At stepํก, letโ ํก+1 be the hidden output obtained by processingํ ํก+1 with the complete working memory M ํก . Then, โ ํก+1 |z process ํ ํก+1 using M ํก =ํ ํ ([ํธ โคํก ; ํ ํก+1 ]) | z apply the complete hybrid prefix .(12) Thus, working memory preserves the text, latent, and tool observations for continued reasoning, without converting latent thoughts into text. Remark A.2. Theorem A.1 shows that retaining complete working memory preserves the effect of the full hybrid history on subsequent generation across turns. This justifies resuming HybridAgent after tool interactions without reconstructing earlier turns or converting latent thoughts into text. Proof.Fixํ ํ and HybridLinkR, and use the same deterministic causal operations, masks, and positional encoding, preserving all existing KV entries. Each cached forward run produces both a hidden output and an updated memory: (ํ ํก+1 ,M ํก ) | z next input and preceding context cached forward run โโ (โ ํก+1 ,M ํก+1 ) | z hidden output and updated memory . The hidden output determines the next text distribution or latent input, while the updated memory provides the context for the following forward run. Here, layer and head indices are omitted for notation simplicity. We compare a memory-based forward run with a full-prefix forward run under the same model and inference settings. Base case (ํก=1). Both forward runs start with empty memory and the same inputํ 1 . At the first layer, they produce the same queries, keys, values, and attention outputs. The remaining token-wise operations produce the same input to the next layer. Repeating this argument through all layers gives M 1 =[ํพ 1 ,ํ 1 ]. Both forward runs also produce the same final hidden output, โ 1 = ํ ํ ([ํ 1 ]). Induction hypothesis. Suppose that, after processing stepํก, the stored keys and values are equal to those computed by a full-prefix forward run: M ํก |z stored KV memory =[ํพ โคํก ,ํ โคํก ] | z KV computed from the complete prefix ํธ โคํก . Induction step (ํก โ ํก+1). Causality and unchanged positional encoding preserve the earlier keys and values when ํ ํก+1 is appended. Both forward runs start the first layer with the same input ํ ํก+1 . 25 Hybrid Reasoning Agents If their inputs to the current layer are equal, each head computes the same query, new keys and values. The earlier KV entries are equal by the induction hypothesis. With the same attention mask, each head therefore produces the same attention output. The remaining token-wise operations produce the same input to the following layer. Repeating this implication through all layers gives the same final hidden output: โ ํก+1 = ํ ํ ([ํธ โคํก ; ํ ํก+1 ]). It also gives the same new keys and values,ํพ ํก+1 ,ํ ํก+1 . Appending them to the stored memory and substituting the induction hypothesis yields M ํก+1 =M ํก โ [ํพ ํก+1 ,ํ ํก+1 ] =[ํพ โคํก ,ํ โคํก ] โ [ํพ ํก+1 ,ํ ํก+1 ] =[ํพ โคํก+1 ,ํ โคํก+1 ]. Thus, the updated memory satisfies the induction hypothesis atํก+1, while the hidden-output equality establishes Eq. 12. By induction, at every input position, the cached forward run produces the same hidden output and updated KV memory as the full-prefix forward run. At the end of each turnํ โ 1, . . . , ํ, letํก= |ํฅ| + ร ํ ํ=1 |ํ (ํ) | count all input slots processed so far, including the initial context and all text, latent, and tool-observation inputs. Starting from M (0) =[ํพ โค|ํฅ| ,ํ โค|ํฅ| ], repeated concatenation gives M (ํ) =M (0) โ [ํพ |ํฅ|+1:ํก ,ํ |ํฅ|+1:ํก ] =[ํพ โค|ํฅ| ,ํ โค|ํฅ| ] โ [ํพ |ํฅ|+1:ํก ,ํ |ํฅ|+1:ํก ] =[ํพ โคํก ,ํ โคํก ]. Each new entry is appended exactly once, so turn boundaries do not change the memory used by subsequent forward runs. Finally, the established hidden-state equality gives Softmax(ํ out โ ํก )= Softmax(ํ out ํ ํ (ํธ โคํก )), R(โ ํก )=R( ํ ํ (ํธ โคํก )). where we retain the corresponding hidden states and tool observations, while using the same random draws for sampling and tool execution in both runs. Then, both runs process the same next input with the same memory and reasoning mode, producing the same hidden output and updated KV memory. Repeating this argument step by step gives identical subsequent hybrid sequences under the shared random draws, and hence identical generation probabilities. Therefore, working memory preserves the effect of the complete hybrid history across turns, without reconstructing latent thoughts as text. โก 26 Hybrid Reasoning Agents B. Design and Analyses of Hybrid Supervised Fine-tuning We expand on the method description of HybridSFT (Section 4.1), providing additional design justifications and implementation details for the overall training scheme. B.1. Why Self-Conditioned Training? Training (Teacher-forced) inputs are ground-truth embeddings; โ(h) is only compared with its target Backbone Emb(y) h โ(h) Emb(y) h โ(h) Emb(y) h โ(h) regression loss vs. target Emb(y) ground-truth latent inputs โ never fed back as an input Inference (Free-running) inputs are the modelโs own โ(h), which were never seen in training Backbone Emb(y) h โ(h) h โ(h) h โ(h) h ยท ยท enter latent mode Accumulated Deviation across Latent Steps Exposure bias text mode input is sampled and re-embedded โ always a vocabulary token โ errors are bounded in the discrete token space latent mode โ(h) is continuous and fed back unquantized โ input never seen in training โ deviation compounds over the span Figure 11|Train-Inference Mismatch in Latent Reasoning. We illustrate the exposure bias that arises when teacher-forced training meets free-running inference. Left: During activation, the backbone consumes ground-truth embeddingsEmb(ํฆ)at latent positions, while HybridLink outputsR(โ)are only trained to match their targets and never fed back as inputs. Right: At inference, every latent input is the modelโs ownR(โ), so deviations from the target embeddings accumulate across the span. The format and HybridLink activation provide a well-aligned initialization, but both are teacher-forced (Figure 11, left). At every latent position, the backbone consumes the ground-truth embedding Emb(ํฆ), and HybridLink is trained only to match its outputR(โ)to that target; the prediction itself is never fed back as an input. At inference, the agent instead runs free (Figure 11, right). Once it enters latent mode, every subsequent input is its ownR(โ), which neither the backbone nor HybridLink has been conditioned on. This train-inference mismatch is akin to exposure bias (Bengio et al., 2015; Ranzato et al., 2015), a standard issue in autoregressive sequence models that are trained on ground-truth prefixes but consume their own predictions at inference. It is worth noting that exposure bias is present in both text and latent modes, since both feed the modelโs own outputs back as inputs. In text mode (as in standard LLM SFT), each fed-back input is sampled and re-embedded, and thus always corresponds to a token in the discrete vocabulary. A prediction error, where the sampled token differs from the ground-truth target, only changes which token is fed back; the input representation itself never leaves the set seen in training, so errors cannot compound in the input space. Latent mode, in contrast, has no such projection.R(โ)is continuous and fed back unquantized, so even a small deviation from the target embedding becomes an input the backbone has never seen in training. This deviation propagates to the next hidden state and hence the next latent input, compounding over the tens to hundreds of steps in a latent span and gradually eroding the semantic coherence of the latent trace. Self-conditioned HybridSFT closes this gap by training both components on the modelโs own generated latent inputs. As in Figure 4, the teacher-forced first pass applies HybridLink to the last-layer hidden state at each latent position, yielding the modelโs own prediction of the next latent input. The second pass then replaces the ground-truth latent embeddings with these predictions and trains the backbone 27 Hybrid Reasoning Agents and HybridLink jointly, so both parts learn under the same latent inputs they encounter at inference. Under this training scheme, the backbone learns to read, and HybridLink learns to produce, latent inputs under the same conditions they encounter at inference. Thus, HybridAgent is trained as an integrated whole rather than two separately activated components. B.2. Learning When to Enter and Exit Latent Mode As stated in Section 3, HybridAgent transitions between modes through two special tokens, the entry anchor<latent>and the exit anchor</latent>. Within a latent span, these anchors are the only positions supervised byL Backbone , while every other latent position is supervised byL HybridLink alone. The two transitions are not symmetric, however. Entering latent mode is decided in text mode, where the backbone samples the next token from the vocabulary as usual, whereas exiting must be decided from a continuous latent state through the readout in Eq. 5. HybridSFT therefore treats the entry anchor as an ordinary token and gives the exit anchor dedicated supervision. Entry as a Text-Mode Decision. Since entering is a text mode decision,<latent>is simply a cross-entropy target, and the backbone learns from the preceding context when to switch. The anchor position then serves as the first latent step, with its last-layer hidden state passed through HybridLink to produce the next latent input, so the span begins without any additional mechanism. Exit as a Latent-Mode Decision. Exiting takes place in latent mode, where no token is sampled. By Eq. 5, a span closes when the HybridLinkโs outputR(โ)is nearest toEmb(</latent>), a decision depending on both components, where the backbone produces a hidden state that encodes the exit and HybridLink maps it onto the anchor embedding. HybridSFT therefore supervises the last latent step of each span from both sides. On the HybridLink side, the regression target at this step is Emb(</latent>), given slightly more weight than the span interior so that the single exit signal is not diluted. On the backbone side,</latent>is also a cross-entropy target predicted from the same hidden state, so the backbone itself learns to signal the exit. 28 Hybrid Reasoning Agents C. Theoretical Analyses of Hybrid Reinforcement Learning C.1. Formulation of Hybrid Policy Factorization Following our notation in Algorithm 1, denoteํ=(ํง, ํฆ, ํ)as a hybrid trajectory, whereTis the set of sampled text positions. Here,ํ ํ (ํ | ํฅ)denotes the likelihood of the agentโs outputs along trajectory ํ, given inputํฅ. Meanwhile, tool observations are generated by the environment and serve as context for subsequent model decisions. We formalize the factorization of the hybrid policy below. Proposition C.1 (Restatement of Hybrid Policy Factorization). Letํbe a hybrid trajectory generated by the policy ํ ํ (induced by ํ ํ ) with fixedR. Then the hybrid policy factorizes as: ํ ํ (ํ | ํฅ)= ร ํกโT ํ ํ ํฆ ํก | ํฅ, ํ <ํก ,(13) whereT is the set of sampled text positions of trajectory ํ. Proof.Fixํand a realized trajectoryํ. At a latent continuation, we havePr(ํ ํก =R(โ ํกโ1 ) | ํฅ, ํ <ํก )=1 with a fixed HybridLinkR. Deterministic reasoning mode transitions (without sampling) also have conditional mass 1. The probability chain rule thus gives ํ ํ (ํ | ํฅ)= " ร ํกโT ํ ํ (ํฆ ํก | ํฅ, ํ <ํก ) # ๏ฃฎ ๏ฃฏ ๏ฃฏ ๏ฃฏ ๏ฃฏ ๏ฃฏ ๏ฃฐ ร ํก: deterministic steps 1 ๏ฃน ๏ฃบ ๏ฃบ ๏ฃบ ๏ฃบ ๏ฃบ ๏ฃป = ร ํกโT ํ ํ (ํฆ ํก | ํฅ, ํ <ํก ), where deterministic steps receive the probability of 1. โก Remark C.2. Proposition C.1 shows that the hybrid policy factorizes over sampled text positions, with each text-token probability conditioned on the complete preceding hybrid context, including text, latent thoughts, and tool observations. Building on this factorization formulation, we show in the next subsection (Theorem C.3) how exact rollout replay enables HybridRLโs policy updates to assign credit to complete recorded hybrid trajectories. C.2. Hybrid Policy Optimization Recall that we collectํ ํ =(ํง ํ , ํฆ ํ , ํ ํ ) ํบ ํ=1 , with group sizeํบ โฅ2, using the rollout policyํ ํ old . During replay,ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก )scores the recorded prefix with the current model across stepํก;ํ ํ (ํ ํ | ํฅ)is the product in Eq. 13 under this same evaluation. Letํ ํ = ํ(ํ ํ )be the reward, andํด ํ be the fixed group-normalized advantage. LetT ํ denote the sampled text positions of ํ ํ . Define ํ ํ,ํก (ํ)= ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ ํ old (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ,(14) L RL (ํ)=โ 1 ร ํ |T ํ | โ๏ธ ํ โ๏ธ ํกโT ํ min ํ ํ,ํก (ํ)ํด ํ , clip(ํ ํ,ํก (ํ))ํด ํ .(15) Here,clip(ํ)restrictsํto[1โ ํ,1+ ํ], where 0< ํ <1. Thus, ratios sufficiently close to 1 are unchanged:clip(ํ)= ํwhenever|ํโ1| < ํ. In the following theorem, we connect this objective to our hybrid policy optimization over complete recorded hybrid trajectories. 29 Hybrid Reasoning Agents Theorem C.3 (Gradient Equivalence in Hybrid Policy Optimization). Based on the rollout replay (Section 4.2), record each trajectoryโs latent inputs and tool observations. Under Theorem A.1 and the replay conditions in Algorithm 1, the accumulated text-token gradient is equivalent to the advantage- weighted likelihood gradient for the complete hybrid trajectories: โโ ํ L RL (ํ old )= 1 ร ํ |T ํ | โ๏ธ ํ ํด ํ โ ํ logํ ํ (ํ ํ | ํฅ) ํ=ํ old .(16) Therefore, the text-token update assigns advantage-weighted policy credit to optimize the complete recorded hybrid trajectories. Remark C.4. Atํ= ํ old , HybridRL produces the same policy update as optimizing the advantage- weighted recorded-trajectory objective. By preserving the context that produced each reward, exact rollout replay enables the backbone to learn from complete recorded hybrid trajectories. Proof.For trajectoryํ ํ , we omit the sample index onํธandํfor notation simplicity. At stepํกof the ํ-th hybrid trajectory ํ ํ , the subsequent input can be denoted by ํ ํก = ๏ฃฑ ๏ฃด ๏ฃด ๏ฃด๏ฃฒ ๏ฃด ๏ฃด ๏ฃด ๏ฃณ Emb(ํฆ ํ,ํก ), generated text token, ํง ํ,ํก ,recorded latent input, Emb(ํ ํ,ํก ), tool observation. During replay,ํง ํ,ํก denotes the latent input recorded underํ old and is fixed when differentiating with respect to the current parametersํ, leading to ํํง ํ,ํก ํํ =0. Here, although the latent inputs are fixed,โ ํกโ1 = ํ ํ (ํธ โคํกโ1 )remains parameter-dependent and retains the chain-rule contribution ํโ ํกโ1 ํํ โค โ โ ํกโ1 logํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ), allowing trajectory-level rewards to optimize the backboneโs pro- cessing of the complete recorded hybrid context, while keeping the latent inputs fixed. Then, by causality and Theorem A.1, full-sequence replay scores each sampled text token at position ํก โ T ํ using the hidden stateโ ํกโ1 = ํ ํ (ํธ โคํกโ1 )computed from the recorded hybrid prefix. With this prefix, taking the logarithm and differentiating Eq. 13 gives โ ํ logํ ํ (ํ ํ | ํฅ)= โ๏ธ ํกโT ํ โ ํ logํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ),(17) which expresses the complete recorded-trajectory score as a sum of text-token scores. To connect this equality to the implemented loss, we next show that each token-ratio gradient equals its text-token score at the rollout policy ํ old . The rollout probability in the denominator of Eq. 14 is fixed during differentiation. Therefore, โ ํ ํ ํ,ํก (ํ)= โ ํ ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ ํ old (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) = ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ ํ old (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) โ ํ ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) = ํ ํ,ํก (ํ)โ ํ logํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ), where the last equality usesโ ํ log ํ= (โ ํ ํ)/ํ. Atํ= ํ old , exact replay reproduces the rollout probability, giving ํ ํ,ํก (ํ old )= 1. Therefore, evaluating the derivative yields โ ํ ํ ํ,ํก (ํ) ํ=ํ old = โ ํ logํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ=ํ old . 30 Hybrid Reasoning Agents Since clipping leaves ratios near 1 unchanged, each summand in Eq. 15 equalsํ ํ,ํก (ํ)ํด ํ locally, leading to โโ ํ L RL (ํ) | ํ=ํ old = 1 ร ํ |T ํ | โ๏ธ ํ ํด ํ โ๏ธ ํกโT ํ โ ํ ํ ํ,ํก (ํ) ํ=ํ old = 1 ร ํ |T ํ | โ๏ธ ํ ํด ํ โ๏ธ ํกโT ํ โ ํ logํ ํ (ํฆ ํ,ํก | ํฅ, ํ ํ,<ํก ) ํ=ํ old = 1 ร ํ |T ํ | โ๏ธ ํ ํด ํ โ ํ logํ ํ (ํ ํ | ํฅ) ํ=ํ old , where the second equality uses the token-ratio derivative at ํ old , and the final equality uses Eq. 17. โก 31 Hybrid Reasoning Agents D. Extended Related Work Adaptive Reasoning on Text and Latent Space. Beyond fixed-length chains of thought, recent work lets LLMs adapt how long and in which medium they reason (Bigverdi et al., 2024; Lv et al., 2026; Yang et al., 2026; Ye et al., 2026), for example by learning when to stop latent reasoning or deciding whether explicit deliberation is needed (Ning et al., 2025). Several methods interleave latent reasoning with text decoding (Yue et al., 2025), using confidence or entropy signals (Xu et al., 2026) to shift into continuous representations at uncertain steps and explore alternative reasoning paths (Fu and Luo, 2026; Shi et al., 2026). However, existing methods largely operate within one reasoning pass or switch modes only at single-turn granularity, and their latent states remain largely opaque to inspect directly. Orthogonal to this line, HybridAgent uses latent mode for efficient deeper reasoning, carries latent context across multiple turns through continuous working memory, keeps latent thoughts directly readable, and preserves the agentic tool-use abilities for long-horizon tasks. Hybrid Communication among Agents. A recent line of work in multi-agent systems (MAS) parallel to HybridAgent studies hybrid-protocol communication, in which each inter-agent message combines two media. A latent channel carries dense intermediate signals such as hidden states or KV entries, while a text channel carries concise commitments that remain inspectable. Early instances augment each natural-language message with the senderโs internal state trajectory (Tang et al., 2025), and later work formalizes the dual-channel design by routing elaborate reasoning through latent vectors while keeping answers and decisions in text (Dai et al., 2026; Mou et al., 2026). More recent works take the same view from the deployment side, pairing every latent payload with a visible text commitment wherever oversight is required (Liu, 2026) and evaluating the security of latent transfer alongside visible text (Brito and Baquero, 2026). Complementary to these inter-agent protocols in the MAS setting, HybridAgent decides the medium at the level of each generation step within a single agent, switching between latent reasoning and text-based tool interaction over multi-turn trajectories. KV-Cache Reuse. Reusing keyโvalue (KV) entries across generation steps is standard practice for efficient serving (Kwon et al., 2023; Zheng et al., 2024), and recent work extends it across requests, caching shared prefixes and prompt modules (Gim et al., 2024; Juravsky et al., 2024; Ye et al., 2024) and composing independently encoded caches so that repeated context need not be prefilled again (Hu et al., 2025; Ma et al., 2025; Yang et al., 2025b). These methods treat the KV cache as an optimization over a context that could in principle be re-encoded from text. HybridAgent likewise builds on the backboneโs own KV entries, using them as a unified working memory that stores and propagates both latent and text information across multi-turn hybrid generation. 32 Hybrid Reasoning Agents E. Hybrid Data Curation Existing Text-Based Data Text modeLatent mode 1 Step Segmentation Split into atomic steps 2 Mode Assignment Combine two signals 3 Visibility Audit Retain key information 4 Hybrid Construction Merge spans and add anchors Original trajectory 1 Plan 2 Reasoning 3 Reasoning 4 Key decision 5 Tool call + result Preserve exact character offsets LLM expert Judgments Frozen model Entropy Assign text / latent mode 12345 Initial mode assignments Tool interactions remain text 1โ5 Latent candidates hidden Independent critic 12345 Restore decision-critical steps Text 1 <latent> 23 Latent </latent> Text 45 Multi-turn Hybrid Trajectories Figure 12|Hybrid Data Curation Pipeline. We convert text-based demonstrations into multi-turn hybrid trajectories using complementary signals from LLM judgments and model entropy to assign reasoning modes, followed by a visibility audit that preserves decision-critical steps in text mode. We curate the hybrid training data by converting existing multi-turn agentic demonstrations (Dong et al., 2025b; Yu et al., 2025) into 54k hybrid trajectories for text and latent supervision. Specifically, an automatic annotation pipeline is designed to assign each source CoT step to either text or latent mode, based on complementary signals from external LLM judges and the target modelโs entropy- based confidence, with no human labeling needed. Accordingly, high-confidence reasoning steps that the model can handle reliably are assigned as latent targets, while audit-critical reasoning and tool-interaction steps are retained as text targets. We describe the detailed curation pipeline below. 1 Step Segmentation. We first split each source trajectory into atomic reasoning steps using a deterministic procedure, recording their exact character offsets. These offsets allow subsequent annotations to identify and group steps while preserving the original content and ordering. 2Mode Assignment. We then leverage external LLM experts (GPT-6.1-Sol/GPT-5.6-Luna) to assign each reasoning step to text or latent mode, with tool interactions and key steps needed for external inspection retained in text mode (See Prompts in Appendix I). Meanwhile, we complement the external selection with the target modelโs prediction entropy. We teacher-force the original textual trajectory through a frozen base model and compute the mean token-level entropy for each step ํ : ํป ํ =โ 1 |I ํ | โ๏ธ ํกโI ํ โ๏ธ ํฃโV ํ ํ (ํฃ | ํฅ, ํ <ํก ) log ํ ํ (ํฃ | ํฅ, ํ <ํก ),(18) whereํ ํ (ํฃ | ํฅ, ํ <ํก )denotes the frozen base modelโs next-token probability after the vocabulary projection and softmax. Here,ํฅis the input question,ํ <ํก contains preceding reasoning and tool observations,I ํ indexes the tokens in stepํ , andVis the vocabulary. Low-entropy steps become latent candidates, while high-entropy steps remain in text mode. Initial mode assignments combining the two complementary signals are then refined through the visibility audit below. 3Visibility Audit. An independent LLM critic next examines the visible version of each annotated trajectory, with candidate latent spans hidden. The critic assesses whether the remaining text and tool interactions provide sufficient information to follow the agentโs decisions. When decision-critical information is missing, the corresponding source steps are restored to text mode. This audit helps preserve the key information needed for external debugging and inspection. 33 Hybrid Reasoning Agents 4Hybrid Trajectory Construction. We merge adjacent latent-assigned steps into continuous spans and programmatically insert the special anchors<latent>and</latent>. Tool calls and observations remain in text form. Finally, we verify that removing the inserted anchors recovers the original trajectory byte for byte. This consistency check ensures that the pipeline annotates reasoning modes without rewriting or altering the source demonstrations. F. Latent Interpretability Evaluation (Figures 2 and 8) In this section, we describe the evaluation setup and metrics used to measure the readability and context specificity of latent readouts in Figures 2 and 8. Probe Setup. We evaluate HybridAgent across 200 questions spanning downstream tasks, including AIME25/26 (math ai, 2025; MathArena, 2026), MATH-500 (HuggingFaceH4, 2023), MuSiQue (Trivedi et al., 2022), GAIA (Mialon et al., 2024), and DSQA (Gupta et al., 2026). Figure 2 compares the final HybridRL checkpoints of HybridAgent at 4B, 8B, and 14B scales. Figure 8 compares format activation, HybridLink activation, self-conditioned HybridSFT, and Coconut on the shared Qwen3- 14B-Base backbone. Generation uses temperature 0.6, top-p 0.95, top-k 20, and a fixed random seed. Each unit inside the plots is a latent span: a maximal sequence of consecutive latent steps. Each plotted point represents one span, and rings mark the means of per-span scores for each model or variant. The annotation ํ= 200 refers to total number of questions. Readability. For a latent spanํcontainingํฟ ํ latent inputsํง ํ,ํก , we measure readability score through their average nearest-token alignment, following Eq. 5: Read(ํ)= 1 ํฟ ํ ํฟ ํ โ๏ธ ํก=1 max ํฃโV cos ํง ํ,ํก , Emb(ํฃ) ,(19) whereVis the vocabulary andEmb(ํฃ)is the input embedding of tokenํฃ. A score of 1 indicates that every latent input shares the direction of a vocabulary embedding, corresponding to the โexact tokenโ reference. This alignment serves as a geometric proxy for readability. To calibrate the noise reference, we apply the same readout to 2,000 Gaussian random vectors and use their mean nearest-token similarity as the thresholdํ noise . Spans above this threshold exhibit stronger average token alignment than the Gaussian reference. Context Specificity. Context specificity measures whether a spanโs pseudo-text is more relevant to its originating question than to other questions from the same task. Letํ ํ denote the pseudo-text obtained by nearest-token readout of spanํ, as in Eq. 5. Letํ(ํ )extract the content words from stringํ : lower-cased alphanumeric tokens longer than two characters, with stop words removed. We use Jaccard overlap,ํฝ(ํด, ํต)=|ํดโฉ ํต|/|ํดโช ํต|. For a task-specific question setํ 1 , . . . , ํ ํ withํ โฅ2, let ํ(ํ) identify the question that produced span ํ. We define the context specificity score as: Spec(ํ)= ํฝ ํ(ํ ํ ),ํ(ํ ํ(ํ) ) 1 ํโ 1 ํ โ๏ธ ํ=1 ํโ ํ(ํ) ํฝ ํ(ํ ํ ),ํ(ํ ํ ) ,(20) when the denominator is positive. A score of 1รindicates equal overlap, while higher scores above 1ร indicate greater lexical relevance to the originating question. We exclude readouts without content words and plot positive scores on a logarithmic axis. Meaningful Region. The shaded region contains spans whose readability exceedsํ noise and whose context specificity exceeds 1. The two axes are complementary: readability measures alignment with 34 Hybrid Reasoning Agents token embeddings, while context specificity measures relevance to the originating question. Together, they provide evidence of readable, question-specific latent readouts that support external inspection. G. Additional Experiments G.1. Experiments on 4B-Scale HybridAgent Table 8|4B-Scale HybridAgent on Math and Knowledge-Intensive Search. We evaluate perfor- mance across both SFT and RL stages. AIME25/26 are reported on avg@16 accuracy. MethodAIME25 AIME26 MATH500 GPQA-D Qwen3-4B-Base Coconut10.613.340.617.2 SoftCoT14.818.555.226.3 Standard Text SFT19.022.777.431.8 HybridAgent (SFT) 22.523.376.830.8 GRPO28.135.680.636.9 ARPO31.3 36.381.838.4 HybridAgent (RL)35.237.582.240.9 To examine the effectiveness of hybrid reasoning at smaller model scales, we evaluate HybridAgent and corresponding text-based and latent baselines on Qwen3-4B-Base. As shown in Table 8, HybridSFT outperforms both latent baselines across all four benchmarks and improves over standard text SFT on AIME25 and AIME26. HybridRL further improves performance across all four benchmarks, achieving the best results and exceeding ARPO by an average of 2.0 percentage points. Together with 8B and 14B comparisons in Table 1 and 2, these results show that the benefits of hybrid reasoning can extend to different model scales of HybridAgent across downstream reasoning tasks. G.2. Cost Analyses on HybridAgent Table 9|Cost Analyses on HybridAgent. We compare HybridAgent with text agents under the same backbones, reporting compute per question and estimated monetary cost per 1M questions. Each text or latent generation step is charged as one full backbone forward pass. Monetary costs assume $2.50 per H100-hour and 10% utilization of peak BF16 throughput (approximately $0.007 per PFLOP). Model Backbone Text Agent HybridAgentCost / 1M questions Cheaper by (TFLOP)(TFLOP) (Text Agentโ HybridAgent) Qwen3-4B-Base51.213.9$359โ $983.7ร Qwen3-8B-Base62.517.2$439โ $1213.6ร Qwen3-14B-Base66.925.1$470โ $1762.7ร Cost Analyses on HybridAgent. To examine whether the efficiency of hybrid generation translates into lower computational cost, we compare HybridAgent with matched text agents across 4B, 8B, and 14B backbones. We estimate decoding compute by charging every text or latent step a full backbone forward pass, together with the cost of vocabulary projection or the HybridLink adapter, respectively. Step counts are averaged over matched evaluations with the same questions, generation budgets, 35 Hybrid Reasoning Agents and tool-call limits. We further estimate monetary costs assuming $2.50 per H100-hour and 10% utilization of peak BF16 throughput. These estimates cover generation compute and exclude prompt prefill, context-dependent attention, and external tool execution. As shown in Table 9, HybridAgent consistently reduces estimated decoding compute across all three model scales, from 51.2โ66.9 TFLOP to 13.9โ25.1 TFLOP per question, corresponding to reductions of 62.5%โ72.9%. Under the stated pricing and utilization assumptions, the estimated cost of answering one million questions decreases from $359 to $98 at 4B, from $439 to $121 at 8B, and from $470 to $176 at 14B, yielding cost reduction factors of 3.7ร, 3.6ร, and 2.7ร, respectively. Together with the shorter generation trajectories in Figure 6, these results demonstrate that hybrid reasoning reduces overall decoding compute while explicitly accounting for the backbone computation incurred by latent steps. H. Experiment Setups H.1. Benchmark and Evaluation Details We evaluate HybridAgent on 11 benchmarks spanning mathematical, knowledge-intensive, and agentic reasoning. Together, these benchmarks assess complementary capabilities in multi-step problem solving, specialized knowledge application, evidence integration, and tool-assisted information seeking. We follow the setup of Dong et al. (2025b) and describe each benchmark in detail below. (i) Mathematical Reasoning Tasks AIME 25 (math ai, 2025): AIME 25 comprises 30 problems from the 2025 American Invitational Mathematics Examination, covering algebra, geometry, number theory, and combinatorics. Its integer- answer problems evaluate competition-level mathematical reasoning, requiring models to combine mathematical insights with precise multi-step calculations. AIME 26 (MathArena, 2026): AIME 26 contains 30 problems from the 2026 American Invitational Mathematics Examination, following the same competition format as AIME 25. It provides a comple- mentary assessment of mathematical problem solving across a separate annual problem set, testing sustained reasoning and accurate numerical derivation. MATH500 (HuggingFaceH4, 2023): MATH500 is a 500-problem subset of the MATH test set, spanning 7 mathematical subjects and 5 difficulty levels. It evaluates math reasoning across diverse problem types, including symbolic manipulation, geometric deduction, and numerical computation. (i) Knowledge-Intensive Reasoning Tasks GPQA-Diamond (Rein et al., 2023): GPQA-Diamond is a curated subset of 198 expert-written multiple- choice questions in biology, physics, and chemistry. Selected through expert and non-expert validation, these questions assess advanced scientific knowledge and reasoning that remain challenging for non-experts even with web access. MedQA (Yang et al., 2024): MedQA is a multiple-choice question-answering benchmark derived from professional medical licensing examinations. The dataset contains 300 questions in total. Its questions assess medical knowledge and clinical reasoning, requiring models to interpret patient information and identify appropriate diagnoses, investigations, or treatments. MuSiQue (Trivedi et al., 2022): MuSiQue is a multi-hop question-answering benchmark constructed by composing single-hop questions into connected reasoning chains of two to four hops. It evaluates the ability to combine evidence across multiple passages, with question construction designed to reduce shortcuts that bypass intermediate reasoning steps. Following Dong et al. (2025b), we use 200 test-set questions for downstream evaluation across all methods. 36 Hybrid Reasoning Agents (i) Agentic Reasoning Tasks General AI Assistants (GAIA) (Mialon et al., 2024): GAIA evaluates general-purpose assistants on real-world questions involving reasoning, web browsing, information processing, and external tool use. Its three difficulty levels reflect increasingly demanding combinations of reasoning steps and tool interactions, assessing the ability to coordinate these capabilities toward a verifiable answer. Humanityโs Last Exam (HLE) (Center for AI Safety et al., 2026): HLE comprises expert-authored questions across a broad range of academic disciplines, including mathematics, natural sciences, and the humanities. Its multiple-choice and short-answer problems assess advanced subject knowledge and reasoning on questions designed to resist quick answers through direct web retrieval. WebWalker (Wu et al., 2025): WebWalkerQA, referred to as WebWalker in our evaluations, is an agentic search benchmark requiring exploration of website subpages and integration of information from one or multiple sources. Its easy, medium, and hard categories reflect increasing traversal depth, testing the ability to locate and synthesize evidence beyond surface-level search results. SealQA (Pham et al., 2026): SealQA evaluates search-augmented question answering on factual questions for which retrieved information may be noisy, conflicting, or unhelpful. We evaluate on Seal- 0 and Seal-Hard, which test factual accuracy and reasoning under challenging retrieval conditions. Seal-0 targets questions selected for near-zero accuracy among the non-reasoning models used during benchmark construction; Seal-Hard includes a broader collection of difficult questions. DeepSearchQA (DSQA) (Gupta et al., 2026): DeepSearchQA evaluates multi-step web research through tasks that require assembling complete answer sets from information distributed across sources. It tests search planning, evidence aggregation, entity disambiguation, and the ability to determine when sufficient information has been collected. We report both full-correct rate and F1 score to assess complete task success and the balance between answer precision and coverage. H.2. Baseline Details To evaluate the effectiveness and efficiency of HybridAgent, we compare with 4 categories of methods, including (i) Text-based Agentic Methods, (i) Latent Reasoning Methods, (i) Frontier LLM Agents, and (iv) Agentic Frameworks. We describe the implementation details of each baseline below. (i) Text-based Agentic Methods Standard Text SFT: We apply standard SFT using the same training data and backbone models as HybridAgent. During evaluation, the models can invoke tools and incorporate the returned observations into subsequent reasoning. We use this baseline mostly to compare with the HybridSFT. Agentic RL (GRPO/ARPO): We apply commonly adopted agentic RL methods after standard text SFT to further train the text agent baselines. GRPO (Shao et al., 2024) optimizes the policy using group-normalized rewards from sampled responses without requiring a separate critic. ARPO (Dong et al., 2025b): ARPO combines entropy-guided adaptive rollouts with step-level advantage attribution to improve multi-turn tool use. We train these methods using the same RL training data and backbone models as HybridAgent, primarily to evaluate the effectiveness of HybridRL. (i) Latent Reasoning Methods Coconut (Hao et al., 2024): Coconut performs continuous latent reasoning by directly feeding the modelโs last hidden state back as the next input embedding. A staged training curriculum progressively replaces textual reasoning steps with latent thoughts, teaching the model to reason in continuous space before generating a textual answer. 37 Hybrid Reasoning Agents SoftCoT (Xu et al., 2025b): SoftCoT uses a lightweight frozen assistant model to generate question- dependent soft thought representations, which a trainable projection maps into the target LLMโs representation space. These representations guide subsequent generation, enabling latent reasoning while keeping the assistant and target LLM frozen. SoftThinking (Zhang et al., 2025): SoftThinking is a context-based method that represents interme- diate reasoning as probability-weighted mixtures of vocabulary embeddings. Feeding these hidden continuous representations back into the model preserves alternatives from the next-token distribution. We implement all latent reasoning baselines using the same backbone models and, where applicable, training settings and budgets as HybridAgent to ensure a fair comparison. (i) Frontier LLM Agents To evaluate HybridAgent in a broader context, we compare it with current leading closed-source and open-source LLM agents, including GPT-5.6-Luna (OpenAI, 2026), Kimi-K3 (Team, 2026), GLM-5.3- Flash (GLM-5-Team et al., 2026), DeepSeek-V4.1-Flash (DeepSeek-AI, 2026), and QwQ-32B (Team, 2025), to assess both performance and inference efficiency of HybridAgent. (iv) Agentic Frameworks We further compare HybridAgent with established agentic frameworks that integrate multi-step reasoning with external tool calling and environmental interactions. We apply Qwen3-14B as the backbone for all these frameworks, with the same tool access and usage budgets as HybridAgent. ReAct (Yao et al., 2023): ReAct interleaves natural-language reasoning with actions and observations from an external environment. This interaction loop allows an agent to gather information, revise its reasoning, and determine subsequent actions based on tool feedback. Search-o1 (Li et al., 2025a): Search-o1 augments large reasoning models with adaptive search to address knowledge gaps encountered during reasoning. Its Reason-in-Documents module analyzes retrieved documents and extracts relevant evidence before incorporating it into ongoing reasoning. WebThinker (Li et al., 2025b): WebThinker equips LLMs with a Deep Web Explorer that supports iterative search, webpage navigation, and information extraction. Its Think-Search-and-Draft strategy interleaves reasoning, evidence collection, and report generation to support complex research tasks. Overall, these baseline methods provide complementary comparisons across training stages, text-based and latent-space reasoning, and tool-integrated agentic settings. H.3. Implementation Details Models and Training Details. We instantiate HybridAgent with Qwen3-Base backbones (Yang et al., 2025a) at three scales of 4B, 8B, and 14B. For HybridLink, we use the same two-layer design across all three backbones. The HybridSFT training data is constructed by converting 54K text-only sources (Dong et al., 2025a,b) into hybrid trajectories. We apply format and HybridLink activation for one epoch each, followed by one additional epoch of self-conditioned training. HybridRL training utilizes 12K deep reasoning examples (Yu et al., 2025) for math and 1K agentic reasoning and search examples (Dong et al., 2025b) for deep search. We train HybridAgent with the GRPO objective and set rollout batches of 512 trajectories (64ร8), followed by one optimization pass over 8 minibatches. Training Hyperparameters. Table 10, 11, and 12 provide detailed parameter setups on HybridSFT and HybridRL. Following Dong et al. (2025b); Yu et al. (2025), we use HybridAgent checkpoints from deep reasoning training for mathematical evaluations and the checkpoint from agentic search training for knowledge-intensive search and agentic reasoning evaluations, as detailed in Appendix H.1. 38 Hybrid Reasoning Agents Table 10 | Hyperparameter Setups of HybridSFT. HyperparameterValue Base modelQwen3-4B/8B/14B-Base Maximum sequence length16,888 Effective batch size16 Backbone learning rate7ร 10 โ6 HybridLink learning rate (Activation / Self-conditioning) 2ร 10 โ4 / 5ร 10 โ5 Weight decay0.0 Warmup ratio0.1 Learning rate schedulerCosine Latent regression weights (ํ cos / ํ mse )1.0 / 0.2 Number of training epochs3 (1 / 1 / 1) Table 11 | Hyperparameter Setups of HybridRL on Agentic Search. HyperparameterValue Initialization8B/14B HybridSFT checkpoint Unique prompts per rollout batch64 Rollouts per prompt (group size)8 Minibatches per rollout batch8 Optimization epochs per rollout batch 1 Total rollout batch size512 trajectories (64ร 8) Optimization per rollout batch1 pass over 8 minibatches Rollout sampling temperature1.0 Rollout sampling top-p1.0 Reward ํ correct token-level F1โ [0, 1] Reward ํ format 0 / -1 Reward ํ tool 0.1 Latent steps per latent block (min/max) 16 / 256 Max tool calls per rollout10 Weight decay0.01 KL penalty coefficient0 Learning rate scheduleconstant Training steps150 Maximum sequence length16,888 Backbone learning rate1ร 10 โ6 OptimizerAdamW, ํฝ=(0.9, 0.95) Search API Setup (per call)top-10, 1000 characters each Inference Setups. During inference, we set the temperature, top-p, and top-k to 0.6, 0.95, and 20, respectively. The generation budget is adjusted for each task based on its relative difficulty and counts both text tokens and latent steps, with limits of 4,096 for mathematical reasoning and knowledge-intensive search tasks, and 24,000 for challenging agentic reasoning tasks. For each latent span, we enforce a minimum of 16 and a maximum of 256 steps to ensure sustained and semantically rich latent reasoning. HybridAgent interacts with external environments primarily through two types of tools: a Python interpreter within sandbox environments and a live search engine (e.g., Tavily). We cap tool usage at 10 calls per trajectory and retrieve the top 10 snippets for each search query. We utilize GPT-5.6-Luna as both the search-page summarizer and LLM judge. All training and inference 39 Hybrid Reasoning Agents Table 12 | Hyperparameter Setups of HybridRL on Deep Reasoning. HyperparameterValue Initialization4B/8B/14B HybridSFT checkpoint Unique prompts per rollout batch64 Rollouts per prompt (group size)8 Minibatches per rollout batch8 Optimization epochs per rollout batch 1 Total rollout batch size512 trajectories (64ร 8) Optimization per rollout batch1 pass over 8 minibatches Rollout sampling temperature1.0 Rollout sampling top-ํ1.0 Reward ํ correct Math Verify (0 / 1) Reward ํ format 0 /โ1 Reward ํ tool +0.1 Latent steps per latent span (min/max) 16 / 256 Max tool calls per rollout5 Weight decay0.01 KL penalty coefficient0 Learning rate scheduleConstant Training steps200 Maximum sequence length16,888 Backbone learning rate1ร 10 โ6 OptimizerAdamW, ํฝ=(0.9, 0.95) are conducted on 32 H100 GPUs. We also provide detailed prompt templates in Appendix I. Infrastructure and Configurations. As existing training and inference frameworks such as verl (Sheng et al., 2025) and vLLM (Kwon et al., 2023) do not directly support multi-turn hybrid generation, we extend their infrastructure to enable hybrid training and generation in HybridAgent. A shared generation loop coordinates text mode, latent mode, and tool interaction while maintaining each trajectoryโs persistent KV cache as continuous working memory across turns. The agent enters latent mode through the special entry anchor<latent>, feeds HybridLink-generated latent inputs back into the backbone, and returns to text mode when the nearest-token readout matches the exit anchor </latent>, as in Eq. 5. Tool observations are tokenized and processed against the existing working memory, appending new KV entries without reconstructing or re-prefilling earlier context. The engine also supports batched rollouts with per-sequence state tracking, allowing trajectories to occupy different generation states within the same batch. Pending tool calls execute concurrently, with waiting and completed sequences masked from further generation. Per-sequence attention masks and position tracking preserve each trajectoryโs causal context as generation proceeds. For HybridRL, exact latent-context replay recomputes sampled text-token likelihoods in a single differentiable forward pass while keeping recorded latent inputs unchanged. We check rolloutโreplay agreement of log-probabilities at unchanged policy parameters. Multi-node data parallelism, sharded optimizer states, mixed precision, gradient checkpointing, and resumable checkpoints support full-parameter backbone optimization. Overall, the same engine supports RL rollouts, training-time validation, and downstream evaluation, ensuring consistent mode transitions and working-memory handling across configurable sampling settings, generation budgets, and tool-call setups. 40 Hybrid Reasoning Agents I. Prompt Template Prompt Template for HybridAgent Training and Inference System Prompt(shared across examples) You are a helpful assistant that solves the given question step by step with the help of an online live search tool and a python interpreter tool. Given a question, you first think about the reasoning process and then provide the final answer, invoking the search tool for factual information and the python interpreter tool for calculations whenever needed. Format: - <think> ... </think>: your reasoning. Start every round with <think>; close it with </think> and then output exactly one of: a <search> call, a <python> call, or the final <answer>. - <latent> ... </latent>: latent reasoning, allowed only inside <think> ... </think>. Put routine internal reasoning (planning, recalling, restating, routine double-checking) in latent mode. Outside <latent>, write only the few decisive steps - key facts, decisions, and conclusions - as plain text. Always start and end the think block with plain text: open with a brief plain-text step (e.g. what the question or the latest result tells you), and close with the plain-text decision or conclusion that leads to your next action. - <search> query </search>: call the online live search tool. - <python> code </python>: call the python interpreter tool; use print() to show the output. - <result> ... </result>: the tool output, inserted by the system after your </search> or </python>. Never write <result> yourself. After each result, start the next round with <think> - or, if the result directly settles the question, give the final <answer> immediately. If a result is empty, an error, or a tool-limit notice, do not repeat the same call - adjust your approach or give your best final answer. - <answer> ... </answer>: the final response, with the exact final answer enclosed in in latex format. Format example: <think> This is a key first step.<latent>This is the latent reasoning process.</latent>This is a key reasoning step. </think><search>search query here</search><result>search result here</result><think> This is a key first step.<latent>This is the latent reasoning process.</latent>This is the key decision step. </think><python>python code here</python><result>python interpreter result here</result><think> This is a key first step.<latent>This is the latent reasoning process.</latent>This is the key conclusion. </think><answer> answer here</answer> User Prompt(question for the current example) question 41 Hybrid Reasoning Agents PromptTemplateforDownstreamLLMJudge Given a Question and its Golden Answer, verify whether the Predicted Answer is correct. The prediction is correct if it fully aligns with the meaning and key information of the Golden Answer. Respond with "Correct" if the prediction is correct and "Incorrect" otherwise. Question: question Golden Answer: labeled_answer Predicted Answer: pred_answer Prompt Template for LLM-Guided Hybrid Data Annotation System Prompt You are a data expert for classifying Chain-of-Thought (CoT) steps produced by an assistant that can use tools (search, python) and outputs a final answer. For each CoT step you will be given, you must label it as either: - ** 0 (latent mode) ** : Internal thinking that is not critical for auditing or debugging. Prefer latent for routine reasoning, filler, or steps that do not need to be shown as text for correctness or interpretability. - ** 1 (text mode) ** : Must be text when (a) the step clearly calls an external tool or relates to a tool call (e.g. contains <search>...</search>, <python>...</python>, <result>...</result>, or <answer>...</answer>), or (b) the step is important for auditing/debugging (e.g. the step that states the final answer, or a core middle step that corresponds to the key solution decision). For efficiency, do NOT mark too many steps as text: only those that are clearly tool-related or genuinely important for understanding the solution. Balance: Prefer latent for non-essential inner reasoning; use text only for tool steps and a small set of critical reasoning/answer steps. When you respond, you MUST first write your reasoning, then output the final JSON array inside a```json ...```code block. Do not skip the reasoning section. User Prompt Below are num_steps chain-of-thought steps from one conversation, labeled step0 to stepN. steps_block Do the following in order: 1. Reasoning: for each step from step0 to stepN, give its label (0 = latent, 1 = text) and a brief reason, e.g. "step0: 0 - internal planning"; "step3: 1 - contains <search>". 2. Check: confirm that every step is labeled and that your array will have exactly num_steps entries. 3. Final answer: end with a JSON code block containing only the array of num_steps integers (0 or 1), in order from step0 to stepN: An example of the final array format for the given steps is: ```json [0,1,1,0] ``` 42 Hybrid Reasoning Agents J. Case Study of HybridAgent HybridAgent on Mathematical ReasoningMATH500 QUESTIONIf each point of the circlex 2 +y 2 = 25is reflected in the point(4,1), the set of image points satisfies the equationx 2 +ay 2 +bx+cy+d= 0. Compute ordered quadruple(a,b,c,d)of real numbers. TURN 01 TEXTTo solve this problem, we need to find the image of each point(x 1 ,y 1 )on the circlex 2 +y 2 = 25when it is reflected in the point(4,1). LATENTThe reflection of a point(x 1 ,y 1 )in another point(x 0 ,y 0 )is given by the formula: (x 2 ,y 2 ) = (2x 0 โx 1 ,2y 0 โy 1 ). In this case,(x 0 ,y 0 ) = (4,1), so the reflection of(x 1 ,y 1 )is: (x 2 ,y 2 ) = (2ยท4โx 1 ,2ยท1โy 1 ) = (8โx 1 ,2โy 1 ). TEXTNow, we need to find the equation of the locus of these image points(x 2 ,y 2 ). LATENTSince(x 1 ,y 1 )lies on the circlex 2 +y 2 = 25, we substitutex 1 = 8โx 2 andy 1 = 2โy 2 into the circleโs equation:(8โx 2 ) 2 + (2โy 2 ) 2 = 25. TEXTWe will expand and simplify this equation to find the values ofa,b,c, andd. Letโs start by expanding the squares: (8โx 2 ) 2 = 64โ16x 2 +x 2 2 , (2โy 2 ) 2 = 4โ4y 2 +y 2 2 . Adding these together, we get:64โ16x 2 +x 2 2 + 4โ4y 2 +y 2 2 = 25. LATENTSimplify the left side:x 2 2 +y 2 2 โ16x 2 โ4y 2 + 68 = 25. Rearrange to standard form by moving 25 to the left side: x 2 2 +y 2 2 โ16x 2 โ4y 2 + 43 = 0. Now we can identify the coefficientsa,b,c, andd:a= 1,b=โ16,c=โ4,d= 43. TEXTLetโs confirm this by implementing the steps in Python to ensure the result is accurate. TOOL python from sympy import symbols, Eq, simplify x1, y1, x2, y2 = symbols('x1 y1 x2 y2') ... polynomial_form = Eq(simplified_eq.lhs - simplified_eq.rhs, 0) print(polynomial_form) ERRORPython exited with code 1 Partial stderr: Traceback (most recent call last): File "<string>", line 53, in <module> File "<string>", line 38, in _execute_user_code File "<python-tool>", line 12, in <module> NameError: name 'solve' is not defined TURN 02 TEXTIt seems that the symbolic computation code had an issue because thesolvefunction was not imported. Let me correct that by importing the necessary functions fromsympy. Iโl also ensure the code is properly encapsulated within the environment. TOOL python from sympy import symbols, Eq, solve, simplify x1, y1, x2, y2 = symbols('x1 y1 x2 y2') ... print(polynomial_form) RESULTEq((x2 - 8) ** 2 + (y2 - 2) ** 2 - 25, 0) TURN 03 LATENTThe output confirms our earlier manual calculation. The equation of the locus of the image points is: (x 2 โ8) 2 + (y 2 โ2) 2 โ25 = 0. Expanding this, we get:x 2 2 โ16x 2 + 64 +y 2 2 โ4y 2 + 4โ25 = 0. Simplifying further:x 2 2 +y 2 2 โ16x 2 โ4y 2 + 43 = 0. TEXTThus, the values ofa,b,c, anddare:a= 1,b=โ16,c=โ4,d= 43. So, the ordered quadruple(a,b,c,d)is: ANSWER(1,โ16,โ4,43)โCorrectanswer 43 Hybrid Reasoning Agents HybridAgent on Knowledge-Intensive ReasoningMuSiQue QUESTIONWhat field of work was the person who discovered the mathematical relationship between peaks and curves of light at different temperatures in? TURN 01 TEXTOkay, so I need to figure out what field of work the person was who discovered the mathematical rela- tionship between peaks and curves of light at different temperatures. Hmm, let me think about this step by step. LATENTFirst, I remember that thereโs a specific in in physics or to the color of light by objects at different temperature. Maybe itโs some like the blackโs function or Wait, or, thatโs more about the energy of energy from a black body. TEXTWait, the question mentions โpeaks and curves of light at different temperatures.โ That sounds like the relationship between temperature and the spectrum of emitted light. Oh, right! The person Iโm thinking of is Max Planck. Heโs known for his work on black-body radiation. Planckโs law describes the spectral density of electromagnetic radiation emitted by a black body in thermal equilibrium at a given temperature. LATENTSo the question is about for the field of work. So I need was a physics, but I need to be more. Let me do a quick search to confirm. Iโl look up the discovery related to peaks and curves of light at different temperatures and the corresponding field. TOOL search discovery of mathematical relationship between peaks and curves of light at different temperatures field RESULTPage 1:Wienโs displacement law states that the black-body radiation curve for different temperatures will peak at different wavelengths that are inversely Page 2:Each blackbody curve represents a blackbody at a specific temperature, and each curve peaks at a different wavelength, so you can figure out the temperature of a blackbody by measuring the wavelength at which its [.. . ] TURN 02 TEXTOkay, so the question is asking about the field of work of the person who discovered the mathematical relationship between peaks and curves of light at different temperatures. LATENTFrom the search results, I can see that the key is to theโs distance law. The is about by William Wien. The search results mention that Wienโs displacement law was discovered by Wilhelm Wien. Now I need to find out what field of work Wilhelm Wien was in. Let me do another search to find out William Wienโs field of work. TEXTWait, I already have the answer from the first search. The question is about the field of work. Since the discovery is related to black-body radiation and physics, itโs safe to assume that Wilhelm Wien was a physicist. LATENTLet me verify this through another search query: TOOL search Wilhelm Wien field of work RESULTPage 1:Wilhelm Wien From ETHW Jump to:navigation, search Wilhelm Wien Birthdate : 1864 Birth- place : East Prussia Associated organizations : University of Munich Fields of study : Quantum physics Awards : Nobel Prize in physics Biography Wilhelm Wien was a German physicist and Nobel-Prize winner who pioneered the study of quantum physics. [...] From early in his career, Wien [. . . ] TURN 03 TEXTOkay, so the question is asking about the field of work of the person who discovered the mathematical relationship between peaks and curves of light at different temperatures. LATENTFrom the first search, I found that the person is related to Williamโs distance law, which was found by William Wien. Then, I did another search to find Wilhelm Wienโs field of work. The search results clearly state that Wilhelm Wien was a German physicist. TEXTMultiple sources confirm that his primary area of work was physics, specifically in the study of thermal radiation and quantum physics. He was awarded the Nobel Prize in Physics for his work on black-body radiation. LATENTThen the field of work is physics. The person who discovered the mathematical relationship between peaks and curves of light at different temperatures was Wilhelm Wien, and his field of work was physics. ANSWERPhysicsโCorrect answer 44 Hybrid Reasoning Agents HybridAgent on Agentic ReasoningGAIA QUESTIONUse the density values from Marisa Alviar-Agnew and Henry Agnewโs CK-12-licensedIntroductory Chemistrymaterials on LibreTexts, as compiled on 08/21/2023. I have one gallon of honey and one gallon of mayonnaise at25 โฆ C. If I remove one cup of honey at a time, how many cups must I remove for the remaining honey to weigh less than the mayonnaise? Assume that the containers have equal mass. TURN 01 TEXTI need the smallest number of one-cup removals that makes the remaining honey lighter than one gallon of mayonnaise. LATENTBecause the containers have equal mass, I only need to compare their contents. I first need the densities of honey and mayonnaise at25 โฆ Cfrom the specified chemistry reference. TEXTSince the containers have equal mass, I can compare their contents usingm=ฯV. Iโl first look up the densities at25 โฆ C. TOOL search density of honey and mayonnaise in g/mL RESULTPage 1: Plug in the values we measured earlier, and weโl get the densities of honey and mayonnaise. The table above shows the densities of honey and mayonnaise. We can see that both substances have a density of approximately 5g/mL. Page 2: Table \( 1\): Densities of Common Substances | Substance | Density at 25ยฐC (g/cm3) | --- | | blood | 1.035 | | body fat | 0.918 [. . . ] TURN 02 TEXTFor the calculation, I use1.42 g/mLfor honey and0.91 g/mLfor mayonnaise. Iโl convert the volumes to milliliters to calculate their masses. LATENTUsing U.S. liquid measures, one gallon is approximately3785.41 mLand one cup is approximately 236.588 mL. The initial mass of the honey is m honey = 1.42ร3785.41 = 5375.2822 g. TEXTThe honey initially weighs about5375.28 g, while the mayonnaise weighs0.91ร3785.41โ3444.72 g. I now need the mass removed per cup to determine when the honey falls below this value. LATENTEach cup of honey has mass m cup = 1.42ร236.588 = 335.95496 g. After removingncups, the required inequality is 5375.2822โ335.95496n<3444.7231, n> 5375.2822โ3444.7231 335.95496 โ5.74648. The smallest valid integer isn= 6. Iโl verify this with Python. TEXTEach cup removes335.95496 g. The condition5375.2822โ335.95496n<3444.7231requires n>5.74648. Iโl check in Python that six cups are sufficient and five are not. TOOL python from math import floor rho_h, rho_m = 1.42, 0.91 gallon_ml, cup_ml = 3785.41, 236.588 m_h = rho_h * gallon_ml m_m = rho_m * gallon_ml m_cup = rho_h * cup_ml n = floor((m_h - m_m) / m_cup) + 1 assert m_h - n * m_cup < m_m assert m_h - (n - 1) * m_cup >= m_m print(f"Number of cups to remove: n") RESULTNumber of cups to remove: 6 TURN 03 TEXTPython confirms the minimum: six cups leave about3359.55 gof honey, below the mayonnaiseโs 3444.72 g; five cups leave about3695.51 g, which is still too heavy. LATENTSix one-cup removals are therefore necessary and sufficient. ANSWER6โCorrect answer 45