Paper deep dive
Probe-then-Plan: Environment-Aware Planning for Industrial E-commerce Search
Mengxiang Chen, Zhouwei Zhai, Jin Li
Intelligence
Status: succeeded | Model: google/gemini-3.1-flash-lite-preview | Prompt: intel-v1 | Confidence: 96%
Last extracted: 3/22/2026, 5:19:24 AM
Summary
The paper introduces Environment-Aware Search Planning (EASP), a novel paradigm for industrial e-commerce search that addresses the 'blindness-latency' dilemma. By utilizing a 'Probe-then-Plan' mechanism, EASP exposes a retrieval snapshot to a lightweight planner, allowing for grounded, single-step reasoning. The framework incorporates offline data synthesis via a Teacher Agent, supervised fine-tuning, and reinforcement learning (GRPO) for business alignment, alongside a complexity-aware router for efficient online serving. Experiments on JD.com demonstrate significant improvements in UCVR and GMV while maintaining sub-second latency.
Entities (5)
Relation Signals (3)
EASP â deployedin â JD.com
confidence 100% ¡ EASP has been successfully deployed in JD.comâs AI-Search system.
EASP â uses â Probe-then-Plan
confidence 100% ¡ EASP introduces a Probe-then-Plan mechanism
GRPO â aligns â Planner
confidence 95% ¡ We employ Group Relative Policy Optimization (GRPO) to align the Planner with business outcomes.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Modern e-commerce search is evolving to resolve complex user intents. While Large Language Models (LLMs) offer strong reasoning, existing LLM-based paradigms face a fundamental blindness-latency dilemma: query rewriting is agnostic to retrieval capabilities and real-time inventory, yielding invalid plans; conversely, deep search agents rely on iterative tool calls and reflection, incurring seconds of latency incompatible with industrial sub-second budgets. To resolve this conflict, we propose Environment-Aware Search Planning (EASP), reformulating search planning as a dynamic reasoning process grounded in environmental reality. EASP introduces a Probe-then-Plan mechanism: a lightweight Retrieval Probe exposes the retrieval snapshot, enabling the Planner to diagnose execution gaps and generate grounded search plans. The methodology comprises three stages: (1) Offline Data Synthesis: A Teacher Agent synthesizes diverse, execution-validated plans by diagnosing the probed environment. (2) Planner Training and Alignment: The Planner is initialized via Supervised Fine-Tuning (SFT) to internalize diagnostic capabilities, then aligned with business outcomes (conversion rate) via Reinforcement Learning (RL). (3) Adaptive Online Serving: A complexity-aware routing mechanism selectively activates planning for complex queries, ensuring optimal resource allocation. Extensive offline evaluations and online A/B testing on this http URL demonstrate that EASP significantly improves relevant recall and achieves substantial lifts in UCVR and GMV. EASP has been successfully deployed in this http URL's AI-Search system.
Tags
Links
- Source: https://arxiv.org/abs/2603.15262v1
- Canonical: https://arxiv.org/abs/2603.15262v1
Trouble viewing inline? Open PDF directly â
Full Text
24,957 characters extracted from source content.
Expand or collapse full text
Probe-then-Plan: Environment-Aware Planning for Industrial E-commerce Search Mengxiang Chen chenmengxiang9@jd.com JD.comBeijingChina , Zhouwei Zhai 1234-5678-9012 zhaizhouwei1@jd.com JD.comBeijingChina and Jin Li lijin.257@jd.com JD.comBeijingChina (2018) Abstract. Modern e-commerce search is evolving from simple keyword matching to resolving complex user intents. While large language models (LLMs) offer powerful reasoning capabilities, existing LLM-based search paradigms suffer from a fundamental blindness-latency dilemma: query rewriting methods are agnostic to retrieval tool capabilities and real-time inventory states, resulting in invalid plans; conversely, deep search agent approaches initially plan without environment awareness, then rely on iterative tool calls and reflection to perceive and correct failures, leading to seconds of latency, incompatible with the sub-second budget for the planning module in industrial e-commerce search. To resolve this conflict, we propose Environment-Aware Search Planning (EASP), a novel paradigm that reformulates search planning as a dynamic reasoning process grounded in environmental reality. EASP introduces a Probe-then-Plan mechanism: a lightweight Retrieval Probe first exposes the retrieval snapshot, enabling the Planner to diagnose execution gaps and generate grounded search plans. Our methodology unfolds in three stages: (1) Offline Data Synthesis: The Teacher Agent synthesizes diverse, execution-validated plans by diagnosing the retrieval environment exposed by the Retrieval Probe. (2) Planner Training and Alignment: The Planner is initialized via supervised fine-tuning (SFT) on the offline dataset to internalize the Teacherâs diagnostic capabilities, followed by alignment with business outcomes (conversion rate) through reinforcement learning. (3) Adaptive Online Serving: A complexity-aware routing mechanism selectively activates the planning pipeline only for complex queries, ensuring optimal resource allocation. Extensive offline evaluations and online A/B testing on JD.com demonstrate that EASP significantly improves relevant recall and achieves substantial lifts in UCVR and GMV. EASP has been successfully deployed in JD.comâs AI-Search system. E-commerce Search, Search Planning, Large Language Models â copyright: acmlicensedâ journalyear: 2018â doi: X.Xâ conference: Make sure to enter the correct conference title from your rights confirmation email; June 03â05, 2018; Woodstock, NYâ isbn: 978-1-4503-X-X/2018/06â ccs: Computing methodologies Natural language processingâ ccs: Applied computing Online shoppingâ ccs: Information systems Information retrieval Figure 1. The training and serving workflow of EASP 1. Introduction Modern e-commerce search is evolving from fulfilling explicit queries to resolving complex exploration scenarios with implicit constraints (e.g., âbottoms match green shirtsâ, âall-day comfort heels for the officeâ). Traditional term matching(Robertson et al., 2009; Aizawa, 2003; Deerwester et al., 1990) and embedding-based retrieval(Karpukhin et al., 2020; Li et al., 2021; Kekuda et al., 2024; He et al., 2023) often fail to decompose such intents, causing recall deficiencies or semantic drift. While LLMs(Achiam et al., 2023; Touvron et al., 2023; Guo et al., 2025) offer strong reasoning capabilities, existing solutions suffer from a fundamental blindness-latency dilemma: generative rewriting methods(Peng et al., 2024; Dai et al., 2024; Nguyen et al., 2025) operate blindly without perceiving initial query retrieval outcomes, producing redundant or infeasible queries; conversely, ReAct(Yao et al., 2022)-style deep search agents(Jin et al., 2025; Qu et al., 2025; Li et al., 2025; Hu et al., 2025; Team et al., 2025) first generate plans without environment awareness, then depend on iterative tool calls and reflection to perceive and correct failures, which incurs seconds of latency, making them impractical for real-time industrial deployment where planning must complete within hundreds of milliseconds. Distinct from open-domain deep search tasks that necessitate multi-hop reasoning, complex e-commerce queries typically operate within a more bounded semantic space. We observe that a single diagnostic reflection on initial retrieval results is sufficient to formulate an effective search plan for most complex e-commerce queries. Motivated by this observation, we propose Environment-Aware Search Planning (EASP), a paradigm that reformulates query planning as a grounded, single-step reasoning process. EASP introduces a Probe-then-Plan mechanism: a lightweight Retrieval Probe first exposes a snapshot of the retrieval environment, enabling the Planner to diagnose execution gaps (e.g., entity drift, attribute misalignment) and generate grounded search plan in one go. Online A/B testing on JD.com live traffic shows that EASP achieves statistically significant lifts in UCVR (+0.89%, pÂĄ0.05) and GMV (+0.57%, pÂĄ0.05), with end-to-end planner latency under 20ms at p75 (dominated by simple queries that bypass the planning pipeline) and under 700ms at p99 (cost of complex queries that trigger full planning) â well within industrial deployment constraints. Based on these results, EASP has been fully deployed in JD.comâs AI-Search system. In summary, our contributions are threefold: (1) an e-commerce search planning paradigm that grounds single-step planning in retrieval reality via Probe-then-Plan; (2) a training framework that enables a lightweight planner to acquire diagnostic capabilities from a teacher through supervised fine-tuning and align with business objectives via reinforcement learning; (3) a deployable industrial architecture that balances latency and effect through complexity-aware routing. 2. Methodology The overall architecture of our proposed framework is illustrated in Figure 1. 2.1. Problem Formulation We formulate the search planning task as a decision-making process within a dynamic retrieval environment. Let â°E denote the e-commerce search engine environment, which contains the complete product inventory and retrieval logic. Given a user query q, the true state of â°E is partially observable. To initiate the planning process, a Retrieval Probe is called to interact with â°E, yielding an initial observation init=Probeâ(â°,q)O_init=Probe(E,q). This observation serves as a snapshot of the retrieval reality relative to q. The planner functions as an agent policy Ďθ _θ, parameterized by θ, which maps the perceptual context (q,init)(q,O_init) to an optimal search plan P: (1) âźĎθ(â |q,init)P _θ(¡|q,O_init) where =a1,âŚ,aNP=\a_1,âŚ,a_N\ is a sequence of parallel search actions (e.g., rewriting, filtering). The objective is to find a policy ĎâĎ^* that maximizes the expected utility of the final outcome given the environmental constraints: (2) Ďâ=argâĄmaxĎâźĎ(â |q,init)â[ââźâ°â()â[Uâ(â,q)]]Ď^*= _ĎE_P Ď(¡|q,O_init) [E_R (P)[U(R,q)] ] where â°â()E(P) denotes the execution of the plan in the environment â°E to obtain results âR, and Uâ(â )U(¡) is the utility function. Table 1. EASP Diagnosis-Planning Matrix with illustrative examples. State Diagnosis Strategy Transformation Flow (qâPerception in (q,Oiânâiât)q Perception in $(q,O_init)$P) Effective State: High relevance Preservation q: âiPhone 17 Proâ âTop results highly relevant Top results highly relevant P: âiPhone 17 Proâ Recall Failure Gap: Query Noise Sanitization q: âlaptttop wth 32Gâ âTypo & unit â32Gâ unmatched Typo \& unit `32G' unmatched P: âlaptop 32GB RAMâ State: Inventory Void No Refinement q: âbrand X waterâ âValid intent but 0 items found Valid intent but 0 items found P: HALT Precision Failure Bias: Entity drift Concretization q: âbottoms match green shirtâ âResults dominated by âshirtsâ Results dominated by `shirts' P: âkhakis â, âjeansâ Bias: Granularity mismatch q: âcampingâ âResults cluttered w/ accessories Results cluttered w/ accessories P: âtentâ, âsleeping bagâ Gap: Attribute misalignment q: âhigh shrimp snackâ âItems show shrimp ratio: 10%, 60% Items show shrimp ratio: 10\%, 60\% P: â60% ratio shrimp snackâ Gap: Scenario misalignment q: âbird watching cameraâ âMixed telephoto and wide-angle results Mixed telephoto and wide-angle results P: âtelephoto cameraâ Note: Bias issues stem from retriever limitations; Gap issues stem from user-catalog vocabulary mismatch. 2.2. Stage 1: Offline Data Synthesis via Teacher Agent The Teacher Agent, based on a SOTA LLM, takes the original query q and its retrieval snapshot initO_init from the Retrieval Probe, then analyzes the environment to diagnose retrieval failures and determine whether and how the query should be refined. Retrieval Probe. Built upon the online search system, this module retains only core retrieval and relevance-matching capabilities, omitting computationally expensive components optimized for conversion. In our JD.com implementation, this design reduces tp99 latency by approximately 75%, yet the retrieved items sufficiently reflect the underlying item distribution and expose the systemâs retrieval boundaries for diagnostic purposes. 2.2.1. Perceptual Diagnosis The Teacher assesses the retrieval state by analyzing initO_init in conjunction with q, categorizing it into one of three mutually exclusive states: ⢠Effective State: initO_init exhibits high relevance with sufficient coverage; no refinement is needed. ⢠Recall Failure: initO_init contains few or zero results. The agent distinguishes two subcases: â Query Noise: The query contains elements that obstruct matching, including conversational fillers, marketing fluff, or lexical errors. â Inventory Void: The query expresses a valid intent, but no matching items exist in the catalog. ⢠Precision Failure: initO_init returns abundant results but with low precision. The agent further diagnoses the root cause along two dimensions: â Bias Perception (Systematic Errors): Problems arising from the retrieverâs inherent limitations, including entity drift (misinterpreting the head entity), granularity mismatch (retrieving peripheral items instead of core categories), and negation failures. â Gap Perception (Semantic Misalignment): Problems arising from the mismatch between user language and catalog vocabulary, including attribute misalignment (vague descriptors vs. concrete specifications) and scenario misalignment (usage scenarios vs. technical product attributes). 2.2.2. Adaptive Planning Guided by this diagnosis, Teacher Agent selects an optimized execution path (detailed in Table 1): ⢠Path A: Preservation (Effective State). When retrieval is already effective, the agent preserves the original query to avoid over-optimization. ⢠Path B: Sanitization (Recall Failure). For recall failures caused by query noise, the agent performs query sanitizationâremoving non-informative elements and correcting lexical errors while preserving core intent. If an inventory void is detected, refinement is halted. ⢠Path C: Concretization (Precision Failure). For precision failures, the agent performs intent concretization, leveraging the LLMâs reasoning and world knowledge to transform vague or misaligned queries into precise, retrievable forms: â For bias issues: re-anchoring drifted entities, focusing on core categories, or handling negated constraints. â For gap issues: mapping vague attributes to concrete specifications or translating usage scenarios to technical product attributes. Diversity & Validation. To ensure the student planner learns a diverse policy space, we employ stochastic decoding during Teacher plan generation. For each (q,init)(q,O_init), we sample multiple trajectories with temperature Ď>0Ď>0, capturing the natural variability in valid reformulation strategies. All sampled plans are validated against the retrieval environment; only those yielding successful outcomes are retained. This yields a diverse set sftD_sft of execution-validated triples (q,init,)(q,O_init,P), exposing the Student to multiple viable behaviors for the same perceptual state. 2.3. Stage 2: Planner Training and Business Alignment 2.3.1. Policy Initialization via Supervised Fine-Tuning The Planner, based on a lightweight LLM, is fine-tuned on Teacherâs diverse plan dataset sftD_sft using standard next-token prediction. This enables the model to internalize diagnostic reasoning patterns from offline demonstrations. 2.3.2. Business Value Alignment via Reinforcement Learning We employ Group Relative Policy Optimization (GRPO)(Shao et al., 2024) to align the Planner with business outcomes. For a given input context, the Planner samples G plans P1,âŚ,PG\P_1,âŚ,P_G\. To compute the reward, each plan PiP_i is executed against the online search engine to retrieve the Top-K items, denoted as the set Pi=d1,âŚ,dKD_P_i=\d_1,âŚ,d_K\. The reward Râ(Pi)R(P_i) is defined as the average predicted conversion of these retrieved items, calculated using online production models: (3) Râ(Pi)=1KââdjâPiâ(Ďrelâ(q,dj)âĽĎ)âHard Relevance Gateâ Ďcvrâ(q,dj)âPredicted CVRR(P_i)= 1K _d_j _P_i I( _rel(q,d_j)âĽĎ)_Hard Relevance Gate¡ _cvr(q,d_j)_Predicted CVR Where: ⢠Ďrel _rel and Ďcvr _cvr are the existing Online Relevance and Conversion Prediction models, respectively. ⢠â(â )I(¡) is a binary indicator function acting as a Hard Relevance Gate. If the raw relevance score is below the threshold Ď, the itemâs contribution is zeroed out (Reward=0). This strictly penalizes the planner for retrieving high-priced but irrelevant items, ensuring that conversion is grounded in semantic accuracy. 2.4. Stage 3: Adaptive Online Serving via Dynamic Query Routing Instead of uniformly processing all requests, we introduce a Complexity-Aware Router (an even smaller language model compared with Planner) to selectively activate the EASP pipeline: ⢠Fast Path: Queries targeting specific products (e.g., âiPhone 17â) bypass the planner entirely. This ensures nearly zero additional latency for the majority (âź 80%) of traffic. ⢠Complex Path: Only complex queries trigger EASP. 3. Experiments 3.1. Experimental Setup Dataset Construction. We constructed our datasets from JD online search logs using a difficulty-aware strategy: (1) SFT Dataset: Real-world traffic is heavy-tailed (80% simple, 20% complex). We up-sampled complex queries and down-sampled simple queries (keeping 10% for regularization) to build a 100k query sample corpus and instructed the Teacher Agent to generate initial SFT dataset. (2) GRPO Subset: For the computationally expensive RL alignment, we selected top 5k queries targeting high-frequency queries with high reward standard deviations. Implementation Details. The Teacher Agent uses DeepSeek-R1(Guo et al., 2025), and the Planner uses Qwen3-4B(Yang et al., 2025). The query complexity router uses Qwen3-0.6B(Yang et al., 2025). SFT was performed for 2 epochs. GRPO used a group size of G=8G=8 on 8 NVIDIA H800 GPUs. 3.2. Offline Evaluation Test Set. We constructed a test set of 10k complex queries sampled from historical logs. Metrics. ⢠REL@30: Number of relevant items in Top-30 candidates. ⢠HR@30: Hitrate@30, which measures whether the finally purchased item appears in the top-30 retrieved candidates. To evaluate intent fulfillment, the ground truth includes purchases made through cross-channel interactions (e.g., recommendation feeds) or subsequent query reformulations within the same session, while maintaining the same underlying intent (same core product and brand). Baselines. We compare EASP against 3 baselines: ⢠Blind Rewriter: An industry standard rewriter (Peng et al., 2024; Dai et al., 2024) using the same backbone (Qwen3-4B) and training (SFT+GRPO) as EASP, but conditioned solely on query q without the retrieval snapshot initO_init, to ablate the environment-aware component. ⢠w/o RL: The same Qwen3-4B student trained on SFT dataset only. This isolates the impact of GRPO alignment. ⢠ReAct Agent: A standard multi-turn agent (based on DeepSeek-R1) with online tool access, representing the upper bound of reasoning, but with unacceptable latency in real online platform. Result Analysis. As shown in Table 2, EASP achieves the optimal balance between performance and efficiency, outperforming baselines across key metrics while maintaining millisecond latency: Value of Environment Awareness. Comparing EASP with the Blind Rewriter isolates the contribution of the Retrieval Probe. Removing probe access degrades all metrics: REL@30 drops from 23.3 to 20.7, HR@30 drops from 31% to 28.6%. These results validate that environment-aware planning is critical for retrieval effectiveness. Value of Business Alignment. The w/o RL ablation achieves comparable REL@30 (23.0 vs. 23.3) to EASP, yet its HR@30 lags (29.5% vs 31.0%).This gap confirms that explicit alignment with conversion objectives via GRPO is essential for bridging relevance and business value. Comparison with ReAct. While ReAct achieves the highest REL@30 (24.1), its gain over EASP is marginal (+0.8 p). More importantly, ReActâs lower HR@30 (30.2% vs. 31.0%) reveals that general semantic relevance does not fully capture JD-specific conversion efficiencyâa gap EASP bridges through business-aligned optimization. Crucially, ReAct incurs multi-second latency, whereas EASP maintains millisecond-level efficiencyâthe only solution delivering both high accuracy and real-time performance. Table 2. Offline Evaluation Result Method REL@30 HR@30 (%) Latency Blind Rewriter 20.7 28.6 low (ms level) w/o RL 23.0 29.5 low (ms level) ReAct Agent 24.1 30.2 high (s level) EASP(ours) 23.3 31.0 low (ms level) 3.3. Online A/B Testing We conducted a two-week online A/B experiment on JD.comâs AI-Search portal, exposing EASP to 10% of live traffic. Compared to the production baseline (a Qwen3-4B planner trained with SFT and RL, but without environment probing), EASP achieved statistically significant gains. On overall traffic (intent-to-treat), EASP lifted UCVR by 0.89% (p ÂĄ 0.05) and GMV by 0.57% (p ÂĄ 0.05). Among requests that actually triggered the new model (the complex path), UCVR increased by 4.10% and GMV by 2.59%. Regarding latency impact, the end-to-end planner latency reaches 20ms at p75 for fast-path traffic and stays under 700ms at p99 for complex queries, well within acceptable bounds given the conversion and revenue gains Based on these results, EASP has been fully deployed in JD.comâs AI-Search system. 4. Conclusion and Future Work We propose EASP to resolve the âBlindness-Latencyâ dilemma in e-commerce search. The âProbe-then-Planâ mechanism grounds LLM reasoning in real-time retrieval snapshots, with GRPO alignment optimizing conversion and complexity-aware routing enabling efficient deployment. Online A/B testing on JD.com confirms significant UCVR and GMV lifts, demonstrating industrial viability. Future work will extend EASP to incorporate user behavioral signals for personalized planning, adapting strategies based on individual preferences and interaction history. Presenter Biography Mengxiang Chen is a Senior Algorithm Engineer at JD.com, where he leads the development of agentic search systems and domain-specific LLMs for e-commerce. He holds a Masterâs degree from Shanghai Jiao Tong University. His research interests include LLM post-training, alignment, and intelligent information retrieval. References J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat, et al. (2023) GPT-4 technical report. arXiv preprint arXiv:2303.08774. Cited by: §1. A. Aizawa (2003) An information-theoretic perspective of tfâidf measures. Information Processing & Management 39 (1), p. 45â65. Cited by: §1. A. Dai, Z. Zhu, H. Hu, G. Tang, L. Liu, and S. Xu (2024) Enhancing e-commerce query rewriting: a large language model approach with domain-specific pre-training and reinforcement learning. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, p. 4439â4445. Cited by: §1, 1st item. S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman (1990) Indexing by latent semantic analysis. Journal of the American society for information science 41 (6), p. 391â407. Cited by: §1. D. Guo, D. Yang, H. Zhang, J. Song, R. Zhang, R. Xu, Q. Zhu, S. Ma, P. Wang, X. Bi, et al. (2025) Deepseek-r1: incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948. Cited by: §1, §3.1. Y. He, Y. Tian, M. M. Wang, F. Chen, L. Yu, M. Tang, C. Chen, N. Zhang, B. Kuang, and A. T. Prakash (2023) Que2Engage: embedding-based retrieval for relevant and engaging products at facebook marketplace. Companion Proceedings of the ACM Web Conference 2023. External Links: Link Cited by: §1. C. Hu, H. Du, H. Wang, L. Lin, M. Chen, P. Liu, R. Miao, T. Yue, W. You, W. Ji, et al. (2025) Step-deepresearch technical report. arXiv preprint arXiv:2512.20491. Cited by: §1. B. Jin, H. Zeng, Z. Yue, J. Yoon, S. Arik, D. Wang, H. Zamani, and J. Han (2025) Search-r1: training llms to reason and leverage search engines with reinforcement learning. arXiv preprint arXiv:2503.09516. Cited by: §1. V. Karpukhin, B. Oguz, S. Min, P. S. Lewis, L. Wu, S. Edunov, D. Chen, and W. Yih (2020) Dense passage retrieval for open-domain question answering.. In EMNLP (1), p. 6769â6781. Cited by: §1. A. Kekuda, Y. Zhang, and A. Udayashankar (2024) Embedding based retrieval for long tail search queries in ecommerce. Proceedings of the 18th ACM Conference on Recommender Systems. Cited by: §1. K. Li, Z. Zhang, H. Yin, L. Zhang, L. Ou, J. Wu, W. Yin, B. Li, Z. Tao, X. Wang, et al. (2025) WebSailor: navigating super-human reasoning for web agent. arXiv preprint arXiv:2507.02592. Cited by: §1. S. Li, F. Lv, T. Jin, G. Lin, K. Yang, X. Zeng, X. Wu, and Q. Ma (2021) Embedding-based product retrieval in taobao search. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. Cited by: §1. D. A. Nguyen, R. K. Mohan, S. Yang, P. S. Akash, and K. C. Chang (2025) Minielm: a lightweight and adaptive query rewriting framework for e-commerce search optimization. In Findings of the Association for Computational Linguistics: ACL 2025, p. 6952â6964. Cited by: §1. W. Peng, G. Li, Y. Jiang, Z. Wang, D. Ou, X. Zeng, D. Xu, T. Xu, and E. Chen (2024) Large language model based long-tail query rewriting in taobao search. In Companion Proceedings of the ACM Web Conference 2024, p. 20â28. Cited by: §1, 1st item. C. Qu, S. Dai, X. Wei, H. Cai, S. Wang, D. Yin, J. Xu, and J. Wen (2025) Tool learning with large language models: a survey. Frontiers of Computer Science 19 (8), p. 198343. Cited by: §1. S. Robertson, H. Zaragoza, et al. (2009) The probabilistic relevance framework: bm25 and beyond. Foundations and TrendsÂŽ in Information Retrieval 3 (4), p. 333â389. Cited by: §1. Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu, et al. (2024) Deepseekmath: pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300. Cited by: §2.3.2. T. D. Team, B. Li, B. Zhang, D. Zhang, F. Huang, G. Li, G. Chen, H. Yin, J. Wu, J. Zhou, et al. (2025) Tongyi deepresearch technical report. arXiv preprint arXiv:2510.24701. Cited by: §1. H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale, et al. (2023) Llama 2: open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288. Cited by: §1. A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. (2025) Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §3.1. S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. R. Narasimhan, and Y. Cao (2022) React: synergizing reasoning and acting in language models. In The eleventh international conference on learning representations, Cited by: §1.