Paper deep dive
HyWe: Unifying Search and Operation for Real-World Hybrid Web Tasks
Zijian Cai, Haowei Liu, Kailai Chen, Lin Peng, Cong Wan, Ziqi Zhang, Chunfeng Yuan, Bing Li, Weiming Hu, Haiyang Xu
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Real-world hybrid web tasks need both information gathering and page interaction, yet search-based and operation-based agents are developed and evaluated separately. To bridge this gap, we introduce HyWe, a framework that unifies both capabilities within one model and trajectory. Its two modes use dedicated prompts and tool sets to sustain sub-goal execution; explicit switching selects the needed capability, and shared history lets each mode build on the other's findings. To provide demonstrations of these behaviors, we develop HyWeCollector, a fully automatic pipeline that uses task prototypes, four switching patterns, and multi-agent synthesis to produce verified hybrid trajectories. We train HyWe-35B on these demonstrations to unify efficient information gathering and browser interaction in a single 35B web agent. To evaluate hybrid task completion, we introduce HyWeBench: 100 human-written tasks on websites distinct from training, with human-written sub-goal checklists and an outcome-based evaluation pipeline. Hybrid training enables HyWe-35B to achieve 47.0% success on this benchmark, improving on the untrained base model by 19.0 percentage points and outperforming existing search-based and operation-based agents. Even before training, the same base model solves 28.0% of tasks with HyWe, versus 11.0% with all tools under one prompt. Beyond hybrid tasks, HyWe-35B achieves 59.0% and 88.3% success on Online-Mind2Web and WebVoyager, outperforming existing open-source baselines and cutting action cost per successful task by 48.3% and 51.9% compared with Fara-7B.
Tags
Links
- Source: https://arxiv.org/abs/2610.16319v1
- Canonical: https://arxiv.org/abs/2610.16319v1
Trouble viewing inline? Open PDF directly â
Full Text
123,958 characters extracted from source content.
Expand or collapse full text
Preprint HYWE: UNIFYING SEARCH AND OPERATION FOR REAL-WORLD HYBRID WEB TASKS Zijian Cai 1,2,3,â , Haowei Liu 4,â , Kailai Chen 5 , Lin Peng 6 , Cong Wan 6 , Ziqi Zhang 1,2 , Chunfeng Yuan 1,2,3,â , Bing Li 1,2,3,7 , Weiming Hu 1,2,3,8 , Haiyang Xu 4 1 Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information, CASIA 2 State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA 3 School of Artificial Intelligence, University of Chinese Academy of Sciences 4 Alibaba Group 5 Northwestern University 6 Xiâan Jiaotong University 7 PeopleAI Inc. 8 ShanghaiTech University caizijian2024@ia.ac.cn cfyuan@nlpr.ia.ac.cn â Equal contribution. â Corresponding author. ABSTRACT Real-world hybrid web tasks need both information gathering and page interac- tion, yet search-based and operation-based agents are developed and evaluated separately. To bridge this gap, we introduce HYWE, a framework that unifies both capabilities within one model and trajectory. Its two modes use dedicated prompts and tool sets to sustain sub-goal execution; explicit switching selects the needed capability, and shared history lets each mode build on the otherâs findings. To pro- vide demonstrations of these behaviors, we develop HYWECOLLECTOR, a fully automatic pipeline that uses task prototypes, four switching patterns, and multi- agent synthesis to produce verified hybrid trajectories. We train HYWE-35B on these demonstrations to unify efficient information gathering and browser interac- tion in a single 35B web agent. To evaluate hybrid task completion, we introduce HYWEBENCH: 100 human-written tasks on websites distinct from training, with human-written sub-goal checklists and an outcome-based evaluation pipeline. Hy- brid training enables HYWE-35B to achieve 47.0% success on this benchmark, improving on the untrained base model by 19.0 percentage points and outper- forming existing search-based and operation-based agents. Even before training, the same base model solves 28.0% of tasks with HYWE, versus 11.0% with all tools under one prompt. Beyond hybrid tasks, HYWE-35B achieves 59.0% and 88.3% success on Online-Mind2Web and WebVoyager, outperforming existing open-source baselines and cutting action cost per successful task by 48.3% and 51.9% compared with Fara-7B. 1INTRODUCTION LLM agents have made substantial progress on web tasks, with approaches broadly falling into two groups. (i) Search agents use search and page-reading APIs to gather information efficiently across websites (OpenAI, 2025; Tongyi DeepResearch Team, 2025). (i) Operation agents observe HTML or screenshots and interact with browsers through clicking and typing (He et al., 2024; Qin et al., 2025). In practice, however, many real-world web tasks are hybrid, and both types of agents struggle to solve them. Figure 1 illustrates a task that requires both finding the Bible verse begin- ning âBlessed are the poor in spiritâ and playing its American Sign Language video on Deaf Bible. Search agents quickly find the verse but cannot play the video because their tools lack page interac- tion; operation agents face long browser navigation to locate it. Existing benchmarks also separate these task types: BrowseComp (Wei et al., 2025) and DeepSearchQA (Gupta et al., 2026a) focus on cross-website information gathering, while Online-Mind2Web (Xue et al., 2025) and WebVoyager (He et al., 2024) typically focus on operations within one website, leaving hybrid task completion insufficiently evaluated. To quantify the limitations of existing search and operation agents, we sample real-world tasks from InSTA (Trabucco et al., 2025) and probe capability and efficiency. For capability, the search agent 1 arXiv:2610.16319v1 [cs.AI] 12 Oct 2026 Preprint Task: Find the book and chapter of the verse âBlessed are the poor in spiritâ (Matthew 5:3), then play its American Sign Language video on the Deaf Bible website. (a) Search-based(b) Operation-based Finds the verse; cannot play the videoGets lost in complex web navigation (c) H Y W E (ours) Search-based mode Operation-based mode SWITCH Fewer steps, successful completion 22 steps â 100 steps â 9 steps â +14+3+27+42 search results 1. 14-16 in Sign Language ... youtube.com 2. Day 283 (Matthew 5-7) youtube.com 3. Matthew 5:41 - #ASL ... Step 1 search(âDeaf Bible Matthew ...â) page text ASLV | Matthew 5:1-12 âBlessed are the poor in spirit: for theirs is the ...â verse foundâ Step 4 visit(â.../ASLV/MAT.5.3â) page text Content is plain text of Bible verses. No iframe, video, or player element found. no video to playâ Step 5 visit(url, goal=âplayerâ) final answer âYou can watch the ASL video for this passage on Deaf Bible at deafbible.com/ASLV/MAT.5.3â video never playedâ Step 22 answer(...) +2+16 Step 1 steps 6â21: searching elsewhere, no playable video Step 22 â search results No results for âsite:deafbible.com ...â 1. Deaf Bible Translation Team ... facebook.com ¡ âBlessed are the poor in spirit ...â page text ASLV | Matthew 5:1-12 3 âBlessed are the poor in spirit ...â no video player in page text SWITCHâ +3 Step 1 search(âsite:deafbible.com Matthew 5:3â)Step 5 visit(â.../ASLV/MAT.5.3â) Step 1 type(âAmerican ...â)Step 16 click( menu)â°Step 20 click(language)Step 48 click(versions)Step 91 type(â/matthew/5â) Step 1 Step 100 step limit â Step 7 goto(â.../ASLV/MAT.5.3â)Step 8 click(741, 485) Step 6 steps 3â100: stuck, no progress toward the video Figure 1: One real-world hybrid task from HYWEBENCH, three agents; key steps are taken from their actual trajectories. (a) A search agent finds the verse but cannot play the video. (b) An operation agent gets lost in complex web navigation and reaches the 100-step limit. (c) HYWE-35B finds the verse with search tools, switches to operation tools, and plays the video in 9 steps. recovers only about 40% of facts obtained through browser interaction (Section 3.2). For efficiency, the search agent solves 29% of the sampled tasks within four steps, compared with 6% for the operation agent (Appendix B). Search agents gather information faster; operation agents use browser actions to achieve required page states or obtain information search cannot provide. To unify these complementary capabilities, we introduce HYWE, a framework for general-purpose web agents that organizes execution around completing sub-goals. An agent should gather enough evidence or complete the required interaction for each sub-goal, while using earlier findings to guide the remaining work. The same model works in a search mode or an operation mode. Mode-specific prompts and isolated tool sets guide evidence gathering, page interaction, and recovery from failed attempts, helping the model focus on the current sub-goal. An explicit SWITCH action makes chang- ing capabilities a deliberate decision: another mode may be needed to finish the current sub-goal or pursue the next one more efficiently. A unified actionâobservation format and shared history carry earlier findings forward so subsequent work builds on existing progress. Together, these designs help the agent complete sub-goals and choose when to change modes. Compared to exposing all tools under one prompt, our framework improves information and operation sub-goal completion from 36.9% and 15.8% to 74.8% and 43.7%, respectively, using the same base model (Section 4.4). To learn how to complete sub-goals and switch between modes, we develop HYWECOLLECTOR, a fully automatic pipeline for collecting high-quality hybrid trajectories on real websites. (i) Task pro- totypes describe reusable sub-goals; (i) four switching patterns capture capability limits, efficiency, and dependencies between sub-goals; and (i) multi-agent trajectory synthesis coordinates task gen- eration, execution, phase control, and review to produce verified examples of hybrid trajectories. We use these examples to train HYWE-35B. As a result, it achieves higher success rates and greater efficiency on operation tasks: 59.0% and 88.3% success on Online-Mind2Web and WebVoyager, using 48.3% and 51.9% fewer actions per successful task than Fara-7B (Awadallah et al., 2025). It also maintains strong deep search capabilities, with 64.0% accuracy on xbench-DeepSearch-2510 (Section 4.5). We introduce HYWEBENCH to evaluate real-world hybrid task completion: 100 high-quality, human-written tasks on websites distinct from those used for training, human-written info/op check- lists, and a corresponding evaluation pipeline. Each task includes at least one op sub-goal; the judge verifies outcomes from execution evidence regardless of the mode used. HYWE-35B achieves 47.0% success, up from 28.0% before training, and outperforms search and operation agents, in- cluding XYZ-Aquila-mini (22.0%) and Fara-7B (13.0%). Its success rate is comparable to Kimi-K3 (46.0%) and Qwen3.8-Max (44.0%), with 1/80 and about 1/69 of their total parameters, respec- tively (Section 4.3). Our contributions are as follows. 2 Preprint (i) HYWE. A framework unifying search and operation capabilities through focused sub-goal exe- cution, explicit mode switching, and shared evidence. (i) HYWECOLLECTOR. A fully automatic pipeline using task prototypes, switching patterns, and multi-agent synthesis to collect high-quality examples of hybrid trajectories. (i) HYWEBENCH.Human-written hybrid tasks and info/op checklists, with an evaluation pipeline. (iv) HYWE-35B. Higher success and efficiency on operation tasks, and substantially better hybrid task performance than existing search and operation agents. 2RELATED WORK Search-based agents and benchmarks. Search-o1 (Li et al., 2025a) and WebThinker (Li et al., 2025b) integrate web search into multi-step reasoning. Search-R1 (Jin et al., 2025) and DeepRe- searcher (Zheng et al., 2025) train search use through reinforcement learning, while WebExplorer (Liu et al., 2025) and Tongyi DeepResearch (Tongyi DeepResearch Team, 2025) scale training with synthetic information-seeking data. These methods focus on finding and reasoning over web infor- mation. HYWE unifies search-based tools with operation-based actions and observations in one tra- jectory, allowing the model to also obtain information produced by page interaction. For example, it can use retrieved requirements to configure a product and read the resulting price. HYWECOLLEC- TOR provides demonstrations of when to choose each mode and how to pass information between them. Benchmarks used to evaluate search-based agents cover several aspects of information gathering. GAIA (Mialon et al., 2023) evaluates tool-assisted reasoning, BrowseComp (Wei et al., 2025) targets hard-to-find facts, and SealQA (Pham et al., 2025) tests reasoning with noisy or conflicting search results. DeepSearchQA (Gupta et al., 2026a) further measures whether agents retrieve complete answer sets. These benchmarks mainly grade final answers against reference answers, which does not establish whether an agent performed the page actions needed for a hybrid task. HYWEBENCH provides human-written tasks on real websites where retrieved information guides page actions, or interaction results guide further search. Its human-written checklists label information-gathering goals as info and operation goals as op, with at least one op sub-goal in every task. Our evaluator checks both the facts obtained and the actions completed. Operation-based agents and benchmarks. SeeAct (Zheng et al., 2024) uses HTML and screen- shots to ground browser actions, while UI-TARS (Qin et al., 2025) learns screenshot-based interac- tion directly. UI-TARS-2 (Wang et al., 2025a) further adds terminal and file-system tools. OpenCUA (Wang et al., 2025b) scales training with human demonstrations, while InSTA (Trabucco et al., 2025) and NNetNav (Murty et al., 2024) generate browser trajectories through website interaction. Our method addresses the cost of gathering information through repeated browser navigation. HYWE lets the model use search-based tools to gather information across websites and operation-based tools for page interaction, with a shared history. A single search can then replace several site visits when the required facts are searchable. HYWECOLLECTOR trains these mode choices through four switching patterns grounded in capability probes. Operation-based benchmarks differ in their environments and evaluation. Mind2Web (Deng et al., 2023) evaluates action prediction against recorded demonstrations, while WebArena (Zhou et al., 2024) checks task completion on self-hosted websites. Online-Mind2Web (Xue et al., 2025) and WebVoyager (He et al., 2024) provide tasks on live websites and use models to judge browser tra- jectories. Hybrid evaluation also needs evidence from search-based tools, which may never appear in browser screenshots. HYWEBENCH tests tasks that require both information gathering and page interaction on real websites. Our evaluator uses text tool observations and screenshots to verify each sub-goal in the human-written checklists. This supports agents with different tool sets and distinguishes completed work from unsupported claims in the final answer. 3METHOD Our method connects sub-goal execution, mode selection, and evidence transfer within one tra- jectory (Figure 2). HYWE includes mode-specific execution, mode switching, and shared context 3 Preprint observation Real websites (InSTA-150k) Product sites Knowledge sites Local services ⢠⢠⢠Capability 1. Task prototypes 36 48 search-base operation-base historical context reputation and reviews deep evidence synthesis product configurator map route mortgage calculator 2. Switching patterns A 1 íŞ â íŽ: switch for efficiency A 2 A 3 A 4 3. Multi-agent synthesis Task synthesizer Controller Reviewer & refiner Use search / browser tools to execute tasks Check progress and gate SWITCH/ ANSWER Verified trajectories Feedback Search-based mode (íŽ) Operation-based mode (íŞ) Role prompt You are a general-purpose agent on the SEARCH-BASED path. Your tools this turn: search, scholar, visit, code_sandbox, SWITCH. - `SWITCH` hands control to the operation-based (browser) path. Use it only when the needed information requires real page interaction (login, form, dynamic content ...). Available tools searchscholarvisit Role prompt You are a general-purpose agent on the OPERATION-BASED path (real browser). You act on the live page: goto, new_tab, click, ... `SWITCH` hands control back to the search-based path. Once a page is open you get its screenshot each turn - ground every action in what is actually visible there. Available tools gotoclicktypescroll observation íŽ action íŞ action Probing íŽ â íŞ: switch when search fails íŽ â íŞ: switch to next íŞ subgoal íŞ â íŽ: switch to next íŽ subgoal ⢠⢠⢠⢠⢠⢠Task Find the well-known free beginner React hooks course on egghead.io, open it, confirm it plays, and report its details. Solution Executor Current Trajectory Raw Hybrid Trajectory search("egghead.io free beginner React hooks course Kent C. Dodds") 1. The Beginner's Guide to React â egghead.io visit(egghead.io/courses/ the-beginner-s-guide- to-react) Free Community Resource 2h 27m ¡ 30 lessons switch() goto(egghead.io/ courses/the-beginner- s-guide-to-react) click(803, 855) <a> "Start Watching"â ⎠click(375, 488) <mux-player>â ANSWER The Beginner's Guide to React Kent C. Dodds ¡ egghead.io self-paced 30 lessons 2h 27m no prerequisites ¡ Free blueprint b = (Ď, w, e, c, d) Ď A3 : S Oâ w egghead.io e a free beginner React hooks course c S_ENTITY_BY_CONSTRAINTS O_COURSE_FILTERâ d easy trajectory completenessâ O-side necessity⥠CoT leak rewrite⢠passâ passâ discard not taken here step 3 <think> ... rewritten ... </think> âThe current rollout objective was to identify the specific free beginner-level React hooks course ... The objective says: 'Continue until this current objective is supported by tool evidence; then request a path switch if another path is needed.' The identification objective is met. âI have now identified the specific free beginner-level React hooks course ... Since the identification step is complete, confirming the course 'plays' likely requires browser interaction. C(b) = (g, δ, m)â gâ íŽ identify the course δ title + URL resolved â s.resultââ g âíŞ open, confirm playback δ playback verified â validators all passâ routeS O matches Ď â phasesalternate, 1 each sitesO phase binds a site depsconsumed value produced N(b)task text hides the plan executor brief sees g ¡ verified results ¡ feedbackâ hiddenC(b) ¡ later goals ¡ policies phase verdicts switch @3δ met, ev 1-2 ââ answer @8δ met, ev 4-7 ââ H Y W E Collector H Y W E Framework Trajectory h t 1 unified actionâobservation interface S segment â becomes shared history after SWITCHO segment (current) SWITCH swap role prompt & tools ¡ new segment 2 3 shared context whole trajectory â model input SWITCH action search(query)textvisit(url)textgoto(url)screenshotclick(x, y)screenshot code_sandbox 1 Instantiate 2 Verify retryâ pass â âx = N(b), C(b) Figure 2: Overview of the HYWE framework. Mode-specific prompts and tools guide sub-goal execution; the SWITCH action lets the model move between search-based and operation-based modes as needed, and shared history carries evidence forward (Section 3.1). The HYWECOLLECTOR data pipeline supplies task prototypes, switching patterns, and website/entity bindings to a multi-agent framework for task synthesis, execution, control, and review (Section 3.2). Colors mark segments: consecutive steps in one mode, separated by mode switches. Prompts and tool calls are abbreviated. (Section 3.1); HYWECOLLECTOR collects demonstrations for this framework (Section 3.2); and supervised fine-tuning produces HYWE-35B (Section 3.3). 3.1HYWE FRAMEWORK To sustain progress on hybrid tasks, HYWE (Figure 2) guides execution within each mode, lets the model switch between search-based and operation-based modes as needed, and carries evidence across modes. Building on ReAct (Yao et al., 2022), one model reasons over observed progress to continue, switch, or answer (Algorithm 1). Formulation. A sub-goal specifies a required fact or page outcome. A segment groups consec- utive steps in one mode; each executed SWITCH ends the current segment and starts the next. A sub-goal can span segments, and a segment can advance several sub-goals. For task x, model Ď Î¸ produces trajectory Ď = (o 0 ,a 1 ,o 1 ,...,a T ), choosing action a t in mode m t â S,O and receiv- ing observation o t : A(m t ) =A m t âŞSWITCH, ANSWER(y),(1) a t âź Ď Î¸ ¡|R(h t ,m t ) , h t = (x, (m i ,a i ,o i ) i<t ).(2) Here A m t contains the active modeâs tools (Appendix I, Table 10), h t is the raw history, and R renders the modelâs context. Mode-specific execution. Each mode exposes its own prompt and tools to focus execution on the current sub-goal. Search-based guidance asks the model to verify facts from source pages and revisit unchecked constraints; operation-based guidance asks it to verify page changes and recover from failed actions. Both prompts require assessing remaining work and checking evidence before answering (Appendix K.1). A common step format (m t ,a t ,o t ) lets the model reason over text search results and browser screenshots within one trajectory. Explicit mode switching. The model can switch when another mode supplies a missing capability or advances a sub-goal more efficiently, including when earlier results enable a dependent sub-goal. It states the reason and calls the argument-free SWITCH action, which changes m t to Ěm t , activates 4 Preprint Algorithm 1 HYWE inference loop Require: task x; initial mode m 1 (start URL if m 1 =O); step budget T max 1: h 1 â (x); s(1)â 1 2: for t = 1,...,T max do 3: c t âR(h t ,m t )⡠render context: Eq. (3) 4:(r t ,a t )âź Ď Î¸ (¡| c t ), a t âA(m t )⡠assess progress; choose one action 5:if a t = ANSWER(y) then return y 6:if a t = SWITCH then 7:o t â hand-off notice; m t+1 â Ěm t ; s(t+1)â t+1 8:else 9:o t â Env m t (a t ); m t+1 â m t ; s(t+1)â s(t) 10:end if 11: h t+1 â h t â (m t ,a t ,o t )⡠append the observed step 12: end for 13: return forced answer⡠only ANSWER is admitted at the budget limit the other prompt and tool set, and starts a new segment without an environment action. At each step, the model decides whether to continue in the current mode, switch modes, or answer. Shared context across modes. Later sub-goals may depend on entities, constraints, or results obtained earlier. To preserve this evidence, steps preceding the current segment are stored in a shared history block H <s(t) , where s(t) starts the current segment. The modelâs context is R(h t ,m t ) = h S m t ; U x,H <s(t) ; (a i ,o i ) tâ1 i=s(t) i .(3) HereS m t is the mode-specific prompt andU holds the task and history. On a switch, completed steps enter the history block with their modes, actions, reasoning, and observations. The next segment thus uses earlier evidence to assess unfinished work and continue from existing progress. Context compression and screenshot handling are detailed in Appendix I.3. 3.2HYWECOLLECTOR TRAJECTORY SYNTHESIS PIPELINE To our knowledge, no open-source work has unified search-based and operation-based trajectories for web tasks. We develop HYWECOLLECTOR (Figure 2) to collect demonstrations for HYWE through three fully automatic stages: abstracting reusable sub-goals, designing switching patterns, and coordinating agents to synthesize tasks and verified trajectories on real websites. Stage 1: task prototypes from capability probing. To identify sub-goals suited to each mode, an operation-based exploration agent visits InSTA websites (Trabucco et al., 2025) and an extractor records facts such as prices and filtered counts. A search-based agent tries to recover them within budget B. For the stable, reliable fact pool F , a judge defines â(f ) = 1 Probe S (f ;B) recovers f , F S =f â F : â(f ) = 1, F O = F \ F S .(4) Of all collected facts, 40% enter F S and 31% enter F O : 18% depend on interaction and 13% reflect probe limits. From F S and F O , we abstract 36 search-based and 48 operation-based task prototypes (Appendix L), such as looking up requirements or configuring a product. Each prototype specifies a sub-goal and typed inputs and outputs for linking it to later sub-goals. Website and entity bindings ground these prototypes during task synthesis. Stage 2: switching pattern design. Our pilot study (Appendix B) shows that search-based agents gather information faster, with low token costs even on failed attempts, while operation-based agents can solve tasks that search-based agents cannot. This motivates two patterns that change capabilities while pursuing the same goal: A 1 , OâS for efficiency, and A 2 , S âO after a bounded search attempt fails. Two further patterns connect dependent sub-goals: A 3 , S âO with search results guiding page interactions, and A 4 , OâS with interaction results guiding further search. Stage 3 instantiates these patterns using the prototypes and site bindings from Stage 1 (Appendix D). Stage 3: multi-agent trajectory synthesis. Four agent roles turn these sub-goals and switching patterns into demonstrations of sustained execution and evidence transfer. 5 Preprint (i) Task synthesizer. It composes prototypes with matching input/output types, binds them to real sites and entities, and builds a task blueprint and private plan: b = (Ď,w,e,c,d), C(b) = (g k ,δ k ,m k ) K k=1 .(5) Here Ď is the switching pattern, w the target sites, e the entity, c the prototype composition, and d the difficulty. Phase k specifies goal g k , condition δ k for ending the phase, and mode m k . The synthe- sizer writes x = N (b) without revealing the plan; validators check site bindings and dependencies (Appendix J.1). (i) Executor. It acts through HYWE using the current goal, verified earlier results, and feedback without plan details; the full plan remains hidden. (i) Controller. It checks δ k against observed progress, approving a switch when the phase condition is met and an answer after all phases finish. For A 2 , the condition is a failed bounded search attempt. Execution and control are expressed as a t âź Ď E ¡| x,g k ,β,Ď(u),Ď <t , v k = ν(δ k ,Ď k ).(6) Here Ď E is the executor, β holds verified earlier results, and Ď(u) removes plan details from con- troller feedback u. The executor observes history Ď <t ; the controller ν evaluates phase evidence Ď k and returns a binary verdict v k . Their outputs are a raw trajectory Ď and a feedback record. (iv) Reviewer & refiner. This role verifies task completion independently of the planned route, using the feedback record to identify steps L containing guidance leakage. Refinement rewrites these steps without changing facts or decisions, followed by acceptance checks: eĎ = Refine(Ď,L),Keep(eĎ ) = Success(x,eĎ )â§ Valid(eĎ,C(b)).(7) Success checks task completion; Valid checks evidence support, required interactions, switching conditions, and residual leakage. In all, we probe facts from 1,110 real websites and construct 35,784 distinct tasks. We run the multi- agent framework on 25,662 of these tasks and retain 3,735 trajectories after review, refinement, and deduplication. Appendix F provides the full pipeline (Algorithm 2) and detailed executorâcontroller interaction (Algorithm 3). 3.3TRAINING Hybrid training samples. We convert the 3,735 trajectories collected by HYWECOLLECTOR into 8,055 multi-turn training samples. We split each trajectory Ď at executed switches and construct one sample per segment using the context rendererR in Eq. (3). At each supervised step t, the model receivesR(h t ,m t ), with earlier segments stored in the history block H <s(t) ; only assistant turns in the current segment are supervised. Thus, each trajectory yields |D(Ď )| = n sw (Ď ) + 1,(8) where D(Ď ) is the set of exported training samples and n sw (Ď ) the number of executed switches. This jointly supervises work within a mode and decisions to SWITCH or ANSWER, conditioned on evidence from earlier segments. Search-based training data. To strengthen search-based capabilities, we supplement the hybrid samples with the 7,000 public search-based trajectories of XYZ Agentic Team (2026), adapting their tool names, observations, and prompts to HYWE. The hybrid trajectories already contain operation- based interactions, so we use no additional operation-based training corpus. Both sources use the inference context format. We fine-tune the language-model parameters of Qwen3.6-35B-A3B (Qwen Team, 2026) with next-token cross-entropy, keeping the vision encoder and projector frozen. Sample processing and training settings are in Appendix G. 4EXPERIMENTS 4.1SETUP Benchmarks. We evaluate operation-based success and efficiency on Online-Mind2Web (Xue et al., 2025) and WebVoyager (He et al., 2024), hybrid task completion on HYWEBENCH, and deep search on HLE (Phan et al., 2025), xbench-DeepSearch-2510 (Chen et al., 2025), and BrowseComp- EN (Wei et al., 2025) (Appendix C). 6 Preprint Table 1: Success and efficiency on Online-Mind2Web and WebVoyager. SR: task success rate (%); Steps/SR: total actions (including failures) per success in our re-runs, using separate success labels from the SR column; Switch: tasks with a mode switch (%). Bold/underline: best/second-best SR and Steps/SR among open-source and HYWE rows. Small values: changes from base (rates in percentage points); green/red/gray: improvement/decline/switch-rate changes. â/â: higher/lower is better; â: unreported. Model / systemSize Online-Mind2WebWebVoyager SRâSteps/SRâSwitchSRâSteps/SRâSwitch FRONTIER LLMS GPT-5.5â74.7â85.1â GPT-5 (SoM)â57.7â90.6â o3 (SoM)â55.4â79.3â Claude-Opus-4.6â88.0â Seed2.1-Proâ59.2â70.6â GLM-5V-Turboâ88.5â Kimi-K2.6â76.8â Qwen3.8-Max2.4T-A95B68.9â77.8â Gemini 2.5 Computer Useâ57.3â OpenAI Operatorâ58.3â87.0â Yutori Navigator (n1)â64.7â OPENSOURCE OPERATION-BASED AGENTS Fara-7B7B34.161.5073.534.90 UI-TARS-1.5-7B7B31.3417.1066.4194.10 GUI-Owl-1.5-8B-Thinking8B48.6207.5078.187.30 GUI-Owl-1.5-32B-Thinking32Bâ82.1 59.50 MolmoWeb-8B8B35.3149.8078.2102.20 HYWE Framework Qwen3.6-35B-A3B (base)35B-A3B51.7 30.937.376.820.820.8 HYWE-35B35B-A3B59.0 +7.331.8+0.993.7 +56.488.3 +11.516.8â4.087.9 +67.1 Baselines. We compare with open-source search-based and operation-based agents and published frontier results. On HYWEBENCH, frontier models also run within HYWE. The Qwen3.6-35B-A3B base model (Qwen Team, 2026) provides training, framework, and mode controls. Baseline details are in Appendix H. 4.2SUCCESS AND EFFICIENCY ON OPERATION-BASED BENCHMARKS Table 1 compares success, efficiency, and switching. Baseline success rates are published results; efficiency is measured on our re-runs (Appendix C.4). Success and efficiency.HYWE-35B leads the evaluated open-source agents with 59.0% and 88.3% success on Online-Mind2Web and WebVoyager. Even before training, the base model in HYWE uses fewer actions per success than every listed operation-based agent: 30.9 and 20.8 Steps/SR, versus at least 61.5 and 34.9. Training raises success by 7.3 and 11.5 points, lowers WebVoyager Steps/SR to 16.8, and keeps Online-Mind2Web efficiency comparable (31.8). Thus, the success gains retain the frameworkâs advantage in execution cost, including actions spent on failed tasks. How switching helps. Search avoids long browser navigation for retrievable facts (A 1 ); switch- ing back completes interaction-dependent goals (A 2 ). All trajectories start in O. On Online- Mind2Web/WebVoyager, training raises switch rates from 37.3%/20.8% to 93.7%/87.9% and mean switches from 0.44/0.23 to 2.01/1.18. Still, 79%/95% of HYWE-35B trajectories switch at most twice: 48%/71% follow O â S and 25%/12% follow O â S â O. These patterns indicate focused use of search and page interaction with limited back-and-forth. 4.3HYBRID CAPABILITY HYWEBENCH. Our benchmark contains 100 high-quality, human-written hybrid tasks on web- sites distinct from training, paired with human-written completion checklists. Items specify infor- 7 Preprint Table 2: Performance on HYWEBENCH. S /O denote search-based/ operation-based modes. Suc- cess: tasks with all checklist items achieved (%); Info. and Op.: achieved information and operation checklist items (%), respectively. Sw.: mean switches per task; %Sw.: tasks with at least one switch (%). Bold/underlined values mark the best/second-best scores;â: higher is better; â: unavailable or inapplicable. SystemSizeMode Successâ Info.â Op.â Sw. %Sw. SEARCH-BASED AGENTS XYZ-Aquila-mini (XYZ Agentic Team, 2026) 35B-A3B S22.071.2 26.7â Agents-A1 (Bai et al., 2026)35B-A3B S13.070.9 23.1â OPERATION-BASED AGENTS GUI-Owl-1.5 (Xu et al., 2026)32B O7.034.3 20.2â Fara-7B (Awadallah et al., 2025)7B O13.037.5 35.2â MolmoWeb (Gupta et al., 2026b)8B O2.011.79.7â UI-TARS-1.5 (Qin et al., 2025)7B O6.024.6 21.1â HYWE Framework Kimi-K3 (zero-shot)2.8TS+O46.083.264.40.5757 Qwen3.8-Max (zero-shot)2.4TS+O44.077.362.30.5954 Qwen3.7-Plus (zero-shot)âS+O33.077.051.80.4442 Qwen3.6-35B-A3B (base)35B-A3BS+O28.074.843.70.4740 HYWE-35B (SFT)35B-A3BS+O47.082.268.82.1099 mation to obtain (info) or interactions and page states to achieve (op); every task includes at least one op item. Task success requires completing all items. Evaluation protocol. An LLM judge verifies each itemâs outcome from text observations and screenshots, regardless of the tools or mode used. All systems share the same tasks, budget, and checklists, keeping evaluation fair across agent types. Checklist statistics and scoring details are in Appendix C.1. Comparison with existing single-mode agents.HYWE-35B achieves 47.0% success, versus 22.0% for XYZ-Aquila-mini and 13.0% for Fara-7B (Table 2), more than doubling the best single- mode result. It also leads the single-mode agents on both information (82.2%) and operation (68.8%) sub-goals, turning progress on both sides into more complete hybrid solutions. Training improves task and operation sub-goal completion by 19.0 and 25.1 points, respectively. Its success rate is comparable to Kimi-K3 (46.0%) and Qwen3.8-Max (44.0%), with 1/80 and about 1/69 of their total parameters, respectively. Why search-based agents receive operation credit. The op labels specify required outcomes, not mandatory tools. Search-based agents receive credit when HTTP requests, parameterized URLs, or retrieved content provide evidence that the required outcome was achieved. 4.4FRAMEWORK AND MODE ABLATIONS Table 3 tests whether mode organization helps hybrid task completion and what each mode con- tributes, using the same base model. Framework ablation. We compare HYWE with naive merging, which exposes search-based and operation-based tools under one prompt (Table 3, panel a). HYWE raises success from 11.0% to 28.0%. Information and operation completion rise from 36.9%/15.8% to 74.8%/43.7%. These results show that our framework based on mode switching is more effective than simply merging the search and operation action spaces. Mode ablation within HYWE. The modes have complementary strengths (panel b): search-based mode completes more information sub-goals, and operation-based mode more operation sub-goals. Before training, using both modes raises success only slightly over operation-based mode alone (28.0% vs. 26.0%). Training with high-quality trajectories from HYWECOLLECTOR raises success to 47.0%, substantially improving the modelâs ability to complete tasks requiring both information gathering and page interaction. 8 Preprint Table 3: Framework and mode ablations on HYWEBENCH (all 100 tasks). Mode: available tools (S search-based,O operation-based). Succ.: tasks with all sub-goals achieved (%); Info./Op.: comple- tion rates of information/operation sub-goals (%). Bold: best base-model scores within each panel; HYWE-35B is a training reference. SystemMode Succ.â Info.â Op.â (a) Framework design Base model, naive mergingS+O11.036.915.8 Base model, HYWES+O28.074.843.7 (b) Modes within HYWE Base modelS7.073.815.8 Base modelO26.057.647.8 Base modelS+O28.074.843.7 HYWE-35B (SFT reference)S+O47.082.268.8 Table 4: Deep search performance (accuracy, %; higher is better). HLE: Humanityâs Last Exam; DS-2510: xbench-DeepSearch-2510; BC-en: BrowseComp-EN. Superscript t marks text-only HLE results; others use the full set; â: unreported. Model / systemSizeHLEâ DS-2510â BC-enâ FRONTIER LLMS GPT-5.6 Solâ58.0â90.4 Claude Fable 5â64.5â88.0 Qwen3.8-Max2.4T56.2â Kimi-K32.8T56.0â91.2 Kimi-K2.61T54.0â83.2 GLM-5.2744B54.7 t â DeepSeek-V4-Pro (Preview)1.6T48.2 t â83.4 OPENSOURCE SEARCH-BASED AGENTS Tongyi DeepResearch30B32.9 t 55.043.4 OpenSeeker-v130Bâ29.5 REDSearcher30B34.3â57.4 MiroThinker-1.7-mini30B36.4 t 57.267.9 FORT-Searcher30Bâ57.272.2 QUEST-35B35B37.2 t â64.6 Agents-A135B47.6 t â75.5 XYZ-Aquila-mini35B51.1 t â78.8 HYWE Framework Qwen3.6-35B-A3B (base)35B-A3B30.549.059.2 HYWE-35B35B-A3B47.864.074.6 Case study. In the reward-chart task (Appendix A.1), HYWE-35B finds the correct builder through search, then switches to browser interaction and completes all seven sub-goals. The base model under the same framework stops after gathering information; this contrast illustrates how training helps turn retrieved evidence into completed page actions. 4.5RETENTION OF DEEP SEARCH CAPABILITIES Alongside higher success on operation-based and hybrid tasks, HYWE-35B substantially improves over the base model on search tasks: from 30.5% to 47.8% on HLE, 49.0% to 64.0% on xbench- DeepSearch-2510, and 59.2% to 74.6% on BrowseComp-EN (Table 4). The agent rarely calls SWITCH, so these evaluations primarily measure deep research in HYWEâs search mode (Ap- pendix C.5). Its 64.0% on xbench-DeepSearch-2510 is the highest among the reported open-source baselines in our comparison. On BrowseComp-EN, HYWE-35B (74.6%) is close to Agents-A1 (75.5%) and above FORT-Searcher (72.2%), showing strong search capability alongside its hybrid gains. 9 Preprint 5CONCLUSION We presented HYWE, HYWECOLLECTOR, and HYWEBENCH to unify search-based and operation-based capabilities, collect hybrid demonstrations, and evaluate real-world hybrid task completion. The central design is to sustain progress on sub-goals within each mode and carry evidence forward when capabilities change. Framework ablations show that this organization im- proves completion over exposing all tools together; hybrid training further strengthens their joint use. The resulting HYWE-35B outperforms the evaluated search-based and operation-based agents on hybrid tasks, achieves higher success and efficiency on operation-based tasks, and preserves deep search capabilities. Our ablations assess the framework as a whole, and the capability probe depends on its search tools and budget. Isolating individual design contributions and improving robustness to changing websites remain open directions. AI USE STATEMENT AI tools assisted with manuscript preparation, language polishing, literature search, LaTeX format- ting, and code debugging. Their use in data synthesis and evaluation is described in Section 3.2 and Appendix C. The authors take full responsibility for the accuracy, originality, and integrity of the final manuscript and research artifacts. ETHICS STATEMENT Our data pipeline and evaluations interact with live, publicly accessible websites. Exploration, prob- ing, and rollouts perform ordinary browsing interactions and do not create accounts, make purchases, submit personal information, or otherwise durably alter site state. We have checked the collected data for personal information; the released data contains no personal information. The fact pool con- tains public facts such as prices, counts, and product attributes. Web agents that can both research and operate websites are dual-use; our release targets research reproducibility, and our operation- based mode training data derives from audited synthetic hybrid trajectories on public sites rather than from interactions with authenticated or private services. REPRODUCIBILITY STATEMENT The inference harnessâmode-specific tool sets, output protocol, and segmented context manage- ment with exact folding watermarksâis specified in Section 3.1, with sampling parameters and seed derivation given in Appendix I.2. The data pipeline, including the switching patterns, natu- ralization validators, dual-blind phase control, audit criteria, and the export invariant, is specified in Section 3.2, and training details in Section 3.3 and Appendix G. Appendix C specifies bench- mark coverage, judge prompts, and scoring; all of our reported results use full benchmark sets. Live websites can change, so identical seeds do not guarantee identical observations. We will release all code and research artifacts, including the framework, collection and evaluation pipelines, task blueprints, training data, fine-tuned checkpoints, and the human-written HYWEBENCH tasks and info/op checklists. REFERENCES Ahmed Awadallah, Yash Lara, Raghav Magazine, Hussein Mozannar, Akshay Nambi, et al. Fara- 7B: An efficient agentic model for computer use. arXiv preprint arXiv:2511.19663, 2025. Lei Bai, Zongsheng Cao, Yang Chen, Zhiyao Cui, Shangheng Du, Yue Fan, Shiyang Feng, Zijie Guo, Haonan He, Liang He, et al. Scaling the horizon, not the parameters: Reaching trillion- parameter performance with a 35B agent. arXiv preprint arXiv:2606.30616, 2026. ByteDance UI-TARS Team. UI-TARS-1.5: Open-source multimodal agent. https://github. com/bytedance/UI-TARS, 2025. Model release, April 2025. Kaiyuan Chen, Yixin Ren, Yang Liu, Xiaobo Hu, Haotong Tian, Tianbao Xie, Fangfu Liu, et al. xbench: Tracking agents productivity scaling with profession-aligned real-world evaluations. arXiv preprint arXiv:2506.13651, 2025. 10 Preprint Zheng Chu, Xiao Wang, Jack Hong, Huiming Fan, Yuqi Huang, Yue Yang, Guohai Xu, Chenxiao Zhao, Cheng Xiang, Shengchao Hu, Dongdong Kuang, Ming Liu, Bing Qin, and Xing Yu. RED- Searcher: A scalable and cost-efficient framework for long-horizon search agents. arXiv preprint arXiv:2602.14234, 2026. Jia Deng, Yimeng Chen, Xiaoqing Xiang, Ziyang Zeng, Shuo Tang, Wayne Xin Zhao, Feng Chang, Chuan Hao, Yuan Wei, Ran Tao, Bryan Dai, and Ji-Rong Wen. FORT-Searcher: Synthesizing shortcut-resistant search tasks for training deep search agents. arXiv preprint arXiv:2606.12087, 2026. Xiang Deng, Yu Gu, Boyuan Zheng, Shijie Chen, Samuel Stevens, Boshi Wang, Huan Sun, and Yu Su. Mind2Web: Towards a generalist agent for the web. In Advances in Neural Information Processing Systems (NeurIPS), 2023. arXiv:2306.06070. Yuwen Du, Rui Ye, Shuo Tang, Xinyu Zhu, Yijun Lu, Yuzhu Cai, and Siheng Chen. OpenSeeker: Democratizing frontier search agents by fully open-sourcing training data.arXiv preprint arXiv:2603.15594, 2026. Nikita Gupta, Riju Chatterjee, Lukas Haas, Connie Tao, Andrew Wang, Chang Liu, Hidekazu Oiwa, Elena Gribovskaya, Jan Ackermann, John Blitzer, Sasha Goldshtein, and Dipanjan Das. DeepSearchQA: Bridging the comprehensiveness gap for deep research agents. arXiv preprint arXiv:2601.20975, 2026a. Tanmay Gupta, Piper Wolters, Zixian Ma, Peter Sushko, Rock Yuren Pang, et al. MolmoWeb: Open visual web agent and open data for the open web. arXiv preprint arXiv:2604.08516, 2026b. Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Yong Dai, Hongming Zhang, Zhenzhong Lan, and Dong Yu. WebVoyager: Building an end-to-end web agent with large multimodal models. In Annual Meeting of the Association for Computational Linguistics (ACL), 2024. arXiv:2401.13919. Bowen Jin, Hansi Zeng, Zhenrui Yue, Jinsung Yoon, Sercan Arik, Dong Wang, Hamed Zamani, and Jiawei Han. Search-R1: Training LLMs to reason and leverage search engines with reinforcement learning. arXiv preprint arXiv:2503.09516, 2025. Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, and Zhicheng Dou. Search-o1: Agentic search-enhanced large reasoning models. arXiv preprint arXiv:2501.05366, 2025a. Xiaoxi Li, Jiajie Jin, Guanting Dong, Hongjin Qian, Yongkang Wu, Ji-Rong Wen, Yutao Zhu, and Zhicheng Dou. WebThinker: Empowering large reasoning models with deep research capability. arXiv preprint arXiv:2504.21776, 2025b. Junteng Liu, Yunji Li, Chi Zhang, Jingyang Li, Aili Chen, Ke Ji, Weiyu Cheng, Zijia Wu, Chengyu Du, Qidi Xu, Jiayuan Song, Zhengmao Zhu, Wenhu Chen, Pengyu Zhao, and Junx- ian He. WebExplorer: Explore and evolve for training long-horizon web agents. arXiv preprint arXiv:2509.06501, 2025. Gr Ě egoire Mialon, Cl Ě ementine Fourrier, Craig Swift, Thomas Wolf, Yann LeCun, and Thomas Scialom. GAIA: A benchmark for general AI assistants. arXiv preprint arXiv:2311.12983, 2023. MiroMind Team. MiroThinker-1.7 & H1: Towards heavy-duty research agents via verification. arXiv preprint arXiv:2603.15726, 2026. Shikhar Murty, Hao Zhu, Dzmitry Bahdanau, and Christopher D Manning. NNetNav: Unsuper- vised learning of browser agents through environment interaction in the wild. arXiv preprint arXiv:2410.02907, 2024. OpenAI.Introducingdeepresearch. https://openai.com/index/ introducing-deep-research/, 2025. Thinh Pham, Nguyen Nguyen, Pratibha Zunjare, Weiyuan Chen, Yu-Min Tseng, and Tu Vu. SealQA: Raising the bar for reasoning in search-augmented language models. arXiv preprint arXiv:2506.01062, 2025. 11 Preprint Long Phan, Alice Gatti, et al. Humanityâs last exam. arXiv preprint arXiv:2501.14249, 2025. Yujia Qin, Yining Ye, Junjie Fang, Haoming Wang, Shihao Liang, et al. UI-TARS: Pioneering automated GUI interaction with native agents. arXiv preprint arXiv:2501.12326, 2025. Qwen Team. Qwen3.6-35B-A3B: Agentic coding power, now open to all, April 2026. URL https://qwen.ai/blog?id=qwen3.6-35b-a3b. Tongyi DeepResearch Team.Tongyi DeepResearch technical report.arXiv preprint arXiv:2510.24701, 2025. Brandon Trabucco, Gunnar Sigurdsson, Robinson Piramuthu, and Ruslan Salakhutdinov. InSTA: Towards internet-scale training for agents. arXiv preprint arXiv:2502.06776, 2025. Haoming Wang, Haoyang Zou, Huatong Song, et al. UI-TARS-2 technical report: Advancing GUI agent with multi-turn reinforcement learning. arXiv preprint arXiv:2509.02544, 2025a. Xinyuan Wang, Bowen Wang, Dunjie Lu, Junlin Yang, Tianbao Xie, et al. OpenCUA: Open founda- tions for computer-use agents. In Advances in Neural Information Processing Systems (NeurIPS), 2025b. arXiv:2508.09123. Jason Wei, Zhiqing Sun, Spencer Papay, Scott McKinney, Jeffrey Han, Isa Fulford, Hyung Won Chung, Alex Tachard Passos, William Fedus, and Amelia Glaese. BrowseComp: A simple yet challenging benchmark for browsing agents. arXiv preprint arXiv:2504.12516, 2025. Jian Xie, Tianhe Lin, Zilu Wang, Yuting Ning, Yuekun Yao, Tianci Xue, Zhehao Zhang, Zhongyang Li, Kai Zhang, Yufan Wu, et al. QUEST: Training frontier deep research agents with fully syn- thetic tasks. arXiv preprint arXiv:2605.24218, 2026. Haiyang Xu, Xi Zhang, Haowei Liu, Junyang Wang, Zhaozai Zhu, Shengjie Zhou, Xuhao Hu, Feiyu Gao, Junjie Cao, et al. Mobile-Agent-v3.5: Multi-platform fundamental GUI agents. arXiv preprint arXiv:2602.16855, 2026. Tianci Xue, Weijian Qi, Tianneng Shi, Chan Hee Song, Boyu Gou, Dawn Song, Huan Sun, and Yu Su. An illusion of progress? assessing the current state of web agents. arXiv preprint arXiv:2504.01382, 2025. XYZ Agentic Team. AI4AI at scale: A full-pipeline system for enhancing LLM agentic capabilities. https://xyz-lab.ai/blogs/ai4ai-at-scale/, 2026. Technical report, July 2026. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. ReAct: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629, 2022. Boyuan Zheng, Boyu Gou, Jihyung Kil, Huan Sun, and Yu Su. GPT-4V(ision) is a general- ist web agent, if grounded. In International Conference on Machine Learning (ICML), 2024. arXiv:2401.01614. Yuxiang Zheng, Dayuan Fu, Xiangkun Hu, Xiaojie Cai, Lyumanshan Ye, Pengrui Lu, and Pengfei Liu. DeepResearcher: Scaling deep research via reinforcement learning in real-world environ- ments. arXiv preprint arXiv:2504.03160, 2025. Shuyan Zhou, Frank F Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig. WebArena: A realis- tic web environment for building autonomous agents. In International Conference on Learning Representations (ICLR), 2024. arXiv:2307.13854. 12 Preprint ACASE STUDIES A.1HYWEBENCH Task: I'd like to create a reward chart for my son Leo using a Pirates theme. The behaviors I want to track are 'Being good' and 'Eating our greens.' Can you figure out how Kiddy Charts categorizes reward charts â like what theme and behavior options are available â and then actually build the chart with those settings and tell me the final step to generate it? search / visitbrowser actionSWITCHcode sandbox ââ final answer 110203036 steps S agent base model, search-based tools only 26 steps â â search results 1. Free Printable Reward Charts for Kids kiddycharts.com/store 2. 190 Reward Charts! ideas pinterest.com 3. Reward chart for 4-year-old ... Step 1 search (âKiddy Charts reward charts ...â) page text (archived copy) â15 different designs, 40 behaviors ...â Themes: Princesses, Pirates, cute, space-themed, math, science Step 17 visit (web.archive.org/...) final answer â15 different designs ... including Princesses, Pirates ... 40â41 pre-set behaviors ...â â describes the builder, never builds Step 26 answer O agent base model, operation- based tools only 36 steps â â Step 21 type(âLeoâ) Step 24 click(128, 669) final answer âOnly 4 themes are available: Fairies, Princess, Racing, and Space ... there is no Pirates theme.â â wrong builder, wrong conclusion Step 36 answer Naive merging base model, both tool sets in one prompt 10 steps â â Step 1 goto(kiddycharts.com) page text Page not found â KiddyCharts âNo Posts Found - We didnât find the posts for that URL.â Step 3 visit (.../printables-and-charts/) final answer âThey offer 15 different design themes including Pirates ... 40 predefined behaviors ...â â the builder is never opened Step 10 answer HyWe-35B ours, S and O modes with SWITCH 26 steps â â SWITCH page text â... different designs ... from Princesses to Pirates ...â â15 different designs, 40 behaviorsâ â build it on this page: SWITCH Step 3 visit(.../reward-me-charts/) Step 16 select_option(..., âPiratesâ) Step 24 click(162, 330) Figure 3: Case study on one HYWEBENCH task with seven sub-goals. Rows 1â3 use the same base model with search-based tools only, operation-based tools only, or both tool sets under one prompt (naive merging); row 4 is HYWE-35B. Each block of a strip is one step, and all strips share one step scale. Dashed lines link key steps to their tool calls (bottom) and results (top). Texts and screenshots are taken from the evaluation runs; quotations are shortened. Figure 3 compares four agents on the task âIâd like to create a reward chart for my son Leo using a Pirates theme . . . build the chart with those settings and tell me the final step to generate itâ. The 13 Preprint first three agents use the same base model, Qwen3.6-35B-A3B, and differ only in their tools and prompt; the fourth is HYWE-35B. Search-based agent. The chart builder is rendered by page scripts, so page reading returns only its description (â15 different designs, 40 behaviorsâ). The agent spends 26 steps on searches, third- party reviews, and archived copies of the page, then answers with a description of the builder. It never configures a chart and achieves 4 of 7 sub-goals. Operation-based agent. Without search-based tools, the agent navigates the siteâs menus and reaches a different builder, Track Me Reward Charts, which offers four themes. After entering the childâs name and trying the theme menu, it concludes that no Pirates theme exists. It achieves 5 of 7 sub-goals in 36 steps. Naive merging. With both tool sets under one prompt, the agent alternates between browser ac- tions and search-based tools five times in ten steps. It opens the site in the browser, reads a missing page through visit, scrolls the browser page, and returns to search. After the first step, it outputs tool calls without any reasoning. It never opens the builder, answers with a description, and achieves 2 of 7 sub-goals. HYWE-35B. Seven search-based steps establish that the Reward Me Charts builder offers a Pi- rates theme and 40 behaviors. The agent then calls SWITCH, stating that the remaining details require interacting with the page, and completes the chart in 17 browser actions: it enters the name, selects the Pirates theme, checks both behaviors, and generates the chart. It achieves all 7 sub-goals in 26 steps. Under the same framework, the base model collects the same information but never calls SWITCH and achieves 3 of 7 sub-goals in 25 steps. This suggests that the gain comes from learning when to switch, not from the tool interface alone. A.2OPERATION BENCHMARKS Figures 4 and 5 show one task from WebVoyager and one from Online-Mind2Web. Both tasks start from a web page. Each figure compares HYWE-35B with GUI-Owl-32B and with the base model under HYWE. A 1 on WebVoyager. The task asks for the Market Data section of BBC News and the company that supplies its data. The BBC discontinued this section in November 2024, so no sequence of page actions can reach it. GUI-Owl-32B clicks the cookie dialog 11 times in its first 14 steps. Its next 41 clicks target the Business tab, but none of them reaches the Business section, and it stops at the 100-step limit. The base model under HYWE browses the News and Business pages for 70 steps and opens a missing markets page. It never calls SWITCH and answers âDow Jonesâ, which no visited page supports. HYWE-35B calls SWITCH at its first step, stating that searching is faster than navigating the site. Its searches find the BBC notice that the feeds were discontinued and a Press Gazette report that the feed was licensed from Morningstar. It answers correctly in 8 steps. A 1 and A 2 on Online-Mind2Web. The task asks to display the chart that compares womenâs un- employment trends in Illinois and Michigan on Americaâs Health Rankings. GUI-Owl-32B scrolls 52 times and opens menus and ranking tables. It reaches the Compare States link only at its 100th step, when the step limit ends the episode. The base model reaches a chart of Illinois against the United States in 16 steps but does not add Michigan. After 41 browser steps, it reports that the site failed to render the chart. HYWE-35B first switches to search (A 1 ) and finds the state comparison page by step 7. Reading that page returns only the default comparison of Illinois with the United States, because page reading cannot operate the state selector. The agent then switches back to the browser (A 2 ), opens the comparison page, selects Michigan, and displays the chart, completing the task in 14 steps. In both tasks, the operation-based baselines spend most of their step budget on navigation. HYWE-35B uses search to locate the target and uses the browser only when the page must be operated. 14 Preprint Task: Find the Market Data section on BBC News and tell me which company the data comes from. WebVoyager, start page bbc.com/news search / visitbrowser actionSWITCHcode sandbox ââ final answer 1255075100 steps GUI-Owl-32B operation-based agent 100 steps â â Step 10 click (âAccept and Continueâ) Step 28 click(âBusinessâ) final answer âTerminated due to step limit. Insufficient information to answer.â â 41 clicks aimed at âBusinessâ Step 100 answer Base model Qwen3.6-35B-A3B in HyWe, with SWITCH 70 steps â â Step 20 goto(bbc.com/news/business) Step 61 goto (.../news/business/markets) final answer âDow Jonesâ â unsupported; never calls SWITCH Step 70 answer HyWe-35B ours 8 steps â â A 1 (O!S) reasoning before SWITCH â... look up which company provides that data rather than navigating the site directly.â A 1 (O!S) for efficiency Step 1 SWITCH page text âThe BBC has discontinued its market data feeds on both the website and red button ...â â the section no longer exists Step 3 visit(bbc.com/news/articles/...) final answer âMorningstarâ: the BBC feed âwas licensed from investment research firm Morningstarâ (Press Gazette) â answered in 8 steps Step 8 answer Figure 4: Case study on a WebVoyager task, showing switching pattern A 1 (OâS for efficiency). The rows compare GUI-Owl-32B, the base model under HYWE, and HYWE-35B. The layout fol- lows Figure 3, and all strips share one step scale. The GUI-Owl-32B screenshots come from its raw rollout. 15 Preprint Task: Display the figure comparing unemployment trends among women in Illinois and Michigan. Online-Mind2Web, start page americashealthrankings.org search / visitbrowser actionSWITCHcode sandbox ââ final answer 1255075100 steps GUI-Owl-32B operation-based agent 100 steps â â Step 48 click(âĂâ) Step 70 click (âExplore Dataâ) final answer âTerminated due to step limit. Insufficient information to answer.â â 52 scrolls; never compares states Step 100 answer Base model Qwen3.6-35B-A3B in HyWe, with SWITCH 41 steps â â Step 15 click(205, 806) Step 16 click(121, 486) final answer âThe website failed to render the specific figure comparing ... Illinois and Michigan.â â Illinois vs. U.S. only; no SWITCH Step 41 answer HyWe-35B ours 14 steps â â A 1 (O!S)A 2 (S!O) reasoning before SWITCH âTo actually display the interactive figure, browser interaction with the dropdowns ... is necessary.â A 2 (S!O) after search falls short Step 9 SWITCH Step 11 type(âMichiganâ) Step 13 scroll(down) Figure 5: Case study on an Online-Mind2Web task, showing switching patterns A 1 and A 2 (SâO after a search attempt falls short). The rows and layout are the same as in Figure 4. 16 Preprint BPILOT STUDY: CAPABILITY AND EFFICIENCY Evidence for A 1 and A 2 . To motivate the two mode-selection patterns, we analyze 100 tasks from InSTA (Trabucco et al., 2025), each run twice under the same harness and budget, once with a search-based agent and once with an operation-based agent (Figure 6). The two agents solve different tasks. The search-based agent solves 60 tasks and the operation-based agent 62, but only 44 are solved by both: 16 are solved only by the search-based agent and 18 only by the operation-based agent (Figure 6a). Stratifying by task requirements reveals different advantages. Retrospective annotation of the orig- inal task descriptions and reference steps identifies 52 information-lookup tasks and 43 interaction- oriented tasks, such as conditional queries, configured quotes, and form submissions. Five uncertain cases remain in the overlap analysis but are omitted from the stratified curves. These labels describe task demands, not mode exclusivity. The search-based agent has an early advantage on information lookup: within four steps, it solves 26/52 tasks (50.0%), compared with 6/52 (11.5%) for the operation-based agent. Final success rates are 82.7% and 67.3%, respectively (Figure 6b). The operation-based agent achieves higher coverage on interaction-oriented tasks, solving 24/43 (55.8%), compared with 15/43 (34.9%) for the search-based agent (Figure 6c). The search-based agent can still solve some of these tasks, so the task category alone does not determine which mode is needed. These observations support two design choices: prefer the search-based mode when it suffices (A 1 ), and fall back to the operation-based mode when the search-based mode fails to obtain the required information (A 2 ). When reachability is uncertain, A 2 permits a bounded search attempt before switching. The pilot motivates these patterns; Section 4.3 evaluates learned switching. S: 60O: 62 164418 Neither: 22 020406080100 0 20 40 60 80 100 Tasks solved (%) S: 82.7% O: 67.3% 4 steps 50% vs. 11.5% 020406080100 S: 34.9% O: 55.8% (a) Success overlap All tasks (n=100) (b) Information lookup n=52 (c) Interaction-oriented n=43 Step budget Search-based (S) Operation-based (O) Figure 6: Pilot study on 100 InSTA tasks with search-based (S) and operation-based (O) runs. (a) Success overlap; circle and intersection areas are proportional to success counts. (b,c) Cu- mulative success rates for information-lookup and interaction-oriented tasks, classified from task descriptions and reference steps. Each denominator includes all tasks in its stratum, including fail- ures. The five uncertain tasks appear only in (a). The curves use matching linear axes and count successful runs completed within the indicated number of steps; they summarize fixed-budget runs, not separate evaluations rerun at each budget. B.1COST AND FAILURE ANALYSIS Paired costs. The pilot contains 100 tasks from 100 domains. Cost ratios are computed within each task and then summarized by their median; they are not ratios of the two modesâ median costs. Steps and token usage are available for all 44 joint successes. Five of these operation-based runs lack wall-clock measurements, so the time comparison uses the remaining 39 pairs without imputation. Two-sided Wilcoxon signed-rank tests on the paired raw costs give p = 0.0089 for steps, p = 5.15Ă 10 â9 for tokens, and p = 1.63Ă 10 â9 for time. The median ratios of operation- based to search-based costs are 1.9, 9.0, and 6.3, respectively. 17 Preprint Tasks solved only by the search-based agent. Of the 16 tasks solved only by the search-based agent, failure annotations for the operation-based agent identify incorrect or incomplete extraction in 7, looping or giving up in 5, widget failures in 2, and page-load failures in 2. Thus 14 failures concern interpreting or interacting with pages rather than loading them. The failed operation-based runs take a median of 25 steps, compared with 10 for their successful search-based counterparts. In 12 of these 16 tasks, the search-based run bypasses on-site navigation through a deep link or a parameterized URL. Tasks solved only by the operation-based agent. Among the 18 tasks solved only by the operation-based agent, failure annotations for the search-based agent identify inaccessible dynamic state in 7, answers sourced only from other sites in 5, incorrect extraction in 4, an incorrect claim of absence in 1, and another failure in 1. The failed search-based run uses a median of 0.22 times the tokens of its successful operation-based counterpart. This measures the overhead of these particular attempts; it does not determine an optimal search budget. Successful operation-based runs are anno- tated as interaction-dependent on 16/18 tasks solved only by the operation-based agent and 26/44 joint successes (two-sided Fisher exact p = 0.0347). Interaction dependence is a trajectory annota- tion: a browser run may use a form even when search can obtain the answer through a direct URL. The pilotâs modes are locked, so these outcomes cannot measure whether the model would choose to switch. Likewise, termination with an answer action alone does not show whether its response acknowledges failure. B.2TASK SELECTION AND ANNOTATION Sample and task requirements. The 100 tasks span 100 domains and form a curated pilot rather than an unfiltered random sample of InSTA. The selection script retains 81 tasks from the first can- didate pool after excluding cases whose operation failure is attributed primarily to anti-bot blocking, then samples 19 tasks from a second pool under the same exclusion rule (seed 20260915). The results therefore describe this filtered sample. For Figure 6b,c, we retrospectively assign task-demand labels using the original task wording and dataset reference steps. This is an AI-assisted annotation, not an independently blinded or human- validated label set. The annotation input records contain no paired outcomes, costs, or rollout-level interaction attributions. Information lookup covers retrieving, comparing, or summarizing existing page content; using a search box or filters merely to locate a named product page does not suffice for an interaction label. Interaction-oriented tasks request conditional query results, filtered catalogue rankings or counts, configured prices, service-generated outputs, or state-changing actions. These categories describe requested outputs and actions; they do not establish that browser operation is necessary. Search may reach a conditional result through a parameterized URL or another permitted route. Five tasks remain uncertain because the reference material does not resolve whether the requested information is directly readable or depends on an interface state: enquiry-form options, bike-station availability, shipment availability for a part, size availability for a boot, and chapter-specific audio languages. They are retained in all aggregate analyses and excluded only from the two stratified panels. No fresh website reachability checks are used to resolve these cases. Table 5 reports all three groups; success counts use every task in each group, including operation-based failures. The task-level annotations retain the original wording, reference steps, source identifiers, and a rationale for each label. Table 5: Pilot results by task requirement. Successes are counts, with success rates in parentheses. Each rate uses all tasks in its row as the denominator, including failed runs. Task demandTasksSearch-based successesOperation-based successes Information lookup5243 (82.7%)35 (67.3%) Interaction-oriented4315 (34.9%)24 (55.8%) Uncertain52 (40.0%)3 (60.0%) All tasks10060 (60.0%)62 (62.0%) 18 Preprint CEVALUATION AND ABLATION DETAILS C.1HYWEBENCH TASKS AND EVALUATION The benchmarkâs 100 tasks and their checklists are written by humans. Each checklist contains 2â11 items (5.6 on average), including 1â6 op items per task. The 556 items comprise 309 info and 247 op sub-goals. Checklists are fixed before evaluation and shared across all systems. Each system runs every task once with a budget of 100 steps. Tasks with a start page begin on that page; the others start without a URL. Kimi-K3 reads the complete execution record, including text tool outputs and browser screenshots with their URLs and page titles. For each item, it reports whether the requested outcome was achieved, the supporting step, and the evidence. Labels describe the requested outcome and do not prescribe tools or modes. External agents retain their native prompts and action spaces; their execution frameworks are described in Appendix C.3. Task success requires every checklist item to be achieved. Information and operation completion rates aggregate achieved items of each type across all 100 tasks. Switching statistics report executed switches per task and the fraction of tasks with at least one switch. Successful-run length averages steps over successful tasks. C.2BASE-MODEL AND FRAMEWORK CONTROLS Base model. Qwen3.6-35B-A3B (Qwen Team, 2026) is the checkpoint from which HYWE-35B is fine-tuned. It has approximately 35B total parameters and 3B active parameters. We evaluate it within HYWE before our training and compare it with HYWE-35B under matched settings to measure the effect of the training procedure in Section 3.3. Framework and mode ablations. Using the same base model, naive merging exposes both tool sets under one prompt without explicit modes or a switch action. The full HYWE configuration adds mode-specific instructions, tool isolation, explicit switching, and shared history. We also evaluate search-based-only and operation-based-only configurations within HYWE, removing SWITCH and its prompt instructions in each single-mode variant. Together, these controls distinguish the effect of organizing tools into modes from the contribution of having access to each tool set (Table 3). The framework-design comparison uses the same base model for both configurations on all 100 tasks. Mode ablations use the same model on all 100 tasks; the HYWE row in panel (a) and theS+O row in panel (b) are the same run. C.3EXECUTION FRAMEWORKS ON HYWEBENCH XYZ-Aquila-mini uses its released AxisAgentic search framework, and Agents-A1 uses the search evaluation implementation in its released repository. Fara-7B runs its official agent and browser en- vironment; GUI-Owl-1.5 uses the Mobile-Agent-v3.5 web evaluation implementation; MolmoWeb- 8B uses its official agent and benchmark runner. For UI-TARS-1.5-7B, we implement the browser execution loop with Playwright, using the released computer-use prompt and action parser. Tra- jectories are converted to a common record format for the HYWEBENCH judge. The base model, HYWE-35B, frontier models, and internal mode ablations use HYWE, with the changes for each ablation described above. C.4OPERATION-BASED EVALUATION PROTOCOL Our agents start in operation-based mode and are evaluated on all 300 Online-Mind2Web tasks and all 643 WebVoyager tasks. We adapt WebJudge (Xue et al., 2025) and the WebVoyager auto- evaluator (He et al., 2024) to include evidence from both modes, retaining o4-mini for WebJudge and GPT-4o for the WebVoyager evaluator. For the open-source operation-based baselines in Table 1, success rates are quoted from the original reports, while step counts are measured on our re-runs judged with Kimi-K3. Published baselines may use different evaluation settings. Steps/SR is the mean action count over all retained task runs, including failures, divided by the success rate of those same runs under Kimi-K3. Actions in both modes and switch calls are counted. This denominator is separate from the published or official- judge SR column. Switch reports the fraction of tasks with at least one executed mode switch. 19 Preprint For example, Fara-7B uses only 12.2 and 10.0 actions on the tasks it solves on Online-Mind2Web and WebVoyager. Counting actions from failed runs as well raises its Steps/SR to 61.5 and 34.9, respectively, about 2.0 and 1.7 times the base modelâs 30.9 and 20.8. Adapting the operation-based benchmark judges to hybrid trajectories. The official judges of Online-Mind2Web (WebJudge) and WebVoyager assess a trajectory from its browser screenshots and final response. A hybrid trajectory also contains steps in the search-based mode whose evidence is textâsearch results, page contents read by visit, code outputsâand a screenshot-only judge cannot see it. We make two changes and keep the official prompts otherwise verbatim. (i) WebJudge. Each text observation is rated against the taskâs key points on the same 1â5 relevance scale and with the same threshold (3) as screenshots; the selected observations enter the final verdict next to the selected screenshots, introduced as page-content evidence with the same status. (i) WebVoyager auto-evaluator. Text observations and screenshots are merged into one chronological timeline, from which the last k = 15 observations are passed to the judge, and one paragraph is added to the system prompt stating that text observations carry the same status as screenshots. Both adapted prompts additionally ask the judge to report, separately from success, whether the site blocked access (CAPTCHA, bot detection, region block); this flag does not enter the success label. C.5SEARCH-BASED EVALUATION PROTOCOL Our agents start in search-based mode. Table 4 reports results for the base model and HYWE- 35B on HLE, xbench-DeepSearch-2510, and BrowseComp-EN, whose full benchmark sets contain 2,500, 100, and 1,266 tasks, respectively. Published baselines in Table 4 retain their reported evaluation settings. HLE results reported as text-only are marked with t ; unmarked HLE scores use the full set. QUEST and REDSearcher use their reported context-management results on BrowseComp-EN. We report xbench-DeepSearch- 2510 scores only when that benchmark version is explicitly identified. Search-based answers are graded against reference answers. Exact matches are accepted directly; other answers receive five Kimi-K3 judge votes at temperature 0.6, with the majority deciding cor- rectness. Each vote uses the prompt in Appendix K.2 and returns a JSON verdict with the extracted final answer and a binary label. C.6SHARED SETTINGS AND BENCHMARK COVERAGE Shared execution settings. The base model and HYWE-35B run in the same HYWE Frame- work with the same tools, prompts, and sampling parameters: a 100-step budget per attempt on operation-based tasks and 300 steps on search-based tasks, reasoning enabled, 8,192 output tokens per call, per-call decorrelated sampling seeds, and the 128K/64K context compression schedule. The SWITCH action remains available unless explicitly disabled for an ablation. The HYWEBENCH comparison uses a 100-step budget for all systems, as detailed in Appendix C.1. Benchmarks. Table 6 lists the full evaluation sets. Online-Mind2Web and WebVoyager measure success and efficiency on operation-based tasks; HYWEBENCH measures hybrid task completion. HLE, xbench-DeepSearch-2510, and BrowseComp-EN assess retention of deep search capabilities. Every system in a controlled comparison is evaluated on the same tasks. Benchmarkn Protocol Online-Mind2Web (Xue et al., 2025)300 adapted WebJudge; o4-mini WebVoyager (He et al., 2024)643 adapted auto-evaluator; GPT-4o HYWEBENCH100 human-written tasks and info/op checklists; at least one op sub-goal per task HLE (Phan et al., 2025)2,500 reference-answer judge xbench-DeepSearch-2510 (Chen et al., 2025)100 full 2510 release; reference-answer judge BrowseComp-EN (Wei et al., 2025)1,266 reference-answer judge Table 6: Benchmark sizes and scoring protocols. n is the full benchmark size. 20 Preprint DSWITCHING PATTERNS AND EXAMPLE TASKS Table 7 summarizes the four patterns and their difficulty profiles; one naturalized task from the design run is shown for each. Difficulty is realized by the number of bound sites and the number of cross-site bridge rounds (a bridge is an S prototype that consumes an O output from one site and produces the input for an O prototype on another). Medium and hard A 3 /A 4 tasks chain phases across sites with one or two bridge rounds, yielding two to five executed switches. Pattern Start Working modes DifficultySwitching motivation A 1 O Sstandard (1 site)The opening decision corrects fromO toS before any browser work: the task is plainly search-answerable. A 2 S S,Ostandard (1 site)A bounded, good-faithS attempt (two materially different exact queries plus one result inspection), then fall back toO once structural insufficiency is established. A 3 S S,Oeasy / medium / hard (1 / 2 / 3 sites) S produces an entity, constraint, identifier, threshold, or shortlist thatO requires. A 4 O O,Seasy / medium / hard (1 / 2 / 3 sites) O surfaces an entity, offer, item, metric, or status that binds the subsequentS question. Table 7: Switching patterns and difficulty levels. S /O denote search-based/operation-based modes. Start is the initial mode; Working modes lists the modes used to perform the task. A 1 (standard). âIâm looking at three stocks for a possible portfolio addition: SoundHound AI (SOUN), BigBear.ai (BBAI), and C3.ai (AI). I want to compare their current market data side by sideâcurrent price, market cap, P/E ratio, 52-week high and low, and average volumeâso I can evaluate which one looks most promising.â The task starts on a finance site, but every requested value is published on indexed pages; the intended decision is to switch toS immediately. A 2 (standard). âI need to check the voting status of Uniswap governance proposals that are still active. Find any proposals whose voting deadline falls on or after August 15, and report the pro- posal title, status, current For and Against vote counts, deadline, and quorum requirement.â Search surfaces proposal titles and discussion threads but not live vote tallies; after a bounded attempt the intended decision is to switch to the governance dashboard. A 3 (medium, two sites). âIâm planning a trip in October and need to get from a small town near Lyon to the nearest major TGV hub. First, find which major TGV station is closest to Vienne, France. Then use Wanderlog to map the driving route from Vienne to that station. After that, look up the transit fare policy from that station to Geneva, and finally use Transit App to check the actual public-transit route and fare.â S resolves the station and the fare policy; eachO phase consumes an S output. A 4 (medium, two sites). âIâm a senior machine-learning engineer looking at both Apple and Airbnb. Find the senior ML engineer opening at Apple that lists PyTorch and TensorFlow as required skills; once you have that role and its job ID, look up how Airbnbâs career site labels the equivalent role family so you can search for the matching opening on Airbnbâs careers page and compare the two listings.â O surfaces the Apple listing;S bridges the role family;O consumes it on the second site. ETRAJECTORY REVIEW AND REFINEMENT The reviewers and refiners in the multi-agent synthesis framework verify and refine the executorâs trajectories. Table 8 lists their checks, inputs, and outputs. Every quotation a judge makes is me- chanically verified against the trajectory; a quotation that cannot be located voids the judgement. 21 Preprint JudgementInputConsumption Unified audit (two stages) rollout, contract, final answer; screenshots forO phases per-phase progress account; leakage steps â rewrite; task-success and route verdicts â filter Leakage rewriteleakage steps and their reasoningreasoning replaced in place under fact/decision/coherence constraints, then re-verified Residue detectioncontrollerâs feedback log (which message reached which step) second rewrite pass; trajectories with pervasive leakage dropped Site fidelity (A 1 )final values, observationsdrop if the answer was not obtained from the named site (judged value by value) Switch rationale (A 1 /A 2 ) rewritten reasoning at the switch step drop if the switch was not triggered by the patternâs intended condition Answer coverageanswer schema, all observationsdrop if a required field is unobtainable; otherwise merge fields obtained in earlier phases (numeric values re-verified against observations) O-segment purity O segments with screenshotsdrop the segment if no browser-only interaction was performed Table 8: Trajectory review checks. 22 Preprint Algorithm 2 HYWECOLLECTOR trajectory synthesis pipeline Require: site set W ; pattern and difficulty ratios; probe budget B; task synthesizer; executor Ď E ; controller ν; reviewers and refiners 1: Stage 1 â task prototypes from capability probing 2: for all sites w â W do 3: F w â Explore(w) ⡠operator drives the browser; extractor records answer-shaped facts 4: end for 5: F â ValueFilter S w F w ⡠keep concrete values; drop scaffolding and duplicates 6: for all facts f â F do 7: â(f )â 1[Probe S (f ;B) recovers f ]⡠Eq. (4); transcript retained 8:label f as search-reachable / intrinsically operation-bound / prober-limited / volatile 9: end for 10: remove unstable or unreliable facts; form F S and F O 11: abstract prototype vocabularies P S ,P O ; retain website and entity bindings 12: Stage 2 â switching pattern design 13: define ÎŚ =A 1 , A 2 , A 3 , A 4 ⡠efficiency, search failure, and information transfer in both directions 14: Stage 3 â multi-agent trajectory synthesis 15: for all blueprints to generate do 16:sample pattern Ď, sites w, entity e, difficulty d; sample composition c over admissible pairs out(p S )â in(p O )⡠Eq. (5); deterministic given the seed 17:build contract C(b) = ((g k ,δ k ,m k )) K k=1 with produce/consume edges⡠Eq. (5) 18:repeat 19:xâ Naturalize(b)⡠question, per-phase goals, switch triggers, answer schema 20:until Validate(x,b) passes or the retry limit is reached 21: end for 22: for all tasks (x,C(b)) do 23: Ď â COORDINATEDEXECUTION(x,C(b))⡠Algorithm 3 24:if Ď did not end in ANSWER then continue 25:(progress,L, verdicts)â Audit(Ď,C(b)) ⡠two stages; every quotation verified verbatim 26:if task not successful then discard Ď 27:for all leakage steps iâ L do 28:r i â Rewrite(r i ); re-verify⡠facts and decision unchanged 29:end for 30:detect residual leakage from the controllerâs feedback log; rewrite again or discard if perva- sive 31:drop rejected intermediate ANSWER steps 32:if site fidelity, switch rationale, or answer coverage fails then discard Ď (or merge fields obtained in earlier phases) 33:for allO segments Ď of Ď do 34:if Ď performed no browser-only interaction then drop Ď 35:end for 36: D âD⪠Export(Ď )⡠Eq. (8): n sw + 1 samples 37: end for 38: returnD FPIPELINE ALGORITHMS Algorithm 2 summarizes the synthesis pipeline of Section 3.2 end to end, and Algorithm 3 expands the collaboration between the executor and controller in Stage 3. This stage also includes task synthesis and trajectory review, as shown in Algorithm 2. Data collection models and task validation checks are described in Appendix J. 23 Preprint Algorithm 3 COORDINATEDEXECUTION: collaboration between the executor and controller Require: task x; contract C = ((g k ,δ k ,m k )) K k=1 ; executor Ď E ; controller ν; sanitizer Ď; per-phase action budgets; step budget T max 1: k â 1; mâ m 1 ; β ââ ; uââ ⡠phase, mode, verified bindings, last control-agent message 2: for t = 1,...,T max do 3: a t âź Ď E ¡| x,g k ,β,Ď(u),Ď <t rendered throughR⡠Eq. (6); plan details hidden 4:if a t = ANSWER(y) then 5:if k = K and ν(δ K ,Ď K ) = 1 then return Ď else u â rejection (answer step recorded, later dropped); continue 6:else if a t = SWITCH then 7:if ν(δ k ,Ď k ) = 1 then 8:β â βâŞbindings(Ď k ); pin cited evidence steps against folding; k â k+1; mâ Ěm; open a new segment 9:else 10:uâ rejection; record the step with switch executed=false ⡠no new segment 11:end if 12:else 13:o t â Env m (a t ); append (m,a t ,o t ) 14:if a human-verification gate is detected then terminate 15:if phase budget exhausted, or no progress for three actions, or eight actions since the last check then 16:uâ Ď Î˝âs assessment of (δ k ,Ď k ) ⡠contract vocabulary stripped before it reaches Ď E 17:end if 18:end if 19: end for 20: return Ď⡠terminated by budget 24 Preprint GTRAINING DETAILS Both data sources are rendered into multi-turn SFT samples using the same code paths as inference. System prompts, history blocks, context compression, and screenshot placement follow Section 3.1. Samples that exceed the context budget even after folding are split into two or three parts by greedy bisection rather than dropped, preserving long-horizon supervision. Table 9 gives the training set- tings. SettingValue BackboneQwen3.6-35B-A3B (Qwen Team, 2026) Trainable parameterslanguage model; vision encoder and visual projector frozen Objectivenext-token cross-entropy Sample unitone segment (context rendered by the harness; targets = the segmentâs assistant turns) Context length131,072 tokens (folded to the 64K watermark when building samples) Reasoning tokensretained and supervised Data mixturehybrid samples and 7,000 public search-based trajectories, stored in one shuffled dataset OptimizerAdam; β 1 = 0.9, β 2 = 0.95, Îľ = 10 â8 Learning ratepeak 2Ă 10 â5 ; minimum 2Ă 10 â6 Schedule5% warmup from zero, followed by cosine decay Weight decay0.1 (constant) Gradient clipping1.0 Training epochs1 Effective batch size32 samples per parameter update PrecisionBF16 Packing / padding-free modedisabled / enabled Random / data seed42 / 42 Data shuffling / validation splitenabled / 0 Activation recomputationfull, uniform, one layer per recomputation group Training frameworkMegatron via ms-swift 4.5.0.dev0 Table 9: Training configuration. HBASELINE DETAILS We describe the baselines in Tables 1, 2, 3, and 4. Published benchmark scores serve as external references; our evaluations on HYWEBENCH compare agents on the same tasks and completion checklists. Evaluation protocols and differences in benchmark coverage are given in Appendix C; base-model and framework controls are in Appendix C.2. H.1OPEN-SOURCE OPERATION-BASED AGENTS These agents choose browser actions from visual observations. All four families appear in both the traditional operation-based evaluation and the comparison on HYWEBENCH; the GUI-Owl model size differs between these settings. Fara-7B. Fara-7B (Awadallah et al., 2025) is a 7B computer-use agent that reads screenshots and predicts mouse and keyboard actions. Its FaraGen data pipeline generates tasks on real websites, collects multiple execution attempts, and filters trajectories using several verifiers. It provides a compact operation-based baseline trained on synthetic web interactions. We use the Fara-7B release. UI-TARS-1.5-7B. UI-TARS-1.5 (Qin et al., 2025; ByteDance UI-TARS Team, 2025) integrates visual perception, reasoning, and action prediction in a vision-language model. It reasons before acting and uses reinforcement learning to improve GUI interaction. Actions include coordinate- based clicks, typing, and scrolling. Our baseline is the publicly released 7B model, which tests whether a general GUI agent can solve the web tasks through browser interaction. GUI-Owl-1.5. GUI-Owl-1.5 (Xu et al., 2026) supports browser, desktop, and mobile interaction. Its training combines synthetic interaction data with reinforcement learning across environments, covering visual grounding, planning, and action execution. We include GUI-Owl-1.5-8B-Thinking 25 Preprint on Online-Mind2Web and WebVoyager (Table 1), and the 32B variant on WebVoyager (Table 1) and HYWEBENCH (Table 2). The 32B variant has no published Online-Mind2Web result, so that benchmark is omitted for it in Table 1. MolmoWeb-8B. MolmoWeb (Gupta et al., 2026b) predicts browser actions from task instructions and screenshots. Its MolmoWebMix training data includes synthetic trajectories, human demonstra- tions, and examples of individual web skills and visual grounding. It interacts through the rendered page without requiring HTML or an accessibility tree. We use the 8B model as an open visual web-agent baseline. H.2OPEN-SOURCE SEARCH-BASED AGENTS All eight agents below appear in the deep search comparison (Table 4). We additionally evaluate XYZ-Aquila-mini and Agents-A1 with search-based tools on HYWEBENCH (Table 2). This classi- fication describes their role in our evaluation; some models also support other agentic tasks. Tongyi DeepResearch. Tongyi DeepResearch (Tongyi DeepResearch Team, 2025) is a 30B-class mixture-of-experts research agent with roughly 3B active parameters. It learns long search-and- reading trajectories through agentic mid-training, supervised fine-tuning, and reinforcement learn- ing. Its training uses automatically generated tasks and trajectories, while context management sup- ports extended information gathering. We include the published scores of its standard open-model setting. OpenSeeker-v1. OpenSeeker (Du et al., 2026) builds on Qwen3-30B-A3B-Thinking-2507 and uses supervised fine-tuning on about 11.7K synthetic trajectories. Its task generation links facts across web pages and hides identifying clues to require multi-step search. This provides a search- based baseline trained with an open data pipeline and SFT alone. We report the first release, OpenSeeker-v1. REDSearcher. REDSearcher (Chu et al., 2026) constructs difficult search tasks by controlling how evidence is connected and distributed across sources. It combines mid-training for evidence grounding, planning, and tool use with supervised fine-tuning and reinforcement learning. A simu- lated search environment reduces the cost of training rollouts. We include the published 30B search- agent results. MiroThinker-1.7-mini. MiroThinker-1.7 (MiroMind Team, 2026) targets long research tasks with agentic mid-training focused on planning, reasoning over accumulated context, and tool in- teraction. These objectives help the agent sustain information gathering across many steps. We include the open 30B MiroThinker-1.7-mini model. FORT-Searcher. FORT-Searcher (Deng et al., 2026) focuses on training tasks that cannot be solved through easy shortcuts. Its data pipeline controls entity selection, evidence connections, and question wording, then refines questions to remove alternative routes that bypass the intended search. It trains on the resulting trajectories using supervised fine-tuning alone. Our comparison uses the published 30B model. QUEST-35B. QUEST (Xie et al., 2026) trains deep research agents with fully synthetic tasks. It organizes evaluation criteria into rubric trees to provide rewards for both factual questions and open- ended research, and combines mid-training, supervised fine-tuning, and reinforcement learning. Its tasks cover evidence gathering and report writing. We include the 35B modelâs published search benchmark results. Agents-A1. Agents-A1 (Bai et al., 2026) is a 35B mixture-of-experts model trained for long- horizon tasks across several agentic domains. Its post-training combines broad supervised data with domain-specific expert knowledge and long interaction trajectories. We include its published deep search results and evaluate its search-based configuration on HYWEBENCH, providing a baseline with the same total parameter scale as HYWE-35B. XYZ-Aquila-mini. XYZ-Aquila-mini (XYZ Agentic Team, 2026) builds on Qwen3.6-35B-A3B and targets deep search through improvements to training data and the execution framework. Its pipeline generates tasks from connected web evidence, preserves tool observations in supervised trajectories, and refines context management using verified evaluation feedback. We include its pub- 26 Preprint lished deep search scores and evaluate its search-based configuration on HYWEBENCH. It shares the backbone family of HYWE-35B. H.3FRONTIER LLM SYSTEMS Operation-based references. Table 1 includes published results for GPT-5.5, GPT-5 (SoM), o3 (SoM), Claude-Opus-4.6, Seed2.1-Pro, GLM-5V-Turbo, Kimi-K2.6, and Qwen3.8-Max. These rows represent models paired with the browser interfaces used in their respective evaluations. SoM denotes a set-of-marks interface that labels actionable screen elements. We also include Gemini 2.5 Computer Use, OpenAI Operator, and Yutori Navigator (n1), which are systems designed for com- puter or browser interaction. These results provide frontier references under their reported settings. Deep search references. Table 4 includes GPT-5.6 Sol, Claude Fable 5, Qwen3.8-Max, Kimi-K3, Kimi-K2.6, GLM-5.2, and DeepSeek-V4-Pro (Preview). Their published scores describe perfor- mance with tool-assisted information gathering and reasoning. These rows provide context for the open-source search agents; differences in evaluation sets are retained in the table annotations and described in Appendix C. Frontier models within HYWE. We evaluate Kimi-K3, Qwen3.8-Max, and Qwen3.7-Plus zero- shot within HYWE on HYWEBENCH. Each has access to both search-based and operation-based modes through the framework. This comparison tests how much hybrid task performance can be obtained from frontier models without our hybrid training. These are our evaluations, separate from the published reference rows above. IFRAMEWORK IMPLEMENTATION DETAILS I.1TOOL FUNCTIONS AND SIGNATURES Table 10 lists tool functions and arguments, grouped into search-based tools, operation-based tools, and tools shared by both modes. Search-based APIs return text; browser actions return a screenshot and status after execution. The reason for switch appears in the preceding reasoning. Coordinates use a 0â1000 logical grid over a 1280Ă 720 viewport and are converted to pixels by the runtime. This convention is learned from data and is not described in the prompt. The search and scholar tools use the Serper API. The visit tool uses the Jina API to fetch page content and deepseek-flash-0731 to summarize it according to the extraction goal. I.2RUNTIME PARAMETERS Table 11 lists the runtime parameters shared by the base and fine-tuned rows of Table 1. I.3CONTEXT COMPRESSION Compression is triggered by two watermarks on the token count T (R) of the rendered context (text tokens, image tokens, and chat-template overhead): if T (R) > θ hi then fold until T (R)⤠θ lo , θ hi = 131,072, θ lo = 65,536,(9) where âfoldâ means truncating a stepâs observation to its first c = 600 characters and dropping its reasoning and screenshot. The trigger actually used reserves room for generation, θ eff hi = min(θ hi ,L max ) â (n out + 256), with L max the serving window and n out the maximum output length. Folding proceeds in a fixed order: first the steps already in the history block, oldest first; only when all of them are folded is the segment start s(t) advanced, which moves the oldest steps of the current segment into the history block, entering it already folded. The most recent step is never folded, tool calls are never altered, and steps cited as evidence by the controller during data collection are exempt. The gap between θ hi and θ lo exists for the keyâvalue cache: a fold rewrites the prefix, so folding âjust enoughâ at every step would invalidate the cache at every step, whereas folding down to θ lo once buys a long run of pure appends. Screenshots follow the same ruleâkept for unfolded steps, dropped once a step is foldedâand observations in the search-based mode never carry images. 27 Preprint ToolArgumentsFunction Search-based tools (S) searchquery (string or list)Search the web; return ranked snippets with titles, URLs, sources, and dates. scholarquery (string or list)Search academic sources; return publication details, citation counts, and PDF links. visiturl (string or list), goal, parsetype Extract goal-relevant text from pages or PDFs; defaults to the current URL and does not change browser state. Operation-based tools (O) goto / newtaburlOpen a URL in the current or a new browser tab. go backnoneReturn to the previous page in the current tab. switchtab / closetab indexSelect or close the specified browser tab. click / doubleclick / hover x, yClick, double-click, or hover at the specified coordinates. typetext, submitEnter text, optionally submitting it. presskeykeysPress a key or key combination. select optionx, y, valueSelect a value in a dropdown at the specified coordinates. scrolldirection, x, yScroll at a position, or scroll the page if no position is supplied. dragfromx, fromy, tox, toy, holdms Drag between two positions, optionally holding before release. waittimeWait for the specified duration. Shared tools (S andO) codesandboxcode, language, stdin, runtimeout, compiletimeout, files, fetchfiles Run isolated code for calculation, parsing, and validation. switchnoneChange mode, replace its tool interface, and rebuild context; return a hand-off notice without executing an environment action. Table 10: HYWE tool functions and arguments, grouped by mode. Bold arguments are required; all other arguments are optional. ParameterValue Viewport1280Ă 720 Coordinate grid0â1000 (converted to pixels by the runtime) Step budget T max per attempt (operation-based)100 Max output tokens per turn8,192 Temperature / top-p / top-k1.0 / 0.95 / 20 Repetition penalty1.05 Fold watermarks θ hi /θ lo 131,072 / 65,536 tokens Folded-observation prefix c600 characters Screenshots retained in contextall unfoldedO steps Search results per querytop 10 visit extractiongoal-conditioned summary, up to 32,000 tokens per chunk Format retries per turn5 (fresh seed each) Error/format-failure attemptsup to 2 Attempts ending at the step limitup to 5, restarting with a fresh context Per-call timeouts (agent / summarizer)1,800 s / 1,800 s Seed derivationbase seed + crc32(task, attempt) +7919¡ t Table 11: HYWE runtime parameters for the base model and HYWE-35B in Table 1. JDATA COLLECTION IMPLEMENTATION DETAILS We use Qwen3.8-Max and Kimi-K3 for the LLM-based components of HYWECOLLECTOR. 28 Preprint J.1NATURALIZATION VALIDATORS A naturalized task is accepted only if all of the following hold; a failure returns the reason to the generator, which re-samples. 1. The question is non-trivial in length and contains no meta-language about agent routing or mode switching. 2. The site bindings in the generated text preserve the blueprintâs fixed site domains exactly. 3. The per-component goals and completion conditions cover the blueprintâs components ex- actly, with no empty entries. 4. No componentâs goal or completion condition names a site outside its declared site scope, except the site of a producer it directly consumes from. 5. For medium and hard A 3 /A 4 tasks, the question explicitly names every target site. 6. The switch triggers cover every switch policy in the blueprint, with no empty entries. 7. A coherence rationale and a non-empty answer schema are present. 8. The dependency bindings match the blueprintâs dependency edges exactly. 9. Producer answers remain unknown in the question text until their phase completes (no leakage of downstream values). 29 Preprint KSYSTEM AND EVALUATION PROMPTS K.1MODE-SPECIFIC SYSTEM PROMPTS The two system prompts share the output-format block; the mode-specific parts are reproduced below verbatim. The answer-shape sentence differs by mode: in S it asks for a concise entity, number, or list; in O it additionally allows stating the end state reached when the task was an operation. Tool schemas (Table 10) are appended after the prompt. Search-based mode (S ). You are a general-purpose agent on the SEARCH-BASED path. Your tools this turn: search, scholar, visit, code_sandbox, switch. -`search` finds sources and verifies facts; it returns ranked results with snippets. -`scholar` is for academic papers, citation-rich evidence and PDFs. -`visit` opens a specific URL and extracts the facts you ask for via`goal`. -`code_sandbox` is for calculation, parsing and validation - never for browsing. -`switch` hands control to the operation-based (browser) path. Use it only when the needed information requires real page interaction (login, form, dynamic content that search and visit cannot reach). It takes no arguments - the reason belongs in`<think>`, do not restate it as a parameter. # Avoiding Dead Ends (read this before every action) Your earlier steps are recorded in the task message below - every query you ran is listed there, though older observations may be truncated to save space. Use it. Before acting, check that history: 1. NEVER re-run a query that is a near-duplicate of one already in the history. If a formulation failed, change the approach, not the wording: switch language, search the concrete entity/attribute instead of the task's paraphrase, add a site: filter or an authoritative source, use quoted exact phrases, boolean OR over alternatives, or negative terms to exclude the wrong candidates. 2. NEVER stay on one candidate for more than Ě5 consecutive actions. If your last several actions all revolve around the same entity and none of them added a NEW confirmed fact, you are stuck. On the next turn you MUST do one of these instead: - name at least two ALTERNATIVE candidates that also satisfy the constraints you have already confirmed, and search for one of them; - run a DISCONFIRMING search for your current candidate - actively look for evidence that it VIOLATES one of the task's constraints; - go back to the task statement, list the constraints you have NOT verified yet, and search for one of those directly. 3. Search snippets are LEADS, not evidence. If a snippet looks like it contains the answer or a decisive fact, open that page with`visit` before you rely on it. Do not build a final answer out of snippets alone. 4. Work the constraints in parallel, not strictly in order. A multi-constraint task is usually cracked by finding the ONE constraint that is rare enough to pin down a small candidate set - start from the most distinctive constraint, and if a line stalls, move to another constraint rather than pushing harder on the same one. 5. If a page fails to load or returns nothing usable, do not retry the same URL. Find another source for the same fact. Operation-based mode (O). You are a general-purpose agent on the OPERATION-BASED path (real browser). You act on the live page: goto, new_tab, click, double_click, hover, type, select_option, scroll, drag, press_key, wait, go_back, switch_tab, close_tab. `code_sandbox` is available for calculation/parsing.`switch` hands control back to the search-based path; it takes no arguments - put the reason in`<think>`. Once a page is open you get its screenshot each turn - ground every action in what is actually visible there. If no page is open yet,`goto` a URL first; there is nothing on screen to click. # Avoiding Dead Ends (read this before every action) Your earlier actions and the resulting pages are recorded in the task message below (older observations may be truncated). Use it. 1. NEVER click the same coordinate twice. If a click produced no visible change 30 Preprint (same page, same layout), that element is not what you thought it was - do NOT click it again, and do NOT click a point a few pixels away hoping for a different result. Re-read the current screenshot and pick a different target, or reach the goal another way (scroll to reveal more, use the page's own navigation/search box, or`goto` a direct URL). 2. If two consecutive actions produced no state change, stop repeating that interaction pattern. Change the approach: scroll, open a different section, use the site's search, or`go_back` and take another route. 3. Before typing, make sure the target field is actually focused - click it first, verify from the screenshot that the caret/highlight is in the field, then type. 4. If the current O-side page clearly presents a CAPTCHA, Cloudflare/Turnstile challenge, "verify you are human" gate, or any other human-verification step, STOP immediately. Do not click, wait, refresh, retry, work around it, or `switch` to another path. End the entire task with`<answer>`, briefly stating that human verification blocked the requested operation and what progress was completed before the block. Human verification is a terminal condition even when the requested result is still incomplete. 5. If the page needs information you cannot reach by interaction for another reason (paywall, login wall, dead link, infinite scroll with no matches), do not keep clicking -`switch` back to the search-based path and find the fact elsewhere. 6. Verify state changes from the screenshot before assuming success. Do not chain several blind actions on the assumption that an earlier one worked. Shared output format (both modes). # Output Format Every turn, output exactly: <think> Your reasoning for this turn: what the last observation told you, what is still unverified, and why this specific next action. </think> <tool_call> "name": "<tool name>", "arguments": ... </tool_call> Call at most ONE tool per turn. The next message contains that tool's result. [...] When you have enough verified evidence, stop calling tools and output: <think> Why the evidence is now sufficient - map each constraint in the task to the fact that confirms it. </think> <answer> your final answer </answer> # Tool call OR answer - never both Each turn ends in EXACTLY ONE of two ways: a`<tool_call>`, or an`<answer>`. Emitting both in the same turn is an error. [...] K.2SEARCH-BASED ANSWER JUDGING The reference-answer judge in Appendix C.5 uses the following prompt for each vote. You are a strict benchmark evaluator. Your task is to judge whether an agent's final answer matches the provided reference answer for the given question. Rules: 1. First extract the agent's final committed answer from the agent output. 2. Judge only whether that extracted final answer matches the reference answer. 3. Ignore extra explanation, evidence, or reasoning unless it changes or contradicts the final answer. 4. Accept semantically equivalent answers even if they differ in formatting, capitalization, punctuation, articles, common abbreviations, or obvious unit/currency/date formatting. 5. For numbers, accept equivalent numeric values after straightforward normalization, but reject materially different values, incompatible units, 31 Preprint or unsupported rounding. 6. For list or set answers, all required items must be present and no materially incorrect extra items should be introduced. 7. If the agent gives multiple conflicting answers, or never clearly commits to a final answer, mark it incorrect. 8. If there is no answer, set extracted_final_answer to null and predicted_label to 0. Return JSON only, with exactly these keys: "extracted_final_answer": "string or null", "reasoning": "brief explanation", "predicted_label": 0 32 Preprint LFULL TASK PROTOTYPE VOCABULARIES Stage 1 of the pipeline (Section 3.2) abstracts two task prototype vocabularies from the probed fact pool; the task synthesizer in Stage 3 composes them into tasks.Each operation prototype names a recurring kind of interaction that produces operation-bound facts and declares a typed interface;each search prototype names a recurring kind of information need satisfiable from the indexed web.The interface types are:for S outputs, entity, candidate set, location, datewindow, constraintset, identifier, threshold, classification, and fact set; forO outputs, liveoffer, quote, rankeditem, configureditem, computedresult, route, itinerary, cart total, metric, livestatus, protocolquote, template, visualitem, record, servicequote, build, plan, and artifact. Tables 12 and 13 list the full vo- cabularies. A pair (p S ,p O ) is admissible when out(p S )â in(p O ). Table 12: Operation-based task prototypes P O (48 total). out: the prototypeâs output type; in: the search-based output types it accepts as inputs. PrototypeInteraction it capturesoutin flightlive fare Live flight fare and itinerary: run a date-, route-, cabin-, and stop-constrained flight search and read the currently displayed itinerary and fare live offer entity, candidate set, location, date window, constraintset, identifier stay availability Live lodging availability: apply destination, dates, party, amenity, and budget constraints and inspect the currently available properties ranked item entity, candidate set, location, date window, constraint set tour slotTour or experience slot: select an experience, date, time, language, and group size and read the available slot and price live offer entity, candidate set, location, date window, constraint set car rental quote Car-rental quote: enter pickup and return details plus vehicle constraints and read the available rental and full quote quote entity, location, date window, constraintset, identifier eventticketEvent ticket inventory: locate an event and inspect live date, section, quantity, and price inventory liveoffer entity, candidate set, location, date window, constraintset, identifier insurance quote Insurance quote wizard: complete a profile-, asset-, location-, and coverage-specific quote flow and read the generated estimate quote entity, constraintset, identifier, threshold, classification finance calculator Finance calculator result: enter amount, term, rate, contribution, and risk assumptions and read the calculated financial result computed result entity, constraintset, threshold, classification product configurator Product configuration: configure a product on its page for a concrete use case and read the resulting model, compatibility, price, and availability configureditem entity, candidate set, constraint set, identifier, threshold, classification auto configurator Vehicle configuration: select model, powertrain, trim, packages, and appearance options and read the resulting configuration and price configured item entity, candidate set, constraint set, identifier, threshold 33 Preprint PrototypeInteraction it capturesoutin marketplace filtereditem Marketplace filtered result: apply category, delivery, seller, condition, rating, and budget constraints and inspect the best displayed result ranked item entity, candidate set, constraint set, identifier, threshold, classification auctionlive bid Auction state: filter auction lots and inspect the current bid, estimate, time remaining, and lot status live status entity, candidate set, constraint set, identifier, threshold, classification maprouteInteractive map route: set endpoints, travel mode, and route constraints and read the rendered route result route entity, candidate set, location, constraintset, identifier transit itinerary Public-transit itinerary: set stops, departure or arrival time, accessibility, and transfer constraints and read the live itinerary itinerary entity, candidate set, location, date window, constraint set, identifier food delivery cart Food delivery selection: filter restaurants or dishes, configure an order, and read availability, substitutions, fees, and total cart total entity, candidate set, location, constraint set, threshold, classification realestate filter Real-estate filtered property: apply location, price, property, amenity, and commute constraints and inspect matching listings ranked item entity, candidate set, location, constraintset, threshold, classification jobfilterJob-board filtered opening: apply role, location, seniority, compensation, skill, and work-mode constraints and inspect matching openings ranked item entity, candidate set, location, constraint set, identifier, threshold, classification course filterCourse or test-prep selection: apply subject, level, schedule, delivery, prerequisite, and price constraints and inspect the matching course ranked item entity, candidate set, constraint set, identifier, threshold, classification sports dashboard Sports dashboard state: set league, season, position, scoring, and split controls and read the requested ranking or metric metric entity, candidate set, datewindow, constraint set, identifier, threshold trading screener Trading screener state: set market, asset, indicator, horizon, and threshold controls and inspect the resulting asset or chart value metric entity, candidate set, datewindow, constraintset, identifier, threshold, classification crypto protocolquote Crypto or DeFi protocol quote: select network, assets, amount, route, and risk constraints and inspect the live swap, bridge, or yield result protocol quote entity, candidate set, constraint set, identifier, threshold, classification template filter Template gallery selection: filter templates by workflow, audience, features, format, and price and inspect the best matching template template entity, candidate set, constraint set, identifier, classification creative visual selection Creative visual selection: apply style, medium, subject, color, and licensing constraints and inspect a visually matching work visual item entity, candidate set, constraint set, identifier, classification 34 Preprint PrototypeInteraction it capturesoutin govrecord lookup Government interactive record lookup: submit jurisdiction, entity, record type, and date constraints and read the returned filing or status record entity, candidate set, location, date window, constraintset, identifier science interactive result Scientific interactive tool result: set dataset, variables, region, transformation, and display controls and read the computed or visualized result computed result entity, candidate set, location, date window, constraintset, identifier, threshold, classification health provider filter Health-provider finder: apply location, specialty, insurance, availability, and patient constraints and inspect matching providers ranked item entity, candidate set, location, date window, constraintset, identifier, classification home service quote Home-service or utility quote: enter property, location, service, usage, and schedule details and read the generated option or quote servicequote entity, candidate set, location, constraintset, identifier, threshold, classification streaming catalog Streaming catalog state: apply region, service, genre, language, and maturity constraints and inspect currently available titles rankeditem entity, candidate set, location, constraint set, identifier, classification game interactive build Interactive game build or state: set character, mode, equipment, map, and performance constraints and read the resulting build or game state build entity, candidate set, constraint set, identifier, threshold, classification fitnessplan result Fitness or wellness plan result: enter profile, goal, schedule, equipment, and limitation constraints and read the generated class or plan plan entity, candidate set, constraint set, identifier, threshold, classification saas data artifact SaaS data transformation artifact: configure a data source, transformation, grouping, visualization, and export and inspect the generated artifact artifact entity, candidate set, constraint set, identifier, threshold, classification flight aggregator search Flight-metasearch itinerary and fare: run a route-, date-, passenger-, cabin-, stop-, and baggage-constrained flight search and inspect a displayed itinerary and fare live offer entity, candidate set, location, date window, constraint set, identifier generalcar rental Car-rental availability and quote: enter pickup and return locations, dates, driver profile, and vehicle constraints and inspect the available rental and complete quote quote entity, location, date window, constraint set, identifier, classification booking tour slot Travel experience availability: filter travel experiences by destination, activity type, date, time, language, accessibility, and group size and inspect a matching live slot live offer entity, candidate set, location, date window, constraintset, identifier 35 Preprint PrototypeInteraction it capturesoutin cruisesailing Cruise sailing and cabin availability: search a cruise line by region, embarkation port, sailing window, duration, party, and cabin constraints and inspect a matching live sailing live offer entity, candidate set, location, date window, constraintset, identifier intercity transport Intercity train or bus itinerary: search an intercity rail or coach service using exact stations, date, time, passenger, transfer, and accessibility constraints itinerary entity, candidate set, location, date window, constraint set, identifier ridefare estimate Ride-hail or micromobility estimate: enter pickup, destination, timing, party, and vehicle or accessibility constraints and inspect the displayed ride estimate quote entity, candidate set, location, date window, constraintset, identifier, threshold urban food delivery Address-specific food delivery cart: set a delivery address, filter restaurants and dishes, configure a cart, and read address-specific availability, fees, and total carttotal entity, candidate set, location, constraint set, threshold, classification gamecatalog filter Game or digital-asset catalog selection: filter a game or digital-asset catalog by platform, genre, mechanics, rating, license, compatibility, and budget and inspect matching listings ranked item entity, candidate set, constraint set, identifier, threshold, classification mortgage calculator Mortgage payment or rate estimate: enter purchase price, down payment, location, loan term, rate assumptions, taxes, and insurance and inspect the generated mortgage estimate computed result entity, location, constraint set, identifier, threshold, classification credit card filter Credit-card offer filter: filter credit-card offers by credit profile, fee, reward type, spending pattern, and welcome-offer constraints and inspect matching offers ranked item entity, candidate set, constraint set, identifier, threshold, classification visual asset filter Licensed visual-asset selection: search and visually inspect images by subject, composition, palette, orientation, people, and licensing constraints visualitem entity, candidate set, constraint set, identifier, classification parkadmission Attraction admission and add-on inventory: select an attraction, visit date, party, admission duration, and add-ons and inspect live ticket options and totals live offer entity, candidate set, location, date window, constraint set, identifier restaurant reservation Restaurant table availability: filter restaurants by location, cuisine, dietary support, date, party size, and price and inspect a live reservation slot live offer entity, candidate set, location, date window, constraint set, identifier, classification science data export Scientific dataset subset and export: choose a dataset, variable, spatial and temporal subset, aggregation, units, and export format and inspect the resulting data product artifact entity, candidate set, location, date window, constraintset, identifier, threshold, classification 36 Preprint PrototypeInteraction it capturesoutin defi governance dashboard DeFi governance proposal or gauge state: filter governance proposals, gauges, or votes by protocol, status, round, date, and threshold and inspect the current voting state live status entity, candidate set, datewindow, constraint set, identifier, threshold, classification collectible marketlisting Collectible marketplace visual listing: filter collectible listings by object type, period, maker, visual condition, authenticity, seller, auction or fixed-price format, and budget visual item entity, candidate set, constraint set, identifier, threshold, classification game item catalog Official game item or mode catalog: filter the official game catalog or current item and mode listings by game mode, item class, role, compatibility, rotation, and cost ranked item entity, candidate set, constraint set, identifier, threshold, classification fantasy lineup Fantasy lineup or roster builder: set contest, slate, roster, salary, position, and projection constraints and inspect the resulting lineup or eligible player set build entity, candidate set, datewindow, constraintset, identifier, threshold, classification Table 13: Search-based task prototypes P S (36 total). out: the prototypeâs output type. A producer supplies an operation-based input; a consumer uses an operation-based output; cross-site bridges serve both roles. PrototypeInformation need it capturesoutrole organization background Organization identity and background: establish who operates the relevant site or entity, where it is based, and the key dated background fact needed by the user factsetconsumer entityby constraints Entity identification by public constraints: identify the named entity that satisfies the public, stable constraints in the scenario entityproducer candidate shortlist Public candidate shortlist: build a short candidate set satisfying stable public criteria before live comparison candidate setproducer nearest relevant location Resolve a relevant location: identify the location, hub, venue, district, or waypoint that best satisfies the stated geographic constraint locationproducer official date window Resolve an official date window: determine the authoritative event, season, deadline, or eligibility dates needed to parameterize the live task date windowproducer requirement derivation Derive requirement set: derive the stable policy, technical, accessibility, dietary, or eligibility requirements that the live result must satisfy constraint setproducer public identifier Resolve public identifier: resolve the canonical identifier, ticker, filing number, model code, station code, or standardized name needed for an exact lookup identifierproducer 37 Preprint PrototypeInformation need it capturesoutrole publicthreshold Find a decision threshold: find the authoritative benchmark, limit, target, or recommended threshold to apply in the interactive tool thresholdproducer public classification Resolve classification: determine the official category, risk class, genre, role family, or product class needed to choose the correct interface controls classification producer official policy check Official policy or eligibility check: use the surfaced entity or result to determine the applicable official policy, eligibility rule, restriction, or obligation fact setconsumer external benchmark External benchmark comparison: compare the surfaced price, quote, metric, route, or calculated value with an authoritative public benchmark on the same basis factsetconsumer creatorowner lookup Creator, owner, or operator lookup: identify the creator, owner, operator, manufacturer, or issuing authority behind the surfaced item factsetconsumer reputationand reviews Independent reputation comparison: use independent public sources to compare reputation, reviews, awards, or reliability for the surfaced option or shortlist fact setconsumer historical context Historical context: place the surfaced entity, metric, status, or result in the relevant historical sequence or prior-period context fact setconsumer technical compatibility Technical compatibility verification: verify from authoritative documentation whether the surfaced configuration, artifact, build, or item is compatible with the userâs external system or requirement fact setconsumer safety accessibility Safety and accessibility follow-up: determine the relevant safety, accessibility, health, or operational constraints for the surfaced route, venue, service, or plan fact setconsumer availability alternative Public alternative discovery: find a publicly documented alternative when the surfaced live result is unavailable, over budget, incompatible, or otherwise unsuitable factsetconsumer method andunit check Method, definition, and unit verification: verify the public definition, method, units, coverage, and limitations needed to interpret the surfaced metric or computed result factsetconsumer public specification Official specification lookup: retrieve the authoritative specifications and limits for the surfaced product, asset, record, or output factsetconsumer multisource factjoin Multi-source enrichment join: join the surfaced entities with the same public attributes from multiple sources and return a comparable table factsetconsumer deep conjunctive entity Conjunctive entity identification: identify an initially unknown entity that uniquely satisfies at least four independent clues distributed across multiple sources entityproducer 38 Preprint PrototypeInformation need it capturesoutrole deepexhaustive shortlist Exhaustive constrained shortlist: enumerate a candidate universe, intersect several independently sourced constraints, deduplicate aliases, and return the complete qualifying shortlist candidate setproducer deeplocation optimization Cross-source location resolution: resolve the exact location that best satisfies geographic, jurisdictional, schedule, accessibility, and proximity constraints drawn from multiple sources locationproducer deep temporal window Temporal provenance and date-window derivation: reconstruct a dated sequence across authoritative records and derive the exact future window in which all eligibility, event, season, or policy constraints overlap date windowproducer deep requirement synthesis Multi-authority requirement synthesis: combine policy, technical, legal, accessibility, or compatibility requirements from several authorities into one operational constraint set constraintsetproducer deep identifier chain Canonical identifier relationship chain: follow a multi-hop relationship chain to resolve the canonical code, registry ID, ticker, model number, station code, or normalized name required for an exact lookup identifierproducer deep threshold aggregation Normalized multi-source threshold: collect comparable numeric evidence from multiple sources, normalize units and time bases, calculate the requested benchmark, and return the decision threshold thresholdproducer deep classification reconciliation Cross-authority classification reconciliation: reconcile conflicting taxonomies, definitions, editions, or jurisdictions and determine the one classification applicable to the userâs scenario classification producer deep result tablejoin Deep result enrichment table: take every entity surfaced by the operation, resolve stable join keys, collect the same public attributes from multiple sources, and produce a comparable qualified table factsetconsumer deepsource reconciliation Conflicting-source result reconciliation: use the surfaced entity or value to gather conflicting public claims, compare definitions, dates, scope, units, and authority, and resolve which interpretation applies factsetconsumer deep historical provenance Historical provenance of surfaced result: trace the surfaced entity, item, status, or metric through a dated origin, ownership, release, renaming, or prior-period chain and explain the verified transitions fact setconsumer 39 Preprint PrototypeInformation need it capturesoutrole deepevidence synthesis Scholarly or technical evidence synthesis: formulate a focused question from the surfaced result, locate multiple primary or review sources, and synthesize methods, findings, disagreement, and limitations fact setconsumer crosssite constraint bridge Cross-site result-to-constraint bridge: use the exact result surfaced on one site to look up the policy, compatibility, eligibility, or comparison rule that becomes a concrete constraint for the next siteâs operation constraint setconsumer / producer crosssite identifier bridge Cross-site canonical-identifier bridge: resolve the surfaced result to the canonical name, code, model, listing identity, or normalized join key required for an exact operation on the next site identifierconsumer / producer deep crosssite constraint bridge Deep cross-site requirement reconciliation: take the prior siteâs exact result, reconcile multi-source policy, technical, legal, or compatibility requirements, and produce one operational constraint set for the next site constraintsetconsumer / producer deep crosssite candidatebridge Deep cross-site candidate transfer: expand and verify the exact entity surfaced on one site against several public sources, reconcile aliases and exclusions, and produce a qualified candidate set for the next siteâs operation candidatesetconsumer / producer 40