Paper deep dive
ScienceFlow: A long-horizon agent for ML research, scientific discovery and beyond
Mingming Zhao, Jiqian Dong, Kangping Xu, Zadid Hasan, Chengrui Fan, Shan Jiang, Shuai Mao, Ting Lingya, Linyi Zou, Tailin Zhou, Yun Hin Chan, Wenkai Zhang, Zhanhong Zhou, Guowei Huang, Hongliang Li, Wenjing Cun, Zhitang Chen, Mingxuan Yuan, Yanhui Geng
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 93%
Last extracted: 8/17/2026, 5:32:11 AM
Summary
ScienceFlow is an end-to-end autoresearch agent framework designed for long-horizon machine learning research and scientific discovery. It addresses limitations in existing agents by organizing research into segments grounded in recoverable executable workspaces. Key components include Executable-State Transition through Re-Anchoring (ESTRA) for managing research trajectory transitions and an evidence-aware execution controller for resource allocation. The system achieves state-of-the-art performance on the MLE-bench with a 70.22% Any-Medal score.
Entities (6)
Relation Signals (4)
ScienceFlow → achievesstateofthearton → MLE-Bench
confidence 95% · ScienceFlow achieves 70.22±1.18% Any-Medal on the full MLE-bench... outperforming prior reported results by 4.92 percentage points.
ScienceFlow → usesmechanism → ESTRA
confidence 95% · Transitions between research segments are governed by Executable-State Transition through Re-Anchoring (ESTRA)
ScienceFlow → developedby → Noah’s Ark Lab
confidence 90% · Affiliation: Noah’s Ark Lab, Huawei
ScienceFlow → outperforms → prior reported results
confidence 90% · outperforming prior reported results by 4.92 percentage points.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Enabling LLM agents to sustain productive, stable, and goal-aligned research over extended horizons is a central challenge for autonomous machine learning and scientific discovery, as progress hinges on continuously managing evolving state, exploration decisions, and computational resources. Pioneering autoresearch agents, despite great success, still lack mechanisms for continuity, recovery from dead ends, and value-driven compute allocation, which inherently undermines overall search efficiency, wastes computational resources, and lowers the chance of ultimate success. To bridge this gap, we introduce ScienceFlow, an end-to-end autoresearch agent framework that organizes long-horizon research work into research segments grounded in executable workspaces. It represents research progress as recoverable executable states, enabling efficient exploration, revision, and execution. Transitions between research segments are governed by Executable-State Transition through Re-Anchoring (ESTRA), which selects either the live state or an archived state as the next anchor and determines whether to continue or redirect the research trajectory. An evidence-aware execution controller allocates resources to physical jobs based on resource availability, remaining budget, and validated progress. We evaluate ScienceFlow on tasks spanning machine learning, scientific modeling, and mathematical optimization. Results on diverse long-horizon benchmarks demonstrate its ability to sustain effective research processes, highlighted by a SOTA 70.22 percent Any-Medal score on the full MLE-bench within a 24-hour budget, outperforming prior reported results by 4.92 percentage points. The efficacy of ScienceFlow further demonstrates that efficient state management, adaptive exploration, and objective-aligned execution are critical for scaling autonomous research beyond short-horizon interactions.
Tags
Links
- Source: https://arxiv.org/abs/2608.14354v1
- Canonical: https://arxiv.org/abs/2608.14354v1
Trouble viewing inline? Open PDF directly →
Full Text
155,905 characters extracted from source content.
Expand or collapse full text
_set:Ne tcboxmath _set:Ne ScienceFlow: A Long-horizon Agent for ML Research, Scientific Discovery and Beyond ScienceFlow Team Affiliation: Noah’s Ark Lab, Huawei Abstract Enabling LLM agents to sustain productive, stable, and goal-aligned research over extended horizons is a central challenge for autonomous machine learning and scientific discovery, as progress hinges on continuously managing evolving state, exploration decisions, and computational resources. Pioneering autoresearch agents, despite great success, still lack mechanisms for continuity, recovery from dead ends, and value‑driven compute allocation, which inherently undermines overall search efficiency, wastes computational resources, and lowers the chance of ultimate success. To bridge this gap, we introduce ScienceFlow, an end-to-end autoresearch agent framework that organizes long-horizon research work into research segments grounded in executable workspaces. It represents research progress as recoverable executable states, enabling efficient exploration, revision, and execution. Transitions between research segments are governed by Executable-State Transition through Re-Anchoring (ESTRA), which selects either the live state or an archived state as the next anchor and determines whether to continue or redirect the research trajectory. An evidence-aware execution controller allocates resources to physical jobs based on resource availability, remaining budget, and validated progress. We evaluate ScienceFlow on tasks spanning machine learning, scientific modeling, and mathematical optimization. Results on diverse long-horizon benchmarks demonstrate its ability to sustain effective research processes, highlighted by a SOTA 70.22% Any-Medal score on the full MLE-bench within a 24-hour budget, and outperforming prior reported results by 4.92 percentage points. The efficacy of ScienceFlow further demonstrates that efficient state management, adaptive exploration, and objective‑aligned execution are critical for scaling autonomous research beyond short‑horizon interactions. GitHub: https://huawei-noah.github.io/noah-research/ScienceFlow/website/ (a) Full MLE-bench Any-Medal rate. (b) Agent capability profile. Figure 1: Performance overview. (a) End-to-end performance on the full MLE-bench, where ScienceFlow achieves 70.22±1.18%70.22± 1.18\% Any-Medal. (b) Capability analysis across Search, Storage, Compute, Model Adaptation, and Time dimensions under full and constrained-reference settings. Each dimension is evaluated independently. Contents 1 Introduction 2 Method 2.1 Preliminaries 2.2 System Overview 2.3 Executable Research Process 2.4 Evidence-Aware Execution Control 3 Experiment 3.1 Machine Learning Engineering 3.2 Mathematical and Engineering Optimization 3.3 Scientific Modeling 4 Related Work 4.1 Scientific Agents 4.2 MLE Agents 4.3 Optimization Agents 5 Conclusion References A Implementation Details A.1 Context Construction and Interaction Pipeline A.2 ESTRA Decision and Re-Anchoring Pipeline B MLE-bench Supplementary Results B.1 Evaluation on the Full MLE-bench Set B.2 Operational Telemetry Coverage C Mathematical Optimization Details C.1 Formal Task Definitions C.2 Evaluation and Feasibility Audit D SpOC4-KTTSP Supplementary Details D.1 Competition, Tracks, and Evaluation Protocol D.2 Context-Folding Trace on KTTSP-hard D.3 ESTRA-Triggered Folding Trace on KTTSP-hard D.4 Peer-Guided Search Trace on KTTSP-hard E SciModelingBench Provenance and Evaluation Metadata 1 Introduction AI autoresearch agents are rapidly evolving beyond isolated reasoning and tool use toward increasingly complete, long-horizon research workflows. Recent systems can formulate hypotheses, modify executable artifacts, run experiments, interpret intermediate evidence, and revise subsequent decisions across machine learning and scientific discovery (41; 74; 63; 72). AlphaEvolve (46), for example, demonstrates that iterative code modification guided by evaluator feedback can produce meaningful improvements in algorithms and scientific constructions. As research agents scale to longer, highly automated workflows, the bottleneck shifts from executing discrete research steps to sustaining productive, stable, and goal-aligned progress over time. This demands that agents preserve state across iterations, synthesize intermediate evidence, navigate competing directions, recover from dead ends, and translate available time and compute into tangible improvements. Achieving sustained progress is complicated by the expanding nature of the research state itself. Over time, the agent’s context grows beyond a simple interaction log into a rich executable workspace containing source code, datasets, cached artifacts, model checkpoints, solver states, evaluation outputs, and other artifacts. While textual summaries can compress past interactions, they cannot faithfully reconstruct the executable state required to reliably resume, reuse, or revisit earlier work—a limitation that has motivated structured memory and persistent workspace designs (83; 11; 52). Moreover, promising directions often consume significant time and compute before revealing their flaws; apparent progress may be an artifact of noisy evaluation signals, implementation choices, or strategies that have already exhausted their local potential (65). Decisions to continue, branch, or revert to an earlier state thus directly govern where additional resources are deployed. Consequently, effective long-horizon research demands that state persistence, exploration choices, and execution control evolve together as evidence accumulates. Recent systems have tackled isolated facets of this problem through disparate representations of the research process. Structured and persistent memories preserve project knowledge and intermediate artifacts across iterations (52; 11), while trajectory-centric methods support branching, recovery, or iterative refinement of research paths (14; 81). Resource-aware systems operate at yet another layer, using runtime signals to place, monitor, and reschedule heterogeneous workloads (69; 42). While individually useful, these representations leave research state, trajectory decisions, and physical execution only loosely connected. Recovery, exploration, evaluation, and resource allocation each often operate over different views of the research process, making it difficult to maintain a consistent notion of progress as research evolves. This fragmentation remains a fundamental obstacle to sustaining coherent, adaptive, and efficient research over long horizons. To this end, we introduce ScienceFlow, a workspace-grounded autonomous research system that supports one or more homogeneous research workers. ScienceFlow organizes research around recoverable executable workspaces, which preserve the concrete state of each research trajectory and serve as stable boundaries for continuation, branching, and recovery. During forward research, task-specific result signals produce validated workspace checkpoints, while text-only responses or context-capacity limits define research-segment boundaries that invoke ESTRA. At each research-segment boundary, a research worker uses ESTRA to continue or redirect from the live workspace, or to restore an archived checkpoint and proceed from that state. Multiple homogeneous workers can operate on independent trajectories in parallel, exchanging only compact progress summaries at research-segment boundaries to limit interference while sharing useful evidence. Beneath this research layer, an evidence-aware execution controller manages the physical jobs associated with each trajectory, using both resource conditions and validated progress to admit, monitor, pause, or terminate execution. Scientific decisions remain with the research workers, while the controller provides resource-aware execution and system-level safeguards. The broader question is whether a common set of long-horizon research abstractions can transfer across substantially different executable tasks. We evaluate this question across machine learning, scientific modeling, and mathematical optimization. ScienceFlow achieves strong performance across all three domains, including a 70.22±1.18%70.22± 1.18\% Any-Medal rate on the full 75-task MLE-bench (10) under a 24-hour budget, 4.92 percentage points above the strongest reported baseline, while also attaining the best group-balanced score on SciModelingBench (57) and reaching/improving published frontiers on multiple mathematical optimization problems. Our contributions are summarized as follows: • We identify that effective long-horizon research depends not simply on extending interaction time or compute, but on jointly maintaining executable state, adapting research trajectories, and aligning execution with validated progress. • ScienceFlow realizes this principle through recoverable executable workspaces, ESTRA-governed transitions between research segments, and evidence-aware execution control, enabling research to continue, redirect, or recover without losing useful progress. • ScienceFlow demonstrates strong and consistent performance across a diverse range of tasks, including machine learning, scientific modeling, and mathematical optimization, with substantial gains on MLE-bench and SciModelingBench and state-of-the-art results across multiple optimization problems. 2 Method 2.1 Preliminaries We formalize executable research tasks whose outcome quality can be quantified by a goal-dependent utility. A task is defined as =(,U,V,B,W0)T=(G,U_G,V_G,B,W_0), where G specifies the research goal and success criteria, U(⋅)U_G(·) denotes the final task utility, V(⋅)V_G(·) is the validation signal observable during research, B specifies the available resource budget, and W0W_0 is the initial executable workspace. Starting from W0W_0, the agent explores a growing collection of recoverable executable states. Let TA_T denote the archive of checkpointed executable states created over a research horizon T. Each executable state sv∈Ts_v _T represents a concrete checkpoint of the evolving research process, including the executable workspace and its associated artifacts, memory, validation evidence, and resource records. The state archive therefore provides a set of recoverable states from which the agent can continue, revisit, or redirect its research trajectory. Since U_G is often unavailable during execution, the agent uses V_G to guide search and seeks the best validated state within the available budget: s^T=argmaxsv∈TV(sv) s.t. CT=∑t=1Tρt⪯B, s_T= _s_v _TV_G (s_v ) s.t. C_T= _t=1^T _t B, (1) where ρt _t denotes the resource-consumption vector at step t, and CTC_T is the cumulative resource expenditure. The budget vector B=(B1,…,BK)B=(B_1,…,B_K) specifies K component-wise limits, such as wall-clock time, compute, and storage. For any t≤Tt≤ T, let Ct=∑τ=1tρτC_t= _τ=1^t _τ and Bt=B−CtB_t=B-C_t denote the cumulative expenditure and remaining resource budget, respectively. The selected state is ultimately assessed by U_G. 2.2 System Overview Long-Horizon Research Process. ScienceFlow extends conventional tool‑using inference loops to long‑horizon executable research by organizing the process around recoverable executable states. Each state binds an executable workspace with compact memory, validation evidence, and resource records. These states persist across research iterations, providing a common foundation for resuming execution, adapting trajectories, and coordinating physical resources as new evidence accumulates. During the long‑horizon search, ScienceFlow uses a stage gate to determine when to checkpoint each research state, including all artifacts of the current workspace and execution results—into the state archive. This stage gate is triggered automatically by a task‑specific result signal. In addition, Executable-State Transition through Re-Anchoring (ESTRA) governs transitions between research segments by selecting the next anchor state and an extend-or-redirect direction. More concretely, ESTRA is triggered by either a text‑only response from the worker or an approaching context‑capacity limit. At each trigger, the research worker uses ESTRA to select an execution anchor and an extend-or-redirect direction based on the available states, accumulated validation evidence, and remaining resource budget. If an archived anchor is selected, ScienceFlow restores the corresponding state before the next research segment begins. Together, these mechanisms connect recoverable executable states, adaptive trajectory transitions, and physical execution within a single long-horizon research process. Figure 2 provides an overview of the ScienceFlow architecture and its long-horizon research process. Figure 2: ScienceFlow system architecture. Research workers operate over recoverable executable states and adapt long-horizon trajectories through ESTRA-governed transitions between research segments, while an evidence-aware execution controller coordinates physical resource allocation and runtime execution. System and Worker Model. ScienceFlow supports one or more homogeneous research workers, each operating within an isolated executable workspace and maintaining its own state archive. Multiple workers explore independent research trajectories and exchange only compact validated progress at research-segment boundaries. They share a physical resource pool governed by a common execution controller, which manages resource availability and runtime execution without participating in scientific route selection. 2.3 Executable Research Process Long‑horizon research is organized as a sequence of research segments. Within each segment, the worker follows its local tool-use policy to inspect, modify, and execute the active workspace. Whenever ScienceFlow detects a task-specific result signal, the stage gate evaluates the result, records the resulting evidence, collects a compact progress summary, and checkpoints the corresponding executable state in the archive. Multiple such checkpoint events may occur within one segment. A text-only response or an approaching context-capacity limit closes the current segment and invokes ESTRA to initialize the next segment from a selected research state and direction. Each design is described in detail in the following subsections. 2.3.1 Research State Representation We begin by defining the research state svs_v, which captures a specific milestone in a long-running research process. Each state is indexed by a unique archive identifier v, which denotes its corresponding entry in the archive A and makes the state retrievable. In ScienceFlow, svs_v maintains four distinct types of information: • Workspace snapshot WvW_v: contains all executable artifacts available at the time of archival—including source code, data-processing scripts, model checkpoints, cached features, validation outputs, submissions, environment metadata, and references to large artifacts. • Structured research memory mvm_v: maintains a compact long-horizon agent memory that persists across all research segments, which is detailed in section 2.3.4. • Validation evidence eve_v: stores the validation results associated with the current research state, defined as ev=V(sv)e_v=V_G(s_v). • Resource records ℓv _v: resource records captured from the current resource ledger at the time of checkpointing. To make this research state svs_v actionable, it is represented as a tuple of these four components: sv=(Wv,mv,ev,ℓv),s_v= (W_v,m_v,e_v, _v ), (2) which can be inserted into or retrieved from the archive A as needed. 2.3.2 Forward Research Each research segment executes a forward research process that may produce multiple checkpointed research states. During this process, the worker follows a local reasoning–action–observation policy to interact with the active workspace. For a given segment n, we define: • PnP_n: the fixed segment-level base context, recovered from the cross-segment structured memory mvm_v from the last research segment. • Wn,jW_n,j: the active workspace at round j, where Wn,0W_n,0 is cloned from the workspace snapshot WvW_v of the previous research segment. • hn,jh_n,j: the segment-local interaction history (agent context) accumulated up to round j. It captures the reasoning content, tool actions, and observations across rounds and is initialized as hn,0=∅h_n,0= . At each round j the policy generates a reasoning output rn,jr_n,j and tool action αn,j _n,j: (rn,j,αn,j)∼πLLM(⋅∣Pn,hn,j).(r_n,j, _n,j) _LLM (· P_n,h_n,j ). (3) If αn,j≠∅ _n,j≠ , ScienceFlow executes the action, producing an observation on,jo_n,j and an updated workspace: (on,j,Wn,j+1)=Exec(αn,j;Wn,j). (o_n,j,W_n,j+1 )=Exec ( _n,j;W_n,j ). (4) If αn,j=∅ _n,j= , the step is text‑only; the workspace remains unchanged, (Wn,j+1=Wn,jCLOSE(W_n,j+1=W_n,j) and no observation is produced (on,j=∅o_n,j= ). After each round, the local history is updated by appending the reasoning, action, and observation: hn,j+1=hn,j⊕(rn,j,αn,j,on,j),h_n,j+1=h_n,j (r_n,j, _n,j,o_n,j ), (5) where ⊕ denotes ordered concatenation. Independently of the local interaction policy, ScienceFlow monitors the updated workspace for a task-specific result signal specified by the task adapter. Upon detection, the stage gate collects the result, invokes the evaluator to obtain validation evidence, and requests a compact progress summary from the worker. It then snapshots the workspace as Wv=Snapshot(Wn,j+1)W_v=Snapshot(W_n,j+1), records the associated memory mvm_v, validation evidence eve_v, and resource records ℓv _v, and inserts the resulting state sv=(Wv,mv,ev,ℓv)s_v=(W_v,m_v,e_v, _v) into the archive nA_n. Temporary stage-gate exchanges are excluded from the segment-local history hn,j+1h_n,j+1, and the worker resumes forward research within the same segment. Separately, the current research segment closes and transfers control to ESTRA when either of the following conditions for a research-segment boundary is met: 1. The policy produces a text‑only response αn,j=∅ _n,j= ; or 2. The accumulated context exceeds the configured capacity threshold |Pn⊕hn,j+1|≥Lctx |P_n h_n,j+1 |≥ L_ctx If neither condition holds, the forward loop proceeds to round j+1j+1. Otherwise, the live workspace at the trigger defines the current state sncurs_n^cur, and ScienceFlow initiates the route-level deliberation described next. When a result signal and the context-capacity condition coincide, ScienceFlow completes stage-gate processing first, making the newly checkpointed state available to the subsequent ESTRA decision. 2.3.3 Re-Anchoring and Exact Restoration At each research-segment boundary, ScienceFlow invokes ESTRA for route-level deliberation by the research worker. The worker policy πLLM _LLM produces an anchor-and-direction decision (an,dn)(a_n,d_n). This decision operates on two independent axes: ana_n selects the execution anchor, either the current trigger state sncurs_n^cur or a previously archived state sv∈ns_v _n, while dnd_n determines whether to extend the current trajectory or redirect onto a new branch from that anchor. The worker bases this decision on the compact memory view, available anchor candidates with their validation evidence, and the current resource envelope. Formally: an∈sncur∪n,dn∈extend,redirect.a_n∈\s_n^cur\ _n, d_n∈\ extend, redirect\. (6) Combining these two choices yields four possible outcomes: extending or redirecting from the current state, and extending or redirecting from an archived state. After the ESTRA decision, the next research segment n+1n+1 is initialized by defining the segment-level base context Pn+1P_n+1 and workspace Wn+1,0W_n+1,0 as: (Pn+1,Wn+1,0)=ESTRA(an,dn,n). (P_n+1,W_n+1,0 )=ESTRA (a_n,d_n;A_n ). (7) If ana_n selects the current executable state, ESTRA retains the current workspace Wn,j+1W_n,j+1 as Wn+1,0W_n+1,0. If ana_n selects an archived executable state sv∈ns_v _n, ESTRA restores the full state, i.e., workspace WvW_v, memory mvm_v, validation evidence eve_v, and resource records ℓv _v, with resource accounting remaining cumulative across restoration, including resources consumed after archiving. The anchor thus determines the workspace from which research resumes, while dnd_n determines whether research extends the anchor’s existing route or redirects from it. The resulting Pn+1P_n+1 carries the anchor’s research summary, relevant evidence, and selected direction, while Wn+1,0W_n+1,0 provides the corresponding executable artifacts. ESTRA preserves the full archive while cleanly setting both the starting state and research direction for the next segment. 2.3.4 Memory and Context Assembly ScienceFlow maintains a persistent memory mvm_v that carries the entire research trajectory across segments. This memory is updated through two core operations: Add appends new progress summaries, and Fold compresses the memory when it grows too large. To support anchor selection during ESTRA, Fold retrieves historical records, and Assemble constructs the prompt that guides the agent’s decision. Together, these operations ensure that the agent always has a compact yet complete view of its research history. Add: accumulating progress. At each stage-gate event, the worker summarizes the evaluated result, relevant artifacts, and current progress into a compact result card qvq_v. This card is added to the persistent memory via: mv=Add(mv,qv).m_v=Add(m_v,q_v). (8) This update preserves the new progress information in mvm_v without resetting the segment-local history. ESTRA later uses the accumulated memory to assemble the context for the next research segment. Fold: compressing memory. When persistent memory mvm_v exceeds its allocated context space BmemB_mem, Fold automatically compresses it: (m~v,ιv)=Fold(mv;Bmem).( m_v, _v)=Fold(m_v;B_mem). (9) where m~v m_v is a compact view that keeps recent, best-validated, and anchor-relevant records in full while summarizing older ones, and ιv _v is an index that maps each folded summary to its original records in the archive. The complete memory mvm_v remains preserved in the archive. ScienceFlow also applies Fold whenever an ESTRA transition closes a research segment, independently of BmemB_mem. If the selected anchor is the current state (an=sncura_n=s_n^cur), Fold summarizes the research segment just ended. If the anchor is an archived state (an=sv∈na_n=s_v _n) it summarizes the exploration performed since last time that state was restored. This summary is carried forward as historical evidence, while the raw result cards remain addressable via unfold. Unfold: retrieving history for anchor selection. To select an anchor during ESTRA, the agent must understand the full trajectory. Unfold retrieves complete records associated with a requested identifier (zvz_v a folded summary or an indexed result card): uv=Unfold(mv,ιv,zv).u_v=Unfold(m_v, _v,z_v). (10) The retrieved records uvu_v temporarily augment the compact memory view for the current deliberation, while mvm_v remains the persistent source. Assemble: constructing the anchor-selection context. With the memory view prepared, ScienceFlow constructs an anchor-specific context Panchor(an)P_anchor(a_n) that presents the agent with the information needed to choose the next anchor and direction. For a selected anchor ana_n, let W(an)W(a_n), m(an)m(a_n), e(an)e(a_n), and ℓ(an) (a_n) denote its retrieved state components, and let m~(an) m(a_n) denote its budgeted memory view (or m(an)m(a_n) if folding is unnecessary). Let u(an)u(a_n) denote any records retrieved via Unfold. The Assemble operation combines these: Panchor(an)=Assemble(m~(an)⊕u(an),e(an),ℓ(an),View(W(an))).P_anchor(a_n)=Assemble\! ( m(a_n) u(a_n),e(a_n), (a_n),View(W(a_n)) ). (11) Where View(W(an))View(W(a_n)) provides a compact description of the available workspace artifacts and execution state. The full base context for the next segment is then: Pn+1=Pworker ⊕Pruntime ⊕Ptools ⊕Ptask ⏟Pstable ⊕Panchor (an)⊕Pdir (dn),P_n+1= P_worker P_runtime P_tools P_task _P_stable P_anchor (a_n ) P_dir (d_n ), (12) where Pstable P_stable contains the worker policy, runtime instructions, tool descriptions, and task specification, and Pdir(dn)P_dir (d_n ) encodes whether the next segment extends or redirects from the selected anchor. The next segment begins with hn+1,0=∅h_n+1,0= and accumulates new interactions through the forward loop. In summary, Add and Fold maintain a complete yet compact persistent memory across the research trajectory; Unfold retrieves historical records when the agent needs to re-anchor; and Assemble constructs the context that guides anchor selection and initializes each new segment. This design preserves the full research record while supplying each segment with a context-bounded, anchor-specific memory view. 2.4 Evidence-Aware Execution Control A key distinction that separates ScienceFlow from existing autonomous research agents is the explicit separation of research-route selection from physical execution control. In this design, the research worker proposes executable jobs, while a dedicated evidence-aware execution controller determines whether, where, and for how long each job runs. This controller evaluates both pending and running jobs using current resource availability, remaining budget, validated research progress, and the recoverable state of execution artifacts. Accordingly, the control process operates in two stages: admission and allocation before a job is launched, and online review and replanning during execution. 2.4.1 Execution Admission and Allocation For each proposed executable job b, ScienceFlow constructs a resource request describing its command, requested device class and count, estimated runtime, memory requirements, and any research-value hints supplied by the research worker. ScienceFlow complements these hints with estimates inferred from the command and execution context to establish the job’s admission priority. This priority reflects expected research value, lineage diversity, proximity to a deliverable, worker starvation, duplication, and runtime risk. The admission-and-lease module then evaluates the request against the live resource state RtR_t, which includes available GPU/CPU capacity, storage constraints, queue state, GPU pressure, and active leases, while also accounting for the remaining budget BtB_t. If the preflight check yields a confident result, it is applied directly; otherwise, the request is passed to an isolated admission LLM for review. This LLM combines the resource request, research-value information, and preflight result to produce the admission decision: δbadm=Admit(b,Rt,Bt)∈_,__,,. _b^adm=Admit(b;R_t,B_t)∈\ RUN\_NOW, OBSERVE\_THEN\_RUN, PENDING, REPLAN\. (13) Each decision corresponds to a specific action: • Run_now: the job is launched immediately after ScienceFlow atomically acquires the required device lease. • Observe_then_run: the job is launched with a short early-review window when its resource behavior remains uncertain. • Pending: the job is retained in the priority-aware queue without a device lease. • Replan: the blocking evidence is returned to the research worker for plan revision. Device leases coordinate exclusive or controlled shared access to compute resources and are released when the corresponding job finishes, is stopped, or no longer requires the assigned device. 2.4.2 Online Review and Replan Admission establishes the initial execution state of a compute job, after which ScienceFlow reviews its progress at successive observation boundaries. At each boundary, the controller collects timestamped evidence from process liveness, logs, metric history, artifact updates, resource utilization, checkpoint availability, and the remaining budget. The controller treats process liveness, log growth, and sustained resource utilization as evidence that a job remains active. Metric improvement, validated results, or newly recoverable artifacts provide stronger evidence that the job is making meaningful research progress. From the accumulated evidence, ScienceFlow estimates the time until the job produces its next useful evidence, such as a comparable metric update or a recoverable artifact. When this useful-evidence ETA falls within the remaining budget and is supported by recent progress, the controller favors continued execution. Persistent non-convergence, low GPU utilization, model limitations, or I/O bottlenecks indicate that a job may fail to produce useful evidence within the remaining budget. When these signals persist across multiple observation windows and the job has produced no recoverable value, they provide strong evidence for stop-and-replan. When execution evidence alone leaves the job’s prospective research value uncertain, ScienceFlow requests a resource advisory from the research worker. The worker reports its preferred action—continue, timebox continue, safe to stop, replan, or unknown—together with its confidence, a measurable commitment, and the expected next artifact. The controller incorporates this advisory as research-value evidence while retaining authority over lease allocation, execution timeboxing, and process termination. The controller then combines the accumulated execution evidence y0:ty_0:t, the optional worker advisory gtg_t, and the remaining budget BtB_t to produce a control decision: ct=Review(y0:t,gt;Bt)∈,,__.c_t=Review(y_0:t,g_t;B_t)∈\ CONTINUE, TIMEBOX, STOP\_AND\_REPLAN\. (14) Each decision corresponds to a specific action: • continue : keeps the current job running. • timebox: grants a bounded proof window tied to a measurable progress condition. • stop_and_replan: terminates the current job and redirects control to the research worker. Notably, recent validated progress, a new checkpoint, or a feasible phase-completion ETA favors continued execution even when the job progresses slowly. Before applying stop and replan, ScienceFlow preserves recoverable artifacts, releases the assigned leases, and returns the observed execution facts to the research worker. Here, REPLAN and __ STOP\_AND\_REPLAN denote execution-control handoffs: the controller returns blocking or runtime evidence to the research worker, which determines the revised scientific plan. These outcomes do not themselves select the ESTRA anchor ana_n or direction dnd_n. Together, admission and online review form a closed execution-control loop: ScienceFlow applies AdmitAdmit before launch and repeatedly applies ReviewReview at subsequent observation boundaries until the job completes or control returns to the research worker for replanning. This loop allocates compute according to research value while coordinating GPU/CPU capacity, storage usage, and wall-clock time throughout execution. 3 Experiment We evaluate ScienceFlow across three classes of executable research tasks: machine learning engineering, mathematical optimization, and scientific modeling, covering substantially different forms of long-horizon research. All runs are conducted in isolated environments without cross-run state sharing, and held-out evaluation information is never exposed to the research agent. Task-specific models, resource budgets, evaluation protocols, tools, and baselines are described in the corresponding subsections. Beyond overall task performance, we examine the research dynamics of ScienceFlow, including state evolution, trajectory adaptation, and resource utilization over the course of extended execution. 3.1 Machine Learning Engineering 3.1.1 Setup Table 1: Representative results on the full 75-task MLE-bench. Any-Medal rates (%) are reported as mean ± SEM when three runs are available. Best results in each column are shown in bold. Agent LLM(s) Lite (%) Medium (%) High (%) All (%) Other reported systems Famou-Agent Gemini-2.5-Pro 75.76 ± 1.52 57.89 ± 1.52 40.00 ± 0.00 59.56 ± 0.89 CAIR MARS+ Gemini-3-Pro-Preview 78.79 ± 1.52 60.53 ± 1.52 44.44 ± 2.22 62.67 ± 0.77 AIBuildAI Claude-Opus-4.6 77.27 ± 0.00 61.40 ± 0.88 46.67 ± 0.00 63.11 ± 0.44 Famou-Agent 2.0 Gemini-3-Pro-Preview 80.30 ± 1.52 64.04 ± 2.32 42.22 ± 2.22 64.44 ± 1.18 Iris Claude-Opus-4.6 80.30 ± 1.50 64.00 ± 0.90 44.40 ± 2.20 64.90 ± 0.40 Open-source baselines ML-Master 2.0 DeepSeek-V3.2-Speciale 75.76 ± 1.51 50.88 ± 3.51 42.22 ± 2.22 56.44 ± 2.47 MLEvolve Gemini-3-Pro-Preview 80.30 ± 1.52 57.89 ± 1.52 42.22 ± 2.22 61.33 ± 1.33 PiEvolve Gemini-3-Pro-Preview 80.30 ± 1.52 58.77 ± 0.88 40.00 ± 0.00 61.33 ± 0.77 MLEvolve Gemini-3.1-Pro-Preview 80.30 ± 1.50 64.00 ± 0.90 46.70 ± 0.00 65.30 ± 0.80 ScienceFlow (Ours) DeepSeek-V4-Flash- Preview 80.30 ± 1.52 74.56 ± 0.88 44.44 ± 2.22 70.22 ± 1.18 Benchmark and Metric We evaluate ScienceFlow on the full MLE-bench (10), which contains 75 real-world Kaggle competitions spanning tabular, vision, language, audio, and time-series tasks. Each task requires the agent to construct an executable machine-learning pipeline and produce a valid submission evaluated on a held-out test set constructed from the original competition data. Unlike evaluations restricted to the 22-task Lite split, we report results on the official Lite, Medium, and High tiers and on the aggregate 75-task benchmark. The primary metric is Any-Medal rate: a task run succeeds when its submission reaches the Bronze, Silver, or Gold threshold derived from the original Kaggle leaderboard. ScienceFlow results are reported as mean ± SEM over three independent runs, while baseline statistics are retained in the form reported by their original sources. Model and Resource Budget For the primary MLE-bench evaluation, ScienceFlow uses DeepSeek-V4-Flash-Preview, with a 24-hour budget and at most 2 GPUs, 16–32 logical CPU cores, and 256 GB RAM per run. Because hardware and concurrency vary across systems, comparisons use wall-clock time rather than normalized accelerator-hours. Budget deviations are documented in Table A3 in Appendix B.1. Tools and Baselines ScienceFlow operates in a sandboxed Python environment, with network access limited to third-party packages and publicly available model checkpoints. Held-out test labels and test-derived feedback are never exposed to the agent; the test set is used only by the final scorer. Baselines are drawn from the official MLE-bench leaderboard (48) and publicly reported studies. 3.1.2 Main Results Table 1 summarizes the main results on MLE-bench. Across the full 75-task benchmark, ScienceFlow achieves an Any-Medal rate of 70.22±1.18%70.22± 1.18\%, exceeding the strongest reported baseline by 4.92 p. The three independent runs obtain medals on 54, 53, and 51 tasks, respectively, demonstrating consistent performance across runs. The improvement is particularly strong on the Medium tier, where ScienceFlow reaches 74.56±0.88%74.56± 0.88\%, 10.52 p above the best reported baseline. It also achieves 80.30±1.52%80.30± 1.52\% on Lite, matching the best reported result, and 44.44±2.22%44.44± 2.22\% on High, within 2.26 p of the best reported baseline. Overall, ScienceFlow performs consistently across task complexities, with its largest advantage concentrated on the Medium tier. The complete leaderboard and protocol annotations are provided in Table A3 in Appendix B.1. 3.1.3 Case Study and Ablations Long-horizon case study Figure 3: A 24-hour ScienceFlow trajectory on the Statoil Iceberg Classifier Challenge, showing validation and retrospective test progress together with checkpointed workspace states and resource-control events. Retrospective test scores are shown only for analysis and are never exposed to the research agent. We use the Statoil Iceberg Classifier Challenge, a satellite-SAR binary classification task, as a representative long-horizon case study. The task requires distinguishing icebergs from ships from satellite SAR imagery under the same 24-hour budget used throughout MLE-bench. ScienceFlow earns a medal in all three independent runs. Figure 3 traces one run and illustrates how recoverable workspace states, ESTRA transitions, and evidence-aware execution control interact over the course of research. The trajectory exhibits both state restoration and selective artifact reuse. After subsequent CNN-only exploration fails to improve the incumbent, ScienceFlow restores S59 as an execution anchor and redirects the search toward tree models over saved CNN features. A later unproductive stacking branch similarly returns to S112 before exploring a new route. Within these branches, the agent selectively reuses earlier workspace artifacts: S59 combines fold checkpoints from S02 and S53, S112 trains a LightGBM model on CNN logits and angle features derived from S53, and S123 combines the wide-64 and wide-96 assets from S53/S55. These operations reduce recomputation while improving validation loss from 0.11000.1100 at S02 to 0.05970.0597 at S123. Validation evidence continuously guides these trajectory decisions. The best validated loss decreases from 0.110.11 to 0.10250.1025 and finally 0.05970.0597, while exploratory trials that fail to improve the incumbent remain preserved in the archive for later comparison or reuse. Retrospective test scores shown in Figure 3 are never exposed to the agent. Their improvement alongside validation provides additional evidence that the validation signal used during search remains informative for the final submission. Resource control operates concurrently with trajectory search. Two workers share a single-GPU device pool, and the marked events show three controller decisions: preserving exclusive GPU access after a sharing review, terminating a CPU-active job that reports 0%0\% GPU utilization, and falling back from a blocked heavy execution to lightweight inference, which produces a valid submission in 13.9113.91 seconds. Research-route selection remains with the worker, while the controller admits and monitors the corresponding physical execution under the available resources. Figure 4: State-matched counterfactual replay on the Tabular Playground Series May 2022 task. Seven historical ESTRA decision points are replayed from their captured executable states under matched budgets. Each point compares four alternatives formed by current or archived anchors and extend or redirect directions. Bars show the mean change in retrospective private-test AUROC relative to the source state across three replay seeds, with error bars denoting sample standard deviation. Red arrows mark the actions selected in the historical run. State-matched re-anchoring study To isolate the effect of re-anchoring from differences in accumulated context and workspace artifacts, we replay seven historical ESTRA decisions from their captured executable states (Figure 4). At each decision point, four alternatives are evaluated by crossing the execution anchor (current or archived state) with the research direction (extend or redirect), using three replay seeds and matched four-hour resource budgets, for a total of 84 replay branches. Because all alternatives are launched from the same recorded decision context and resource budget, their differences enable a controlled comparison of the execution-anchor and research-direction choices. The historical ESTRA action achieves the best mean replay score, including ties, at five of the seven decision points. Relative to an oracle that selects the best of the four replayed actions at each point, the historical policy has zero median regret and a mean regret of 1.725×10−31.725× 10^-3 AUROC, with the largest regret of 11.572×10−311.572× 10^-3 occurring at P07. The two deviations provide complementary evidence about how action value depends on execution reliability and the remaining search horizon. At P04, the historical archived-redirect action underperforms the source state in all three four-hour replays, including one run that exhausts the replay budget and degrades substantially. The corresponding original trajectory later reaches a stronger downstream result after 5.26 hours, indicating that the observed regret reflects both short-horizon execution instability and delayed payoff. At P07, the historical decision extends the current trajectory near the end of the 24-hour budget, while the counterfactual replay favors restoration from a strong archived state. These cases illustrate that effective re-anchoring should account jointly for transition reliability, remaining budget, and archived-state quality. Figure 5: MLE-bench Lite mechanism ablation over a 24-hour window. Curves show the cumulative Any-Medal rate averaged over three seeds, and shaded bands show the sample standard deviation. Mechanism ablation We ablate ESTRA and Evidence-Aware Execution Control on the official 22-task MLE-bench Lite split under a 24-hour evaluation window. Figure 5 shows the cumulative first-medal rate over time, where a task is counted once it first reaches Bronze, Silver, or Gold. Curves show the mean across three seeds, with shaded bands denoting the sample standard deviation. At 24 hours, the full system reaches an Any-Medal rate of 80.30±2.62%80.30± 2.62\%, compared with 66.67±2.62%66.67± 2.62\% without ESTRA and 69.70±5.25%69.70± 5.25\% without execution control. The difference emerges early: by 12 hours, ScienceFlow reaches 77.27±4.55%77.27± 4.55\%, while the two ablations remain at 66.67±2.62%66.67± 2.62\% and 69.70±5.25%69.70± 5.25\%, respectively. The full system therefore improves both final Any-Medal rate and the speed of medal acquisition. Task-level trajectories further separate the two effects. On the Jigsaw Toxic Comment Classification Challenge, the median first-medal time increases from 2.12 hours with ScienceFlow to 5.17 hours without ESTRA, while the variant without execution control remains close to the full system at 2.41 hours. This comparison more directly associates the delay with the removal of ESTRA. Execution control becomes more consequential on longer-running tasks. On the APTOS 2019 Blindness Detection competition, removing Evidence-Aware Execution Control increases the median first-medal time from 5.18 to 8.05 hours, a 2.87-hour delay, while the slowest seed increases from 6.64 to 10.45 hours. The corresponding median without ESTRA is 5.91 hours, indicating that the larger delay is specifically associated with execution control. On the Leaf Classification competition, ScienceFlow succeeds in all three seeds, whereas both ablations fail in all three. Therefore, this task can be treated as evidence of joint mechanism dependence rather than attributing it to either mechanism alone. System-wide mechanism telemetry To complement the controlled ablations, Table 2 summarizes mechanism-level telemetry for 54 of the 75 MLE-bench tasks (72.0%) with both ESTRA activity and workspace-state records. We focus on post-ESTRA completions, checkpoint reuse, and snapshot reuse as operational indicators of recovery and state reuse, since explicit restoration events are only sparsely logged. These statistics characterize the behavior of ScienceFlow during execution and are not used for benchmark scoring. Table 2: Operational telemetry for ScienceFlow mechanisms on 54 of 75 MLE-bench tasks (72.0% coverage), including ESTRA activity, workspace-state reuse, storage efficiency, and resource control. Mechanism Sub-metric Value Interpretation ESTRA ESTRA decisions 561 total 469 continue; 92 switch. Post-ESTRA completions 71 completed points Post-ESTRA outcomes. Comparable improvements 19 / 70 (27.1%) Selective gains. Workspace state Checkpoint reuse 436 / 437 (99.8%) Near-complete reuse. Snapshot object reuse 177,234 / 221,925 (79.9%) Snapshot dedup. Storage footprint 2204.6 GiB → 189.2 GiB Storage-covered sources. Storage saving 91.4% Delta footprint. Resource control Device-utilization samples 20,075 samples Device samples. Mean utilization 27.5% Observed mean. Active device buckets 42.7% >10%>10\% util. buckets. Guard terminations 202 stops Guarded stops. Low-value early stops 157 stops Low-value stops. 3.1.4 Resource Sensitivity and Efficiency Resource-Constrained Performance We examine ScienceFlow under tighter storage, compute, and time budgets. We simulate a 32 GiB per-task storage limit and compare full workspace snapshots with delta-based states. Among the 33 tasks with available footprint measurements, all delta states remain below the limit, whereas nine medal-producing tasks exceed it when stored as full snapshots. Applying these observed violations to the three evaluation seeds reduces the Any-Medal rate from 70.22±1.18%70.22± 1.18\% with delta states to 59.11±0.44%59.11± 0.44\% with full snapshots. Across the measured tasks, delta states reduce the aggregate footprint from 2204.6 GiB to 189.2 GiB, a 91.4% reduction. Using the recorded task-level GPU configurations, we estimate each task to at most one GPU. A tighter compute budget produces a similar reduction in retained performance. Limiting each task to at most one GPU yields medals on 48, 48, and 47 tasks across the three runs, corresponding to 63.56±0.44%63.56± 0.44\% Any-Medal, compared with 70.22±1.18%70.22± 1.18\% under the reported two-GPU ceiling. Backbone Sensitivity and Efficiency We test ScienceFlow using four backbones: GLM-5.1, openPangu-2.0-Pro, DeepSeek-V4-Flash-Preview, and DeepSeek-V4-Pro-Preview, under the same two-worker, 24-hour protocol on the Tabular Playground Series May 2022 task. In addition to token consumption, model-priced LLM cost is reported to reflect differences in inference pricing across backbones. Figure 6 compares their 24-hour token trajectories and endpoint performance-cost trade-offs over three independent runs. openPangu-2.0-Pro is served from our local deployment without prefix/KV-cache optimization, resulting in a 0% cache-hit rate. Its cost is estimated using Huawei Cloud’s official uncached Pro pricing at the corresponding request-length tier.11 1 Huawei Cloud ModelArts Studio pricing, accessed August 3, 2026. We use the same model-specific pricing procedure for the other backbones so that reported costs reflect their actual inference tariffs rather than token counts alone. The results reveal distinct quality, throughput, and cost trade-offs. GLM-5.1 processes the most input context and achieves the highest mean test AUROC of 0.99470.9947, but its $8.11 LLM cost is approximately 84×84× that of DeepSeek-V4-Flash-Preview. DeepSeek-V4-Flash-Preview reaches 0.98820.9882 for $0.096, providing the strongest quality–cost trade-off among the lower-cost backbones. openPangu-2.0-Pro consumes fewer input tokens than DeepSeek-V4-Flash-Preview but reaches a lower mean AUROC of 0.98670.9867 at a higher cost of $0.447, and is therefore dominated by DeepSeek-V4-Flash-Preview on this task. DeepSeek-V4-Pro-Preview has the lowest cost at $0.074, but also the lowest mean AUROC at 0.98470.9847. The wider seed variation of openPangu-2.0-Pro and DeepSeek-V4-Pro-Preview further indicates that backbone choice affects reliability as well as throughput, cost, and endpoint quality. Given only three runs on one task, these comparisons are descriptive rather than statistically conclusive. (a) Cumulative input tokens. (b) Mean best test and cost. Figure 6: Backbone sensitivity and efficiency on the Tabular Playground Series May 2022 task under the same two-worker, 24-hour protocol, showing cumulative input-token consumption and endpoint performance-cost trade-offs over three independent runs. “DS” is an abbreviation for “DeepSeek” in the figure legends. 3.2 Mathematical and Engineering Optimization We evaluate ScienceFlow in two complementary optimization settings: mathematical optimization problems and tournament scheduling optimization. The former includes three auditable mathematical problems, while the latter considers the easy, medium, and hard tracks of the SpOC4 KTTSP challenge. Both require iterative construction and executable validation of candidate solutions, but differ in problem structure, resource budget, and evaluation protocol. Their setups and results are presented separately below. 3.2.1 Continuous Mathematical Optimization Tasks The mathematical optimization suite contains three problems. Circle Packing maximizes the sum of the radii of 26 disjoint circles inside a unit square under boundary and non-overlap constraints. Ratio Minimization minimizes dmax/dmind_ /d_ for a configuration of 16 planar points, where dmind_ and dmaxd_ are the minimum and maximum pairwise distances. Uncertainty Inequality searches over Hermite–Gaussian constructions to tighten a valid upper bound on the Fourier sign-uncertainty constant C4C_4; Appendix C.1 gives the formal definition. Protocol For each mathematical problem, ScienceFlow runs for a 12-hour wall-clock budget using two research workers and a single backbone per run. We evaluate DeepSeek-V4-Flash-Preview and openPangu-2.0-Pro. We rerun OpenEvolve (58) locally using its 500-iteration configuration with DeepSeek-V4-Flash-Preview, while published baselines retain their reported setups. Because budgets and worker topologies differ across systems, the comparison is descriptive rather than compute-normalized. All ScienceFlow scores are re-evaluated from saved solution artifacts using task-specific feasibility checks; Appendix C.2 provides the complete audit procedure. Results Table 3 reports the best audited score from each ScienceFlow configuration. On Circle Packing, ScienceFlow with DeepSeek-V4-Flash-Preview obtains 2.6359830849, approximately 7.5×10−97.5× 10^-9 above ThetaEvolve; at this scale, the two results are best interpreted as a numerical near tie. On Ratio Minimization, ScienceFlow obtains 3.590157365310609, matching MLEvolve at the table’s 12-decimal precision. On Uncertainty Inequality, ScienceFlow with openPangu-2.0-Pro reaches 0.343293122432, reducing the strongest published Hermite-based upper bound by 2.5%. DeepSeek-V4-Flash-Preview gives the better ScienceFlow result on the first two tasks, whereas openPangu-2.0-Pro performs better on the uncertainty task. Table 3: Best-score comparison on three mathematical optimization tasks. Arrows indicate the optimization direction. Bold entries denote the best compared results, including ties at the reported precision; underlined entries denote the second-best results. Published baselines retain their reported protocols, while OpenEvolve is rerun locally under the configuration described in the text. Uncertainty-inequality results compare only Hermite–Gaussian constructions. Task Method Model Performance Circle Packing ∑iri _ir_i (↑ ) AlphaEvolve (46) Gemini 2.0 Pro + Flash 2.6358627564 ShinkaEvolve (36) Claude Sonnet 4 + GPT-4.1 family 2.6359828390 ThetaEvolve (70) DeepSeek-R1-0528-Qwen3-8B 2.6359830774 MLEvolve (17) Gemini-3.1-Pro-Preview 2.6359830395 OpenEvolve (58) DeepSeek-V4-Flash-Preview 2.6344194866 ScienceFlow (Ours) DeepSeek-V4-Flash-Preview 2.6359830849 ScienceFlow (Ours) openPangu-2.0-Pro 2.6359824748 Ratio Minimization dmax/dmind_ /d_ (↓ ) AlphaEvolve (46) Gemini 2.0 Pro + Flash 3.590162407473 FM Agent (38) Gemini-2.5-Pro 3.590157406159 MLEvolve (17) Gemini-3.1-Pro-Preview 3.590157365311 OpenEvolve (58) DeepSeek-V4-Flash-Preview 3.658667107456 ScienceFlow (Ours) DeepSeek-V4-Flash-Preview 3.590157365311 ScienceFlow (Ours) openPangu-2.0-Pro 3.590157365325 Uncertainty Inequality C4C_4 bound (↓ ) AlphaEvolve (46) Gemini Pro + Flash 0.352099104423 FM Agent (38) Gemini-2.5-Pro 0.352099104416 MLEvolve (17) Gemini-3.1-Pro-Preview 0.352099104416 OpenEvolve (58) DeepSeek-V4-Flash-Preview 0.352581132500 ScienceFlow (Ours) DeepSeek-V4-Flash-Preview 0.348200107555 ScienceFlow (Ours) openPangu-2.0-Pro 0.343293122432 3.2.2 Combinatorial Scheduling Optimization Task KTTSP is a main challenge in the fourth ESA Space Optimisation Competition (SpOC4), organized with GECCO 2026 (19). It models a lunar-orbit collection mission in which a spacecraft must visit all targets in the shortest possible time. A solution jointly determines the target order, departure epochs, and flight durations. Transfers follow Lambert dynamics and must satisfy a ΔV V limit, with at most E higher-budget exceptions. We evaluate the easy, medium, and hard instances through the official ESA Optimise evaluator. Protocol ScienceFlow evaluates all three KTTSP tracks through the official SpOC4 evaluator, which accepts candidate solutions serialized in the prescribed JSON format. KTTSP-hard is assigned a separate ten-day campaign using DeepSeek-V4-Pro-Preview, DeepSeek-V4-Flash-Preview, and GLM-5.1, and provides the persisted worker trace used in the subsequent analysis. We report the public leaderboard outcomes for all three tracks. Because competing teams do not disclose uniform compute budgets or model configurations, the leaderboard provides an outcome comparison rather than a compute-normalized evaluation. Overall results ScienceFlow obtains scores of 116.911, 234.929, and 393.229 on KTTSP-easy, KTTSP-medium, and KTTSP-hard, ranking 10th, 8th, and 3rd, respectively. Because the three tracks use different instances, their raw mission times are not directly comparable across difficulty levels. On KTTSP-hard, ScienceFlow finishes 42.786 mission days ahead of the fourth-place entry, fcmaes (436.015), and 55.583 days behind the winning entry, TGMA (337.646). The campaign-level leaderboard score is 393.229; the worker-level trace analyzed below ends at 393.229. Long-horizon memory folding Figure 7 traces worker W01 during the ten-day KTTSP-hard campaign. Across 188 persisted snapshots, the result-card ledger in .run_results.md, which serializes the persistent memory mvm_v, grows from 0.65k to 87.9k characters. In contrast, the 114 recorded context packets assembled at research-segment boundaries remain between 4.4k and 13.4k characters, with a median size of 8.8k and a median paired packet-to-ledger ratio of 13.7%. This separation reflects the Add, Fold, and Assemble operations in Section 2.3.4: accumulated stage records remain persistent, while each new research segment receives a bounded, anchor-specific memory view. The reported packet sizes characterize this dynamic memory component rather than the complete context Pn+1P_n+1 of the next research segment. The trace contains 185 valid evaluation stages and 26 incumbent updates. W01 reduces the objective from 1928.39 mission days at S01 to 393.229 at S112, a 79.6% reduction. Improvement continues late in the campaign: after the incumbent remains at 1641.42 days on June 25, phase-aware route construction coincides with the S80 improvement to 573.03 days, and subsequent route and timing refinement reaches 420.27 at S97, 415.56 at S109, and 393.229 at S112. At this final incumbent, the most recent paired context packet contains 6.37k characters, compared with an 80.17k-character result-card ledger (7.9%). Fourteen subsequent valid trials do not improve the incumbent, indicating late-stage saturation rather than termination at the first strong solution. This single-run trace does not establish that memory folding causes the score improvements; it instead shows that late-stage improvement and continued validation can coexist with a persistent result-card history and bounded anchor-specific context packets. Table 4: Public leaderboard for the KTTSP-hard track. Scores report total mission elapsed time in days (lower is better), and timestamps identify each team’s best submission in UTC+8. Boldface marks the winning score and the ScienceFlow entry. In the model column, DS-V4-Preview denotes DeepSeek-V4-Flash-Preview, and DS-V4-Pro-Preview denotes DeepSeek-V4-Pro-Preview. Team names link to their public ESA Optimise profiles. Leaderboard snapshot accessed on July 6, 2026. Rank Team Model Score ↓ Submitted (UTC+8) 1 TGMA – 337.646 2026-07-01 13:50 2 AC_TUWien – 337.700 2026-07-01 01:05 3 ScienceFlow (Ours) DS-V4-Pro-Preview / DS-V4-Preview + GLM-5.1 393.229 2026-07-01 09:33 4 fcmaes – 436.015 2026-06-30 14:01 5 Team HRI – 526.078 2026-06-30 21:17 6 SINTEF – 587.050 2026-06-30 20:27 7 $tellaris – 613.794 2026-06-30 04:57 8 J&C SolExp – 879.511 2026-07-05 22:52 9 ScholORs_HFUU+Sunway – 1965.276 2026-05-02 18:10 Figure 7: Persistent-memory growth and validation progress for worker W01 during the ten-day KTTSP-hard campaign. The right axis uses log10(score/2000) _10(score/2000) coordinates with raw mission-day tick labels; lower is better. Invalid evaluation outputs are excluded. Peer-guided search The same trace illustrates cross-worker coordination at research-segment boundaries. At W01’s S25 research-segment boundary, W00 had reached 521.9054 mission days while W01 remained at 1746.8935; W00’s validated score prompted W01 to redirect from timing-only refinement toward route ordering. After W01 improved to 1321.8824 days, the S79 research-segment boundary supplied a compact method summary of W00’s search, prompting an operator-level redirect toward route swaps and continuous retiming. W01 subsequently reached a validated score of 420.2742 within 12 hours and 17 minutes of the S79 decision and later improved to 393.229. The workers exchanged no executable artifacts or workspace state; all subsequent candidates were generated and validated within W01’s isolated workspace. The trace therefore illustrates how peer evidence can guide route selection without direct solution reuse, rather than providing a controlled estimate of the coordination effect. Appendix D.4 provides the underlying records and checkpoint timeline. Route and timing refinement A KTTSP candidate contains two coupled decision components: a discrete visit permutation π=(v1,…,vN)π=(v_1,…,v_N) and a continuous schedule τ=(ti,tofi)i=1N−1τ=\(t_i,tof_i)\_i=1^N-1 of departure epochs and flight durations. Figure 8 compares two validated candidates generated during W01’s search: an inclination-binned phase ordering and a phase-proximal construction followed by multiresolution retiming. The procedures below summarize their decision structures while omitting implementation-specific optimization loops. These strategies are task-specific artifacts produced by the research worker rather than fixed components of ScienceFlow. Initial strategy: Inclination-binned phase ordering. BIN-INCLINATION → SORT-PHASE → CONCATENATE → FIXED-ROUTE RETIME The worker groups targets by inclination, orders each group by orbital phase, concatenates the groups, and then retimes the fixed route. This construction provides a feasible starting route but can retain unfavorable adjacencies at group boundaries. Refined strategy: Phase-proximal construction and retiming. PHASE-NEIGHBORS → LAMBERT-FILTER → APPEND-ROUTE → MULTIRESOLUTION-RETIME → FORWARD-PASS At each construction step, the worker considers phase-proximal successors, filters infeasible candidates with the Lambert evaluator, and appends a transfer-aware feasible choice. Coarse-to-fine retiming and a forward feasibility pass then update the schedule under the temporal and transfer constraints. Between the evaluator-valid S78 and S112 candidates, fewer than 7% of directed consecutive target pairs are shared, while mission duration decreases from 1321.8824 to 393.229 days, a 70.25% reduction. This descriptive comparison associates the improvement with joint route reordering and retiming rather than isolating individual search operators. (a) Initial strategy at S78: inclination-binned phase ordering (1321.8824 days). (b) Refined strategy at S112: phase-proximal construction and retiming (393.229 days). Figure 8: Route and timing refinement within the W01 KTTSP-hard trajectory. Figures (a) and (b) visualize two evaluator-valid candidates that visit the same target set. Target color progresses from blue to yellow with scheduled visit order, and thin links connect consecutive targets. 3.3 Scientific Modeling 3.3.1 Setup Benchmark and tasks SciModelingBench tests whether agents can use offline observations to find high-value designs for a hidden scientific or engineering objective. Its 12 tasks cover seven settings across DNA binding, RNA and protein design, superconducting materials, preclinical toxicology, and embodied control. Six DrugMatrix tasks use the same study collection but predict different clinical pathology endpoints. The suite begins with scientific settings from Design-Bench (66), but returns to their original data and rebuilds the tasks. Learned evaluators make validation approximate and risky under extrapolation (6); oracle architecture and training seed can also change method rankings (60). We instead standardize candidate identity and repeated measurements, remove split leakage, regenerate simulator labels with repeated rollouts, and keep only tasks with reproducible evaluators. The full provenance and reconstruction details are provided in Appendix E. Protocol Each task provides an objective, a typed manifest, and offline observations; evaluation candidates are separated by lower-score truncation or a structured holdout. The agent submits a ranked list of candidates. When trusted scores cover the full domain, it may propose any valid design for black-box optimization. Otherwise, it ranks a disclosed pool whose labels remain hidden. Both settings use measurements, exact lookups, or simulator outcomes rather than a fitted proxy. A fixed query budget allows iterative improvement, but each query returns only the score of the submitted batch, not individual candidate outcomes. Performance metrics We use best-K mean to reward a few strong designs, normalized enrichment for unordered batches, and global NDCG for ranked submissions. For a batch B of size N and reference pool P, normalized enrichment (NE) is defined as NE(B)=s¯B−s¯Ps¯TopN(P)−s¯PNE(B)= s_B- s_P s_Top_N(P)- s_P; random selection has expected score zero and the ideal batch scores one. We set split thresholds and batch sizes from data audits and preliminary baselines before the agent runs. For the aggregate score, Random maps to zero and the attainable oracle optimum to 100. The six DrugMatrix endpoints are averaged as one group, weighted equally with each of the six other tasks. Table 5: Task-level results under a two-hour budget with DeepSeek-V4-Flash-Preview. BKM, NE, and NDCG denote best-K mean, normalized enrichment, and global NDCG. Best and second-best agent scores are bolded and underlined. Task Metric Random OpenCode Pi Codex Claude Code ScienceFlow (Ours) Standalone scientific design tasks TFBind8 BKM 0.7533 0.9764 0.9730 0.9718 0.9648 0.9769 Superconductor NDCG 0.2800 0.4929 0.8671 0.8188 0.8132 0.8583 UTR MRL NE -0.0006 0.6523 0.7533 0.7424 0.7367 0.7605 TFBind10 Pho4 NE 0.0000 0.2467 0.2473 0.2024 0.3197 0.2543 GFP NE 0.0001 0.2600 0.2692 0.2586 0.1977 0.2732 Hopper Controller NDCG 0.1698 0.3917 0.3248 0.3755 0.3718 0.3756 Rat clinical pathology tasks (DrugMatrix) MCHC NDCG 0.1733 0.7344 0.3720 0.6178 0.6503 0.7220 MCH NDCG 0.2669 0.4147 0.3673 0.4242 0.3623 0.4793 Creatinine NDCG 0.1955 0.6081 0.7638 0.5681 0.8038 0.6995 Sodium NDCG 0.1519 0.7619 0.8283 0.7696 0.8498 0.8488 Chloride NDCG 0.1689 0.5106 0.4551 0.5589 0.5397 0.5488 Phosphorus NDCG 0.2040 0.4130 0.4917 0.3749 0.3999 0.5985 Table 6: Group-balanced results. Scores map Random to 0 and the attainable optimum to 100. The DrugMatrix endpoints form one group, weighted equally with each standalone task. Average rank uses the same seven groups. Best and second-best values are bolded and underlined; lower rank is better. Agent Standalone Design (6) Rat Clinical Pathology (6) Group-balanced Score ↑ 7-group Avg. Rank ↓ Task Wins Pi 52.77 43.12 51.39 2.79 1/12 Claude Code 51.65 49.64 51.37 3.69 3/12 Codex 51.49 43.79 50.39 3.64 1/12 OpenCode 43.84 46.44 44.21 3.33 2/12 ScienceFlow (Ours) 54.16 55.91 54.41 1.55 5/12 Model, compute and evaluation budget All systems use DeepSeek-V4-Flash-Preview with the same two-hour limit and the same task-level quota of 8–20 batch submissions, fixed before the runs. We run each system–task pair once and report its best valid submission within these limits. ScienceFlow splits the quota between two homogeneous workers, which share only short summaries of their best score and method. Each system–task run uses eight logical CPU cores, no accelerator, and less than 32 GiB peak RSS. Tools and baselines Agents receive an isolated workspace with shell, Python, and common data and machine-learning packages. Hidden labels and evaluator state remain outside the workspace, and network access is disabled. The model may still use knowledge learned during pretraining. We compare ScienceFlow with OpenCode, Pi, Codex, and Claude Code (49; 79; 47; 1). 3.3.2 Main Results We report results at both the task level and after group-balanced aggregation. As a reference, Random is the mean score of 5,000 uniformly sampled, task-sized batches. Each batch contains distinct candidates and, for ranking tasks, uses a random order. Table 7: Candidate coverage in the Phosphorus case study. Repeated conditions across batches are counted once; coverage is relative to the 390-condition candidate pool. System Distinct candidates Pool coverage ScienceFlow 66 16.9% Pi 38 9.7% OpenCode 32 8.2% Codex 24 6.2% Claude Code 32 8.2% (a) Group-balanced best-so-far score. (b) ScienceFlow’s signed margin over the strongest baseline at each budget fraction. Figure 9: Cross-task progress under matched query budgets. The DrugMatrix endpoints form one group, and ScienceFlow’s worker submissions are merged in chronological order. Table 5 reports the task-level results. All five systems beat Random on every task. ScienceFlow ranks first on five tasks and second on six, placing in the top two on 11 of 12. It leads on TFBind8, UTR MRL, GFP, MCH, and Phosphorus. Its largest margins over the runner-up are 0.0551 on MCH and 0.1068 on Phosphorus, while TFBind8 is nearly tied at a margin of 0.0005. Creatinine is its only result outside the top two. Table 6 summarizes the group-balanced comparison. ScienceFlow scores highest on both groups, with 54.16 on the standalone tasks and 55.91 on rat clinical pathology. Its overall score is 54.41, 3.02 points above Pi, and its average rank is 1.55 versus Pi’s 2.79. Each of the other agents leads at least one task, showing that their strengths differ by domain. 3.3.3 Analysis Case study: independent hypothesis coverage We use DrugMatrix Phosphorus as a case study of exploration under sparse feedback. Each system has eight batch evaluations and ranks 16 of 390 label-hidden five-day treatment conditions by their change in phosphorus relative to matched controls. The evaluator reports only a batch score, with no candidate-level labels. Table 7 summarizes coverage across the eight batches. ScienceFlow evaluates 66 distinct conditions, compared with 24–38 for the baselines. Its two workers each cover 43 conditions, with only 20 shared. One uses a general molecular and experimental-context model; the other models repeated measurements and matches treatment and control across dose and duration. Their partly non-overlapping coverage reflects complementary, protocol-aware hypotheses rather than duplicate searches, under the same eight submissions and batch-level feedback as the baselines. Query-budget saturation across tasks We next track the aggregate best-so-far score across all 12 tasks to see how quickly each system uses its query quota. Figure 9 shows that Codex leads from 10% through 20% of the quota, but ScienceFlow jumps from 38.43 to 52.24 at 25% and remains ahead thereafter. Its advantage over the strongest baseline is about five points at that point and ends at 3.01. By 50%, ScienceFlow, Codex, and Claude Code are within 2.2 points of their final scores, while Pi has reached 92% of its final score. By 80%, those four are within 0.36 points; OpenCode improves later. Most systems therefore approach their final result before exhausting the quota, leaving room for several rounds of refinement rather than making the last query decisive. 4 Related Work 4.1 Scientific Agents Several recent surveys systematize this rapidly fragmenting landscape along complementary axes: a six-stage methodological pipeline and three-phase historical evolution (63); a five-task taxonomy spanning scientific comprehension, academic survey, discovery, writing, and peer review (13); a decomposition into five foundational agent capabilities (reasoning and planning, tool integration, memory, multi-agent collaboration, and optimization) measured along an autonomy scale from “computational oracle” to “generative architect” (72); and a task-and-evaluation lifecycle view that emphasizes benchmarking, trustworthiness, and the risks of generative misuse (18). Representative end-to-end systems instantiate this paradigm across disciplines. In machine learning, The AI Scientist (41) unified idea generation, code execution, and paper writing into the first fully autonomous research loop, and its successor employs agentic tree search to explore parallel research directions and self-review the resulting manuscripts (74). In the natural sciences, agents now couple LLM reasoning with wet-lab hardware to autonomously plan, execute, and interpret experiments, from chemical synthesis (7) to the de-novo design of experimentally validated nanobodies by multi-agent virtual research teams (62), while generate–debate–evolve multi-agent systems (72) and self-evolving pipelines that expand their own toolkits (46) push toward long-horizon, cross-domain discovery. The same agentic primitives—iterative refinement over literature (3), case-based reasoning (25), reflection (59), and executable skill libraries for open-ended embodied learning (67)—recur across these systems, and analogous techniques now extend to software engineering (2), algorithm and reward design (53; 40; 20; 29), and open-ended scientific discovery (50). Despite this breadth, the field shares persistent limitations that the surveys converge on: brittle reproducibility and provenance, uncalibrated confidence and weak novelty validation, monolithic domain-specific architectures that fail to transfer, and long-horizon memories that cannot sustain causally-linked experiment histories (63; 72; 18). Machine-learning engineering is the most mature and most heavily benchmarked slice of this paradigm: a fully simulated discovery loop that exercises experimental preparation, execution, and iterative optimization without a wet lab, with protocols such as MLE-bench (10) providing a standardized, compute-bounded testbed. ScienceFlow is positioned squarely within this slice, advancing the execution, optimization, and memory capabilities that the broader AI-Scientist literature identifies as the binding bottlenecks to trustworthy autonomy. 4.2 MLE Agents MLE-bench (10) has recently emerged as the de facto evaluation protocol for autonomous machine-learning-engineering (MLE) agents. It curates 75 real-world Kaggle competitions spanning tabular, vision, language, audio, and time-series modalities, requiring agents to deliver end-to-end solutions within a fixed 24-hour budget on a single GPU. Submissions are evaluated directly against original Kaggle medal thresholds and screened for plagiarism via automated detectors. The reference baseline—the tree-search agent AIDE (33) powered by o1-preview—attains a mere 16.9% medal rate on the full benchmark. This pronounced gap between AI and human performance has catalyzed a rapid proliferation of novel agent architectures. We survey this expanding landscape along three complementary dimensions: search, multi-agent collaboration, and memory. Search- and evolution-driven agents A prominent line of work formulates solution generation as search over a structured code space. 65 provide a unifying formalization of these agents; critically, they demonstrate that under AIDE’s operator set, advanced search policies (e.g., Monte Carlo tree search, evolutionary algorithms) yield marginal benefits. Their analysis points to the operator set as a key bottleneck and further reveals a validation-to-test generalization gap that can misdirect search trajectories. ML-Master (39) expands this search process with MCTS-inspired exploration and a steerable reasoning engine conditioned on adaptive memory from parent and sibling trajectories. MARS (12) combines budget-aware MCTS with an efficiency-guided reward, a modular design-decompose-implement pipeline, and comparative reflective memory for credit assignment, achieving a 56%-62.7% medal rate. MLEvolve (17) further replaces the rigid search tree with Monte Carlo graph search, allowing non-adjacent solutions to recombine through cross-branch references. Together with an entropy-driven exploration schedule, it reaches a 65.3% medal rate under half of the standard time budget. Iris (22) shifts from solution-centric search to an inquiry, which builds revision loop over a revisable information state, using epistemic actions to resolve decision-critical unknowns and reaching a 64.9% Any-Medal rate under a 12-hour budget. Hierarchical multi-agent systems Rather than refining a centralized search policy, an alternative paradigm decomposes the engineering workflow into collaborating specialists. For instance, R&D Agent (76) implements a dynamic interaction between ”Researcher” and ”Developer” roles to periodically synthesize superior outcomes, while InternAgent (32) proposes a closed-loop framework that tightly integrates idea generation with experimental execution. To scale such coordination, the FM Agent (38) employs a multi-population island evolutionary model, augmented by expert-guided cold starts and diversity-driven sampling on a distributed asynchronous infrastructure. Addressing cognitive biases, MLE-STAR (44) counteracts the tendency of agents to over-rely on familiar, outdated models through web-search-based initialization and ablation-guided code refinement, integrating explicit data-leakage checkers for robustness. More recently, AIBuildAI (80) introduces a hierarchical Manager–Designer–Coder–Tuner topology that adaptively orchestrates seven parallel solution repositories, boosting the full-benchmark medal rate to 63.1%. Memory, knowledge, and long-horizon control Because long-horizon MLE tasks generate extensive execution histories that quickly saturate context windows, contemporary architectures prioritize restructuring memory over simply expanding it. ML-Master 2.0 (83) introduces a three-tier hierarchical cognitive cache that distills transient execution traces into cross-task insights, lifting the full-benchmark success rate to 56.4%. KAPSO (43) grounds code optimization in a Git-native experimentation engine and a typed knowledge graph extracted from thousands of repositories, achieving a 50.7% medal rate. Other works target environment reliability and state persistence: a file-as-bus framework (11) externalizes decision-relevant states for long-horizon control; Arbor (34) maintains a persistent hypothesis tree regulated by a held-out merge gate; and EurekAgent (73) posits that engineering the operational environment, including permissions, artifacts, and budgets, is more critical than prescribing rigid workflows. Complementary efforts explore reinforcement learning for strategic ideation (82), lightweight ReAct-style memory tiers (16), and alignment risks, demonstrating that agents can be steered to sandbag or backdoor solutions while evading language-model monitors (71). Closest mechanisms and distinction Several adjacent systems expose individual mechanisms used by ScienceFlow, but assign them different roles. AutoSci stores typed project artifacts and lifecycle states in an active research memory (52), while MAGE organizes action–observation histories as an execution-state tree and revises erroneous segments from a restored boundary (14). PIVOT instead refines planned trajectories through repeated execution and verification (81). At the systems layer, recent agentic schedulers combine admission control with live CPU–GPU telemetry (69) or use an LLM and runtime monitor to select immediate GPU execution, queued GPU execution, or CPU offload (42). ScienceFlow does not claim that memory, checkpointing, trajectory revision, or resource scheduling is individually new. Its distinction is to make a recoverable executable research state—not a dialogue trace, candidate script, workflow variable, or inference session—the common object of persistence, trajectory adaptation through re-anchoring, and evidence-aware execution control. Consequently, scientific route selection remains with the research agent, whereas a separate controller owns resource admission and termination authority using both physical constraints and validated research progress. 4.3 Optimization Agents Parallel to the MLE-bench paradigm, a distinct class of autonomous agents has emerged to tackle numerical and combinatorial optimization. Rather than relying on fixed heuristics, these agents iteratively propose, evaluate, and refine solutions, and are benchmarked on standard black-box suites (e.g., BBOB (28)) as well as high-stakes engineering tasks. The core challenge is that an agent must operate within a limited interaction budget, extract actionable knowledge from a growing trial history, and balance exploration with exploitation. We survey this agent-driven optimization landscape along three complementary dimensions: prompt-level search, agent-guided algorithm design, and hierarchical multi-agent end-to-end pipelines. Agents That Optimize at the Prompt Level The most direct agent architecture converts optimization into a natural-language sequential decision process. Instead of explicitly coding search operators, the agent relies entirely on prompt-based reasoning over previous trials (15). The OPRO framework exemplifies this approach: it encapsulates the entire optimization trajectory within a meta-prompt, enabling the agent to propose improved candidates solely by analyzing score sequences (75). This paradigm has achieved state-of-the-art results in prompt tuning, code generation, and even mathematical reasoning. Nevertheless, pure prompt-level agents often exhibit strong warm-start behavior but stagnate in later iterations, lacking the rigorous exploration-exploitation trade-off mechanisms inherent to classical solvers. Consequently, hybrid agents are being developed that couple prompt-based candidate generation with Bayesian optimization surrogates, combining semantic insight with principled uncertainty management. Agents That Design Optimization Algorithms A second dimension elevates the role of the agent from solution proposer to solver architect. Here, agents are embedded within classical optimization pipelines as intelligent components that design, configure, and evolve the algorithms themselves. Rather than merely executing a fixed solver, these agents actively shape the optimization process: they recommend promising candidate solutions informed by domain priors, strategically narrow or restructure the search space to focus on high-potential regions, and filter or rank evaluated candidates to guide subsequent iterations (51; 77). Beyond solution-level guidance, agents also autonomously synthesize novel crossover and mutation operators by analyzing historical population statistics (61), dynamically adjust algorithm hyperparameters in response to convergence trends, and serve as lightweight surrogate evaluators that predict solution quality to reduce costly full simulations (78). Works such as EvoLLM (35) demonstrate that an agent can iteratively refine a differential evolution algorithm across generations, effectively endowing the solver with self-evolution capabilities. This shifts the optimization problem from finding a single solution to continuously improving the algorithm that finds solutions. Hierarchical Multi-Agent End-to-End Optimization Pipelines A hierarchical multi-agent system can decompose complex optimization workflows into specialized roles when a single agent cannot effectively manage problem formulation, constraint analysis, code generation, and evaluation. Typical architectures decompose the workflow into specialized roles such as algorithm selection, constraint analysis, code generation, and execution evaluation, which collectively form a fully automated pipeline that covers the entire optimization life cycle (24; 5). These collectives have demonstrated competitive performance on standard benchmarks and have been extended to adversarial settings where multiple agents cooperatively generate adversarial examples to probe and improve model robustness. Furthermore, experience-driven multi-agent frameworks allow agents to accumulate and transfer knowledge across tasks, dramatically improving sample efficiency in repeated black-box attack scenarios. By distributing cognitive load and enabling inter-agent critique, these hierarchical architectures deliver more robust and high-quality solutions than their single-agent counterparts. 5 Conclusion We have introduced ScienceFlow, a workspace-grounded autonomous research system for long-horizon executable work. ScienceFlow combines recoverable workspace states, ESTRA-governed transitions between research segments, and evidence-aware execution control, while supporting configurable homogeneous research workers with isolated workspaces and synchronization at research-segment boundaries. We evaluated ScienceFlow across machine learning engineering, mathematical and engineering optimization, and scientific modeling and design. ScienceFlow achieves 70.22±1.18%70.22± 1.18\% Any-Medal on the full 75-task MLE-bench. Across mathematical and engineering optimization, ScienceFlow matches the strongest results on circle packing and ratio minimization, improves the best published Hermite-based uncertainty bound by 2.5%, and ranks third on KTTSP-hard. On SciModelingBench, ScienceFlow achieves the best group-balanced score of 54.41 among the evaluated agents. Overall, ScienceFlow delivers strong and consistent performance across a diverse range of long-horizon autonomous research tasks. Contributions and Acknowledgments Mingming Zhao, Jiqian Dong, Kangping Xu† † Work completed during an internship., Zadid Hasan, Chengrui Fan, Shan Jiang, Shuai Mao, Ting Lingya, Linyi Zou, Tailin Zhou, Yun Hin Chan, Wenkai Zhang, Zhanhong Zhou, Guowei Huang, Hongliang Li, Wenjing Cun, Zhitang Chen** * Team leaders., Mingxuan Yuan*, and Yanhui Geng*. References Anthropic (2026) Anthropic Claude Code. Note: npm software releaseVersion 2.1.72; accessed August 12, 2026 External Links: Link Cited by: Appendix E, §3.3.1. Antoniades et al. (2025) A. Antoniades, A. Örwall, K. Zhang, Y. Xie, A. Goyal, and W. Y. Wang SWE-search: enhancing software agents with monte carlo tree search and iterative refinement. In International Conference on Learning Representations, Cited by: §4.1. Baek et al. (2025) J. Baek, S. K. Jauhar, S. Cucerzan, and S. J. Hwang Researchagent: iterative research idea generation over scientific literature with large language models. In Proceedings of the 2025 conference of the nations of the Americas chapter of the association for computational linguistics: human language technologies (volume 1: long papers), p. 6709–6738. Cited by: §4.1. Barrera et al. (2016) L. A. Barrera, A. Vedenko, J. V. Kurland, et al. Survey of variation in human transcription factors reveals prevalent DNA binding changes. Science 351 (6280), p. 1450–1454. External Links: Document Cited by: Table A8. Baumann and Kramer (2025) J. Baumann and O. Kramer An llm-based multi-agent framework for evolutionary blackbox optimization. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, GECCO ’25 Companion, New York, NY, USA, p. 671–674. External Links: ISBN 9798400714641, Document Cited by: §4.3. Beckham et al. (2024) C. Beckham, A. Piché, D. Vázquez, and C. Pal Exploring validation metrics for offline model-based optimisation with diffusion models. Transactions on Machine Learning Research. External Links: Link Cited by: §3.3.1. Boiko et al. (2023) D. A. Boiko, R. MacKnight, B. Kline, and G. Gomes Autonomous chemical research with large language models. Nature 624 (7992), p. 570–578. External Links: ISSN 1476-4687 Cited by: §4.1. Bolotin (2016) D. Bolotin Local fitness landscape of the green fluorescent protein. Note: figshare datasetDataset; C BY 4.0 External Links: Document, Link Cited by: Table A8. Botla et al. (2025) S. K. Botla, K. Sankar, A. Chopde, and F. Pettiwala Pi-Evolve: long-horizon evolutionary optimization for autonomous scientific discovery. Note: GitHub softwareAccessed August 12, 2026 External Links: Link Cited by: Table A3. Chan et al. (2025) J. S. Chan, N. Chowdhury, O. Jaffe, J. Aung, D. Sherburn, E. Mays, G. Starace, K. Liu, L. Maksin, T. Patwardhan, et al. Mle-bench: evaluating machine learning agents on machine learning engineering. International Conference on Learning Representations. Cited by: §1, §3.1.1, §4.1, §4.2. Chen et al. (2026a) G. Chen, J. Chen, L. Chen, J. Zhao, F. Meng, W. X. Zhao, R. Song, C. Chen, J. Wen, and K. Jia Toward autonomous long-horizon engineering for ml research. arXiv preprint arXiv:2604.13018. Cited by: §1, §1, §4.2. Chen et al. (2026b) J. Chen, B. D. Mishra, J. Nam, R. Meng, T. Pfister, and J. Yoon MARS: modular agent with reflective search for automated ai research. arXiv preprint arXiv:2602.02660. Cited by: Table A3, §4.2. Chen et al. (2025) Q. Chen, M. Yang, L. Qin, J. Liu, Z. Yan, J. Guan, D. Peng, Y. Ji, H. Li, M. Hu, Y. Zhang, Y. Liang, Y. Zhou, J. Wang, Z. Chen, and W. Che AI4Research: A Survey of Artificial Intelligence for Scientific Research. Note: arXiv:2507.01903 External Links: 2507.01903 Cited by: §4.1. Chen et al. (2026c) Y. Chen, H. Lai, Y. Feng, C. Han, et al. Beyond semantic organization: memory as execution state management for long-horizon agents. arXiv preprint arXiv:2606.06090. Cited by: §1, §4.2. Cheng et al. (2024) J. Cheng, X. Liu, K. Zheng, P. Ke, H. Wang, Y. Dong, J. Tang, and M. Huang Black-box prompt optimization: aligning large language models without model training. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), p. 3201–3219. Cited by: §4.3. Chopde et al. (2025) A. Chopde, F. Pettiwala, S. Kirubananth, S. K. Botla, and P. A. Kethan PiML: automated machine learning workflow optimization using LLM agents. In Proceedings of the Fourth International Conference on Automated Machine Learning, Proceedings of Machine Learning Research, Vol. 293, p. 1/1–42. External Links: Link Cited by: §4.2. Du et al. (2026) S. Du, X. Yan, J. Shi, Z. Cao, S. Feng, Z. Liang, B. Sun, T. Peng, Y. Zhou, X. Li, J. Zhou, L. He, B. Zhang, and L. Bai MLEvolve: a self-evolving framework for automated machine learning algorithm discovery. arXiv preprint arXiv:2606.06473. Cited by: Table A3, Table 3, Table 3, Table 3, §4.2. Eger et al. (2026) S. Eger, Y. Cao, J. D’Souza, A. Geiger, C. Greisinger, S. Gross, Y. Hou, B. Krenn, A. Lauscher, Y. Li, C. Lin, N. S. Moosavi, W. Zhao, and T. Miller Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation. Note: arXiv:2502.05151 External Links: 2502.05151 Cited by: §4.1, §4.1. European Space Agency, Advanced Concepts Team (2026) European Space Agency, Advanced Concepts Team SpOC 4: Space Logistics. Note: European Space Agency competition webpageAccessed August 12, 2026 External Links: Link Cited by: §D.1, §3.2.2. Faldor et al. (2025) M. Faldor, J. Zhang, A. Cully, and J. Clune OMNI-EPIC: open-endedness via models of human notions of interestingness with environments programmed in code. In International Conference on Learning Representations, Cited by: §4.1. Fordyce Lab (2018) Fordyce Lab BET-seq Processed Data. Note: figshare datasetDataset; C BY 4.0 External Links: Document, Link Cited by: Table A8. Fu et al. (2026) S. Fu, Y. Tao, L. Jin, J. Zhao, Q. Shi, T. Pan, H. Li, C. Wang, J. Wu, and C. Huo Beyond solution-centric search: adaptive inquiry and knowledge revision for autonomous ML engineering. arXiv preprint arXiv:2608.02143. Cited by: Table A3, §4.2. Gonçalves et al. (2017) F. Gonçalves, D. O. e Silva, and S. Steinerberger Hermite polynomials, linear flows on the torus, and an uncertainty principle for roots. Journal of Mathematical Analysis and Applications 451 (2), p. 678–711. External Links: Document, Link Cited by: §C.1. Guo et al. (2025) H. Guo, Z. Ma, Y. Ma, X. Zhang, W. Chen, and Y. Gong DesignX: human-competitive algorithm designer for black-box optimization. Advances in Neural Information Processing Systems 38, p. 6582–6615. Cited by: §4.3. Guo et al. (2024) S. Guo, C. Deng, Y. Wen, H. Chen, Y. Chang, and J. Wang DS-agent: automated data science by empowering large language models with case-based reasoning. In Proceedings of the 41st International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 235, p. 16813–16848. External Links: Link Cited by: §4.1. Hamidieh (2018a) K. Hamidieh A data-driven statistical model for predicting the critical temperature of a superconductor. Computational Materials Science 154, p. 346–354. External Links: Document Cited by: Table A8. Hamidieh (2018b) K. Hamidieh Superconductivty data. Note: UCI Machine Learning RepositoryDataset; C BY 4.0 External Links: Document, Link Cited by: Table A8. Hansen et al. (2021) N. Hansen, A. Auger, R. Ros, O. Mersmann, T. Tušar, and D. Brockhoff COCO: a platform for comparing continuous optimizers in a black-box setting. Optimization Methods and Software 36 (1), p. 114–144. Cited by: §4.3. Hazra et al. (2025) R. Hazra, A. Sygkounas, A. Persson, A. Loutfi, and P. Z. D. Martires REvolve: reward evolution with large language models using human feedback. In International Conference on Learning Representations, Cited by: §4.1. HeyNeo Team (2025) HeyNeo Team Neo: next-generation ai agents. Note: https://heyneo.so/blog Cited by: Table A3. Hume et al. (2015) M. A. Hume, L. A. Barrera, S. S. Gisselbrecht, and M. L. Bulyk UniPROBE, update 2015: new tools and content for the online database of protein-binding microarray data on protein–DNA interactions. Nucleic Acids Research 43 (D1), p. D117–D122. External Links: Document Cited by: Table A8. InternAgent Team (2025) InternAgent Team InternAgent: when agent becomes the scientist – building closed-loop system from hypothesis to verification. arXiv preprint arXiv:2505.16938 [cs.AI]. Cited by: Table A3, §4.2. Jiang et al. (2025) Z. Jiang, D. Schmidt, D. Srikanth, D. Xu, I. Kaplan, D. Jacenko, and Y. Wu AIDE: ai-driven exploration in the space of code. arXiv preprint arXiv:2502.13138. Cited by: Table A3, §4.2. Jin et al. (2026) J. Jin, Y. Hu, K. Qiu, Q. Dai, C. Luo, G. Dong, X. Li, T. Zhao, X. Ma, G. Zhang, et al. Toward generalist autonomous research via hypothesis-tree refinement. arXiv preprint arXiv:2606.11926. Cited by: §4.2. Lange et al. (2024) R. Lange, Y. Tian, and Y. Tang Large language models as evolution strategies. In Proceedings of the Genetic and Evolutionary Computation Conference Companion, p. 579–582. Cited by: §4.3. Lange et al. (2025) R. T. Lange, Y. Imajuku, and E. Cetin Shinkaevolve: towards open-ended and sample-efficient program evolution. arXiv preprint arXiv:2509.19349. Cited by: Table 3. Le et al. (2018) D. D. Le, T. C. Shimko, A. K. Aditham, A. M. Keys, S. A. Longwell, Y. Orenstein, and P. M. Fordyce Comprehensive, high-resolution binding energy landscapes reveal context dependencies of transcription factor binding. Proceedings of the National Academy of Sciences 115 (16), p. E3702–E3711. External Links: Document Cited by: Table A8. Li et al. (2025) A. Li, C. Wu, Z. Ge, Y. H. Chong, Z. Hou, L. Cao, C. Ju, J. Wu, H. Li, H. Zhang, S. Feng, M. Zhao, F. Qiu, R. Yang, M. Zhang, W. Zhu, Y. Sun, Q. Sun, S. Yan, D. Liu, D. Yin, and D. Shen The FM agent. CoRR abs/2510.26144. Cited by: Table A3, Table 3, Table 3, §4.2. Liu et al. (2025) Z. Liu, Y. Cai, X. Zhu, Y. Zheng, R. Chen, Y. Wen, Y. Wang, S. Chen, et al. ML-master: towards ai-for-ai via integration of exploration and reasoning. arXiv preprint arXiv:2506.16499. Cited by: Table A3, §4.2. Lu et al. (2024a) C. Lu, S. Holt, C. Fanconi, A. J. Chan, J. N. Foerster, M. van der Schaar, and R. T. Lange Discovering preference optimization algorithms with and for large language models. In Advances in Neural Information Processing Systems, Cited by: §4.1. Lu et al. (2024b) C. Lu, C. Lu, R. T. Lange, J. Foerster, J. Clune, and D. Ha The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery. Note: arXiv:2408.06292 External Links: 2408.06292 Cited by: §1, §4.1. Lu and Reda (2026) T. Lu and S. Reda Agentic cpu-gpu scheduling for heterogeneous ai workloads. arXiv preprint arXiv:2607.22242. Cited by: §1, §4.2. Nadafian et al. (2026) A. Nadafian, A. Mohammadshahi, and M. Yazdani KAPSO: a knowledge-grounded framework for autonomous program synthesis and optimization. arXiv preprint arXiv:2601.21526. Cited by: Table A3, §4.2. Nam et al. (2025) J. Nam, J. Yoon, J. Chen, J. Shin, S. Ö. Arık, and T. Pfister MLE-star: machine learning engineering agent via search and targeted refinement. arXiv preprint arXiv:2506.15692. Cited by: Table A3, §4.2. National Toxicology Program (NTP) (2023) National Toxicology Program (NTP) DrugMatrix. National Institute of Environmental Health Sciences. Note: Chemical Effects in Biological Systems (CEBS) External Links: Document, Link Cited by: Table A8. Novikov et al. (2025) A. Novikov, N. Vũ, M. Eisenberger, E. Dupont, P. Huang, A. Z. Wagner, S. Shirobokov, B. Kozlovskii, F. J. R. Ruiz, A. Mehrabian, M. P. Kumar, A. See, S. Chaudhuri, G. Holland, A. Davies, S. Nowozin, P. Kohli, and M. Balog AlphaEvolve: a coding agent for scientific and algorithmic discovery. External Links: 2506.13131, Link Cited by: §C.1, §C.1, §C.1, §1, Table 3, Table 3, Table 3, §4.1. OpenAI (2026a) OpenAI Codex CLI. Note: npm software releaseVersion 0.144.5; accessed August 12, 2026 External Links: Link Cited by: Appendix E, §3.3.1. OpenAI (2026b) OpenAI MLE-bench Leaderboard. Note: GitHub repositoryAccessed August 12, 2026 External Links: Link Cited by: §B.1, §3.1.1. OpenCode Contributors (2026) OpenCode Contributors OpenCode: the open source AI coding agent. Note: npm software releaseVersion 1.18.4; accessed August 12, 2026 External Links: Link Cited by: Appendix E, §3.3.1. O’Neill et al. (2025) C. O’Neill, T. Ghosal, R. Răileanu, M. Walmsley, T. Bui, K. Schawinski, and I. Ciucă Sparks of science: hypothesis generation using structured paper data. arXiv preprint arXiv:2504.12976. Cited by: §4.1. Pandit et al. (2025) S. Pandit, A. Jain, R. Cohen, Z. Deng, S. Karandikar, S. Perel, A. Raghunathan, and P. Ranganathan LLM-box : an agentic framework for guided black-box optimization in mapping LLMs onto specialized hardware accelerators. In Machine Learning for Systems 2025, Cited by: §4.3. Qian et al. (2026) W. Qian, B. Xu, Z. Xie, B. Fan, et al. AutoSci: a memory-centric agentic system for the full scientific research lifecycle. arXiv preprint arXiv:2605.31468. Cited by: §1, §1, §4.2. Romera-Paredes et al. (2024) B. Romera-Paredes, M. Barekatain, A. Novikov, M. Balog, M. P. Kumar, E. Dupont, F. J. R. Ruiz, J. S. Ellenberg, P. Wang, O. Fawzi, P. Kohli, and A. Fawzi Mathematical discoveries from program search with large language models. Nature 625 (7995), p. 468–475. External Links: ISSN 1476-4687 Cited by: §4.1. Sample et al. (2019) P. J. Sample, B. Wang, D. W. Reid, V. Presnyak, I. J. McFadyen, D. R. Morris, and G. Seelig Human 5’ UTR design and variant effect prediction from a massively parallel translation assay. Nature Biotechnology 37 (7), p. 803–809. External Links: Document Cited by: Table A8. Sample et al. (2018) P. J. Sample, B. Wang, and G. Seelig Human 5’ UTR design and variant effect prediction from a massively parallel translation assay. Note: NCBI Gene Expression OmnibusDataset; accession GSE114002 External Links: Link Cited by: Table A8. Sarkisyan et al. (2016) K. S. Sarkisyan, D. A. Bolotin, M. V. Meer, et al. Local fitness landscape of the green fluorescent protein. Nature 533 (7603), p. 397–401. External Links: Document Cited by: Table A8. SciModelingBench (2026) SciModelingBench SciModelingBench Design-Bench Data. Note: Hugging Face datasetHugging Face dataset, version 0.10.0 Cited by: §1. Sharma (2025) A. Sharma OpenEvolve: an open-source evolutionary coding agent. Note: GitHub softwareAccessed August 12, 2026 External Links: Link Cited by: §3.2.1, Table 3, Table 3, Table 3. Shinn et al. (2023) N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao Reflexion: language agents with verbal reinforcement learning. In Advances in Neural Information Processing Systems, Vol. 36, p. 8634–8652. Cited by: §4.1. Surana et al. (2024) S. Surana, N. Grinsztajn, T. Atkinson, P. Duckworth, and T. D. Barrett Overconfident oracles: limitations of in silico sequence design benchmarking. In ICML 2024 Workshop on AI for Science, External Links: Link Cited by: §3.3.1. Suwandi et al. (2025) R. C. Suwandi, F. Yin, J. Wang, R. Li, T. Chang, and S. Theodoridis Adaptive kernel design for bayesian optimization is a piece of CAKE with LLMs. In The Thirty-ninth Annual Conference on Neural Information Processing Systems, Cited by: §4.3. Swanson et al. (2025) K. Swanson, W. Wu, N. L. Bulaong, J. E. Pak, and J. Zou The virtual lab of AI agents designs new SARS-CoV-2 nanobodies. Nature 646, p. 716–723. Cited by: §4.1. Tie et al. (2026) G. Tie, P. Zhou, and L. Sun A Survey of AI Scientists. Note: arXiv:2510.23045 External Links: 2510.23045 Cited by: §1, §4.1, §4.1. Todorov et al. (2012) E. Todorov, T. Erez, and Y. Tassa MuJoCo: a physics engine for model-based control. In IEEE/RSJ International Conference on Intelligent Robots and Systems, p. 5026–5033. External Links: Document Cited by: Table A8. Toledo et al. (2025) E. Toledo, K. Hambardzumyan, M. Josifoski, R. Hazra, N. Baldwin, A. Audran-Reiss, M. Kuchnik, D. Magka, M. Jiang, A. M. Lupidi, et al. AI research agents for machine learning: search, exploration, and generalization in mle-bench. arXiv preprint arXiv:2507.02554. Cited by: Table A3, §1, §4.2. Trabucco et al. (2022) B. Trabucco, X. Geng, A. Kumar, and S. Levine Design-Bench: benchmarks for data-driven offline model-based optimization. In Proceedings of the 39th International Conference on Machine Learning, Proceedings of Machine Learning Research, Vol. 162, p. 21658–21676. External Links: Link Cited by: Appendix E, Table A8, §3.3.1. Wang et al. (2023) G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar Voyager: an open-ended embodied agent with large language models. arXiv preprint arXiv:2305.16291. Cited by: §4.1. Wang et al. (2025a) X. Wang, B. Li, Y. Song, F. F. Xu, X. Tang, M. Zhuge, J. Pan, Y. Song, B. Li, J. Singh, et al. Openhands: an open platform for ai software developers as generalist agents. International Conference on Learning Representations. Cited by: Table A3. Wang et al. (2026) Y. Wang, H. Ye, Y. Xu, C. Guo, C. Wei, Q. Wang, D. Li, T. Chen, H. Li, D. Zhuo, and Y. Chen MARS: efficient, adaptive co-scheduling for heterogeneous agentic systems. arXiv preprint arXiv:2604.26963. Cited by: §1, §4.2. Wang et al. (2025b) Y. Wang, S. Su, Z. Zeng, E. Xu, L. Ren, X. Yang, Z. Huang, X. He, L. Ma, B. Peng, H. Cheng, P. He, W. Chen, S. Wang, S. S. Du, and Y. Shen ThetaEvolve: test-time learning on open problems. arXiv preprint arXiv:2511.23473. Cited by: Table 3. Ward et al. (2025) F. R. Ward, T. van der Weij, H. Gábor, S. Martin, R. Mehta Moreno, H. Lidar, L. Makower, T. Jodrell, and L. Robson CTRL-ALT-DECEIT: sabotage evaluations for automated AI R&D. Advances in Neural Information Processing Systems. Cited by: §4.2. Wei et al. (2025) J. Wei, Y. Yang, X. Zhang, Y. Chen, X. Zhuang, Z. Gao, D. Zhou, G. Wang, Z. Gao, J. Cao, Z. Qiu, M. Hu, C. Ma, S. Tang, J. He, C. Song, X. He, Q. Zhang, C. You, S. Zheng, N. Ding, W. Ouyang, N. Dong, Y. Cheng, S. Sun, L. Bai, and B. Zhou From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discovery. Note: arXiv:2508.14111 External Links: 2508.14111 Cited by: §1, §4.1, §4.1, §4.1. Xin et al. (2026) A. Xin, J. Siow, J. Wang, Z. Yao, J. Song, L. Hou, J. Li, and F. Zhang EurekAgent: agent environment engineering is all you need for autonomous scientific discovery. arXiv preprint arXiv:2606.13662. Cited by: §4.2. Yamada et al. (2025) Y. Yamada, R. T. Lange, C. Lu, S. Hu, C. Lu, J. Foerster, J. Clune, and D. Ha The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search. Note: arXiv:2504.08066 External Links: 2504.08066 Cited by: §1, §4.1. Yang et al. (2024) C. Yang, X. Wang, Y. Lu, H. Liu, Q. V. Le, D. Zhou, and X. Chen Large language models as optimizers. In The Twelfth International Conference on Learning Representations, Cited by: §4.3. Yang et al. (2025a) X. Yang, X. Yang, S. Fang, Y. Zhang, J. Wang, B. Xian, Q. Li, J. Li, M. Xu, Y. Li, H. Pan, Y. Zhang, W. Liu, Y. Shen, W. Chen, and J. Bian R&D-Agent: an LLM-agent framework towards autonomous data science. arXiv preprint arXiv:2505.14738. Cited by: Table A3, §4.2. Yang et al. (2025b) Z. Yang, D. Wang, L. Ge, B. Wang, T. Fu, and Y. Li Reasoning bo: enhancing bayesian optimization with long-context reasoning power of llms. arXiv preprint arXiv:2505.12833. Cited by: §4.3. Yuan et al. (2026) J. Yuan, J. Wang, Z. Wang, Q. Sun, R. Wang, and J. Li AgenticGEO: a self-evolving agentic system for generative engine optimization. arXiv preprint arXiv:2603.20213. Cited by: §4.3. Zechner (2026) M. Zechner Pi Coding Agent. Note: npm software releaseVersion 0.81.1; accessed August 12, 2026 External Links: Link Cited by: Appendix E, §3.3.1. Zhang et al. (2026a) R. Zhang, P. Qin, Q. Cao, L. Zhang, and P. Xie AIBuildAI: an ai agent for automatically building ai models. arXiv preprint arXiv:2604.14455. Cited by: Table A3, §4.2. Zhang et al. (2026b) T. Zhang, A. Popa, Y. Xu, R. Song, and D. Dimitriadis PIVOT: bridging planning and execution in llm agents via trajectory refinement. arXiv preprint arXiv:2605.11225. Cited by: §1, §4.2. Zhang et al. (2026c) Y. Zhang, K. Zhou, Z. Xu, K. Ramnath, Y. Zhou, S. Woo, H. Ding, and L. L. Cheong Learning to ideate for machine learning engineering agents. arXiv preprint arXiv:2601.17596. Cited by: §4.2. Zhu et al. (2026) X. Zhu, Y. Cai, Z. Liu, B. Zheng, C. Wang, R. Ye, J. Chen, H. Wang, W. Wang, Y. Zhang, L. Zhang, W. E, D. Jin, and S. Chen Toward ultra-long-horizon agentic science: cognitive accumulation for machine learning engineering. arXiv preprint arXiv:2601.10402. Cited by: Table A3, §1, §4.2. Appendix A Implementation Details A.1 Context Construction and Interaction Pipeline Within each research segment, ScienceFlow follows a standard reasoning–action–observation loop. At the start of the segment, it assembles the model-facing context in a fixed order from a stable prefix, the selected anchor state, and the ESTRA direction; segment-local interaction history is then accumulated during tool use. Table A1 details these components and their update scopes, complementing the context assembly defined in Section 2.3.4. Table A1: Model-facing context components in assembly order. The first four components form the cache-friendly prefix; subsequent components vary with the recoverable state or current research segment. Component Contents Update scope PworkerP_worker Generic research-worker and workspace-interaction policy Worker lifecycle PruntimeP_runtime Runtime behavior, safety, and tool-use policy Worker lifecycle PtoolsP_tools Tool names, descriptions, argument schemas, and call policy Worker lifecycle PtaskP_task Objective, evaluator contract, budget envelope, task adapter, and initial analysis guidance Task run Panchor(an)P_anchor(a_n) Workspace view, folded or unfolded memory, validation evidence, and resource status for the selected anchor Research segment Pdir(dn)P_dir(d_n) Extend-or-redirect instruction selected by ESTRA Research segment hv,jh_v,j Reasoning outputs, tool calls, and compact observations Tool-use round Initial segment. The initial segment combines the stable context PstableP_stable with a compact view of the initial workspace W0W_0. The task component specifies the objective, evaluator contract, resource budget, and required artifact interface. For MLE-bench, the initial guidance prioritizes file and modality inspection, leakage-safe validation, and a bounded baseline before expensive training. For optimization tasks, it specifies the objective, constraints, evaluator, and candidate-solution contract. These instructions define the initial inspection priorities, while subsequent actions remain selected by the worker’s local policy. Schematic context views for initial and subsequent segments [stable prefix: P_stable] worker: generic research-worker policy runtime: execution and tool-use policy tools: read / search / edit / write / execute / inspect task: objective + evaluator + budget + artifact contract [initial segment] workspace_view: View(W_0) instruction: inspect task -> analyze data -> build bounded baseline [subsequent segment] anchor: current_state | archived_state workspace_view: View(W(a_n)) memory_view: Fold(m(a_n); B_mem) [+ optional Unfold(...)] validation: e(a_n) resources: l(a_n) + remaining budget B_t direction: extend | redirect closed_branch: Fold(completed exploration) [segment-local history: h_n,j] reasoning -> tool action -> observation -> workspace update -> ... Stage-gate and research-segment transitions. During forward research, a task-specific result signal invokes the stage gate. The gate records a result card qvq_v, snapshots the active workspace as WvW_v, stores validation evidence eve_v and resource records ℓv _v, and inserts the resulting state svs_v into the archive. The worker then resumes the current research segment, with the stage-gate exchange excluded from its segment-local history. A text-only response or context-capacity limit closes the current segment and invokes ESTRA to select the next anchor ana_n and direction dnd_n. A current-state anchor retains the live workspace, whereas an archived-state anchor restores the corresponding workspace exactly and folds the post-anchor branch into completed evidence. The underlying result cards remain indexed and can later be retrieved through Unfold. Stable-prefix caching. The stable prefixPstable=Pworker⊕Pruntime⊕Ptools⊕PtaskP_stable=P_worker P_runtime P_tools P_task is placed before all anchor-specific and segment-local content. The worker policy, runtime instructions, and tool schemas remain fixed over the worker lifecycle, while the task contract remains fixed within a task run. Workspace views, memory, validation evidence, resource status, and ESTRA directions are appended afterward and updated at research-segment boundaries. This ordering preserves a common prefix across tool rounds and research segments. Backend-reported cache telemetry is recorded when available, while cache availability does not alter the research-state transitions. A.2 ESTRA Decision and Re-Anchoring Pipeline ESTRA, introduced in Section 2.3.3, jointly selects an execution anchor ana_n and a research direction dnd_n at each research-segment boundary. The anchor determines whether the next research segment retains the current workspace or restores an archived executable state, while the direction determines whether research extends the selected route or redirects from it. When an archived anchor is selected, exploration performed after that anchor is folded into completed evidence before the next research segment begins. Table A2: Evidence provided to ESTRA at a research-segment boundary. Optional components are included only when corresponding records are available. Component Contents Current state Active workspace summary, latest result card, and current validation evidence Archived anchors Recoverable states with workspace summaries and associated validation evidence Memory view Folded research history, recent result cards, and indexed evidence available through Unfold Peer evidence Optional validated scores and compact method summaries from other workers Resource envelope BtB_t Remaining wall-clock budget and current execution constraints Decision prompt ESTRA evaluates candidate anchors using their validation evidence, recoverable workspace contents, recent progress, failure history, peer evidence, and the remaining resource budget. The validation metric is treated as one signal rather than the sole decision criterion, allowing ESTRA to preserve promising but not yet leading routes or redirect from saturated ones. Tool use is disabled during this deliberation, and the research worker returns one structured decision specifying the anchor ana_n, direction dnd_n, supporting evidence, and intended search focus. Schematic ESTRA decision contract decision axes: anchor = current_state | archived_state direction = extend | redirect evidence: current_state archived_anchor_candidates memory_view validation_history optional_peer_evidence remaining_resource_budget requirements: select exactly one anchor and one direction identify the current bottleneck justify the decision using recorded evidence specify the next search focus structured output: anchor, target_state, direction, bottleneck, supporting_evidence, decision_reason, next_search_focus Folding and segment initialization. At a research-segment boundary, Fold summarizes the completed exploration as historical evidence for the next research segment. If ESTRA selects the current state, ScienceFlow retains the active workspace and folds the research segment that just ended. If it selects an archived state, ScienceFlow restores the corresponding workspace snapshot and folds the post-anchor branch that is no longer active. The original result cards and archived states remain preserved and addressable. ScienceFlow then applies Assemble to combine the stable prefix, selected-anchor context, ESTRA direction, and optional peer evidence into Pn+1P_n+1. Schematic ESTRA folding and segment initialization [completed exploration] terminal_state: Syy selected_anchor: current_state | archived_state Sxx direction: extend | redirect folded_evidence: methods attempted validated outcomes observed failures avoid-repeat guidance [next segment] stable_prefix: P_stable workspace: current workspace | Restore(W(Sxx)) anchor_context: memory view validation evidence resource records workspace view direction_context: extend | redirect optional_context: peer evidence local_history: empty The anchor and direction axes yield four ESTRA outcomes: extending or redirecting from either the current state or an archived state. Exact workspace restoration is required only when an archived anchor is selected. Appendix D.3 presents a recorded archived-anchor transition and its folded post-anchor branch, while Appendix D.4 presents a KTTSP research-segment boundary at which peer evidence is included in the ESTRA context before a subsequent redirect. Appendix B MLE-bench Supplementary Results B.1 Evaluation on the Full MLE-bench Set We report per-task results on all 75 MLE-bench competitions, grouped by the official Lite, Medium, and High complexity splits. Each Score is the mean task-specific benchmark score over three independent runs. Because evaluation metrics differ across competitions, these raw scores should not be compared across tasks. A checkmark in Any-Medal indicates that at least one of the three runs reached a bronze, silver, or gold threshold. For each run, Cost($) is the cumulative LLM/API expenditure up to the first medal-producing result; if no medal is obtained, it is the total expenditure over the complete run. The reported cost is averaged over the three runs and excludes accelerator infrastructure costs. First Medal Time (h) is averaged only over medal-producing runs and is reported as “–” when no run earns a medal. A value of 0 in GPUs denotes CPU-only execution. All runs use DeepSeek-V4-Flash-Preview as the research-worker backbone. The per-task Any-Medal indicator reports the best observed outcome across runs and is therefore descriptive. It differs from Table 1, which computes the medal rate independently for each run and reports mean ± SEM across three runs. Collapsing the archive by competition yields 54 of 75 tasks (72.0%) with at least one medal: 22 gold, 17 silver, and 15 bronze. Four-hour archival cutoff. The Time dimension in Figure 1(b) uses archived first-medal timestamps to characterize continued progress beyond a short horizon. By the four-hour cutoff, 35 of 75 tasks (46.67%) had a documented medal-producing result; the final archive contains at least one medal for 54 tasks. The four-hour value is a descriptive best-observed cutoff reconstructed from available task logs, rather than the mean of three independent four-hour evaluations. It should therefore be interpreted as trajectory evidence that additional tasks continue to reach medal quality after four hours, not as a compute-normalized comparison or a causal estimate of any individual ScienceFlow mechanism. The full-setting endpoint shown in the profile follows the headline three-run 24-hour result of 70.22±1.18%70.22± 1.18\%. Official-leaderboard entries below follow the public MLE-bench leaderboard (48); available system papers are cited alongside the corresponding agent names. Table A3: Full-set MLE-bench Any-Medal results. Values are percentages reported as mean ± SEM over three runs. Baseline results retain their published reporting protocols. Systems are grouped by source, and the best result in each column is bolded. Agent LLM(s) used Lite (%) Medium (%) High (%) All (%) ScienceFlow (Ours)5 DeepSeek-V4-Flash-Preview 80.30 ± 1.52 74.56 ± 0.88 44.44 ± 2.22 70.22 ± 1.18 Public study Iris (22)4 Claude-Opus-4.6 80.30 ± 1.50 64.00 ± 0.90 44.40 ± 2.20 64.90 ± 0.40 MLEvolve (17)6 Gemini-3.1-Pro-Preview 80.30 ± 1.50 64.00 ± 0.90 46.70 ± 0.00 65.30 ± 0.80 Official leaderboard Famou-Agent 2.0 (38) Gemini-3-Pro-Preview 80.30 ± 1.52 64.04 ± 2.32 42.22 ± 2.22 64.44 ± 1.18 AIBuildAI (80) Claude-Opus-4.6 77.27 ± 0.00 61.40 ± 0.88 46.67 ± 0.00 63.11 ± 0.44 CAIR MARS+ (12) Gemini-3-Pro-Preview 78.79 ± 1.52 60.53 ± 1.52 44.44 ± 2.22 62.67 ± 0.77 MLEvolve4 Gemini-3-Pro-Preview 80.30 ± 1.52 57.89 ± 1.52 42.22 ± 2.22 61.33 ± 1.33 PiEvolve (9) Gemini-3-Pro-Preview3 80.30 ± 1.522 58.77 ± 0.882 40.00 ± 0.002 61.33 ± 0.772 Famou-Agent 2.0 Gemini-2.5-Pro 75.76 ± 1.52 57.89 ± 1.52 40.00 ± 0.00 59.56 ± 0.89 ML-Master 2.0 (83) DeepSeek-V3.2-Speciale 75.76 ± 1.51 50.88 ± 3.51 42.22 ± 2.22 56.44 ± 2.47 CAIR MARS Gemini-3-Pro-Preview 74.24 ± 1.52 52.63 ± 3.04 37.78 ± 2.22 56.00 ± 1.54 PiEvolve4 Gemini-3-Pro-Preview3 74.24 ± 3.032 45.61 ± 0.882 35.55 ± 2.222 52.00 ± 0.772 Leeroo (43) Gemini-3-Pro-Preview3 68.18 ± 2.622 44.74 ± 1.522 40.00 ± 0.002 50.67 ± 1.332 Thesis gpt-5-codex 65.15 ± 1.52 45.61 ± 7.18 31.11 ± 2.22 48.44 ± 3.64 CAIR MLE-STAR-Pro-1.5 (44) Gemini-2.5-Pro 68.18 ± 2.62 34.21 ± 1.52 33.33 ± 0.00 44.00 ± 1.33 Famou-Agent Gemini-2.5-Pro 62.12 ± 1.52 36.84 ± 1.52 33.33 ± 0.00 43.56 ± 0.89 Operand ensemble gpt-5 (low verbosity/effort)1 63.64 ± 0.00 33.33 ± 0.882 20.00 ± 0.002 39.56 ± 0.442 CAIR MLE-STAR-Pro-1.04 Gemini-2.5-Pro 66.67 ± 1.52 25.44 ± 0.88 31.11 ± 2.22 38.67 ± 0.77 InternAgent (32)4 DeepSeek-R1 62.12 ± 3.03 26.32 ± 2.63 24.44 ± 2.22 36.44 ± 1.18 R&D-Agent (76)4 gpt-5 68.18 ± 2.62 21.05 ± 1.52 22.22 ± 2.22 35.11 ± 0.44 Neo (30) multi-agent4 undisclosed 48.48 ± 1.52 29.82 ± 2.32 24.44 ± 2.22 34.22 ± 0.89 AIRA-dojo (65) o3 55.00 ± 1.47 21.97 ± 1.17 21.67 ± 1.07 31.60 ± 0.82 R&D-Agent o3 + GPT-4.1 51.52 ± 4.01 19.30 ± 3.16 26.67 ± 0.00 30.22 ± 0.89 ML-Master (39)4 DeepSeek-R1 48.48 ± 1.52 20.18 ± 2.32 24.44 ± 2.22 29.33 ± 0.77 R&D-Agent o1-preview 48.18 ± 1.11 8.95 ± 1.05 18.67 ± 1.33 22.40 ± 0.50 AIDE (33) o1-preview 35.91 ± 1.86 8.45 ± 0.43 11.67 ± 1.27 17.12 ± 0.61 AIDE gpt-4o-2024-08-06 18.55 ± 1.26 3.06 ± 0.33 8.15 ± 0.84 8.63 ± 0.54 AIDE claude-3-5-sonnet 19.70 ± 1.52 2.63 ± 1.52 2.22 ± 2.22 7.56 ± 1.60 OpenHands (68) gpt-4o-2024-08-06 12.12 ± 1.52 1.75 ± 0.88 2.22 ± 2.22 4.89 ± 0.44 AIDE llama-3.1-405b 10.23 ± 1.14 0.66 ± 0.66 0.00 ± 0.00 3.33 ± 0.38 MLAB gpt-4o-2024-08-06 4.55 ± 0.86 0.00 ± 0.00 0.00 ± 0.00 1.60 ± 0.27 1 Uses light assistance from Gemini-2.5-Pro, Grok-4, and Claude 4.1 Opus, distilled by Gemini-2.5-Pro. 2 For incomplete three-run evaluations, missing runs are counted as Any-Medal failures when computing the reported mean and SEM. 3 Uses Gemini-3-Pro-Preview primarily, with selected modules using GPT-5 and GPT-5-mini. 4 Uses a reported 12 h or 36 h per-task budget rather than the standard 24 h budget; the exact setting follows the cited source. 5 ScienceFlow evaluates tensorflow-speech-recognition-challenge using the corrected setup from MLE-bench issue #63; baseline aggregates are retained as reported. 6 MLEvolve with Gemini-3.1-Pro-Preview uses a 12 h per-task budget. Table A4: Per-task results on the 22-task MLE-bench Lite split. Field definitions follow Section B.1. Competition Name Year Score Cost($) GPUs Any-Medal First Medal Time (h) detecting-insults-in-social-commentary 2012 0.9588 0.0618 1 ✓ 2.54 the-icml-2013-whale-challenge-right-whale-redux 2013 0.9486 1.4995 1 ✓ 0.12 mlsp-2013-birds 2013 0.9099 0.1483 1 ✓ 1.95 random-acts-of-pizza 2015 0.7713 1.0641 1 ✓ 0.35 denoising-dirty-documents 2015 0.0116 0.0141 1 ✓ 1.08 text-normalization-challenge-russian-language 2017 0.9791 0.3177 1 ✓ 1.35 dogs-vs-cats-redux-kernels-edition 2017 0.0150 0.0150 1 ✓ 0.48 spooky-author-identification 2017 0.2800 0.2299 1 ✓ 3.66 text-normalization-challenge-english-language 2017 0.9965 0.1472 1 ✓ 1.59 leaf-classification 2017 0.0121 0.0603 0 ✓ 5.76 jigsaw-toxic-comment-classification-challenge 2018 0.9865 0.1521 1 ✓ 2.93 new-york-city-taxi-fare-prediction 2018 4.8527 0.2986 0 - - nomad2018-predict-transparent-conductors 2018 0.0550 0.1805 0 ✓ 0.09 dog-breed-identification 2018 0.3525 0.5283 1 - - aerial-cactus-identification 2019 1.0000 0.2885 1 ✓ 2.11 aptos2019-blindness-detection 2019 0.9204 0.3543 1 ✓ 4.84 histopathologic-cancer-detection 2019 0.9970 0.0214 1 ✓ 1.07 siim-isic-melanoma-classification 2020 0.9353 1.9233 2 ✓ 11.98 plant-pathology-2020-fgvc7 2020 0.9928 0.0283 1 ✓ 0.46 ranzcr-clip-catheter-line-classification 2021 0.9124 0.2221 1 - - tabular-playground-series-dec-2021 2021 0.9622 0.0106 0 ✓ 0.42 tabular-playground-series-may-2022 2022 0.9882 0.5283 0 - - Table A5: Per-task results on the 38-task MLE-bench Medium split. Field definitions follow Section B.1. Competition Name Year Score Cost($) GPUs Any-Medal First Medal Time (h) AI4Code 2022 0.7911 1.6478 1 - - alaska2-image-steganalysis 2020 0.8992 1.6478 2 ✓ 22.27 billion-word-imputation 2014 4.4668 0.1794 2 ✓ 7.87 cassava-leaf-disease-classification 2021 0.8995 0.3477 2 ✓ 11.77 cdiscount-image-classification-challenge 2017 0.7248 0.4307 2 ✓ 23.04 chaii-hindi-and-tamil-question-answering 2021 0.7458 0.0056 1 ✓ 6.11 champs-scalar-coupling 2019 0.6758 0.4361 1 - - facebook-recruiting-i-keyword-extraction 2013 0.5037 1.6478 0 - - freesound-audio-tagging-2019 2019 0.7346 0.2054 1 ✓ 2.04 google-quest-challenge 2020 0.3806 0.1189 1 ✓ 1.05 h-and-m-personalized-fashion-recommendations 2022 0.0248 0.0309 0 ✓ 10.20 herbarium-2020-fgvc7 2020 0.4146 0.1594 1 ✓ 2.97 herbarium-2021-fgvc8 2021 0.1656 0.4524 1 ✓ 4.06 herbarium-2022-fgvc9 2022 0.6994 0.2894 1 ✓ 6.88 hotel-id-2021-fgvc8 2021 0.1116 0.1905 1 ✓ 2.57 hubmap-kidney-segmentation 2021 0.9681 0.0891 1 ✓ 0.45 icecube-neutrinos-in-deep-ice 2023 1.3585 0.2270 1 - - imet-2020-fgvc7 2020 0.6544 0.6925 1 ✓ 22.33 inaturalist-2019-fgvc6 2019 0.2972 0.2171 1 ✓ 3.49 iwildcam-2020-fgvc7 2020 0.7329 0.1496 1 ✓ 2.63 jigsaw-unintended-bias-in-toxicity-classification 2019 0.8494 0.3405 1 - - kuzushiji-recognition 2019 0.9527 0.0462 1 ✓ 3.01 learning-agency-lab-automated-essay-scoring-2 2024 0.8355 0.6734 1 ✓ 1.27 lmsys-chatbot-arena 2024 1.0010 0.4159 1 ✓ 9.55 multi-modal-gesture-recognition 2013 0.2177 0.1462 1 ✓ 7.96 osic-pulmonary-fibrosis-progression 2020 -6.7620 1.5486 2 ✓ 11.87 petfinder-pawpularity-score 2022 16.9877 0.9553 1 ✓ 12.03 plant-pathology-2021-fgvc8 2021 0.9072 0.1213 1 ✓ 1.42 seti-breakthrough-listen 2021 0.8002 2.1684 1 ✓ 6.25 statoil-iceberg-classifier-challenge 2018 0.1349 3.0067 1 ✓ 23.42 tensorflow-speech-recognition-challenge 2018 0.9841 1.2587 1 ✓ 1.52 tensorflow2-question-answering 2020 0.5691 0.1996 1 - - tgs-salt-identification-challenge 2018 0.7704 1.1963 1 - - tweet-sentiment-extraction 2020 0.7178 0.8099 1 ✓ 11.80 us-patent-phrase-to-phrase-matching 2022 0.8707 0.4126 1 ✓ 4.01 uw-madison-gi-tract-image-segmentation 2022 0.6902 2.4634 1 - - ventilator-pressure-prediction 2021 0.3384 0.5535 1 - - whale-categorization-playground 2018 0.4783 0.8077 1 ✓ 3.70 Table A6: Per-task results on the 15-task MLE-bench High split. Field definitions follow Section B.1. Competition Name Year Score Cost($) GPUs Any-Medal First Medal Time (h) 3d-object-detection-for-autonomous-vehicles 2019 0.0597 0.1874 1 ✓ 1.73 bms-molecular-translation 2021 4.8469 1.0800 1 - - google-research-identify-contrails-reduce-global-warming 2023 0.4474 4.1043 1 - - hms-harmful-brain-activity-classification 2024 0.8100 4.1043 1 - - iwildcam-2019-fgvc6 2019 0.2107 0.1442 1 ✓ 0.68 nfl-player-contact-detection 2023 0.6585 4.1043 1 ✓ 1.63 predict-volcanic-eruptions-ingv-oe 2021 3,068,390.3330 2.8259 1 ✓ 4.57 rsna-2022-cervical-spine-fracture-detection 2022 0.5613 4.1043 1 - - rsna-breast-cancer-detection 2023 0.1225 4.1043 1 - - rsna-miccai-brain-tumor-radiogenomic-classification 2021 0.6163 4.4492 1 ✓ 0.59 siim-covid19-detection 2021 0.4527 4.1043 1 - - smartphone-decimeter-2022 2022 4.6753 4.1043 0 - - stanford-covid-vaccine 2020 0.2272 0.0580 1 ✓ 0.07 vesuvius-challenge-ink-detection 2023 0.1415 4.1043 1 - - vinbigdata-chest-xray-abnormalities-detection 2021 0.3344 0.4418 1 ✓ 1.43 B.2 Operational Telemetry Coverage All 75 tasks are included in the performance evaluation under the same ScienceFlow protocol. The operational analysis is retrospective and requires both ESTRA-event records and checkpoint/snapshot telemetry. Both streams are available for 54 tasks; the remaining 21 tasks retain benchmark outcomes but lack complete mechanism-level records. The smaller denominator therefore reflects telemetry availability rather than task selection or a different system configuration. These records support the mechanism analysis in Table 2. Appendix C Mathematical Optimization Details C.1 Formal Task Definitions Circle packing. For n=26n=26, a candidate consists of circle centers pi=(xi,yi)∈[0,1]2p_i=(x_i,y_i)∈[0,1]^2 and radii ri≥0r_i≥ 0. The task is max∑i=126pi,rii=126risubject tori≤xi,yi≤1−ri,∥pi−pj∥2≥ri+rj(i≠j). _\p_i,r_i\_i=1^26 _i=1^26r_i to r_i≤ x_i,y_i≤ 1-r_i, p_i-p_j _2≥ r_i+r_j (i≠ j). (A1) The first constraint keeps every circle inside the unit square, and the second prevents pairwise overlap. The reported score is the sum of radii of a feasible configuration, so larger values are better (46). Ratio minimization. A candidate is a set of n=16n=16 distinct points P=p1,…,p16⊂ℝ2P=\p_1,…,p_16\ ^2. Define dmin(P)=mini<j∥pi−pj∥2,dmax(P)=maxi<j∥pi−pj∥2.d_ (P)= _i<j p_i-p_j _2, d_ (P)= _i<j p_i-p_j _2. (A2) The objective is minP:dmin(P)>0ρ(P),ρ(P)=dmax(P)dmin(P). _P:\,d_ (P)>0ρ(P), ρ(P)= d_ (P)d_ (P). (A3) The objective is invariant to translation, rotation, and uniform scaling. AlphaEvolve defines the objective as ρ(P)ρ(P) but follows the source packing tables in reporting ρ(P)2ρ(P)^2 (46). To match Table 3, we take the positive square root of such published values and report ρ(P)ρ(P) for every method; lower values are better. Uncertainty inequality. For an integrable real-valued function f:ℝ→ℝf:R , let f^(ξ)=∫ℝf(x)e−2πixξx,A(f)=infr>0:f(x)≥0 for all |x|≥r. f(ξ)= _Rf(x)e^-2π ixξ\,dx, A(f)= \r>0:f(x)≥ 0 for all |x|≥ r\. (A4) For nonzero even functions satisfying maxf(0),f^(0)<0 \f(0), f(0)\<0 and having finite A(f)A(f) and A(f^)A( f), the Fourier sign-uncertainty constant is C4=inffA(f)A(f^).C_4= _fA(f)A( f). (A5) Our benchmark follows the first, Hermite-polynomial formulation used by 46, which refines the construction of 23. It searches over Q(z)=∑k=0mckH4k(z),f(x)=Q(2πx)e−πx2,Q_ c(z)= _k=0^mc_kH_4k(z), f_ c(x)=Q_ c( 2π\,x)e^-π x^2, (A6) where HjH_j is the physicists’ Hermite polynomial. The degrees 4k4k make f_ c invariant under the Fourier transform. As in the official AlphaEvolve verifier, the final coefficient is chosen so that Q(0)=0Q_ c(0)=0, and the polynomial is oriented to be positive at infinity. After removing the resulting factor z2z^2, let rmaxr_ be the largest positive real root across which Q(z)/z2Q_ c(z)/z^2 changes sign. The evaluator returns U()=rmax22π,C4≤U().U( c)= r_ ^22π, C_4≤ U( c). (A7) Thus the reported score is the verified Hermite-construction upper bound on C4C_4, and lower values are better. This benchmark does not include the separate Laguerre-polynomial refinement also discussed by AlphaEvolve. C.2 Evaluation and Feasibility Audit ScienceFlow candidates are re-evaluated from the JSON artifacts stored in immutable workspace snapshots rather than from rounded stage-ledger metrics. The audit parses the saved decimal literals, verifies the task-specific structure and feasibility conditions, and recomputes the displayed objective. Unreadable artifacts, malformed candidates, and candidates that fail the corresponding feasibility test are excluded from comparison. Circle packing. The strict audit treats every saved coordinate and radius as an exact decimal rational and applies the inequalities in Equation A1 with zero numerical tolerance. It records the minimum boundary slack and the minimum squared pairwise slack. For a candidate with a small negative slack, we also compute the smallest common radius reduction δ≥0δ≥ 0 that makes its fixed centers feasible; the repaired score is ∑iri−26δ _ir_i-26δ. This repair is used only to produce a conservative feasible score and never to improve a candidate. The artifact underlying the reported value 2.63598308492.6359830849 requires δ=9.26×10−15δ=9.26× 10^-15 and yields the strictly feasible score 2.635983084917455692.63598308491745569, which is unchanged at the precision shown in Table 3. Ratio minimization. The audit parses coordinates with 60-digit decimal precision, requires exactly 16 two-dimensional points, recomputes all 120 pairwise Euclidean distances, and rejects a candidate when dmin=0d_ =0. It then evaluates dmax/dmind_ /d_ directly, avoiding the six-decimal inverse-squared metric stored in the stage ledger. The best audited DeepSeek-V4-Flash-Preview candidate gives 3.5901573653106093.590157365310609, while the best openPangu-2.0-Pro candidate gives 3.5901573653253704783.590157365325370478. Both values are reported as the unsquared ratio dmax/dmind_ /d_ . Uncertainty inequality. We reconstruct the public AlphaEvolve B.4 Hermite verifier exactly. The audit enforces Q(0)=0Q_ c(0)=0 and a positive limit at infinity, divides out the factor z2z^2, computes the real roots symbolically, and selects the largest positive sign-changing root using 200-digit root approximations. The resulting bound is evaluated by Equation A7. The reported ScienceFlow bounds 0.3482001075550.348200107555 and 0.3432931224320.343293122432 both pass this verifier. Baseline provenance. Published entries in Table 3 are transcribed from their cited papers or released repositories and retain the construction and precision reported by those sources; they are not presented as independent reruns. The AlphaEvolve uncertainty entry is independently reproduced with its public Hermite verifier. OpenEvolve is run locally as described in Section 3.2.1; its retained scores come from the local task evaluator. In particular, its circle-packing output does not preserve the final evaluated coordinates for a separate exact-decimal audit. The local paper archive contains the derived audit summaries used here; some corresponding raw run artifacts remain in the original experiment storage and are not duplicated in the paper repository. Appendix D SpOC4-KTTSP Supplementary Details D.1 Competition, Tracks, and Evaluation Protocol SpOC4 is the fourth Space Optimisation Competition organized by ESA’s Advanced Concepts Team. Its Keplerian Tomato Traveling Salesperson Problem asks a spacecraft to collect all targets in lunar orbit in minimum mission time while respecting orbital-transfer and maneuverability constraints (19). We evaluate the three official instances. The easy, medium, and hard tracks contain 50, 182, and 1,052 targets, respectively; their minimum transfer times are 0.001, 0.01, and 1/14401/1440 days, and their maximum mission durations are 200, 500, and 3,000 days. For an N-target instance, a submission contains a permutation of all targets, N−1N-1 departure epochs, and N−1N-1 transfer durations. The evaluator checks the permutation, time bounds, and chronological consistency before solving each transfer with a Lambert solver in both directions and with at most 20 revolutions. A nominal leg may use at most 100ms−1100\,m\,s^-1 of ΔV V; at most five exception legs may exceed this threshold, and no leg may exceed 600ms−1600\,m\,s^-1. The score is the arrival time at the final target in days, so lower is better. Candidates are serialized as an official-format JSON decision vector, and invalid candidates receive no score. Trajectory evaluation is CPU-only. The easy and medium results were obtained through staged continuation runs, whereas KTTSP-hard used the separate ten-day campaign described in Section 3.2.2, with DeepSeek-V4-Pro-Preview, DeepSeek-V4-Flash-Preview, and GLM-5.1. Because resumed stages and worker counts differed across tracks, we report the public leaderboard outcomes without treating them as a compute-normalized comparison. D.2 Context-Folding Trace on KTTSP-hard This section instantiates the memory operations in Section 2.3.4 with a recorded W01 checkpoint from the KTTSP-hard run. At S115, the append-only stage ledger mvm_v contained 115 result cards and occupied 73,964 characters. When the memory view exceeded BmemB_mem, Fold compressed cards S01--S112 into the addressable summary L_S01_S112. The resulting view m~v m_v occupied 4,661 characters, a 93.7% reduction relative to the raw ledger. At the same research-segment boundary, the runtime emitted a 6,773-character memory-bearing state packet for the next research segment. This telemetry covers the folded view and associated state metadata, rather than the complete context Pn+1P_n+1; the stable prefix, resource provenance, workspace view, and direction instruction are composed during final context assembly. Before context folding: persistent ledger. The memory mvm_v keeps each stage as an independently addressable result card in .run_results.md. The excerpts below reproduce selected fields from three decision-critical cards; line wrapping is added only for page layout. The validity field denotes ScienceFlow’s internal evidence tier, not the KTTSP track difficulty or the official feasibility decision. The initial feasible result, an unverified intermediate attempt, and the best validated result are all retained rather than keeping improvements alone. Selected fields from stage cards before context folding S01 metric=1928.39350319; validity=medium BRIEF: Bridge strategy achieves 0 infeasible transfers with 4 exceptions and 1928.39d duration. WHY: First fully feasible candidate. S18 metric=1761.93330934; validity=low NOTE: invalid_submission: no submission artifact found. BRIEF: Finer local-window timing refinement reached 1761.93d. WHY: Timing resolution helped, but the result was not eligible as a verified comparable entry. S112 metric=393.229; validity=high BRIEF: Forward-pass timing refinement improved 696 legs and saved 7.70d locally, but yielded only 0.001d net gain. WHY: Five frozen exception legs absorbed the upstream savings; further progress requires re-timing or re-routing them. FILES: code=refine_timing_fast.py After context folding: budgeted view. In m~v m_v, the historical portion is replaced by a compact summary with an addressable identifier, while cards needed for verification and immediate continuation remain raw. The generated summary records the folded range, its best stage, representative early evidence, the number of omitted intermediate cards, and the last folded stage: Folded stage-memory view Historical summary: L_S01_S112 [S01--S112] best_stage=S112 - S01: metric=1928.39350319; validity=medium; first feasible - S02: metric=1928.39350319; validity=medium; safe baseline - S03: metric=1928.39350319; validity=high; validated baseline - S04: metric=1891.24195011; validity=medium; timing re-opt ... 107 intermediate stages summarized ... - S112: metric=393.229; validity=high; frozen exception legs block the timing cascade key_stage_index: S112=best_valid available_expand_id: L_S01_S112 verification_raw_cards: S01, S18, S112 current_raw_segment: S113, S114, S115 Active review through unfolding. The runtime field available_expand_id exposes the identifier used by the formal Unfold operation. The following view illustrates an active comparison of the unverified timing attempt and the best validated route. This is an observed Unfold event from the archived W01 runtime trace, shown using the corresponding indexed cards: On-demand unfolded memory view request: Unfold(L_S01_S112, stages=S18, S112) index: L_S01_S112 -> .run_results.md [S01--S112] returned_raw_cards: - S18: metric=1761.93330934; validity=low NOTE: invalid_submission: no submission artifact found BRIEF: Finer local-window timing refinement reached 1761.93d. WHY: Timing resolution helped, but the result was not eligible as a verified comparable entry. - S112: metric=393.229; validity=high BRIEF: Forward-pass timing refinement improved 696 legs and saved 7.70d locally, but yielded only 0.001d net gain. WHY: Five frozen exception legs absorbed the upstream savings; further progress requires re-timing or re-routing them. FILES: code=refine_timing_fast.py context_effect: temporary augmentation of folded view ledger_effect: none (m_v remains append-only) The index resolves the request to the original cards in .run_results.md. In the implementation, this runtime-executed Unfold is realized through indexed workspace reads rather than a separate memory service. D.3 ESTRA-Triggered Folding Trace on KTTSP-hard This section instantiates the ESTRA-triggered fold in Sections 2.3.3 and 2.3.4 with a recorded W01 transition. At 17:17 UTC on June 21, at a research-segment boundary caused by the context limit, the worker selected the runtime action switch_stage, moving from terminal stage S27 to the archived anchor at S23. The transition folded the post-anchor branch S24--S27 into an 845-character summary and assembled a 3,583-character state packet for the restored trajectory. Unlike capacity-based folding of the persistent memory view, this fold scope was determined by the selected archived anchor: it closes the abandoned branch and carries its diagnosis into the next research segment. Before ESTRA-triggered folding: abandoned tail. The four cards refer to the same 1746.8935-day artifact, and no new route is produced. Their internal evidence tiers vary because the repeated evaluations provide different amounts of verification evidence; this variation does not indicate different outcomes under the official KTTSP feasibility checks: Selected fields from abandoned-tail cards S24 metric=1746.89350787; validity=medium BRIEF: Existing artifact re-scored end-to-end with pykep; 1046 feasible, 4 exceptions, 0 infeasible. S25 metric=1746.89350787; validity=high BRIEF: Direct pykep recomputation validates the artifact before route-ordering experiments. S26 metric=1746.89350787; validity=medium BRIEF: Baseline survives the transition but remains far behind peer W00. WHY: Timing-only refinement is exhausted on the sorted route. S27 metric=1746.89350787; validity=medium WHY: Route ordering is the dominant bottleneck; the next route should use proxy-prefiltered construction and bounded checks. After ESTRA-triggered folding: restored-state evidence. The generated summary preserves the branch-level conclusion rather than carrying all four cards verbatim into the next segment’s agent-facing state packet: ESTRA-folded abandoned-tail view runtime_action: switch_stage restore: terminal S27 -> target S23 fold_scope: abandoned tail S24--S27 tail_summary: - Repeated pykep rescoring only revalidated the existing 1746.89d artifact; no new candidate was produced. - Validity fluctuated between medium and high on the same artifact; treat the repeated rescoring as non-informative. - Timing-only refinement on the sorted route is saturated. - The 1746.89d baseline remains far behind W00 at 521.91d; route-ordering or structural changes are required. - Avoid redundant validation passes and further timing polish without a new ordering or construction strategy. summary_chars: 845 restored_state_packet_chars: 3583 preserved: raw cards, snapshot, logs, terminal archive After restoration, the worker resumes from the executable workspace snapshot at S23, while the folded S24--S27 branch is retained as completed negative evidence. The original cards remain addressable in the archived memory through Unfold. Thus, the ESTRA-triggered fold changes the active research route and agent-facing context without altering the persistent research record. D.4 Peer-Guided Search Trace on KTTSP-hard The W01 trajectory in Figure 7 contains a concrete cross-worker coordination episode. W00 established an early validated solution of 521.9054 mission days at S60, while W01 remained at 1746.8935 days. Each worker maintained an isolated executable workspace, and no artifact or workspace state was transferred between them. Instead, compact peer evidence comprising W00’s validated score and method summary entered W01’s ESTRA context. The worker used this evidence to redirect its search from timing-only refinement toward route-ordering strategies. The archived runtime records preserve both the peer-evidence payload and the resulting direction instruction. We identify each archived ESTRA decision by its worker and stage as ESTRA-Wxx-Syy. At W01’s S25 research-segment boundary, compact peer evidence comprising W00’s validated score and a brief windowed-2-opt summary entered the worker’s ESTRA decision (event ESTRA-W01-S25). The worker used the performance gap to diagnose route ordering as the bottleneck, but redirected toward its own proxy-prefiltered nearest-neighbor construction rather than copying W00’s procedure. PyKEP supplies the Lambert-transfer evaluation. Selected fields from ESTRA-W01-S25 Route order is the bottleneck not timing; need faster N using orbital-element proxy pre-filter then pykep verify only top-3, not full grid on 30 candidates. Bottleneck: Route ordering is the dominant factor: 1746d vs peer 521d, but greedy N with pykep evaluation is too slow to complete within resource limits. Exploration summary: Timing refinement on original sorted route converged at 1746.89d; greedy N route rewrite attempted but too slow at 47s/10 legs. Peer at 521.91d via windowed 2-opt. Redirect: Proxy-pre-filtered N: rank by orbital distance, pykep-verify only top 3-5 with coarse grid. After several route-ordering attempts, W01 reached 1321.8824 days but still trailed W00 by approximately 802 days. At S79, the peer summary provided more explicit method-level evidence, producing a second redirect at the operator level (event ESTRA-W01-S79). Selected fields from ESTRA-W01-S79 Worker decision: Adapt the peer-validated 2-opt+SLSQP operators; inclination-bin sorting appears saturated. Bottleneck: Static inclination-bin sorting cannot match W00’s route-reordering and timing-optimization strategy (519 days). Evidence: An approximately 802-day gap remains; finer bins improve the objective by only 54 days, while greedy variants remain infeasible. Next action: Apply 2-opt route swaps and SLSQP timing refinement to W01’s 1321.8824-day incumbent. Table A7: Validated checkpoints and ESTRA decisions in the KTTSP-hard peer-guided overtaking case. Mission duration is measured in days; lower is better. Time (UTC) Worker Stage Duration Search event Jun 21 16:12 W00 S60 521.9054 Early peer best Jun 21 16:20 W01 S25 1746.8935 Structural ESTRA redirect Jun 25 18:04 W01 S78 1321.8824 Fine inclination bins Jun 25 19:12 W01 S79 1321.8824 Operator-level ESTRA redirect Jun 25 23:01 W01 S80 573.0305 Phase-greedy narrow bins Jun 26 00:00 W01 S85 525.9948 Near peer best Jun 26 07:29 W01 S97 420.2742 First validated lead over W00 Jun 27 00:06 W01 S110 393.2352 Ultrafine timing grid Jun 28 23:29 W01 S112 393.229 Final refinement Between the first peer-aware ESTRA decision at S25 and its first validated lead over W00 at S97, W01 reduced its incumbent from 1746.8935 to 420.2742 days, a 75.9% improvement over 4 days and 15 hours. More directly, W01 produced the 420.2742-day result within 12 hours and 17 minutes of the operator-level redirect at S79. It ultimately reached 393.229 days, outperforming W00’s final validated 519.6255-day result by 24.32%. The trace supports peer-guided adaptation rather than direct solution reuse. Applying windowed SLSQP to W01’s existing route at S94 improved the objective by only 0.02 days. W01 established the subsequent lead after combining a 10-degree inclination-bin route with phase-proximal construction and finer timing grids. Peer evidence therefore served as search guidance: it revealed the structural limitations of the current route family and identified promising operators, while W01 independently instantiated and validated a distinct route and schedule. Appendix E SciModelingBench Provenance and Evaluation Metadata This appendix records the data sources and hidden evaluation boundary for the 12 SciModelingBench tasks in Section 3.3. We use the public SciModelingBench 0.10.0 release and its released dataset. In Table A8, N is the number of candidates in each submission, K is the summary size used by the shared diagnostics, and Q is the total query limit for one system–task pair. ScienceFlow’s two workers split this limit. The external baselines are OpenCode 1.18.4 (49), Pi 0.81.1 (79), Codex 0.144.5 (47), and Claude Code 2.1.72 (1). All four use DeepSeek-V4-Flash-Preview through non-interactive clients. Table A8: SciModelingBench task metadata. Visible scale describes the data given to the agent; evaluation scale describes the exact reference domain or label-hidden pool. Values in parentheses are canonical candidates represented by row-level observations. DrugMatrix contains six endpoint tasks from one study collection. BKM, NE, and NDCG denote best-K mean, normalized enrichment, and global NDCG. Data terms come from the original source, while the Hopper row separately identifies simulator software licenses. Task group Visible Evaluation N/K/QN/K/Q Trusted evaluator Source / terms TFBind8 BBO 32,768 sequences 65,536 sequences 32/5/20 Normalized PBM E-score lookup; BKM PBM/UniPROBE (4; 31); source-specific academic-use terms TFBind10 Pho4 BBO 2,087,323 rows (524,300 seq.) 4104^10 sequences 128/16/20 Four-replicate affinity posterior; NE BET-seq (37; 21); C BY 4.0 Superconductor ranking 16,795 records (12,179 groups) 2,985 groups 32/5/20 Median critical temperature by composition; NDCG UCI Superconductivity Data (27; 26); C BY 4.0 UTR MRL ranking 76,877 50-mers 5,043 50-mers 128/16/10 Two-replicate mean ribosome load; NE GEO GSE114002/mRNABench (55; 54); terms unknown GFP ranking 41,372 proteins 10,343 proteins 128/16/20 Protein-level median log brightness; NE Sarkisyan Figshare (8; 56); C BY 4.0 Hopper Controller ranking 1,920 policies 1,280 policies 32/5/10 Mean of 500 frozen Hopper-v5 rollouts; NDCG Design-Bench policy assets (terms not separately stated); Gymnasium (MIT), MuJoCo (Apache-2.0) (66; 64) DrugMatrix (6) ranking 9,442 animal rows 390 conditions 16/5/8 Absolute log treatment–control deviation; NDCG NIEHS CEBS DrugMatrix (45); terms unspecified Reconstruction principle SciModelingBench takes its scientific settings from Design-Bench (66), but does not automatically treat the packaged arrays as ground truth. For every retained setting, we return to the original experiment or simulator assets. We then define the candidate identity, visible observations, hidden reference data, and trusted objective separately. Agents may train predictive models to rank candidates, but those predictions are not used as ground truth outside the training distribution. We omit settings that do not support reproducible candidates and evaluation, rather than keep them only to match a historical learned oracle. Transcription-factor binding For TFBind8, the original PBM table stores an 8-mer and its reverse complement in separate columns that share one E-score. The historical preprocessing joins these columns, producing 65,792 rows and duplicating the 256 reverse-complement palindromes. We remove only these exact duplicates, keep non-palindromic reverse complements as distinct valid sequences, and verify that the result contains all 484^8 8-mers exactly once. We also retain both the published and normalized E-score scales. The resulting complete measured landscape supports direct lookup without a learned oracle. For TFBind10 Pho4, the legacy table contains replicate-level binding estimates. The same 10-mer can therefore have conflicting values, and using row order as a lookup rule silently selects one replicate. We rebuild the task from four BET-seq bound/input count replicates. The lower-half observations expose the raw replicate measurements, while a deterministic affinity posterior covers the complete 4104^10 domain and is oriented so that higher values are better. This keeps replicate disagreement visible instead of hiding it behind the final row. Superconducting materials Design-Bench uses a fitted random forest to score arbitrary composition vectors. Composition alone, however, omits crystal structure, phase, pressure, defects, and processing. The source data also contain repeated compositions with different measured critical temperatures. We first realign the two UCI tables and normalize the amounts of the 86 elements. We then group proportional formulas under one canonical composition while retaining every measurement. The group median is the ranking target, and the measurement range and dispersion remain visible to the agent. Evaluation is limited to the measured high-temperature pool, so composition-only extrapolations are not treated as physical ground truth. UTR and GFP sequence measurements The original UTR setting uses a learned ResNet to score arbitrary sequences. We instead use the unique 50-nucleotide variable regions measured in the eGFP reporter assay. We select the unmodified-RNA condition, use the mean ribosome load over two replicates, and hold out one group defined by (uAUG presence,Kozak quality)(uAUG presence,Kozak quality) as a finite measured pool. For GFP, translating the legacy nucleotide rows produces 56,086 rows but only 51,715 unique proteins. Among the 1,202 duplicated protein groups, 1,201 have conflicting labels, and the wild type alone appears 534 times. We instead use the authors’ protein-level aggregate, verify the unique 237-residue sequences, and split the data by protein identity before adding nucleotide and barcode observations. This prevents synonymous encodings of the same protein from appearing on both sides of the split. Both tasks therefore evaluate measured candidates rather than predictions from historical neural-network oracles. Hopper controller relabeling We keep Design-Bench’s 3,200 policy vectors as candidates but replace the historical labels, each of which came from a single return. Every policy is evaluated over 500 stochastic episodes in Hopper-v5. Policies share the same reset-seed schedule but use separate action-noise seeds. The released data include raw returns, episode lengths, termination flags, and uncertainty summaries; mean return is the frozen target. From the offline observations, the agent ranks a held-out pool of higher-performing measured policies. It cannot access the simulator, train PPO, or request online rollouts during the task. DrugMatrix reconstruction The legacy ChEMBL arrays represent each condition only by a molecular token, dropping its dose, duration, route, vehicle, study, sex, and animal-group context. Nearly every molecule then maps to several endpoint labels, and a row-level split can place the same molecular identity on both sides. We therefore rebuild the task from the NIEHS CEBS individual-animal clinical-pathology release instead of reusing these arrays. We preserve the treatment context and controls, map chemical identity by strict name and CASRN matching, and use ChEMBL only to link structures rather than supply endpoint labels. Candidates are five-day treatments at the highest observed dose, with complete endpoints and controls matched by study, duration, route, vehicle, and sex. We hide the treatment-animal rows for these candidates but keep their matched controls and observations from other doses or times visible. All six tasks use the same candidate conditions and rank them by the absolute log difference between the endpoint mean and the matched-control mean. This score measures the size of a biological change, not drug safety or quality. Protocol and metric audit Before running any agents, we fixed the lower-score thresholds, structured holdouts, submission sizes, and primary metrics using source-data analyses and task-specific random, simple, and cross-validated audits. These audits helped us avoid saturated metrics, distinguish strong submissions, and keep the queried fraction small relative to the hidden domain. The choices were not based on ScienceFlow or external-agent results. Here, an “exact” evaluator returns the same score whenever it is applied to the same frozen data. The underlying experimental measurements may still contain noise. Runtime leakage controls and contamination scope The agent workspace contains only the exported observations, candidate view, manifest, task contract, and submission directory. Hidden labels, trusted objectives, evaluator caches, full dataset copies, and submission records stay outside the workspace, and external network access is disabled. The evaluator returns one score for the full batch rather than a score for each candidate. The harness separately records query use and the best valid artifact. These controls block runtime answer lookup through the benchmark infrastructure. They do not show that public papers or upstream data were absent from model pretraining. We therefore claim runtime leakage controls and audited provenance, not a contamination-free evaluation. General scientific knowledge is allowed, although in some cases it is difficult to distinguish inference from memorized candidate labels. Licensing and availability SciModelingBench and Design-Bench software use the MIT license, but this does not relicense the underlying experimental data. Table A8 therefore lists the original source-specific, C BY 4.0, or unknown data terms. Because these terms differ, the dataset card lists the license as “other” rather than assigning one license to the full collection. Processing records and task-specific details are available in the public suite documentation and dataset card.