Paper deep dive
FineART: Fine-Grained Annotated Robotic Trajectory Dataset and Vision-Language-Action Model for Bimanual Manipulation
Jade Choghari, Pepijn Kooijmans, Mansi Agarwal, Yusuf Umut Ciftci, Aseem Doriwala, Catherine Weaver, Mouli Sivapurapu, Kai Yang, Thomas Wolf, Jackson Lee, Pragna Mannam
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 90%
Last extracted: 10/2/2026, 8:33:08 AM
Summary
The paper introduces FineART, a large-scale, densely annotated bimanual manipulation dataset containing 40,543 episodes and 533,913 subtask labels across 151 tasks. It also presents FineART-VLA, a vision-language-action model that uses mid-training on these subtask annotations to improve spatial grounding and long-horizon instruction following. The model achieves 100% success on spatial instructions and 76% on unseen long-horizon tasks with human guidance, while requiring only one-tenth of the fine-tuning data compared to baselines.
Entities (10)
Relation Signals (9)
FineART-VLA â appliestechnique â Knowledge Insulation
confidence 95% · Knowledge insulation (KI) has been shown to mitigate the degradation of pre-trained VLM knowledge... With KI enabled
FineART â collectedon â Trossen Stationary AI
confidence 95% · All data are collected on the Trossen Stationary AI bimanual leaderâfollower system
FineART â comparedwith â ABC-130K
confidence 95% · Table 1 compares all of these datasets... FineART is the only dataset combining bimanual manipulation... and dense sub-episode labels across its entire duration
FineART â comparedwith â MolmoAct2
confidence 90% · Two very recent efforts push bimanual scale further still: MolmoAct2âs Bimanual YAM release... and the ABC-130K dataset
FineART â contains â FineART-VLA
confidence 90% · FineART is used as a mid-training dataset for FineART-VLA.
FineART-VLA â generalizesto â YAM
confidence 90% · generalizes zero-shot to tasks unseen on the new hardware... distinct robot platform (YAM)
FineART-VLA â usesbackbone â $\\pi_{0.5}$
confidence 90% · built on a pi0.5 flow-matching backbone
FineART-VLA â usescomponent â SigLIP
confidence 90% · with a SigLIP vision encoder
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Robots operating in real-world environments must often execute complex, multi-step bimanual tasks over long horizons rather than single, isolated actions. Current manipulation datasets struggle to support this capability: although single-arm datasets reach hundreds of thousands of trajectories, they typically provide only one high-level instruction per episode, while existing bimanual datasets with subtask labels annotate only part of their recorded hours. We present FineART, a densely annotated bimanual manipulation dataset comprising 40,543 episodes (1,718 hours) and 533,913 subtasks across 151 tasks. We also introduce FineART-VLA, a vision-language-action policy that predicts its own next subtask to guide its actions. Mid-training on FineART's subtask annotations raises FineART-VLA's success at following spatial instructions from 32.0% to 100.0%. With step-by-step human subtask guidance, it also raises success on unseen long-horizon tasks from 16.0% to 76.0%. Furthermore, after minimal fine-tuning on a new robot, the policy requires only one-tenth of the data needed by baselines without this mid-training and generalizes zero-shot to tasks unseen on the new hardware. We open-source the full dataset, model weights, and training code.
Tags
Links
- Source: https://arxiv.org/abs/2609.36416v2
- Canonical: https://arxiv.org/abs/2609.36416v2
Trouble viewing inline? Open PDF directly â
Full Text
74,200 characters extracted from source content.
Expand or collapse full text
Scale AI Research /hf-logo-with-title.png 0.32in 0.22in 1923 â footnotetext: *Equal contribution. â Equal senior contribution. ⥠Work done while at Scale AI. FineART: Fine-Grained Annotated Robotic Trajectory Dataset and Vision-Language-Action Model for Bimanual Manipulation Jade Choghari Affiliation: Scale AI Pepijn Kooijmans Affiliation: Hugging Face Mansi Agarwal Affiliation: Scale AI Yusuf Umut Ciftci Affiliation: Scale AI Affiliation: University of Southern California Affiliation: Stanford University Aseem Doriwala Affiliation: Scale AI Catherine Weaver Affiliation: Scale AI Mouli Sivapurapu Kai Yang Affiliation: Scale AI Thomas Wolf Affiliation: Hugging Face Jackson Lee Affiliation: Scale AI Pragna Mannam Affiliation: Scale AI Abstract Robots operating in real-world environments must often execute complex, multi-step bimanual tasks over long horizons rather than single, isolated actions. Current manipulation datasets struggle to support this capability: although single-arm datasets reach hundreds of thousands of trajectories, they typically provide only one high-level instruction per episode, while existing bimanual datasets with subtask labels annotate only part of their recorded hours. We present FineART, a densely annotated bimanual manipulation dataset comprising 40,54340,543 episodes (1,7181,718 hours) and 533,913533,913 subtasks across 151151 tasks. We also introduce FineART-VLA, a vision-language-action policy that predicts its own next subtask to guide its actions. Mid-training on FineARTâs subtask annotations raises FineART-VLAâs success at following spatial instructions from 32.0%32.0\% to 100.0%100.0\%. With step-by-step human subtask guidance, it also raises success on unseen long-horizon tasks from 16.0%16.0\% to 76.0%76.0\%. Furthermore, after minimal fine-tuning on a new robot, the policy requires only one-tenth of the data needed by baselines without this mid-training and generalizes zero-shot to tasks unseen on the new hardware. We open-source the full dataset, model weights, and training code. Figure 1: Representative demonstrations from FineART dataset. FineART is the largest subtask-annotated manipulation dataset to date, consisting of 40.5K episodes and 534K subtasks, totaling 1,718 hours. 1 Introduction âDivide each difficulty into as many parts as is feasible and necessary to resolve it.â â RenĂ© Descartes, Discourse on Method (1637), Part I Robotic assistants that work in real households and workplaces must handle long-horizon tasks â such as preparing a meal, sorting tools, or packing a bag â that demand dozens of coordinated two-handed actions over several minutes. Humans manage this complexity by continuously breaking a task into a running sequence of subtasks (e.g., pick up plate, pick up toast, put toast on plate) instead of holding one instruction for the full duration. Giving a robot policy that same ability requires two foundations: (1) long-horizon bimanual manipulation data and (2) language supervision that marks subtask boundaries densely and persistently enough to train on directly. While single-arm datasets [28, 20] scale to hundreds of thousands of trajectories, they consist mainly of short pick-and-place episodes associated with single instructions. Recent bimanual datasets [36, 13, 12] address embodiment gaps and scale, but even the largest [2] only annotates subtask labels for a fraction of its hours. Furthermore, they report diversity in aggregate, obscuring whether they cover contact-rich, long-tail skills like insertion, deformable object manipulation, or tool use. Existing annotation pipelines [26, 1, 3] make this worse: they either assign broad, high-level labels to entire videos or try to generate subtasks on the fly during execution, rather than giving the model step-by-step guidance directly throughout training. Without step-by-step labels during training, current models struggle to handle long tasks. Flat vision-language-action models [6, 22] map an instruction and image directly to actions, with no way to track progress through a multi-minute task, while hierarchical alternatives [1, 31] split planning and execution across two separate models. No existing dataset-and-model combination offers persistent, dense subtask training for long-horizon bimanual manipulation inside a single end-to-end policy. FineART closes this gap: a bimanual manipulation dataset where every one of its 1,7181,718 hours across 40,54340,543 episodes (averaging 152.5152.5 seconds each) carries dense subtask annotations â 533,913533,913 subtask labels in total, roughly 1313 per episode â paired with a training recipe that treats these subtasks as persistent supervision inside a single end-to-end policy. Our contributions are: âą FineART Dataset. An open-source bimanual manipulation dataset with dense subtask annotations, containing 40,54340,543 labeled episodes and 533,913533,913 subtask labels. âą FineART-VLA. A single end-to-end policy, extended from a pretrained vision-language-action backbone, that pairs System-2 subtask prediction in language with System-1 continuous-action execution using hierarchical inference and knowledge insulation instead of splitting planning and execution across two separate models. âą Dense Subtask Training. Dense subtask training improves spatial grounding and long-horizon instruction following, raising success rate from 32.0%32.0\% to 100.0%100.0\% on a spatial disambiguation task and from 16.0%16.0\% to 76.0%76.0\% on a long-horizon task requiring human corrections, compared to a matched policy trained without subtask training. âą Cross-Embodiment Mid-Training. Mid-training on FineART enables zero-shot transfer to unseen tasks â after fine-tuning on only five atomic tasks, the policy generalizes to unseen, multi-stage tasks on a distinct robot platform (YAM), reaching 28.0%28.0\% success on prepare breakfast, 12.0%12.0\% on sort tools, and 60.0%60.0\% on put cable into bin under distractors. We open-source the model and training code alongside the dataset. 2 Related Work 2.1 Large-Scale Robot Learning Datasets Robot learning has scaled in waves. An early single-arm dataset [19] established teleoperated data collection at growing scale, but it stayed within a handful of tasks and seconds-long episodes. Later efforts [28, 20] pushed scale further still, aggregating over a million and 76k trajectories respectively across dozens of platforms and hundreds of in-the-wild scenes, yet both remain dominated by single-arm, short-horizon pick-and-place, with one instruction typically covering an entire episode. Bimanual datasets close part of that gap [36, 13, 12, 27]: two introduce low-cost teleoperation for contact-rich two-arm manipulation, one adds force and audio modalities across 110k sequences, and the last extends coverage to over 100 more tasks. Two very recent efforts push bimanual scale further still: MolmoAct2âs Bimanual YAM release [11] and the ABC-130K dataset [2], the latter also annotating a 1,552-hour subset with sub-episode task labels. Table 1 compares all of these datasets across trajectory count, task count, and annotated hours: FineART is the only dataset combining bimanual manipulation, multi-minute episodes, and dense sub-episode labels across its entire duration, rather than a curated subset of it. Dataset Traj. Tasks Hours Subtask Hours Sec./Ep. MT-Opt [19] 800,000 12 5,556 0 25 RH20T [12] 110,000 147 1,111 0 36.4 RoboSet [4] 7,500 38 N/A 0 N/A BridgeData V2 [33] 60,096 13 127 0 7.6 Open X-Embodiment [28] 1M+ 500+ N/A 0 N/A DROID [20] 76,000 86 350 0 16.6 MolmoAct2 (Bimanual YAM) [11] 34,500 28 720 0 75.1 ABC-130K [2] 134,806 195 3,553 1,552 94.9 FineART (Ours) 40,543 151 1,718 1,718 152.5 Table 1: Comparison of open-source robot manipulation datasets. FineART has the most densely annotated subtask hours. N/A: not reported. 2.2 Data Curation and Annotation Pipelines Dense temporal annotation of long videos originated in captioning work [23], which jointly localized and described events in multi-minute footage. Robotics applied coarser versions of the same idea [26, 1], pairing subtasks with play data or decomposing an instruction into skills online rather than annotating the training data itself. A closer prior effort [3] inserted an intermediate language-motion layer between task and action, but its hierarchy was produced online rather than as a persistent, dataset-wide label. FineART instead annotates every episode directly, producing 533,913533,913 subtask labels (an average of 1313 per episode) that are available as fixed training targets rather than being generated at inference time. 2.3 Language-Conditioned Policies Augmenting end-to-end policies with an explicit high-level reasoning step improved performance on long-horizon tasks [1, 31, 24, 14], particularly when the high-level step could draw on a pretrained LLM or VLM. Flat vision-language-action models [6, 22] skip this step, mapping a single instruction and image directly to actions; one extension [9] carries the same recipe to heterogeneous embodiments without unifying the action space. These architectures degrade over long horizons because the model does not track task progress. Most hierarchical methods instead split the two roles across separate models, with a VLM predicting semantic subtasks and a distinct low-level policy executing them [1, 31, 24]; others [25] conditioned on short natural-language subtasks mined from unstructured play data rather than a plannerâs output. FineART instead uses a single model for both stages, closer to chain-of-thought [34] than to a two-model pipeline, built on a Ï0.5 _0.5 flow-matching backbone [29] and knowledge insulation [10] to prevent continuous-action gradients from destroying pretrained VLM representations. Two concurrent efforts pursued closely related ideas: dense per-clip language annotation for policy learning [21], and a diffusion policy conditioned on foundation-model-generated subtasks [17]; a third [18] paired a VLM subtask planner with a flow-matching controller in a similar spirit. None reported a dataset combining bimanual multi-minute episodes with persistent sub-episode labels at FineARTâs scale. 3 FineART Dataset FineART is a bimanual manipulation dataset consisting of 40,54340,543 teleoperated episodes (1,7181,718 hours, 185.5185.5 M frames) spanning 151151 tasks. It is the largest subtask-annotated robot dataset to the best of our knowledge, providing full temporal supervision across 100%100\% of its hours and tasks. Figure 2: FineART dataset overview. (a) Distinct object classes represented in FineART and ABC-130K across semantic categories. (b) Frequency of descriptive object modifiers in subtask annotations. (c) Collected hours across manipulation primitives, highlighting the high-volume head and contact-rich tail. (dâf) Episode duration, subtask duration, and arm-speed distributions, respectively, compared with ABC-130K. 3.1 Data Collection Protocol All data are collected on the Trossen Stationary AI bimanual leaderâfollower system by human teleoperators. Each follower arm carries an ALOHA2 gripper rated for a 11 kg payload and executes a 5050 Hz control loop, with joint telemetry logged at 300300 Hz. Visual state is recorded at 3030 fps (1280Ă7201280Ă 720) across four Intel RealSense D405 cameras: a birdâs-eye view for global tabletop context, a wormâs-eye view for low-angle contact physics, and dual wrist-mounted cameras for egocentric local manipulation. A second independent team of human annotators labeled trajectories with natural task descriptions, without VLM assistance. Finally, a third independent team of human auditors performed quality control on a statistically significant sample of the labeled trajectories. This process ensures that the dataset is free of labeling bias from the teleoperators, and that the annotations are accurate, complete, and consistent. Labeling yields two granularities (Fig. 3). Demonstration Label: Whole-episode text summary paired with metadata describing execution quality and outcome success. Subtask Labels: Contiguous, non-overlapping temporal segments containing untemplated free-text task descriptions. Figure 3: FineART annotation schema. A multi-stage task with demonstration-level and temporally segmented subtask annotations. Subtask labels shown are illustrative categorical examples, not the actual annotations. 3.2 Dataset Composition: Long Multistage Tasks While single-arm datasets like Bridge V2 [33] and DROID [20] provide large trajectory volumes, they pair multiminute trajectories with a single instruction. ABC-130K [2] represents the only prior single-embodiment dataset providing timestamped subtask text alongside raw trajectories. Therefore, we use ABC-130K as a reference while analyzing our dataset composition. FineART features long-horizon tasks that require multiple manipulation subtasks to complete, averaging 13.17 subtasks per task. The median episode duration is approximately 2.02.0 min, with a long tail of episodes lasting more than 1010 min (Fig. 2d). 3.2.1 Subtask Composition FineART deliberately concentrates most of its subtasks on a small set of reusable manipulation primitives, then adds a long tail of physically distinct, contact-rich skills on top. In a mid-training dataset, a policy needs to see a primitive many times to learn it reliably, while the contact-rich tail tests whether that learned representation actually carries over to harder, fine-grained tasks. To capture manipulation diversity, we define a primary vocabulary of 3131 leading verbs categorized into seven fundamental manipulation primitives (Fig. 2c). While the majority of the dataset (1,326.21,326.2 h; 77.2%77.2\% of hours) concentrates on gross pick-and-place (572.7572.7 h) and semantic organization (753.5753.5 h) to build core spatial manipulation abilities, the remaining 391.8391.8 h (22.8%22.8\% of hours) forms a long tail of contact-rich operations. This long tail covers tight tolerances, near-unbounded configuration states, and complex contact dynamics across deformable textile manipulation (126.0126.0 h), tool-mediated assembly (111.9111.9 h), flexible linear object routing (59.459.4 h), compliant alignment (50.850.8 h), and high-precision mechanical insertion (43.743.7 h). Though smaller in total volume, this tail provides the essential demonstration signal needed for policies to move beyond simple prehension toward fine-motor, contact-guided behavior. Section 4 tests that hypothesis directly by ablating the tail from the training mixture. We observe that FineART subtasks are about 2.52.5 times as long as ABC-130K subtasks, with median duration of 8.68.6 s versus 3.53.5 s (Fig. 2e), even though the datasets have similar arm-speed distributions (Fig. 2f). This indicates that FineART subtasks capture more multi-stage manipulation (stack, remove, close), while ABC-130K subtasks often segment simpler, individual actions (pass, grab, flatten). 3.2.2 Object Diversity Object diversity is introduced during collection through object rotation and spatial randomization. Every five episodes, a unique set of objects is assigned to each task-operator pair. Objects are repositioned and reoriented for each episode so that no arrangement is repeated. This protocol varies both the objects used to perform tasks and the spatial configurations in which they must be manipulated. To compare object diversity, we apply a shared rule-based parser to the subtask annotations of FineART and ABC-130K. After spelling normalization and typo correction, we extract noun phrases and represent object classes by singularized head nouns, retaining noun qualifiers for generic heads (e.g., chess piece). Preceding modifiers are retained separately as descriptors and tagged using lexicons for color, material, size, shape, pattern, state, spatial position, and ordinal attributes. The parser filters non-object expressions such as regions, robot parts, pronouns, and measurements. These statistics measure objects named in the annotations: a class is a normalized object label, and a mention is an occurrence of that label. Figure 2a shows broad coverage across everyday object categories, spanning 657657 distinct object classes in total. FineART contains more distinct labels than ABC-130K in food, clothing, receptacles, tools, electronics, and toiletries. Coverage also extends to stationery, tableware, parts, toys, and materials, with comparable coverage of surfaces and fewer labels for dĂ©cor. Thus, the repeated manipulation primitives described above are demonstrated across a range of object identities, materials, and geometries. Because this comparison is annotation-based, it reflects both collection diversity and how specifically annotators name objects. The Other category contains extracted labels that could not be mapped to a semantic category from the noun alone. FineART entries include ambiguous nouns such as stick and mesh, and parser leftovers such as form from the phrase âto form a loop.â In ABC-130K, approximately 95%95\% of these mentions use generic labels such as personal item, distractor, chemistry item, and product. 3.2.3 Descriptive Specificity The annotations describe not only which object class is involved, but also attributes that distinguish an object within a scene. Figure 2b reports descriptor frequency per object mention. Color modifiers occur in 81.1%81.1\% of FineART mentions, compared with less than 0.01%0.01\% in ABC-130K; spatial modifiers occur in 14.8%14.8\% versus 0.80%0.80\%. Material, size, ordinal, and pattern descriptors provide additional distinctions. ABC-130K uses state and shape modifiers more frequently, largely because of its many deformable-object demonstrations featuring descriptors such as folded, flattened, and crumpled. This descriptive detail is reflected in the diversity of the annotation text: FineART contains 110,299110,299 distinct subtask strings and 23,58923,589 distinct object-referring expressions, compared with 7,9777,977 and 534534, respectively, in ABC-130K. In cases involving two objects of the same class, FineART annotations disambiguate the objects 81.4%81.4\% of the time, compared with 44.0%44.0\% in ABC-130K. Such distinctions let a subtask specify which instance to manipulate, beyond naming the action and object class. Together, object variation and instance-specific language provide supervision for selecting and manipulating objects throughout multi-stage tasks. Section 4 evaluates how mid-training with these subtask annotations affects spatial grounding, instruction following, and transfer to a different embodiment. 4 Experiments We evaluate FineART as a mid-training dataset for a pre-trained generalist VLA [29], mid-training for a relatively short run (300300k steps) and then asking three questions (Sections 4.2 and 4.3). Does dense subtask training, together with knowledge insulation (KI), improve out-of-distribution generalization and long-horizon instruction following? How much does long-tail training data contribute to overall performance? And does FineART mid-training reduce the data required to adapt to a new embodiment? Over the course of our experiments, we execute 3,4003,400 rollouts. 4.1 Policy and Mid-Training Setup We start from Ï0.5 _0.5 publicly released via LeRobot [29, 7], whose implementation does not support subtask training, knowledge insulation, or hierarchical subtask-then-action inference. We extend the architecture to add all three and refer to the resulting model as FineART-VLA: a System-2 subtask predictor and a System-1 continuous-action controller in one policy. It combines a 22B-parameter Gemma backbone [15] with a SigLIP vision encoder [35] and a separate 300300M-parameter Gemma-style action expert. Images and language form one bidirectional attention block; the state/action suffix attends to itself and to that full block but not vice versa, and the subtask span being generated is further restricted to its own earlier tokens, matching autoregressive generation at inference. At step t the policy observes ot=(It1:3,qt)o_t=(I_t^1:3,q_t), three of the rigâs camera streams (birdâs-eye and both wrists, resized to 224Ă224224Ă 224; the wormâs-eye view is recorded but not consumed) and the 1414-dim bimanual joint and gripper states. The policy is conditioned on a language context â that is either the task string âtask ^task or a subtask âsub ^sub. Following [29], the policy emits three outputs per forward pass: the next subtask in language, a FAST-tokenized action sequence a~ a, and a continuous chunk At=[at,âŠ,at+Hâ1]ââHĂ14A_t=[a_t,âŠ,a_t+H-1] ^HĂ 14 with H=50H=50. Writing zΞâĄzΞâ(ot,âsub)z_Ξ⥠z_Ξ(o_t, ^sub) for the backbone representation, pΞ(âsub,a~,AtâŁot,âtask)= p_Ξ ( ^sub, a,A_t o_t, ^task )= pΞâ(âsubâŁot,âtask)âpΞâ(a~âŁot,âsub)âpΞâ(AtâŁzΞ). p_Ξ ( ^sub o_t, ^task )\;p_Ξ ( a o_t, ^sub )\;p_Ξ (A_t z_Ξ ). (1) The continuous action head predicts a velocity vΞv_Ξ from the noised chunk AtÏ=(1âÏ)âAt+ÏâÏ”A_t^Ï=(1-Ï)A_t+ÏΔ, trained by flow matching to minimize the L2-norm between vΞv_Ξ and the target field Ï”âAtΔ-A_t, while the discrete and text heads use next-token cross-entropy. The objective is ââĄ(Ξ)=λflowââflow+λfastââfast+λtextââtext,L(Ξ)= _flowL_flow+ _fastL_fast+ _textL_text, (2) with λflow=10 _flow=10, λfast=1 _fast=1 and λtextâ0,1 _textâ\0,1\. Each action chunk in the dataset is represented in both the continuous flow target and the discretized token sequence. Including explicit task-to-subtask predictions (λtext>0 _text>0) has been shown to improve performance on long-horizon tasks, even compared to human oracle subtask planning [29]. Setting λtext=0 _text=0 removes the subtask channel, conditioning the policy on âtask ^task directly. Knowledge insulation (KI) [10] has been shown to mitigate the degradation of pre-trained VLM knowledge that occurs when a randomly initialized flow-based action expert is attached to the backbone. Insulating the backbone from âflowL_flow restores language-following, accelerates convergence by roughly 7.5Ă7.5Ă, and improves generalization to unseen objects and environments. With KI enabled, the action expert attends to stop-gradient copies of the backboneâs keys and values so that âΞVLMâflow=0 _ _VLML_flow=0 and the backbone is shaped only by the token-level losses. When λtext=1 _text=1, 30%30\% of each batch is a sample (âtask ^task, âsub ^sub, oto_t) for âtextL_text and 70%70\% is a sample (AtA_t, a~ a, oto_t, âsub ^sub) for âflowL_flow and âfastL_fast. All runs train for 300300k steps at a global batch of 6464, about 10%10\% of one epoch over the 185.5185.5M frames, using AdamW at 2.5Ă10â52.5Ă 10^-5 decayed to 5Ă10â65Ă 10^-6 in bfloat16. Mid-training draws frames with a task-balanced sampler following [29]: a task contributing nin_i frames is sampled with probability proportional to niαn_i^α, so α=0α=0 weights every task equally regardless of size (task-based sampling) and α=1α=1 weights every frame equally across the pooled dataset (raw frequency). We use α=0.5α=0.5, a blend of the two. In-distribution Partial ID Out-of-distribution Overall Checkpoint Shelf Towel Vase Pegboard Saucer Sort tools Avg. (a) subtask training and knowledge insulation (α=0.5α=0.5, full data) Run 1.1 (subtask training + KI) 91.0 / 72.0 72.0 / 32.0 75.0 / 16.0 55.0 / 0.0 73.0 / 20.0 69.5 / 28.0 72.6 / 28.0 Run 1.2 (no subtask training + KI) 97.0 / 96.0 50.0 / 16.0 74.0 / 24.0 72.0 / 0.0 33.0 / 4.0 76.5 / 16.0 67.1 / 26.0 Run 1.3 (subtask training, no KI) 77.0 / 64.0 86.0 / 44.0 66.0 / 16.0 49.0 / 0.0 69.0 / 12.0 58.5 / 12.0 67.6 / 24.7 Run 1.4 (no subtask training, no KI) 82.0 / 72.0 58.5 / 4.0 41.0 / 12.0 65.0 / 0.0 58.0 / 12.0 50.0 / 4.0 59.1 / 17.3 (b) Mid-training data ablations (w/ subtask training, no KI, α=0.5α=0.5) Run 1.3 (full data) 77.0 / 64.0 86.0 / 44.0 66.0 / 16.0 49.0 / 0.0 69.0 / 12.0 58.5 / 12.0 67.6 / 24.7 Run 2.1 (no long-tailâ ) 88.0 / 68.0 29.5 / 0.0 67.0 / 8.0 58.0 / 0.0 56.0 / 0.0 67.0 / 8.0 60.9 / 14.0 Each cell reports progress rate / success rate in percent over 2525 rollouts; the final column averages over all 150150 rollouts per checkpoint. Bold marks the best success rate in each column. â 2.1 restricts training to the two majority task-label categories in Fig. 2. Table 2: In-embodiment (ALOHA) results on the 6-task evaluation suite. Figure 4: Success rate of FineART-VLA by task regime (ID, partial ID, OOD) with subtask supervision and knowledge insulation. (n=25n=25 per task, n=50n=50 per regime, n=150n=150 overall). Subtask training and KI improve most significantly on OOD tasks. 4.2 In-Embodiment Results (ALOHA) We train policy ablations via Section 4.1 on the full FineART dataset and evaluate the policies on the same embodiment used for collection (Stationary Trossen ALOHA). For all experiments, each checkpoint is evaluated with 2525 rollouts per task and is initialized with a prescribed set of 2525 object locations, meaning all checkpoints are evaluated under the same initial conditions. We report success rate (SR) and progress rate (PR, the average fraction of task stages completed). At 2525 rollouts, per-task SR is quantized to 44 points with a standard error near 99, and per-checkpoint averages carry roughly 33 to 44, indicating large, consistent effects rather than single-task differences. 4.2.1 Does dense subtask training and knowledge insulation (KI) improve OOD generalization? We isolate the effect of subtask training (i.e., λtext=1 _text=1) and KI with a 2Ă22Ă 2 ablation that varies each independently: Run 1.1 (subtask training + KI), Run 1.2 (no subtask training + KI), Run 1.3 (subtask training, no KI), and Run 1.4 (no subtask training, no KI), each evaluated on the same suite of six tasks. The tasks are grouped in Table 2 by their relation to the tasks present in the FineART training set. Shelf and towel are in-distribution, with literal subtask strings. Vase and pegboard are partial, in that the insertion dynamics appear but the prompts differ. Saucer and sort tools are out-of-distribution: the dataset contains no saucer and no type-routed sorting of tools. Comparing performance across in-distribution, partially in-distribution, and out-of-distribution tasks (Fig. 4), subtask training and knowledge insulation each improve overall performance. Policies with both subtask training and KI show the highest OOD generalization capabilities, indicating that both subtask training and knowledge insulation are necessary to maintain general pre-trained task knowledge. With in-distribution tasks, performance is dependent on the type of task (Table 2). Shelf placement is a saturated, single-step task, and no subtask training and KI achieves the highest performance (96.0%96.0\% vs. 72.0%72.0\%) indicating that subtask training may hinder task performance, while KI is important to maintain task understanding. Conversely, towel folding, which is a more ambiguous task, benefits from subtask training more than KI. KI and subtask training both improve performance compared to the baseline in Partial ID tasks, but benefit the most from KI alone; the comparatively worse performance with subtask training may indicate an over-sensitivity to language conditioning. 4.2.2 How much does long-tail data contribute to overall performance? Run 2.1 (Table 2b) removes the long-tail task categories defined in Fig. 2c from mid-training, keeping the same number of training steps; the retained set is only pick-and-place and sorting, 106106 of 151151 task labels (71.0%71.0\% of valid frames), compared against Run 1.3 (full data, otherwise identical). Overall success drops from 24.7%24.7\% to 14.0%14.0\%. The simple shelf task is the exception, holding its SR steady (64.0%64.0\% to 68.0%68.0\%), but every other evaluation task degrades substantially when the long-tail is excluded, even though those tasks are nominally covered by the retained categories â indicating that long-tail diversity, not merely category coverage, drives generalization. 4.2.3 Does subtask training provide spatial grounding and long-horizon instruction following? In Fig. 5, we further evaluate Run 1.3 (subtask training, no KI) against Run 1.4 (no subtask training, no KI) â KI fixed off in both arms to isolate subtask training alone â on two tasks designed to test spatial grounding or long-horizon instruction following. The experimental procedure is the same: 2525 rollouts per task with prescribed initial conditions. Spatial grounding. On put donut into the left, right, middle bin, the target is distinguished only by a spatial word in the instruction. Subtask training saturates the task with 100% SR. In contrast, the no-subtask policy only achieves 32% success and all 17 failures were due to placing the object in the incorrect bin. The results indicate that the dense subtask annotations in the FineART dataset are critical for spatial grounding and instruction following. Long-horizon instruction following. Prepare breakfast is a multi-minute task whose subtasks are present in the dataset, but not the full task sequence. Figure 5 contrasts two inference conditions: autonomous execution, where the policy proposes its own subtasks (Run 1.3, hierarchical subtask-then-action prediction [29]) or acts on the task label alone (Run 1.4), against human-provided subtask guidance at inference, where a human oracle labels each subtask, advancing to the next one only after the prior one is judged complete. Both autonomous policies fail completely (0.0%0.0\% success, at 54.9%54.9\% and 54.3%54.3\% progress respectively) since one misstep is enough to stall the whole rollout. With human-provided subtask guidance, Run 1.3 reaches 76.0%76.0\% success against 16.0%16.0\% for Run 1.4 â despite identical guidance, so subtask training at training time, not guidance at inference, is what drives the gap. Figure 5: Evaluation of subtask training on instruction following tasks (Run 1.3 against Run 1.4, no KI). The solid fill is success rate and the pale bar behind it progress rate. 4.2.4 Observation: policies exhibit recovery and complex bimanual behaviors FineART-VLA reproduced notable behaviors that the dataset may contain in small proportion, but the task instruction does not explicitly call for (Table 3). Self-correction: a sort tools policy redirected a trajectory already heading for the wrong bin. Failure recovery: a fallen cup was re-grasped and the placement completed, instead of the rollout stalling on the first error. Bimanual coordination: on a flower in vase rollout, the left arm steadied the vase so that the right could insert the flower. These behaviors indicate that policies are exhibiting closed-loop behavior and reacting to state feedback. Task Behavior Run 1.1 (subtask training + KI) Sort tools Corrected in-flight trajectory toward wrong bin Run 1.2 (no subtask training + KI) Sort tools Recovery, and a handover between the arms Sort tools Handover between the arms Run 1.4 (no subtask training, no KI) Fold towel Completed two folds with the towel lifted Run 2.1 (no long-tail) Cup on shelf Re-grasped fallen cup and completed place Flower in vase Left arm steadied the vase so right could insert âą Note: These are observations found via inspection and do not indicate the relative frequency of such behaviors. Table 3: Notable behaviors observed in rollouts. 4.3 Cross-Embodiment Transfer (YAM) Section 4.2 measures mid-trained policy performance on the in-distribution FineART embodiment. In this section, we evaluate whether the mid-trained FineART-VLA shows similar improved performance on an out-of-distribution embodiment. We fine-tune the best-performing checkpoint from Table 2a (Run 1.1, subtask training + KI, 300300k steps) for an additional 5,0005,000 steps on YAM, using five of the six ALOHA evaluation tasks â shelf, towel, vase, pegboard, and saucer â as the fine-tuning set. Sort tools and prepare breakfast are held out entirely from YAM fine-tuning, to test transfer to unseen tasks later in this section. We examine policies trained on 1010, 2525, 5050, and 250250 training episodes per task. Evaluations consist of 2525 rollouts each (125125 rollouts per checkpoint). The embodiment gap is substantial: Stationary ALOHA arms are mounted on opposite sides of the table facing each other, whereas YAM arms face forward towards the back of the table. We compare against three alternatives fine-tuned identically: the upstream Ï0.5 _0.5 initialization with no FineART mid-training, and two checkpoints mid-trained on different datasets (ABC, and Ai2âs MolmoAct2 YAM release). FineART is the only one of the three datasets entirely on a different embodiment. Figure 6: FineART-VLA cross-embodiment YAM evaluation. Policies are mid-trained for 300k steps on the FineART, ABC, or MolmoAct2 datasets, then fine-tuned on YAM data for a fixed 5k steps at each data budget. Upstream Ï0.5 _0.5 open-source weights are not fine-tuned in mid-trained checkpoints. Since ABC and MolmoAct2 datasets contain YAM data, zero-shot (ZS) policies are evaluated for ABC and MolmoAct2 only. Number of Fine-Tuning Trajectories Mid-Trained Checkpoint Zero-shot 50 125 250 1250 (10/task) (25/task) (50/task) (250/task) (a) Five-task YAM benchmark FineART-VLA (ours, ALOHA) â 45.9 / 14.4 55.9 / 26.4 53.7 / 27.2 69.2 / 33.6 None (upstream Ï0.5 _0.5 init) â 25.0 / 2.4 33.4 / 6.4 36.1 / 8.0 50.8 / 18.4 ABC (XDOF, YAM data) ⥠22.5 / 0.0 63.0 / 24.8 66.0 / 25.6 73.1 / 34.4 64.7 / 24.0 MolmoAct2⥠(Ai2, YAM data) 18.2 / 0.0 61.1 / 20.8 66.7 / 19.2 62.4 / 22.4 68.1 / 24.8 (b) Put cable into bin, unseen target and unseen distractors FineART-VLA (ours) â 38.0 / 36.0 44.0 / 44.0 46.0 / 44.0 64.0 / 60.0 ABC â 52.0 / 52.0 28.0 / 28.0 4.0 / 4.0 22.0 / 20.0 âą Cells are progress rate / success rate in percent. Block (a): average of 125125 rollouts across the first five tasks in Table 2; block (b): single held-out task with 2525 rollouts. Bold marks the best success rate per column. ⥠-shot rates are reported only for ABC and MolmoAct2, whose mid-training datasets already include YAM data. Table 4: Cross-embodiment transfer to YAM, after a fixed 55k-step fine-tune at each budget. 4.3.1 Does mid-training on FineART reduce embodiment-specific downstream data requirements? The FineART-VLA (orange) yields a 10Ă10Ă reduction in downstream data compared to a checkpoint with no mid-training (black) in Fig. 6. FineART-VLA reaches 26.4%26.4\% SR at 2525 fine-tuning episodes per task, compared to the 18.4%18.4\% SR at 250250 episodes per task when there is no mid-training. Both checkpoints start from the same Ï0.5 _0.5 weights and differ only in whether the FineART mid-training occurred, so the gain comes from the mid-training stage rather than the underlying pre-training or model architecture. 4.3.2 How does FineART-VLA performance on YAM (cross-embodiment) compare to policies from YAM open source datasets? We compare FineART-VLA to ABC and MolmoAct2, both of which include the YAM embodiment in their pre-training dataset. On the five evaluation tasks in Fig. 6a, at the smallest budget FineART-VLA is the weakest (14.4%14.4\% against 24.8%24.8\% for ABC and 20.8%20.8\% for MolmoAct2), which is consistent with the embodiment gap: ten episodes per task is not enough YAM data to re-target ALOHA kinematics. FineART-VLA is the only checkpoint whose success rate increases monotonically to 33.6%33.6\% SR at 12501250 episodes. MolmoAct2âs SR plateaus in the low twenties despite a 25-fold increase in data (20.8% to 24.8%), while ABC peaks mid-sweep at 34.4% before dropping to 24.0%. Both baselines score 0.0% success zero-shot, indicating task-embodiment fine-tuning is necessary regardless of mid-training dataset. 4.3.3 Does FineART-VLA pick the right object among distractors on YAM? An additional task tests spatial grounding: put the cable into the bin, with a bread roll and a donut as distractors, where the target and both distractors are absent from the YAM fine-tuning data. FineART-VLA improves monotonically from 36.0%36.0\% to 60.0%60.0\% success as the budget grows. ABC starts higher at ten episodes (52.0%52.0\%) but then drops sharply as the fine-tuning set grows, suggesting the representation is overwritten, not refined, by fine-tuning. Figure 7: FineART-VLA transfer to tasks absent from the YAM five-task fine-tuning set; 300k ALOHA mid-training steps + 5k fine-tuning steps on YAM. 4.3.4 Does fine-tuning on non-relevant YAM tasks enable transfer to unseen long-horizon tasks? The most striking result is on tasks that appear nowhere in the YAM fine-tuning data. After the same 55k-step fine-tune on the five basic tasks (Fig. 6a), we evaluate FineART-VLA on prepare breakfast, which requires placing a plate on the tray and then arranging two donuts and a slice of bread on it. As shown in Fig. 7, the policy reaches 28.0%28.0\% SR and 78.3%78.3\% PR with autonomous hierarchical execution, executing the full multi-stage sequence on a robot it had seen only through five unrelated tasks. It also emits the Adjust subtask to realign the tray, a behavior annotated in the FineART ALOHA data and never performed in the YAM fine-tuning set. Sort tools, also unseen on YAM, reaches 12.0%12.0\% SR and 60.0%60.0\% PR. These results indicate that subtask-level task structure transfers across the embodiment gap, and the fine-tuning trajectories supply the kinematics for embodiment-specific motor patterns. 5 Conclusion To our knowledge, FineART is the largest open-source subtask-annotated manipulation dataset: 533,913533,913 labels covering every one of its 40,54340,543 episodes and 151151 tasks, spanning hundreds of distinct object classes plus a long tail of contact-rich skills beyond ordinary pick-and-place tasks (Section 3). Experiments with our FineART-VLA policy indicate that the FineART dataset (Section 4) enables meaningful performance gains on in-distribution and out-of-distribution tasks and across embodiments. Inclusion of long-tail tasks enables higher performance across partially in-distribution and out-of-distribution evaluation tasks, indicating object variety alone is not sufficient for task diversity. Subtask training enables FineART-VLA to parse instructions, which a flat policy cannot, and to execute long-horizon sequential tasks. In cross-embodiment experiments with minimal target embodiment fine-tuning (Stationary table-top ALOHA to Mobile YAM), our FineART-VLA policy completes long-horizon tasks not present in the target embodiment fine-tuning set. These results indicate that FineART-VLA learned subtask-level planning during ALOHA mid-training, and the target embodiment fine-tuning trains the policy on the target robotâs kinematics without forgetting the sequential task planning. Limitations and Future Work. Our dataset focuses on a single robot platform, and our policy is only trained for about 10%10\% of an epoch. Training for longer and testing more base models would likely show a larger impact of dense subtask annotations. Given the impressive performance gains from our subtask-conditioned FineART-VLA policy, we are excited to see progress on subtask-conditioned world models [16], reward models [8], and advantage-conditioned RL [30], which enables learning from rejected rollouts instead of discarding them. VLM-automated labeling shows promise for reducing subtask annotation burden as the dataset grows [5]. Finally, while fine-tuning on five non-relevant YAM tasks enabled transfer to unseen, long-horizon YAM tasks, it is unclear which types of fine-tuning tasks drove cross-embodiment transfer. A task, annotation, and embodiment sweep [28, 9] would help isolate the effects of mid-training and fine-tuning dataset diversity. By releasing the FineART dataset, model, and training code, we present a canvas for future exploration in our field. Acknowledgments We thank our robot operators for data collection, annotation, evaluations, and logistics, and the many colleagues across engineering and program leadership who supported this work. See Appendix C for full acknowledgments. References [1] M. Ahn, A. Brohan, N. Brown, Y. Chebotar, O. Cortes, B. David, C. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, et al. (2022) Do As I Can, Not As I Say: Grounding Language in Robotic Affordances. In Conf. on Robot Learning (CoRL), p. 287â318. Cited by: §1, §1, §2.2, §2.3. [2] A. Allshire, H. G. Singh, R. Singh, A. Rashid, H. Choi, D. McAllister, J. Yu, Y. Chen, H. Huang, P. Abbeel, et al. (2026) Scalable Behavior Cloning with Open Data, Training, and Evaluation. Note: arXiv:2606.27375 Cited by: §1, §2.1, Table 1, §3.2. [3] S. Belkhale, T. Ding, T. Xiao, P. Sermanet, Q. Vuong, J. Tompson, Y. Chebotar, D. Dwibedi, and D. Sadigh (2024) RT-H: Action Hierarchies Using Language. In Robotics: Science and Systems (RSS), Cited by: §1, §2.2. [4] H. Bharadhwaj, J. Vakil, M. Sharma, A. Gupta, S. Tulsiani, and V. Kumar (2024) RoboAgent: Generalization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking. In IEEE Int. Conf. on Robotics and Automation (ICRA), p. 4788â4795. Cited by: Table 1. [5] N. Blank, M. Reuss, M. RĂŒhle, Ă. E. YaÄmurlu, F. Wenzel, O. Mees, and R. Lioutikov (2024) Scaling Robot Policy Learning via Zero-Shot Labeling with Foundation Models. In Conf. on Robot Learning (CoRL), p. 4158â4187. Cited by: §5. [6] A. Brohan, N. Brown, J. Carbajal, Y. Chebotar, X. Chen, K. Choromanski, T. Ding, D. Driess, A. Dubey, C. Finn, et al. (2023) RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control. In Conf. on Robot Learning (CoRL), p. 2165â2183. Cited by: §1, §2.3. [7] R. Cadene, S. Alibert, F. Capuano, M. Aractingi, A. Zouitine, P. Kooijmans, J. Choghari, M. Russi, C. Pascal, S. Palma, M. Shukor, J. Moss, A. Soare, D. Aubakirova, Q. Lhoest, Q. GallouĂ©dec, and T. Wolf (2026) LeRobot: An Open-Source Library for End-to-End Robot Learning. In The Fourteenth International Conference on Learning Representations, Cited by: §4.1. [8] Q. Chen, J. Yu, M. Schwager, P. Abbeel, Y. Shentu, and P. Wu (2026) SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulation. In Int. Conf. on Learning Representations (ICLR), Cited by: §5. [9] R. Doshi, H. Walke, O. Mees, S. Dasari, and S. Levine (2024) Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation. In Conf. on Robot Learning (CoRL), p. 496â512. Cited by: §2.3, §5. [10] D. Driess, J. T. Springenberg, B. Ichter, L. Yu, A. Li-Bell, K. Pertsch, A. Z. Ren, H. Walke, Q. Vuong, L. X. Shi, and S. Levine (2025) Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better. Note: arXiv:2505.23705 Cited by: §2.3, §4.1. [11] H. Fang et al. (2026) MolmoAct2: Action Reasoning Models for Real-world Deployment. Note: arXiv:2605.02881 Cited by: §2.1, Table 1. [12] H.-S. Fang, H. Fang, Z. Tang, J. Liu, C. Wang, J. Wang, H. Zhu, and C. Lu (2024) RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shot. In IEEE Int. Conf. on Robotics and Automation (ICRA), p. 653â660. Cited by: §1, §2.1, Table 1. [13] Z. Fu, T. Z. Zhao, and C. Finn (2024) Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation. In Conf. on Robot Learning (CoRL), p. 4066â4083. Cited by: §1, §2.1. [14] Gemini Robotics Team, S. Abeyruwan, J. Ainslie, J.-B. Alayrac, M. G. Arenas, T. Armstrong, A. Balakrishna, R. Baruch, M. Bauza, M. Blokzijl, et al. (2025) Gemini Robotics: Bringing AI into the Physical World. Note: arXiv:2503.20020 Cited by: §2.3. [15] Gemma Team et al. (2024) Gemma 2: Improving Open Language Models at a Practical Size. Note: arXiv:2408.00118 Cited by: §4.1. [16] Y. Guo, L. X. Shi, J. Chen, and C. Finn (2026) Ctrl-World: A Controllable Generative World Model for Robot Manipulation. In Int. Conf. on Learning Representations (ICLR), Cited by: §5. [17] S. Hu and T. Horii (2026) SADP: Subgoal-Aware Diffusion Policy for Long-Horizon Manipulation Learned from Foundation Model Generated Demonstrations. Note: arXiv:2605.16871 Cited by: §2.3. [18] T. Jiang, T. Yuan, Y. Liu, C. Lu, J. Cui, X. Liu, S. Cheng, J. Gao, H. Xu, and H. Zhao (2025) Galaxea Open-World Dataset and G0 Dual-System VLA Model. Note: arXiv:2509.00576 Cited by: §2.3. [19] D. Kalashnikov, J. Varley, Y. Chebotar, B. Swanson, R. Jonschkowski, C. Finn, S. Levine, and K. Hausman (2021) Scaling Up Multi-Task Robotic Reinforcement Learning. In Conf. on Robot Learning (CoRL), p. 557â575. Cited by: §2.1, Table 1. [20] A. Khazatsky, K. Pertsch, S. Nair, A. Balakrishna, S. Dasari, S. Karamcheti, S. Nasiriany, M. K. Srirama, L. Y. Chen, K. Ellis, et al. (2024) DROID: A Large-Scale In-the-Wild Robot Manipulation Dataset. In Robotics: Science and Systems (RSS), p. 1â13. Cited by: §1, §2.1, Table 1, §3.2. [21] B. Kim, R. Wang, D. Acuna, J. Jung, A. Trevithick, B. Cui, Y. Choi, and P. Ammanabrolu (2026) How to Instruct Your Robot: Dense Language Annotations Power Robot Policy Learning. Note: arXiv:2605.17077 Cited by: §2.3. [22] M. J. Kim, K. Pertsch, S. Karamcheti, T. Xiao, A. Balakrishna, S. Nair, R. Rafailov, E. Foster, G. Lam, P. Sanketi, Q. Vuong, T. Kollar, B. Burchfiel, R. Tedrake, D. Sadigh, S. Levine, P. Liang, and C. Finn (2024) OpenVLA: An Open-Source Vision-Language-Action Model. In Conf. on Robot Learning (CoRL), p. 2679â2713. Cited by: §1, §2.3. [23] R. Krishna, K. Hata, F. Ren, L. Fei-Fei, and J. C. Niebles (2017) Dense-Captioning Events in Videos. In IEEE Int. Conf. on Computer Vision (ICCV), p. 706â715. Cited by: §2.2. [24] Y. Li, Y. Deng, J. Zhang, J. Jang, M. Memmel, R. Yu, C. R. Garrett, F. Ramos, D. Fox, A. Li, A. Gupta, and A. Goyal (2025) HAMSTER: Hierarchical Action Models for Open-World Robot Manipulation. In Int. Conf. on Learning Representations (ICLR), Cited by: §2.3. [25] C. Lynch, A. Wahid, J. Tompson, T. Ding, J. Betker, R. Baruch, T. Armstrong, and P. Florence (2023) Interactive Language: Talking to Robots in Real Time. IEEE Robotics and Automation Letters (RA-L), p. 1â8. External Links: Document Cited by: §2.3. [26] O. Mees, L. Hermann, E. Rosete-Beas, and W. Burgard (2022) CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks. IEEE Robotics and Automation Letters (RA-L) 7 (3), p. 7327â7334. Cited by: §1, §2.2. [27] T. Motoda, M. Murooka, R. Nakajo, M. A. Muttaqien, K. Makihara, H. Oh, K. Shirai, F. Erich, R. Hanai, and Y. Domae (2025) AIST Bimanual Manipulation Dataset. Note: https://aistairc.github.io/aist_bimanip_site/ Cited by: §2.1. [28] Open X-Embodiment Collaboration et al. (2024) Open X-Embodiment: Robotic Learning Datasets and RT-X Models. In IEEE Int. Conf. on Robotics and Automation (ICRA), p. 6892â6903. Cited by: §1, §2.1, Table 1, §5. [29] Physical Intelligence et al. (2025) Ï0.5 _0.5: a Vision-Language-Action Model with Open-World Generalization. Note: arXiv:2504.16054 Cited by: §A.1, §2.3, §4.1, §4.1, §4.1, §4.1, §4.2.3, §4. [30] Physical Intelligence et al. (2025) Ï0.6âÏ^*_0.6: a VLA That Learns From Experience. Note: arXiv:2511.14759 Cited by: §5. [31] L. X. Shi, B. Ichter, M. Equi, L. Ke, K. Pertsch, Q. Vuong, J. Tanner, A. Walling, H. Wang, N. Fusai, A. Li-Bell, D. Driess, L. Groom, S. Levine, and C. Finn (2025) Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Models. In Int. Conf. on Machine Learning (ICML), p. 54919â54933. Cited by: §1, §2.3. [32] FlashRT External Links: Link Cited by: §A.6, §A.6. [33] H. R. Walke, K. Black, T. Z. Zhao, Q. Vuong, C. Zheng, P. Hansen-Estruch, A. W. He, V. Myers, M. J. Kim, M. Du, A. Lee, K. Fang, C. Finn, and S. Levine (2023) BridgeData V2: A Dataset for Robot Learning at Scale. In Conf. on Robot Learning (CoRL), p. 1723â1736. Cited by: Table 1, §3.2. [34] J. Wei, X. Wang, D. Schuurmans, M. Bosma, B. Ichter, F. Xia, E. Chi, Q. V. Le, and D. Zhou (2022) Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. Advances in Neural Information Processing Systems 35, p. 24824â24837. Cited by: §2.3. [35] X. Zhai, B. Mustafa, A. Kolesnikov, and L. Beyer (2023) Sigmoid Loss for Language Image Pre-Training. In Int. Conf. on Computer Vision (ICCV), p. 11975â11986. Cited by: §4.1. [36] T. Z. Zhao, V. Kumar, S. Levine, and C. Finn (2023) Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware. In Robotics: Science and Systems (RSS), Cited by: §1, §2.1. Appendix Appendix A FineART-VLA: Architecture and Mid-Training Details Figure 8 gives the full computational path behind Section 4.1âs architecture, Fig. 9 gives the attention masks behind 1âs two training shapes, and Table 5 gives the mid-training configuration behind all of our subtask/KI runs in Table 2(a). Observations oto_t3 camera views, 224Ă224224Ă224Task string âtask ^taskSigLIPvision encoderGemma-2Blanguage model Backbone zΞz_Ξ (bidirectional attention)Subtask head(LM head, CE)âsub ^subFAST tokens(same LM head, CE, λfast=1 _fast=1)a~ aAction expert(Gemma-300M)+ state qtq_t, discretized in promptFlow-matching head(L2, λflow=10 _flow=10)Atââ50Ă14A_t\!â\!R^50Ă 14conditions low-levelstream (70%70\% of batch)attends to sgâĄ(K,V)sg(K,V)under KI Figure 8: FineART-VLA architecture. The backbone zΞz_Ξ is a 22B-parameter Gemma language model with a SigLIP vision encoder, attending bidirectionally over the camera views and the task string. Its LM head decodes the subtask âsub ^sub and, right after it, the FAST-tokenized action sequence a~ a. The separate 300300M-parameter action expert reads out the continuous chunk AtA_t through its own flow-matching loss. Under knowledge insulation, the action expert attends to stop-gradient copies of the backboneâs keys and values. The LM head decodes the subtask on 30%30\% of samples (λtext=1 _text=1), and the action expert conditions on it for the remaining 70%70\% (1). The action expert always conditions on the 1414-dim joint state qtq_t, discretized into 256256 bins and embedded as text in the same prompt rather than passed through the backbone. The FAST and the flow-matching output never attend to each other. With knowledge insulation on, the flow lossâs gradient never reaches ΞVLM _VLM while the FAST loss â computed entirely by the backboneâs own LM head â is unaffected either way (Section A.2). Because a sample either generates the subtask (30%30\%) or predicts the FAST and action outputs conditioned on it (70%70\%), these two cases use two different attention patterns rather than one shared sequence, shown side by side in Fig. 9 (Section A.2). Setting Value (a) Mid-training data Dataset FineART, task-label-repaired release Episodes / frames 40,54340,543 / 185,534,500185,534,500 Tasks 151151 (dense task index) Cameras birdâs-eye, left wrist, right wrist (360Ă640360Ă640, resized 224Ă224224Ă224) State / action 1414-dim bimanual joint + gripper, per frame Sampling task-balanced, α=0.5α=0.5, idle chunks stripped (â3.1%â 3.1\% of frames) (b) Optimization Optimizer AdamW (ÎČ1=0.9 _1=0.9, ÎČ2=0.95 _2=0.95, Ï”=10â8Δ=10^-8) Learning rate 2.5Ă10â52.5Ă 10^-5, cosine decay to 5Ă10â65Ă 10^-6 Warmup 2,0002,000 steps Weight decay 10â1010^-10 Gradient clip 1.01.0 (global norm) Text CE z-loss weight 10â410^-4 (large-vocab logit regularizer) Precision native bfloat16 (no autocast), gradient checkpointing (c) Compute Hardware 11 node, 8Ă8ĂH100 per run Global batch 6464 (88 per device Ă 88 devices) Steps 300,000300,000 (â10%â 10\% of one epoch) Wall-clock â1â 1 week per run (four runs trained in parallel) Checkpointing every 2,5002,500 steps (120120 checkpoints saved) All four subtask/KI ablation runs in Table 2(a) share this configuration and differ only in the recipe (subtask training on/off) and whether knowledge insulation is enabled. Per-component learning-rate multipliers for the LM head, backbone, and action expert are all 1.01.0 (no differential scaling). Table 5: Mid-training configuration for FineART-VLA. A.1 Task-Balanced Sampling FineARTâs 151151 tasks range from a few dozen episodes to tens of thousands, so sampling frames uniformly from the pooled dataset would spend most of training on whichever tasks happen to be over-represented, starving all others. We use the temperature-sampling scheme from [29] behind the âtask-balanced, α=0.5α=0.5â row of Table 5(a): task i, with nin_i valid (non-idle) frames, is drawn with probability pâĄ(task=i)=niαâjnjα,p(task=i)= n_i^α _jn_j^α, (3) and once a task is chosen, the frame itself is drawn uniformly from that taskâs nin_i valid frames. α interpolates between two extremes. At α=0α=0, Eq. 3 gives pâĄ(task=i)=1/151p(task=i)=1/151 for every task regardless of size, so a task with a handful of episodes gets exactly as many gradient steps as one an order of magnitude larger. At α=1α=1, it reduces to ni/âjnjn_i/ _jn_j, i.e., sampling frames uniformly from the pooled dataset, so the largest tasks dominate in direct proportion to their size. We use α=0.5α=0.5 for every run in this paper: a task twice as large as another is still sampled more often, but only by a factor of 2 2 rather than 22. We do not implement Eq. 3 as a single per-frame weight vector handed to a weighted sampler since building and drawing from a categorical distribution over FineARTâs 185.5185.5M frames is beyond what torch.multinomialâs categorical cap (2242^24 entries) supports. We sample hierarchically: draw a task from Eq. 3 by an inverse-CDF lookup on the 151151-entry task distribution, then draw a frame uniformly from a precomputed per-task index of valid frames, costing two small lookups per sample instead of one lookup into a 185.5185.5M-entry table. A.2 Knowledge Insulation Section 4.1 asserts that knowledge insulation makes âΞVLMâflow=0 _ _VLML_flow=0. Here we show why. At every layer l=1,âŠ,Ll=1,âŠ,L of the joint attention, drop the head dimension and write the VLM streamâs own query/key/value as Qvlm(l),Kvlm(l),Vvlm(l)Q_vlm^(l),K_vlm^(l),V_vlm^(l) (projections of the backbone hidden state hvlm(lâ1)h_vlm^(l-1)) and the action expertâs as Qact(l),Kact(l),Vact(l)Q_act^(l),K_act^(l),V_act^(l) (projections of hact(lâ1)h_act^(l-1), its own 300300M-parameter Gemma tower). Because the prefix never attends into the suffix (Fig. 9), the VLM streamâs attention is ordinary self-attention, Attvlm(l)=softmaxâĄ(Qvlm(l)âKvlm(l)â€d+Mvlm)âVvlm(l),Att_vlm^(l)=softmax\! ( Q_vlm^(l)\,K_vlm^(l) d+M_vlm )V_vlm^(l), (4) and its final layerâs output realizes the backbone representation zΞz_Ξ of 1. The action streamâs attention additionally reads the VLM streamâs keys and values (it is conditioned on the backbone, not vice versa): Attact(l)=softmaxâĄ(Qact(l)â[Îș(l);Kact(l)]â€d+Mact)â[Μ(l);Vact(l)],Att_act^(l)=softmax\! ( Q_act^(l)\,[Îș^(l);K_act^(l)] d+M_act )[Μ^(l);V_act^(l)], (5) where [â ;â ][·\,;\,·] concatenates along the key/value sequence axis and Mvlm,MactM_vlm,M_act are the additive masks realizing Fig. 9(b). Without KI, Îș(l)=Kvlm(l)Îș^(l)=K_vlm^(l) and Μ(l)=Vvlm(l)Μ^(l)=V_vlm^(l) directly. With KI, Îș(l)=sgâĄ(Kvlm(l))Îș^(l)=sg (K_vlm^(l) ) and Μ(l)=sgâĄ(Vvlm(l))Μ^(l)=sg (V_vlm^(l) ), where sgâĄ(â )sg(·) is the stop-gradient operator: the identity in the forward pass (sgâĄ(x)=xsg(x)=x) but a constant under differentiation (âsgâĄ(x)/âxâĄ0â\,sg(x)/â x⥠0). Figure 10 draws this split for a single layer. Because sgâĄ(â )sg(·) is the identity in the forward direction, Eq. 5 takes the exact same numerical value whether or not KI is enabled. KI is a purely backward-pass ablation, changing which parameters receive gradient and not what the model computes. Let ΞVLM _VLM denote every backbone parameter feeding Kvlm(l),Vvlm(l)K_vlm^(l),V_vlm^(l) at any layer, and note that âflowL_flow (Eq. 2) is read out of the action streamâs outputs only, âflow=gâĄ(Attact(1),âŠ,Attact(L))L_flow=g (Att_act^(1),âŠ,Att_act^(L) ), never touching Attvlm(l)Att_vlm^(l) directly. With KI, for every layer l, âAttact(l)âΞVLM=âAttact(l)âsgâĄ(Kvlm(l))ââsgâĄ(Kvlm(l))âΞVLMâ⥠0+âAttact(l)âsgâĄ(Vvlm(l))ââsgâĄ(Vvlm(l))âΞVLMâ⥠0= 0, â\,Att_act^(l)â _VLM= â\,Att_act^(l)â\,sg(K_vlm^(l)) â\,sg(K_vlm^(l))â _VLM_âĄ\,0\;+\; â\,Att_act^(l)â\,sg(V_vlm^(l)) â\,sg(V_vlm^(l))â _VLM_âĄ\,0\;=\;0, (6) so by the chain rule âΞVLMâflow=âl=1LââflowâAttact(l)â âAttact(l)âΞVLM=0 _ _VLML_flow= _l=1^L _flowâ\,Att_act^(l)· â\,Att_act^(l)â _VLM=0. This split is applied uniformly at every one of the L backbone layers (once per layer of the fused forward), so no VLM parameter at any depth â not just a given layerâs own K/V projection weights, but every earlier embedding and layer that produced hvlm(lâ1)h_vlm^(l-1) â can reach âflowL_flow through this path either. sgâĄ(â )sg(·) severs the graph at that node regardless of what feeds into it upstream. The FAST-tokenized output (Fig. 8) is computed from the VLM stream, not the action stream. FAST tokens are appended to the prefixâs own text tokens before layer 11 (Fig. 9(b): âFAST tokensâ shares the bidirectional-prefix side with âSubtask + Stateâ) and read out through Attvlm(L)Att_vlm^(L) using the same PaliGemma LM head that predicts the subtask. Both âtextL_text and âfastL_fast are sliced from the same VLM-stream output tensor, which Eq. 5 never modifies. So âΞVLMâtextâ 0,âΞVLMâfastâ 0, _ _VLML_textâ 0, _ _VLML_fastâ 0, (7) by the same argument in reverse: neither lossâs computational graph passes through an sgâĄ(â )sg(·) node, so the backbone continues to receive full gradient from both. KI insulates the backbone from the continuous action loss only, not from the discrete one â consistent with âthe backbone is shaped only by the token-level lossesâ (Section 4.1). (a) Text generation (high-level)ImagesTaskSubtaskImagesTaskSubtaskbidirectional prefix(b) Action prediction (low-level)ImagesSubtask +StateFASTtokensActionImagesSubtask +StateFASTtokensActionbidirectional prefix Figure 9: Block-causal attention pattern. Colored cells can attend to each other, white cells are masked, and the diagonal split means attention is causal within that block. (a) Generating the subtask (30%30\% of samples). Images and the task string form the bidirectional prefix, and the subtask is generated one token at a time, so each subtask token can only see earlier subtask tokens â the autoregressive restriction described in Section 4.1. (b) Predicting the action (70%70\% of samples, or every sample for the no-subtask arm). Here the subtask and discretized state are given as input rather than generated, so they join the bidirectional prefix instead. The FAST-tokenized sequence is still generated token by token, so it stays causal like the subtask span in (a). The continuous action tokens have no such restriction: flow matching denoises the whole chunk at once, so they can all attend freely to each other. In no panel does the prefix attend back into a generated or predicted suffix, and the FAST and continuous-action outputs are mutually invisible so neither loss leaks into the other. This masking pattern is fixed by the recipe regardless of knowledge insulation. hvlm(lâ1)h_vlm^(l-1)Qvlm,Kvlm,VvlmQ_vlm,K_vlm,V_vlmAttvlm(l)Att_vlm^(l)hvlm(l)h_vlm^(l)hact(lâ1)h_act^(l-1)Qact,Kact,VactQ_act,K_act,V_actAttact(l)Att_act^(l)hact(l)h_act^(l)sgâĄ(Kvlm,Vvlm)sg(K_vlm,V_vlm)Ăblocked Figure 10: Knowledge insulation at layer l. The VLM streamâs attention Attvlm(l)Att_vlm^(l) (top) is untouched by KI. The action streamâs attention Attact(l)Att_act^(l) (bottom) reads the VLM streamâs keys and values only through the stop-gradient copy sgâĄ(Kvlm,Vvlm)sg(K_vlm,V_vlm) (purple, dashed), which blocks âΞVLMâflow _ _VLML_flow at the red Ă (Eq. 6). A.3 Optimization Objective Equation 2 gives the three loss terms. In practice all of them are computed on every action chunk regardless of λtext _text since the same chunk is flow-matched and FAST-tokenized at once. We also put a z-loss on the text logits, weight 10â410^-4: without it, a large-vocabulary head like PaliGemmaâs 257257K tokens can let its log-partition function drift while cross-entropy itself persists. The recipe stack can drop the subtask context at random during training, so the policy learns to fall back on the task string alone. We leave that dropout at 00 for every run in this paper. Mid-training required 300300K steps at a global batch of 6464 â about 10%10\% of one epoch over FineARTâs 185.5185.5M frames â roughly a week of wall-clock time on a single 8Ă8ĂH100 node. We ran the four subtask/KI ablations on separate nodes at the same time rather than one after another, so all four checkpoints in Table 2(a) were ready within that same week. A.4 Inference At deployment, the same checkpoint can be executed in three different ways, independent of how it was mid-trained (Fig. 11). All three call the same action expert and flow-matching head from Fig. 8. They differ in where the low-level conditioning comes from and how often it gets refreshed. Task âtask ^taskAction expert+ flow headâAtâ A_t(a) Flat re-conditions on the raw task string every chunk; the LM head is never called Task âtask ^taskLM headgenerates âsub ^subAction expert+ flow headâAtâ A_t(b) Hierarchical LM head re-queried every N chunks (default N=1N=1), held between Operator subtask âsub ^subAction expert+ flow headâAtâ A_t(c) Interactive holds the operatorâs subtask across chunks until the operator advances it Figure 11: Inference-time conditioning modes. The three panels show where the action expertâs low-level conditioning comes from. In (a) Flat it is just the raw task string, re-fed every chunk with the LM head never called. It is the only correct way to deploy the no-subtask arm (Run 1.41.4 in Table 2) since its LM head was never trained to produce anything. (b) Hierarchical is how the trained FineART-VLA is deployed (Fig. 8): the LM head autoregressively generates a subtask âsub ^sub every N chunks and the action expert conditions on it until the next regeneration, which is how the subtask-trained arm (Run 1.31.3) is deployed. (c) Interactive skips the LM head altogether and lets an operator supply âsub ^sub directly. It is the human-oracle protocol behind the long-horizon instruction-following result in Fig. 5, where the operator moves on to the next subtask once the previous one is judged done rather than waiting on the LM head to propose it. Chunk-level execution is the same in all three modes: a fresh action chunk is predicted from a new observation every n_action_steps control steps while the policy runs open-loop in between. In (b) and (c), the subtask is held across several chunks so that it spans seconds rather than a single 5050-step chunk and matches how subtasks are actually distributed in training. We run inference eager rather than compiled because the action expertâs prompt embeds the discretized joint state as text. With token count shifting with almost every observation, a compiled graph re-specializes on nearly every call, so compilation never pays off. A.5 Language Runtime and Subtask Execution FineART-VLA integrates with LeRobotâs interactive rollout runtime, which separates language-level instruction updates from action-chunk execution. The runtime keeps the policy, observation processors, and robot connection initialized throughout a session. A terminal interface and a programmatic controller expose the same instruction-update and execution operations. Human-provided subtasks. An operator can replace the active instruction during execution without reloading the model. Under synchronous inference, the runtime discards queued policy actions computed under the previous instruction, and the next prediction uses the updated instruction. When real-time chunking is enabled, the new instruction conditions the next action chunk, which is blended with the remaining action prefix. Autonomous subtask inference. Given a high-level goal, the runtime periodically requests a subtask from FineART-VLA using the current observation. The generation prompt is constructed from the checkpointâs saved training recipe, preserving the prompt structure used for subtask supervision. The generated text becomes the active instruction for subsequent action predictions and remains in effect until replaced. Each planning query receives the original goal. The replanning interval is configurable and measured from the application of the preceding subtask; the runtime does not itself detect subtask completion. A.6 Efficient Training and Inference Training. The implementation shares backbone computation across language, FAST-token, and flow-matching objectives when their corresponding supervision is present. To amortize visual-language prefix computation, multiple independent noise and timestep draws reuse the same prefix, with five draws by default. Action embeddings and output projections are vectorized across these draws. Attention masks isolate the action sequences and prevent access to FAST action targets, and the flow losses are averaged across draws. Additional optimizations include sparse and bucketed cross-entropy computation, per-layer vision activation checkpointing, and fused AdamW updates. Optional backends support compiled cross-entropy and FlashRT [32] adaptive RMSNorm kernels. For flow-only batches with knowledge insulation and no language or FAST supervision, the implementation can also omit the backboneâs backward graph. Inference. Autoregressive subtask generation uses incremental keyâvalue caching. The action-denoising implementation reuses the visual-language prefix cache across steps and crops appended action entries instead of copying the cache at each step. An optional FlashRT backend provides calibrated FP8 MLP kernels for Gemma and SigLIP. These kernels are inference-only, change numerical precision, and are disabled by default. Liang Su, author of FlashRT [32], contributed substantial implementation and optimization work underlying this section, including denoising-cache improvements, training-path optimizations, and FlashRT kernel integration. Appendix B Evaluations Our evaluations total 3,4003,400 rollouts across 2323 checkpoints between experiments on ALOHA and YAM, summarized in Table 6. Table 6: Summary of Evaluations Task Total Rollouts ALOHA Experiment YAM Experiment Put cup on shelf 575 Benchmark Benchmark Fold towel 575 Benchmark Benchmark Insert flower in vase 575 Benchmark Benchmark Insert tool into pegboard 575 Benchmark Benchmark Put cup on saucer 575 Benchmark Benchmark Sort tools 150 Benchmark Cross-Embodiment Transfer Put donut into bin 50 Spatial Grounding â Prepare breakfast 125 Long-Horizon Cross-Embodiment Transfer Put cable into bin 200 â Unseen Target and Distractors B.1 Procedure Evaluations of our scale demand procedural rigor. Across benchmark suites, we predetermine 2525 initial conditions, namely position and orientation, for each task (Table 7). Table 7: Benchmark suites by initial conditions. Benchmark Suite Benchmark Tasks Initial Conditions In-Embodiment 66 150150 Cross-Embodiment 55 125125 Total 11 275 Fig. 12 illustrates the 2525 initial conditions for an in-distribution benchmark task: put cup on shelf. Figure 12: Initial conditions for put cup on shelf. B.2 Rubric We evaluate each checkpoint by progress rate based on subtask completion percentage. Subtasks are defined such that one subtask must be completed before the next can begin (Table 8). Prepare breakfast is an exception, with no prescribed order after its first subtask. Table 8: Tasks by Subtask Task Subtask # Subtask Description Subtask Completion (%) Put cup on shelf 1 Approach cup 25.0 2 Grasp cup 50.0 3 Move cup toward shelf 75.0 4 Place cup on shelf 100.0 Fold towel 1 Approach first boundary of towel 12.5 2 Grasp first boundary of towel 25.0 3 Move toward opposite boundary 37.5 4 Place at opposite boundary 50.0 5 Approach second boundary of towel 62.5 6 Grasp second boundary of towel 75.0 7 Move toward opposite boundary 87.5 8 Place at opposite boundary 100.0 Insert flower in vase 1 Approach flower 25.0 2 Grasp flower 50.0 3 Move flower toward vase 75.0 4 Insert flower in vase 100.0 Insert tool into pegboard holder 1 Approach tool 25.0 2 Grasp tool 50.0 3 Move tool toward pegboard 75.0 4 Insert tool into pegboard holder 100.0 Put cup on saucer 1 Approach cup 25.0 2 Grasp cup 50.0 3 Move cup toward saucer 75.0 4 Place cup on saucer 100.0 Sort tools 1 Approach first tool 12.5 2 Grasp first tool 25.0 3 Move toward bin 37.5 4 Drop object in corresponding bin 50.0 5 Approach second tool 62.5 6 Grasp second tool 75.0 7 Move toward bin 87.5 8 Drop object in corresponding bin 100.0 Put donut into bin 1 Approach donut 25.0 2 Grasp donut 50.0 3 Move donut toward correct bin 75.0 4 Place donut into correct bin 100.0 Prepare breakfast 1 Pick and place plate on tray 14.3 2 Pick up bread 28.6 3 Place bread on plate 42.9 4 Pick up pink donut 57.1 5 Place pink donut on plate 71.4 6 Pick up blue donut 85.7 7 Place blue donut on plate 100.0 Put cable into bin 1 Pick up cable 50.0 2 Put cable into bin 100.0 Appendix C Acknowledgments Our work would not be possible without the support of colleagues and friends at Scale AI, Hugging Face, and the community. âą We thank Alex Finch, Angel Uribe, Luke Pulaski, and Marci Ramos for their work in operations for data collection; Ana Paula Estevez, Juan Carlos Becerril, Jose Antonio Gonzalez, Paulina Vergara Montoya, and Astrid Hernandez Galvez for their work in operations for data annotation; Aidan Walker, Amanda Dee, Angel Uribe, Devender Bankoti, Luke Pulaski, and Marci Ramos for their work in operations for evaluation; and Aidan Walker, Aliyah Dela Cruz, Amanda Dee, Angel Uribe, Caroline Doubane, Devender Bankoti, Isaiah Smith, Joshua Diaz, Katerina Connearney, Marci Ramos, Reeya Shrestha, Rudy Garcia, Sherwood Yee, Tony Alfatooni, Travis Bringas, and Veronika Tsvelodub for their work as on-site contributors. âą We thank Selam Gano, Sidney Nimako, Tyler Smithline, Martin Lombardo, Matias Del Carlo, Fran Espeche, Gabriel Blanchard, Shreyas Chakravarthula, Eric Taylor, and Tim Lu for their work in hardware engineering for data collection; Martin Lombardo, Matias Del Carlo, Fran Espeche, and Gianluca Bobbio for their work in software engineering for data collection; Gregorio Freidin, Matias Carou, Santiago Illi, and Gianluca Bobbio for their work in software engineering for data processing; and Garrett Matsuda, Juan Cabrera, Malena Goñi, Conrado Mader Blanco, Ezequiel Romio, Micaela Alvarez, Luis Lopez Castaneda, Ankit Vedak, Gianluca Bobbio, and Tim Lu for their work in software engineering for data annotation. âą We thank Caroline Clark, Kendyl Burkitt, and Molly Taudvin for their go-to-market support; and Javier Gonzalez for their cross-functional support. âą We thank Harsha Mohan, Michel Aractingi, Caroline Pascal, Carlos Jerez, Ke Wang, and Khalil Meftah for their early discussions on policy and dataset design. âą We thank Liang Su for their work on training and inference speed optimizations for FineART-VLA; and Steven Palma and the LeRobot team for their contributions to the interactive rollout runtime. âą We thank Ben Levin, Natasha Dadabhoy, and Joe Fox Jr. for their leadership and for approving the public release of the dataset.