Paper deep dive
WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
Xuerun Yan, Zhexi Lian, Nuoheng Zhang, Shiyu Fang, Haoran Wang, Chen Lv, Jia Hu, Binyang Song
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 94%
Last extracted: 7/10/2026, 5:32:58 AM
Summary
WCog-VLA is a dual-level World-Cognitive Vision-Language-Action framework for end-to-end autonomous driving that bridges semantic world forecasting with generative world evolution to enable proactive driving. It integrates a VLM backbone with 3D spatial perception, Game-theoretic Chain-of-Thought reasoning, and an Aligned Decoupled Diffusion Transformer (ADDT) for joint multi-agent trajectory generation. Trained on 85k Game-CoT annotations, it achieves a state-of-the-art PDMS score of 92.9 on the NAVSIM benchmark.
Entities (8)
Relation Signals (7)
WCog-VLA → achieves → PDMS score of 92.9
confidence 98% · Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9
WCog-VLA → evaluatedon → NAVSIM
confidence 98% · Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9
WCog-VLA → employs → Game-CoT
confidence 97% · we further construct a large-scale dataset featuring 85k Game-CoT annotations
ADDT → isa → generative world model
confidence 96% · we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model
WCog-VLA → uses → ADDT
confidence 96% · we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model
InternVL3-2B → servesas → VLM Backbone
confidence 94% · we adopt InternVL3-2B as our VLM backbone
TrackFormer → extracts → agent tokens
confidence 93% · we employ a TrackFormer that maps dense BEV features to sparse agent-centric tokens
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Vision-Language-Action (VLA) models have advanced end-to-end autonomous driving. However, existing methods either lack comprehensive world cognition or suffer from fragmented world foresight, inherently confining these models to reactive driving. To address this limitation, we propose WCog-VLA, a novel dual-level World-Cognitive VLA framework that successfully bridges semantic world forecasting with generative world evolution to achieve proactive autonomous driving. At the semantic level, WCog-VLA unifies world cognition and reasoning by incorporating 3D spatial perception and injecting agent tokens to capture the world dynamics, while concurrently enabling Game-theoretic Chain-of-Thought (Game-CoT) reasoning. At the generative level, we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model that synthesizes physically-plausible joint multi-agent trajectories. Through scene representation alignment, ADDT reduces the number of denoising steps required and thus significantly accelerates inference. To facilitate strategic reasoning, we further construct a large-scale dataset featuring 85k Game-CoT annotations. Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9.
Tags
Links
- Source: https://arxiv.org/abs/2607.08375v1
- Canonical: https://arxiv.org/abs/2607.08375v1
Trouble viewing inline? Open PDF directly →
Full Text
51,365 characters extracted from source content.
Expand or collapse full text
WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving Xuerun Yan 1,2† , Zhexi Lian 1† , Nuoheng Zhang 1 , Shiyu Fang 1 , Haoran Wang 1 , Chen Lv 2 , Jia Hu 1⊠ , and Binyang Song 2⊠ 1 Tongji University, China 2 Nanyang Technological University, Singapore † Equal contribution ⊠ Corresponding author Abstract. Vision-Language-Action (VLA) models have advanced end- to-end autonomous driving. However, existing methods either lack com- prehensive world cognition or suffer from fragmented world foresight, inherently confining these models to reactive driving. To address this limitation, we propose WCog-VLA, a novel dual-level World-Cognitive VLA framework that successfully bridges semantic world forecasting with generative world evolution to achieve proactive autonomous driving. At the semantic level, WCog-VLA unifies world cognition and reason- ing by incorporating 3D spatial perception and injecting agent tokens to capture the world dynamics, while concurrently enabling Game-theoretic Chain-of-Thought (Game-CoT) reasoning. At the generative level, we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model that synthesizes physically-plausible joint multi-agent trajectories. Through scene representation alignment, ADDT reduces the number of denoising steps required and thus signifi- cantly accelerates inference. To facilitate strategic reasoning, we further construct a large-scale dataset featuring 85k Game-CoT annotations. Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9. Keywords: End-to-end autonomous driving· Vision-Language-Action · World cognition 1 Introduction End-to-end (E2E) autonomous driving has emerged as a dominant paradigm by directly mapping raw sensory inputs to planned trajectories [5, 19, 20, 26] within a unified and differentiable framework. Although these E2E models show remarkable performance in common scenarios, they often struggle in complex or long-tail situations [4,63]. This fragility arises from insufficient causal reasoning and world knowledge, leaving the models unable to fully understand and reason about the surrounding environments. arXiv:2607.08375v1 [cs.CV] 9 Jul 2026 2X. Yan et al. ! " # $ % &' ( )# &' ( &' ( *+*,-.-/0,1*/233456789:;<= >5?@1---A1-8@;@B8CDEF98G-4HI-JBJ@8->5=K8@-233456789:;<=0-0 Fig. 1: Four paradigms of leveraging VLM in E2E autonomous driving. Our method (d) advances existing frameworks to enable proactive driving by establishing a dual-level world cognition with the integration of semantic forecasting and generative evolution. To address these long-tail challenges, Vision-Language-Models (VLMs) [1,2] have been increasingly integrated into E2E autonomous driving frameworks [25,47,53]. Equipped with extensive world knowledge and strong reasoning ca- pabilities, VLMs significantly advance scene comprehension in complex driving scenarios [27,60]. Building upon this foundation, Vision-Language-Action (VLA) models further extend VLM capabilities to action generation. Existing VLA ap- proaches typically operate in two ways. The first formulates action outputs as autoregressive sequence generation (Fig. 1(a)), producing either discrete text to- kens [37, 39, 42] or learned action codes [64]. Alternatively, the second utilizes VLMs as cognitive encoders and attaches dedicated action decoders (Fig. 1(b)) to generate continuous trajectories [13,52], e.g., diffusion models [23,32]. Despite these advancements, existing VLA models still face several chal- lenges: (1) Lack of 3D spatial awareness. Relying primarily on 2D image fea- tures, current models lack structured 3D spatial representations of surrounding road participants [38,63], which are essential for accurate spatial reasoning and precise ego planning. (2) Insufficient world cognition. Existing methods strug- gle to adequately represent world states and forecast future dynamics [46], such as the intentions of surrounding agents. This confines current methods to reac- tive rather than proactive driving (Fig. 1(a),(b)). While some works incorporate world cognition via VLM hidden states [28,54], they treat world modeling as an auxiliary semantic task while neglecting generative-level world evolution. This fragmented world foresight (Fig. 1(c)) overlooks the reciprocal interplay between the ego and surrounding agents, failing to synthesize joint interactive trajectories from a world-generative perspective. (3) Absence of strategic social reasoning. Current reasoning mechanisms mainly focus on static scene descriptions [7,39], lacking the game-theoretic ‘if-what’ imagination required for proactive social interaction among traffic participants. Motivated by these limitations, we seek to answer a key question: How can we endow VLA models with com- WCog-VLA3 prehensive world cognition across both semantic-level forecasting and generative-level evolution, thereby enabling proactive driving? To address these challenges, we propose WCog-VLA, a novel VLA frame- work featuring dual-level World Cognition (Fig. 1(d)). WCog-VLA achieves comprehensive world cognition by bridging the gap between semantic-level fore- casting and generative-level physical evolution. At the semantic level, WCog- VLA first embeds 3D spatial priors into the VLM, establishing a cognitive foun- dation for structured environment understanding. To operationalize the seman- tic world understanding, we decouple the VLM’s output hidden states into two functional roles. The cognition role encapsulates the understanding of current world states and future world dynamics. Meanwhile, the reasoning role drives a four-step game-theoretic reasoning process. This strategic reasoning mechanism transforms the ego vehicle from a passive observer to a proactive negotiator in social driving scenarios. At the generative level, we introduce the Aligned Decou- pled Diffusion Transformer (ADDT) as our generative world model. Conditioned on the VLM’s hidden states, ADDT employs a decoupled encoder-decoder archi- tecture to generate multi-agent trajectories. Specifically, the condition encoder explicitly aligns its latent space with dynamic scene representation. Guided by this alignment, the generation decoder efficiently synthesizes joint multi-agent trajectories, firmly grounding ego-planning within predicted interactive future dynamics. In summary, our main contributions are as follows: 1. Dual-level world cognition framework. We propose WCog-VLA that bridges semantic-level forecasting with generative-level evolution, enabling proac- tive autonomous driving. 2. Generative world model. We introduce ADDT as a generative world model, which synthesizes physically-plausible joint multi-agent trajectories with efficient inference time. 3. Game-theoretic reasoning dataset. We construct Game-CoT, a Game- theoretic Chain-of-Thought reasoning dataset with 85k samples that fills the gap in game-theoretic reasoning supervision for social driving. 4. State-of-the-art (SOTA) performance. WCog-VLA achieves a SOTA PDMS score of 92.9 on the NAVSIM [10] benchmark. 2 Related Work End-to-End Autonomous Driving. E2E autonomous driving directly maps sensory inputs to trajectories within unified frameworks [8, 19, 33]. Pioneering works like UniAD [20] and VAD [26] integrate perception and planning using dense Bird’s-Eye-View (BEV) representations, while SparseAD [45] improves efficiency via sparse queries. Recent paradigms, e.g., GenAD [61], DiffusionDrive [35], and VADv2 [5], introduce generative and probabilistic models for multi- modal trajectory planning [62]. However, current E2E models are limited by training data coverage, frequently failing in long-tail scenarios. This fragility primarily stems from an inherent lack of semantic reasoning and environment understanding capabilities, motivating the integration of VLMs into E2E driving. 4X. Yan et al. VLA for Autonomous Driving. VLMs are initially applied as high-level semantic interpreters for scenario understanding, such as DriveGPT4 [55] and DriveLM [47]. Building upon this, unified VLA models have been proposed to directly map multi-modal inputs to driving actions [25], exemplified by EMMA [22, 53], SimLingo [44], and DriveMoE [56]. While early VLA models driving actions directly as text [37,39], later work such as AutoVLA [64] introduces au- toregressive generation of action tokens. More recently, studies integrate VLM with generative planners [29, 49] to mitigate modal collapse between text and actions, e.g., VAE-based ORION [13] and diffusion-based ReCogDrive [32]. How- ever, current VLA methods predominantly remain reactive observers. Lacking explicit world cognition and future forecasts, they fail to anticipate dynamic changes in complex social scenarios, motivating the integration of comprehen- sive world cognition into the VLA framework. World Cognition Building for VLA-based Autonomous Driving. The latest VLA studies [24,36,51,54] have sought to incorporate world cognition. One branch of research focuses on enhancing spatial awareness of VLMs [9,16], e.g., DrivePI [38] introduces spatial-aware world cognition, and SGDrive [28] builds world features around a scene-agent-goal hierarchy. Another branch leverages generative forecasting for future foresight, employing future image generation as an auxiliary objective, e.g., UniDrive-WM [54] and DriveVLA-W0 [30]. However, these methods exhibit fragmented world foresight. Whether relying on seman- tic or image forecasting, they treat world evolution as a supervised perceptual task and lack joint multi-agent planning, failing to model interactive physical behaviors from a generative world perspective. To bridge this gap, WCog-VLA introduces a unified, dual-level world cognition framework. At the semantic level, the explicit agent tokens encapsulate the cognition of world dynamics. At the generative level, our ADDT synthesizes joint multi-agent trajectories, manifest- ing explicit world cognition within the generative execution stage. 3 WCog-VLA As shown in Fig. 2, our WCog-VLA consists of two tightly coupled compo- nents that bridge semantic-world understanding and reasoning with generative trajectory synthesis. First, a VLM Backbone is constructed on a multi-modal ar- chitecture to jointly process multi-view camera inputs and textual instructions. These heterogeneous tokens are fused to facilitate a game-theoretic Game-CoT reasoning process, enabling structured reasoning over scene context and agent interactions. To explicitly model spatial structure and agent dynamics, the VLM backbone further incorporates agent tokens from a 3D perception module. A spe- cialized world head then decodes the aggregated agent tokens to current 3D per- ception and future trajectory predictions of surrounding agents, enabling explicit semantic-level world cognition. Second, to seamlessly bridge semantic intent with physically feasible motion, we employ the ADDT as a generative world model. By intrinsically aligning its latent space with implicit scene dynamics through a WCog-VLA5 !! """ # $ % # & ' % "& ' ( ) % * ' + """ % *% """ , - ! . / . ,/ !! """ ! """ . / % 0 $ 1 %2) ' 3* % ! ! 2) ) 4 ( 1 5657898:56;69<==>?@ABCDEFGH IJKD;888L;8ADFDBAMN?OPAQ8>RS8TBTDA8IJHUAD8<==>?@ABCDEFGHV8V Fig. 2: Overview of WCog-VLA. Our framework achieves dual-level world cognition by tightly coupling a multi-modal VLM backbone with a generative world model ADDT. The VLM integrates vision, text, and agent tokens to perform Game-CoT reasoning and semantic world forecasting, while the ADDT translates these cognitive representations to generate physically-plausible, joint multi-agent trajectories. structured conditioning mechanism, ADDT generates high-fidelity, joint multi- agent trajectories. Collectively, the proposed framework consistently translates explicit semantic world cognition into coherent and dynamically plausible tra- jectory generation. Detailed model architectures are provided in this section. 3.1 VLM Backbone Model Inputs and Base VLM Model. The VLM takes multi-view cam- era images, instructions, and ego-vehicle states as inputs. The visual input I = I i 6 i=1 comprises six surround-view images. The instruction l ins provides navigation commands (e.g., ‘turn right’). The ego state S = v,a,T hist en- capsulates the current velocity v, acceleration a, and a 2-second historical tra- jectory T hist sampled at 2 Hz. To process these multi-modal inputs, we adopt InternVL3-2B [65] as our VLM backbone, utilizing a 300M-parameter InternViT vision encoder and a Qwen2.5 Large Language Model (LLM). 3D Spatial Perception. We extend 2D VLM perception into the 3D domain to enable explicit 3D spatial perception. Specifically, the multi-view camera features extracted by the vision encoder are lifted into a BEV representationF BEV via an off-the-shelf BEV encoder from BEVFormer [34]. To extract structured object representations, we employ a TrackFormer [20] that maps dense BEV features 6X. Yan et al. ! "# $%$ & $ ' ( ) *$! + , -.$/%# !$ ,%0 $,1 2!+$!"!+ , 3 ! ,%$! + , 2!+$! 4 %$., 4.& + (& *$! 56- 7 ', & !$%$! *#!8 !$ 9, $,%! + "!+ , $ ' ( : 4.& + (& *$! 56- 2!+$! 4 %$., ;<;=>?>;;@A?BCDDEFGHI JKLMA>>>DA>NMGMONPQRSTNU>VWC>XOXMN>JKIYNM>CDDEFGHI@>@ Fig. 3: Illustration of the ADDT. The ADDT features a decoupled architecture com- prising a condition encoder with representation alignment and a generation decoder. to sparse agent-centric tokens. By performing cross-attention between learnable agent queries Q agent and F BEV , the module extracts a set of N a agent tokens T agent = t j agent N a j=1 , where N a denotes the number of detected agents. These explicit agent tokens capture spatial locations and geometric features, providing structured inputs for subsequent multi-modal reasoning. Unified World Cognition and Reasoning. To achieve comprehensive scene understanding, the vision (T vision ), text (T text ), and agent tokens (T agent ) are concatenated along the sequence dimension and fed into the LLM to model multi-modal interaction and fusion. The resulting hidden states are defined as: O vision ,O text ,O agent = LLM([T vision ,T text ,T agent ])(1) We decouple these output tokens of hidden states to support two distinct downstream tasks. Specifically, O agent encapsulates semantic-level world cogni- tion, which is routed to a specialized world head for current 3D perception and future trajectory prediction of surrounding agents. Meanwhile, O vision and O text are processed by the language modeling head to generate textual responses. Trained via our Game-CoT reasoning paradigm, the model can output explicit game-theoretic reasoning processes in its textual responses. 3.2 Aligned Decoupled Diffusion Transformer While diffusion transformers exhibit remarkable generation quality, they suffer from an optimization dilemma in single-network architectures [41]: the encoding of low-frequency abstract semantics conflicts with the decoding of high-frequency continuous details [48]. In autonomous driving, this manifests as a tension be- tween modeling complex multi-agent interactions and generating precise trajec- tories. To resolve this challenge and bridge VLM semantic cognition with physi- cal actions, we propose ADDT (Fig. 3), which features a decoupled architecture comprising a specialized condition encoder and a dedicated generation decoder. Condition Encoder. The condition encoder focuses on extracting structural and interactive semantics, decoupled from the burden of precise trajectory re- covery. Let x t ∈ R N m ×H×3 denote the joint multi-agent action noises at diffusion timestep t, where N m is the maximum number of agents and H is the planning WCog-VLA7 horizon. To inject temporal and cognitive context, we construct a fused noises representation F at by concatenating embedded noise actions, historical ego ac- tions τ his , and average-pooled VLM output tokens ̄ F VLM . As shown in Fig. 3, F at serves as the primary input for N 1 Diffusion Transformer (DiT) blocks. Within these blocks, the diffusion timestep t and ego states S are injected via AdaLN modulation to provide physical kinematics guidance. Concurrently, the full-sequence VLM output tokens F VLM = [O vision ,O text ,O agent ] are injected into cross-attention layers, providing high-level semantic cognition priors. Finally, the encoder outputs a semantic self-condition feature z t , formulated as: z t = Encoder(F at ,t,S,F VLM ), F at = concat(E act (x t ),E his (τ his ), ̄ F VLM )(2) The resulting feature z t captures semantic scene dynamics, which guides the subsequent trajectory generation process. Representation Alignment. To ensure z t adheres strictly to real-world dy- namics, we introduce a representation alignment mechanism. Specifically, the intermediate feature h i from the i-th DiT block of the condition encoder is aligned with a latent scene representation r ∗ extracted from a pre-trained VAE encoder, thereby reducing the ‘semantic’ gap between condition encoder output and latent scene space. Following GenAD [61], this VAE is pre-trained to re- construct multi-agent trajectories via an MLP encoder and GRU decoder. The resulting latent space after VAE encoder captures both global traffic patterns and individual characteristics of each agent. We enforce this alignment using a cosine similarity constraint [57] with a learnable projection MLP h φ : L align = 1− cos(r ∗ ,h φ (h i ))(3) Crucially, this explicit alignment acts as a regularization technique, main- taining the local consistency of z t across adjacent denoising timesteps. It en- sures that the generated trajectories are grounded in feasible scene dynamics while stabilizes semantic features throughout the progressive denoising steps. Generation Decoder. The generation decoder, comprising N 2 DiT blocks, shares the condition encoder’s architecture but focuses exclusively on recover- ing high-frequency geometric details. Guided by the self-condition feature in z t , it processes the fused action noises F at and VLM output tokens F VLM to es- timate the denoised multi-agent trajectories. Unlike the condition encoder, the generation decoder injects both the timestep t and the self-condition feature z t via AdaLN modulation, enabling semantically aligned denoising. The decoding process is formulated as: x t−1 = Decoder(F at ,t,z t ,F VLM )(4) 3.3 Game-CoT Reasoning Annotation Existing reasoning datasets often lack social interaction logic and game-theoretic analysis. To bridge this gap, we propose an automated annotation pipeline pow- ered by advanced Qwen3-VL-Plus to generate structured reasoning across four 8X. Yan et al. ! "# $# # % & ! $' # & ($ )( #$ * + ! * + ,) # !,' ! ' & # , - . / , % $ 0102343501602789:;<=79>?@=A> B:C?6333D638?=?98EF<GH8I3JKL3M9M?83B:>N8?3789:;<=79>?@=A>O3O Fig. 4: Illustration of four-stage training paradigm of WCog-VLA, including three- stage supervised fine-tuning and one-stage reinforcement fine-tuning. sequential steps: (1) scene description, (2) critical object analysis, (3) game- theoretic reasoning, and (4) payoff evaluation. The final output includes the op- timal ego action and the inferred responses of surrounding agents. Specifically, the game-theoretic reasoning step formulates traffic interactions as a Stackelberg game [17], where the ego vehicle acts as the leader and surrounding agents serve as followers. Adopting a ‘if-what’ imagination, the model enumerates candidate ego actions and infers the corresponding reactions of followers. The payoff evalu- ation step then assesses the safety and efficiency of these hypothetical outcomes to determine the optimal strategy. To minimize hallucinatory outputs and ensure logical consistency, we incor- porate Ground-Truth (GT) actions as guiding hints. This compels the VLM to reconstruct explicit causal chains linking observed scene contexts to final GT ac- tions. Ultimately, we construct a Game-CoT dataset comprising 85k high-quality annotations on the NAVSIM benchmark. More detailed Game-CoT annotation process is illustrated in the Supplemental Material. 3.4 WCog-VLA Training Fig. 4 shows our four-stage training paradigm, including Supervised Fine-Tuning (SFT) in Stages 1–3 and Reinforcement Fine-Tuning (RFT) in Stage 4. 3D Perception Pre-Training. This stage optimizes the BEV encoder and TrackFormer. Following the perception training method in UniAD [20], we utilize a detection head for class labeling and 3D box regression. The overall detection loss combines a focal loss for classification and an L 1 loss for 3D box localization: L s1 = λ focal L focal + λ L1 L L1 with weighting coefficients λ focal and λ L1 . WCog-VLA9 VLM Supervised Fine-Tuning. This stage optimizes the VLM for both Vi- sual Question Answering (VQA) capability and world cognition. The language modeling is trained on a mixture of public driving VQA datasets (e.g., Driv- eLM), trajectory-specific VQA, and our Game-CoT dataset. The learned se- mantic world cognition are routed through a world head into current perception and future prediction of surrounding agents, which are supervised by ground- truth 3D bounding boxes, and future trajectories. The overall training objective combines the text generation loss L LM and the world cognition loss L world : L s2 =L LM + λ world L world (5) L world = 1 N a N a X i=1 λ box L L1 (b i ) + 1 N a H N a X i=1 H X t=1 λ traj L L1 (τ i,t ) (6) whereL LM is the standard cross-entropy loss for language modeling,L L1 (b i ) and L L1 (τ i,t ) denote the L 1 losses for 3D box localization and trajectory prediction of agent i at timestep t. The λ terms denote the corresponding weights. ADDT Supervised Fine-Tuning. In Stage 3, we freeze the pre-trained VLM to serve as a semantic-level world model and train the ADDT for joint multi- agent trajectory generation. The training objective combines the standard L 2 denoising loss L diff and the representation alignment loss L align : L s3 =L diff + λ align L align (7) L diff = E z t ,F at ,ε∼N(0,I) ∥W⊙ ε− ε θ (F at ,t,z t ,F VLM ) ∥ 2 2 (8) where L diff optimizes the generation decoder ε θ to predict the added noise ε, and ⊙ is the Hadamard product.W is an agent-specific weight mask applying distinct penalties (α ego and α surr ) to prioritize the generative accuracy of the ego vehicle over surrounding agents and λ align is the weighting coefficient. Reinforcement Fine-Tuning. To enable driving exploration beyond imitation [21], we adopt DiffGRPO [14, 32], a diffusion-specific GRPO algorithm. The DiffGRPO loss includes an RL policy optimization loss and a Behavior Cloning (BC) loss to prevent policy collapse during exploration: L s4 =− 1 GT G X i=1 T X t=1 γ t−1 logπ θ (x (i) t−1 | x (i) t ) ˆ A i | z L RL −λ bc 1 GT G X i=1 T X t=1 logπ θ ( ̃x (i) t−1 | ̃x (i) t ) | z L BC (9) where G and T denote the sampled group size and total denoising steps, respec- tively. γ is the discount coefficient mitigating instability in early denoising steps, π θ (x (i) t−1 | x (i) t ) is each step’s conditional probability. ˆ A i is the group-relative ad- vantage, λ bc is the weight of the BC loss. ̃x (i) t−1 and ̃x (i) t are sampled from the reference policy π ref (e.g., the model after SFT). 10X. Yan et al. We design a joint reward function decoupling the ego vehicle and surrounding agents. Ego driving quality is evaluated via the NAVSIM Predictive Driving Model Score (PDMS), whereas surrounding agents are optimized for accurate motion forecasting via a negative L 1 displacement penalty. The overall reward is formulated as r i = r PDMS − λ surr L L1 (τ surr ) where λ surr balances ego planning performance with consistent surrounding agents’ trajectory prediction. 4 Experiments 4.1 Experimental setup Dataset. We evaluate WCog-VLA on the large-scale, real-world simulation benchmarks NAVSIMv1 and NAVSIMv2 [10]. NAVSIM is a planning-oriented dataset comprising challenging scenarios. The data is partitioned into 1,192 training (navtrain) and 136 test (navtest) scenes. To establish the foundational driving cognition of the VLM, we compile a comprehensive training mixture comprising over 158k samples from open-source driving VQA datasets, including DriveLM [47], CODA-LM [3], LingoQA [40], nuScenes-QA [43], NuInstruct [11], and DriveGPT4 [55]. This corpus is further augmented with 170K NAVSIM- tailored samples, including 85k trajectory-specific VQA and 85k Game-CoT rea- soning samples. Implementation Details. Our training pipeline consists of four sequential stages. First, the 3D perception module is trained on NAVSIM for 1 epoch. Second, the VLM is pre-trained for 1 epoch on the 158k VQA samples, followed by 3 epochs of joint fine-tuning with the world heads using the 170K NAVSIM- tailored samples. Third, with the VLM frozen, ADDT is trained via DDPM [18] for 200 epochs on NAVSIM. The ADDT features a symmetric 16-block DiT architecture (8 blocks each for the condition encoder and generation decoder). Representation alignment is extracted from the 6th DiT encoder block. Finally, ADDT is refined via GRPO on NAVSIM for 10 epochs using 6 group sizes. All training stages are conducted on 4 NVIDIA A100 40GB GPUs. Additional implementation details are provided in the Supplemental Material. 4.2 Main Results Results on NAVSIM v1. Tab. 1 presents the closed-loop evaluation of our WCog-VLA on the NAVSIM v1. Our method achieves a SOTA PDMS of 92.9, outperforming all listed standard end-to-end and VLM-based methods. No- tably, despite using only camera inputs, WCog-VLA surpasses multi-modal base- lines that leverage both camera and lidar inputs, yielding an improvement of 4.6 PDMS over WoTE. Furthermore, WCog-VLA demonstrates clear advan- tages over VLM-based methods. It outperforms two massive generalist models, QwenVL2.5 and InternVL3, by 9.6 PDMS, validating the effectiveness of our tailored architecture and driving knowledge injection. Crucially, our compact WCog-VLA11 Table 1: Performance comparison on NAVSIM v1 navtest. Our WCog-VLA is evalu- ated after the complete four-stage training. Metrics include NC (no at-fault collision), DAC (drivable area compliance), TTC (time-to-collision), Comf. (comfort), EP (ego progress), and PDMS (predictive driver model score).† indicates models fine-tuned on the NAVSIM trajectory-specific dataset. MethodImage LidarNC↑ DAC↑TTC↑ Comf. ↑ EP↑PDMS↑ Constant Velocity68.0 57.850.0 100 19.420.6 Ego Status MLP 93.0 77.383.6 100 62.865.6 VADv2-V 8192 [5]✓97.2 89.191.6 100 76.080.9 DrivingGPT [6]✓98.9 90.794.995.6 79.782.4 UniAD [20]✓97.8 91.992.9 100 78.883.4 BevDrive [58]✓97.7 92.592.9 100 78.783.8 TransFuser [8]✓97.7 92.892.8 100 79.284.0 PARA-Drive [50] ✓97.9 92.493.099.8 79.384.0 DRAMA [59]✓98.0 93.194.8 100 80.185.5 Hydra-MDP-V 8192 -W-EP [33]✓98.3 96.094.6 100 78.786.5 DiffusionDrive [35] ✓98.2 96.294.7 100 82.288.1 WoTE [31]✓98.5 96.894.999.9 81.988.3 iPad [15]✓98.6 98.394.9 100 88.091.7 VLMs-based Methods QwenVL2.5-8B [2] † ✓97.8 92.192.8 100 78.383.3 InternVL3-8B [65] † ✓97.0 92.491.8 100 78.983.3 ReCogDrive-2B [32]✓97.9 97.394.9 100 87.390.8 AutoVLA-3B [64] ✓99.1 97.197.1 100 87.692.1 LatentVLA-3B [52] ✓98.9 98.295.2 100 88.292.4 WCog-VLA-2B(ours)✓99.4 98.898.5 100 87.192.9 2B model surpasses the RL-refined VLM-based methods, ReCogDrive and Au- toVLA, by at least 0.8 PDMS and outperforms the 3B-parameter LatentVLA by 0.5 PDMS. These results underscore that enhancing VLA with world cognition and world-dynamics forecasting enables superior planning performance. Beyond overall planning performance, WCog-VLA excels in safety metrics, achieving a remarkable 99.4 in NC and 98.5 in TTC. This is because our model anticipates the future intents of surrounding agents, enabling proactive safety measures and collision avoidance in complex scenarios. Results on NAVSIM v2. Tab. 2 presents the evaluation on the NAVSIM v2 benchmark, with WCog-VLA deployed after three-stage SFT process. Our WCog-VLA achieves a SOTA Extended PDMS (EPDMS) of 85.9, outperforming DiffusionDrive by 1.6 EPDMS. Besides, WCog-VLA attains the highest safety scores in both NC and TTC, while maintaining highly competitive performance across all other metrics. These findings further confirm the effectiveness and robust generalization capability of WCog-VLA in extended driving evaluations. 4.3 Ablation Study Effect of the Four-Stage Training. Tab. 3 ablates our four-stage training paradigm. Using only Stage 2 yields a baseline PDMS of 84.4, whereas incor- porating 3D perception pre-training improves 1.1 PDMS, reflecting enhanced 12X. Yan et al. Table 2: Performance comparison on NAVSIM v2 navtest with extended metrics. Our WCog-VLA is evaluated after three-stage SFT. Newly introduced metrics include DDC (driving direction compliance), TLC (traffic light compliance), LK (lane keeping), HC (history comfort), EC (extended comfort), and EPDMS (extended PDMS). MethodNC ↑ DAC ↑ DDC ↑ TLC ↑EP ↑ TTC ↑ LK ↑ HC ↑ EC ↑EPDMS ↑ VADv2 [5]97.3 91.7 98.2 99.977.6 92.7 66.0 100 97.476.6 TransFuser [8]97.7 92.8 98.3 99.979.2 92.8 67.6 100 95.377.8 HydraMDP++ [33] 97.9 96.5 98.9 10079.2 93.4 67.2 100 97.780.6 ARTEMIS [12]98.3 95.1 98.6 99.881.5 97.4 96.5 100 98.383.1 ReCogDrive-8B [32]98.3 95.2 99.5 99.887.1 97.5 96.6 98.3 86.583.6 WoTE [31]98.5 96.8 98.8 99.886.1 97.9 95.5 98.3 82.984.2 DiffusionDrive [35] 98.0 96.0 99.5 99.887.7 97.1 97.2 98.3 87.684.3 WCog-VLA-2B(ours)98.8 96.6 99.3 99.885.8 98.2 96.4 98.3 86.385.9 Table 3: Ablation on the four-stage training process. Trajectories are gen- erated as textual tokens via the VLM in IDs 1 and 2, and as continuous ac- tions through ADDT in IDs 3 and 4. IDStage 1 Stage 2 Stage 3 Stage 4PDMS ↑ 1✓84.4 2✓85.5 3 ✓89.3 4 ✓92.9 Table 4: Ablation on dual-level world cogni- tion. Cur and Fut denote current perception and future prediction supervision. Generative enables joint multi-agent trajectory synthesis; otherwise, only ego-trajectory generated. ID Semantic GenerativePDMS ↑ CurFut 186.5 2 ✓87.0 3✓87.2 4✓88.1 5✓87.4 6 ✓89.3 spatial understanding. Introducing ADDT in Stage 3 fundamentally shifts the paradigm from discrete textual output to continuous trajectory generation, re- sulting in a 3.8 PDMS improvement. Finally, Stage 4 RFT further optimizes the driving policy, improving 3.6 PDMS and achieving the SOTA 92.9. These consistent gains confirm that every training stage is indispensable. Effect of Dual-Level World Cognition. Tab. 4 evaluates the effect of dual- level world cognition, where all variants are trained with the three-stage SFT. The baseline without either cognitive level achieves 86.5 PDMS. Integrating semantic current perception or future prediction improves the score to 87.0 and 87.2, respectively, while combining both yields 88.1. Enabling only generative- level multi-agent synthesis without semantic cognition achieves 87.4. Ultimately, unifying both semantic with generative cognition triggers a synergistic leap to 89.3 PDMS. These findings demonstrate that coupling semantic forecasting with generative evolution is essential for robust planning. Effect of ADDT. Tab. 5 evaluates our ADDT design in terms of PDMS and inference time. We compare pure VLM text generation, including direct answer (VLM wo/r ) and Game-CoT reasoning (VLM w/r ), against a Standard Diffusion Transformer (SDT) [41] and several ADDT variants: without alignment (DDT), without the decoupled architecture (ADT), and the full ADDT. All diffusion WCog-VLA13 Table 5: Effect of ADDT. wo/r means VLM text output without reasoning, w/r is with reasoning. MethodDenoise stepPDMS ↑Infer Time (s) ↓ VLM wo/r 85.01.131 VLM w/r 85.59.896 VLM+SDT [41] 587.40.105 2088.50.388 VLM+DDT 587.90.108 2088.70.381 VLM+ADT 588.60.103 2089.10.392 VLM+ADDT 589.30.106 2089.60.383 Table 6: Effect of VQA dataset. IDTraj Drive CoTPDMS ↑ 1✓86.7 2✓88.2 3✓87.5 4✓89.3 Table 7: 3D perception effect. 3D perceptionPDMS ↑ ×86.0 ✓89.3 models utilize an identical DiT backbone and are trained with three-stage SFT. Results show that ADDT with 5 denoising steps achieves a 10.7× speedup over direct VLM text generation. Crucially, ADDT attains superior performance with fewer denoising steps. Compared to the 20-step SDT, our 5-step ADDT improves PDMS by 0.8 while accelerating inference by 3.7×. Besides, ADDT exhibits low sensitivity to the number of denoising steps: increasing the steps from 5 to 20 yields a marginal 0.3 PDMS gain. This robustness stems from the explicit alignment mechanism, which maintains consistent encoder latent features across different denoising steps and reduces the need for costly iterative refinement. Effect of VQA Dataset. Tab. 6 shows that training solely on NAVSIM trajectory-specific VQA yields a baseline PDMS of 86.7. Adding open-source driving VQA (Drive) or Game-CoT reasoning data (CoT) improves PDMS to 88.2 and 87.5. Combining all three data sources achieves the highest PDMS of 89.3, confirming that incorporating diverse VQA data can improve performance. Effect of 3D Perception. Tab. 7 validates the contribution of the 3D per- ception module. Without explicit 3D perception, ADDT relies solely on generic VLM vision tokens, which limits spatial precision and yields a PDMS of 86.0. Incorporating the dedicated 3D perception boosts performance to 89.3. More ablation study results (e.g., effect of alignment layer position) are shown in the Supplemental Material. 4.4 Qualitative Results Compare with Previous SOTA Method. Fig. 5 compares WCog-VLA with ReCogDrive [32] in complex urban scenarios. ReCogDrive acts overly conserva- tively, remaining trapped in the current slow lane. Conversely, WCog-VLA iden- tifies the slow leading bus in the current lane and changes the lane to improve efficiency, closely matching the human ground truth. This visualization demon- strates our WCog-VLA enables efficient and human-aligned driving behaviors. Proactive Driving via Generative-Level World Cognition. Fig. 6 high- lights the advantages of generative world cognition. In the intersection scenario, 14X. Yan et al. Ground truthEgo planning trajectory Front concat viewReCogDriveWCog-VLA 忽略了对旁边大卡车体型的 感知，导致想插进去 Compare with previous method Fig. 5: Comparison with previous SOTA method on Navtest. Ground truthEgo planning trajectorySurrounding predicted trajectory Front concat viewWithout generative world cognition With generative world cognition Fig. 6: Visualization of proactive driving via generative-level world cognition. PredictionGround truth Ground truth boxesPredicted boxesFuture prediction Fig. 7: Visualization of our semantic-level world cognition. the baseline lacks interactive foresight of the oncoming vehicle and generates an ego-only trajectory, resulting in passive deceleration to blindly avoid spu- rious conflicts. Conversely, our model synthesizes joint multi-agent trajectories that explicitly forecast the oncoming vehicle’s straight trajectory. This foresight enables ego vehicle to confidently execute a left turn. The results confirm that generative world cognition empowers the model to perform proactive maneuvers. Explicit Semantic-Level World Cognition Representation. Fig. 7 shows the semantic world cognition decoded via the world head. Both 3D perception and future trajectory prediction align closely with the ground truth, demonstrat- ing the model’s cognition of current world states and future world dynamics. More qualitative results are shown in the Supplemental Material. 5 Conclusion In this work, we propose WCog-VLA, a novel VLA framework with explicit dual-level World Cognition for end-to-end autonomous driving. To bridge the WCog-VLA15 gap between semantic-level forecasting and generative-level evolution, WCog- VLA tightly couples a multi-modal VLM backbone with a generative Aligned Decoupled Diffusion Transformer (ADDT). At the semantic level, our model unifies the world cognition and reasoning, enabling comprehensive world un- derstanding and interactive game-theoretic reasoning. At the generative level, ADDT acts as a generative world model, translates the VLM’s cognitive rep- resentations into physically-plausible joint multi-agent trajectories. Extensive experiments on the NAVSIM v1 and v2 benchmarks demonstrate SOTA perfor- mance of WCog-VLA. However, the current semantic cognition focuses on agents and omits the future evolution of road geometry and map topology. Future work will incorporate these dynamics to build a more comprehensive world model. 16X. Yan et al. References 1. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al.: Gpt-4 technical report. arXiv preprint arXiv:2303.08774 (2023) 2. Bai, S., Cai, Y., Chen, R., Chen, K., Chen, X., Cheng, Z., Deng, L., Ding, W., Gao, C., Ge, C., et al.: Qwen3-vl technical report. arXiv preprint arXiv:2511.21631 (2025) 3. Chen, K., Li, Y., Zhang, W., Liu, Y., Li, P., Gao, R., Hong, L., Tian, M., Zhao, X., Li, Z., et al.: Automated evaluation of large vision-language models on self-driving corner cases. In: 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). p. 7817–7826. IEEE (2025) 4. Chen, L., Wu, P., Chitta, K., Jaeger, B., Geiger, A., Li, H.: End-to-end autonomous driving: Challenges and frontiers. IEEE Transactions on Pattern Analysis and Ma- chine Intelligence 46(12), 10164–10183 (2024) 5. Chen, S., Jiang, B., Gao, H., Liao, B., Xu, Q., Zhang, Q., Huang, C., Liu, W., Wang, X.: Vadv2: End-to-end vectorized autonomous driving via probabilistic planning. arXiv preprint arXiv:2402.13243 (2024) 6. Chen, Y., Wang, Y., Zhang, Z.: Drivinggpt: Unifying driving world modeling and planning with multi-modal autoregressive transformers. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. p. 26890–26900 (2025) 7. Chi, H., Gao, H.a., Liu, Z., Liu, J., Liu, C., Li, J., Yang, K., Yu, Y., Wang, Z., Li, W., et al.: Impromptu vla: Open weights and open data for driving vision- language-action models. arXiv preprint arXiv:2505.23757 (2025) 8. Chitta, K., Prakash, A., Jaeger, B., Yu, Z., Renz, K., Geiger, A.: Transfuser: Imi- tation with transformer-based sensor fusion for autonomous driving. IEEE trans- actions on pattern analysis and machine intelligence 45(11), 12878–12895 (2022) 9. Dang, C., Wang, J., Li, G., Hou, Z., You, Z., Ye, H., Ma, J., Chen, L., Wang, Y.: Sparseoccvla: Bridging occupancy and vision-language models via sparse queries for unified 4d scene understanding and planning. arXiv preprint arXiv:2601.06474 (2026) 10. Dauner, D., Hallgarten, M., Li, T., Weng, X., Huang, Z., Yang, Z., Li, H., Gilitschenski, I., Ivanovic, B., Pavone, M., et al.: Navsim: Data-driven non-reactive autonomous vehicle simulation and benchmarking. Advances in Neural Information Processing Systems 37, 28706–28719 (2024) 11. Ding, X., Han, J., Xu, H., Liang, X., Zhang, W., Li, X.: Holistic autonomous driving understanding by bird’s-eye-view injected multi-modal large models. In: Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. p. 13668–13677 (2024) 12. Feng, R., Xi, N., Chu, D., Wang, R., Deng, Z., Wang, A., Lu, L., Wang, J., Huang, Y.: Artemis: Autoregressive end-to-end trajectory planning with mixture of experts for autonomous driving. IEEE Robotics and Automation Letters 11(1), 226–233 (2025) 13. Fu, H., Zhang, D., Zhao, Z., Cui, J., Liang, D., Zhang, C., Zhang, D., Xie, H., Wang, B., Bai, X.: Orion: A holistic end-to-end autonomous driving framework by vision-language instructed action generation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. p. 24823–24834 (2025) 14. Guo, D., Yang, D., Zhang, H., Song, J., Wang, P., Zhu, Q., Xu, R., Zhang, R., Ma, S., Bi, X., et al.: Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948 (2025) WCog-VLA17 15. Guo, K., Liu, H., Wu, X., Pan, J., Lv, C.: ipad: Iterative proposal-centric end-to- end autonomous driving. arXiv preprint arXiv:2505.15111 (2025) 16. Han, J., Tian, M., Zhu, J., He, F., Zhang, H., Guo, S., Zhu, D., Tang, H., Xu, P., Guo, Y., et al.: Percept-wam: Perception-enhanced world-awareness-action model for robust end-to-end autonomous driving. arXiv preprint arXiv:2511.19221 (2025) 17. Hang, P., Lv, C., Xing, Y., Huang, C., Hu, Z.: Human-like decision making for au- tonomous driving: A noncooperative game theoretic approach. IEEE Transactions on Intelligent Transportation Systems 22(4), 2076–2087 (2020) 18. Ho, J., Jain, A., Abbeel, P.: Denoising diffusion probabilistic models. Advances in neural information processing systems 33, 6840–6851 (2020) 19. Hu, S., Chen, L., Wu, P., Li, H., Yan, J., Tao, D.: St-p3: End-to-end vision-based autonomous driving via spatial-temporal feature learning. In: European Conference on Computer Vision. p. 533–549. Springer (2022) 20. Hu, Y., Yang, J., Chen, L., Li, K., Sima, C., Zhu, X., Chai, S., Du, S., Lin, T., Wang, W., et al.: Planning-oriented autonomous driving. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. p. 17853– 17862 (2023) 21. Huang, Z., Sheng, Z., Qu, Y., You, J., Chen, S.: Vlm-rl: A unified vision language models and reinforcement learning framework for safe autonomous driving. Trans- portation Research Part C: Emerging Technologies 180, 105321 (2025) 22. Hwang, J.J., Xu, R., Lin, H., Hung, W.C., Ji, J., Choi, K., Huang, D., He, T., Cov- ington, P., Sapp, B., et al.: Emma: End-to-end multimodal model for autonomous driving. arXiv preprint arXiv:2410.23262 (2024) 23. Jiang, A., Gao, Y., Sun, Z., Wang, Y., Wang, J., Chai, J., Cao, Q., Heng, Y., Jiang, H., Dong, Y., et al.: Diffvla: Vision-language guided diffusion planning for autonomous driving. arXiv preprint arXiv:2505.19381 (2025) 24. Jiang, A., Gao, Y., Wang, Y., Sun, Z., Wang, S., Heng, Y., Sun, H., Tang, S., Zhu, L., Chai, J., et al.: Irl-vla: Training an vision-language-action policy via reward world model. arXiv preprint arXiv:2508.06571 (2025) 25. Jiang, B., Chen, S., Liao, B., Zhang, X., Yin, W., Zhang, Q., Huang, C., Liu, W., Wang, X.: Senna: Bridging large vision-language models and end-to-end au- tonomous driving. arXiv preprint arXiv:2410.22313 (2024) 26. Jiang, B., Chen, S., Xu, Q., Liao, B., Chen, J., Zhou, H., Zhang, Q., Liu, W., Huang, C., Wang, X.: Vad: Vectorized scene representation for efficient autonomous driving. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. p. 8340–8350 (2023) 27. Jiang, S., Huang, Z., Qian, K., Luo, Z., Zhu, T., Zhong, Y., Tang, Y., Kong, M., Wang, Y., Jiao, S., et al.: A survey on vision-language-action models for au- tonomous driving. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. p. 4524–4536 (2025) 28. Li, J., Wu, J., Hu, D., Huang, X., Sun, B., Hao, Z., Lang, X., Zhu, X., Zhang, L.: Sgdrive: Scene-to-goal hierarchical world cognition for autonomous driving. arXiv preprint arXiv:2601.05640 (2026) 29. Li, P., Zheng, Y., Wang, Y., Wang, H., Zhao, H., Liu, J., Zhan, X., Zhan, K., Lang, X.: Discrete diffusion for reflective vision-language-action models in autonomous driving. arXiv preprint arXiv:2509.20109 (2025) 30. Li, Y., Shang, S., Liu, W., Zhan, B., Wang, H., Wang, Y., Chen, Y., Wang, X., An, Y., Tang, C., et al.: Drivevla-w0: World models amplify data scaling law in autonomous driving. arXiv preprint arXiv:2510.12796 (2025) 18X. Yan et al. 31. Li, Y., Wang, Y., Liu, Y., He, J., Fan, L., Zhang, Z.: End-to-end driving with online trajectory evaluation via bev world model. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. p. 27137–27146 (2025) 32. Li, Y., Xiong, K., Guo, X., Li, F., Yan, S., Xu, G., Zhou, L., Chen, L., Sun, H., Wang, B., et al.: Recogdrive: A reinforced cognitive framework for end-to-end autonomous driving. arXiv preprint arXiv:2506.08052 (2025) 33. Li, Z., Li, K., Wang, S., Lan, S., Yu, Z., Ji, Y., Li, Z., Zhu, Z., Kautz, J., Wu, Z., et al.: Hydra-mdp: End-to-end multimodal planning with multi-target hydra- distillation. arXiv preprint arXiv:2406.06978 (2024) 34. Li, Z., Wang, W., Li, H., Xie, E., Sima, C., Lu, T., Yu, Q., Dai, J.: Bevformer: learning bird’s-eye-view representation from lidar-camera via spatiotemporal trans- formers. IEEE Transactions on Pattern Analysis and Machine Intelligence 47(3), 2020–2036 (2024) 35. Liao, B., Chen, S., Yin, H., Jiang, B., Wang, C., Yan, S., Zhang, X., Li, X., Zhang, Y., Zhang, Q., et al.: Diffusiondrive: Truncated diffusion model for end-to-end au- tonomous driving. In: Proceedings of the Computer Vision and Pattern Recognition Conference. p. 12037–12047 (2025) 36. Liu, L., Song, Z., Jia, C., Ye, H., Hao, X., Chen, L., et al.: Driveworld-vla: Unified latent-space world modeling with vision-language-action for autonomous driving. arXiv preprint arXiv:2602.06521 (2026) 37. Liu, P., Ning, Q., Lu, X., Liu, H., Ma, W., She, D., Jia, P., Lang, X., Ma, J.: Omnireason: A temporal-guided vision-language-action framework for autonomous driving. arXiv preprint arXiv:2509.00789 (2025) 38. Liu, Z., Huang, R., Yang, R., Yan, S., Wang, Z., Hou, L., Lin, D., Bai, X., Zhao, H.: Drivepi: Spatial-aware 4d mllm for unified autonomous driving understanding, perception, prediction and planning. arXiv preprint arXiv:2512.12799 (2025) 39. Luo, Y., Li, F., Xu, S., Lai, Z., Yang, L., Chen, Q., Luo, Z., Xie, Z., Jiang, S., Liu, J., et al.: Adathinkdrive: Adaptive thinking via reinforcement learning for autonomous driving. arXiv preprint arXiv:2509.13769 (2025) 40. Marcu, A.M., Chen, L., Hünermann, J., Karnsund, A., Hanotte, B., Chidananda, P., Nair, S., Badrinarayanan, V., Kendall, A., Shotton, J., et al.: Lingoqa: Visual question answering for autonomous driving. In: European Conference on Computer Vision. p. 252–269. Springer (2024) 41. Peebles, W., Xie, S.: Scalable diffusion models with transformers. In: Proceedings of the IEEE/CVF international conference on computer vision. p. 4195–4205 (2023) 42. Qian, K., Jiang, S., Zhong, Y., Luo, Z., Huang, Z., Zhu, T., Jiang, K., Yang, M., Fu, Z., Miao, J., et al.: Agentthink: A unified framework for tool-augmented chain- of-thought reasoning in vision-language models for autonomous driving. arXiv preprint arXiv:2505.15298 1(2), 3 (2025) 43. Qian, T., Chen, J., Zhuo, L., Jiao, Y., Jiang, Y.G.: Nuscenes-qa: A multi-modal visual question answering benchmark for autonomous driving scenario. In: Pro- ceedings of the AAAI Conference on Artificial Intelligence. vol. 38, p. 4542–4550 (2024) 44. Renz, K., Chen, L., Arani, E., Sinavski, O.: Simlingo: Vision-only closed-loop au- tonomous driving with language-action alignment. In: Proceedings of the Computer Vision and Pattern Recognition Conference. p. 11993–12003 (2025) 45. Sun, W., Lin, X., Shi, Y., Zhang, C., Wu, H., Zheng, S.: Sparsedrive: End-to-end autonomous driving via sparse scene representation. In: 2025 IEEE International Conference on Robotics and Automation (ICRA). p. 8795–8801. IEEE (2025) WCog-VLA19 46. Team, R., Gao, Z., Wang, Q., Zeng, Y., Zhu, J., Cheng, K.L., Li, Y., Wang, H., Xu, Y., Ma, S., et al.: Advancing open-source world models. arXiv preprint arXiv:2601.20540 (2026) 47. Tian, X., Gu, J., Li, B., Liu, Y., Wang, Y., Zhao, Z., Zhan, K., Jia, P., Lang, X., Zhao, H.: Drivevlm: The convergence of autonomous driving and large vision- language models. arXiv preprint arXiv:2402.12289 (2024) 48. Wang, S., Tian, Z., Huang, W., Wang, L.: Ddt: Decoupled diffusion transformer. arXiv preprint arXiv:2504.05741 (2025) 49. Wang, Y., Luo, W., Bai, J., Cao, Y., Che, T., Chen, K., Chen, Y., Diamond, J., Ding, Y., Ding, W., et al.: Alpamayo-r1: Bridging reasoning and action pre- diction for generalizable autonomous driving in the long tail. arXiv preprint arXiv:2511.00088 (2025) 50. Weng, X., Ivanovic, B., Wang, Y., Wang, Y., Pavone, M.: Para-drive: Parallelized architecture for real-time autonomous driving. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. p. 15449–15458 (2024) 51. Xiao, J., Yang, Y., Chang, X., Chen, R., Xiong, F., Xu, M., Zheng, W.S., Zhang, Q.: World-env: Leveraging world model as a virtual environment for vla post-training. arXiv preprint arXiv:2509.24948 (2025) 52. Xie, C., Sun, B., Li, T., Wu, J., Hao, Z., Lang, X., Li, H.: Latentvla: Efficient vision-language models for autonomous driving via latent action prediction. arXiv preprint arXiv:2601.05611 (2026) 53. Xing, S., Qian, C., Wang, Y., Hua, H., Tian, K., Zhou, Y., Tu, Z.: Openemma: Open-source multimodal model for end-to-end autonomous driving. In: Proceed- ings of the Winter Conference on Applications of Computer Vision. p. 1001–1009 (2025) 54. Xiong, Z., Ye, X., Yaman, B., Cheng, S., Lu, Y., Luo, J., Jacobs, N., Ren, L.: Unidrive-wm: Unified understanding, planning and generation world model for autonomous driving. arXiv preprint arXiv:2601.04453 (2026) 55. Xu, Z., Zhang, Y., Xie, E., Zhao, Z., Guo, Y., Wong, K.Y.K., Li, Z., Zhao, H.: Drivegpt4: Interpretable end-to-end autonomous driving via large language model. IEEE Robotics and Automation Letters 9(10), 8186–8193 (2024) 56. Yang, Z., Chai, Y., Jia, X., Li, Q., Shao, Y., Zhu, X., Su, H., Yan, J.: Drivemoe: Mixture-of-experts for vision-language-action model in end-to-end autonomous driving. arXiv preprint arXiv:2505.16278 (2025) 57. Yu, S., Kwak, S., Jang, H., Jeong, J., Huang, J., Shin, J., Xie, S.: Representation alignment for generation: Training diffusion transformers is easier than you think. arXiv preprint arXiv:2410.06940 (2024) 58. Yu, Z., Li, J., Wei, Y., Lyu, Y., Tan, X.: Combining camera–lidar fusion and motion planning using bird’s-eye view representation for end-to-end autonomous driving. Drones 9(4), 281 (2025) 59. Yuan, C., Zhang, Z., Sun, J., Sun, S., Huang, Z., Lee, C.D.W., Li, D., Han, Y., Wong, A., Tee, K.P., et al.: Drama: An efficient end-to-end motion planner for autonomous driving with mamba. arXiv preprint arXiv:2408.03601 (2024) 60. Zhang, D., Sun, J., Hu, C., Wu, X., Yuan, Z., Zhou, R., Shen, F., Zhou, Q.: Pure vision language action (vla) models: A comprehensive survey. arXiv preprint arXiv:2509.19012 (2025) 61. Zheng, W., Song, R., Guo, X., Zhang, C., Chen, L.: Genad: Generative end-to-end autonomous driving. In: European Conference on Computer Vision. p. 87–104. Springer (2024) 20X. Yan et al. 62. Zheng, Y., Liang, R., Zheng, K., Zheng, J., Mao, L., Li, J., Gu, W., Ai, R., Li, S.E., Zhan, X., et al.: Diffusion-based planning for autonomous driving with flexible guidance. arXiv preprint arXiv:2501.15564 (2025) 63. Zhou, X., Han, X., Yang, F., Ma, Y., Tresp, V., Knoll, A.: Opendrivevla: Towards end-to-end autonomous driving with large vision language action model. arXiv preprint arXiv:2503.23463 (2025) 64. Zhou, Z., Cai, T., Zhao, S.Z., Zhang, Y., Huang, Z., Zhou, B., Ma, J.: Autovla: A vision-language-action model for end-to-end autonomous driving with adaptive reasoning and reinforcement fine-tuning. arXiv preprint arXiv:2506.13757 (2025) 65. Zhu, J., Wang, W., Chen, Z., Liu, Z., Ye, S., Gu, L., Tian, H., Duan, Y., Su, W., Shao, J., et al.: Internvl3: Exploring advanced training and test-time recipes for open-source multimodal models. arXiv preprint arXiv:2504.10479 (2025)