Paper deep dive
General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems
Lei Zhang, Chun Ye, Le Yang, Zhaozhong Wang, Deng-Ping Fan, Hang Dai, Binglu Wang
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 94%
Last extracted: 9/22/2026, 5:40:46 AM
Summary
This paper presents a comprehensive review of General Collaborative Intelligence (GCI) for multi-agent unmanned systems, transitioning from isolated ego-centric sensing to networked intelligence. It introduces a five-dimensional taxonomy (collaboration stage, communication paradigm, fusion architecture, learning strategy, application domain) and three operational conditions for cognitive synergy: Semantic Disambiguation, Pragmatic Information Exchange, and Proactive Informational Foraging. The authors propose GCI-Bench, a scoring protocol to address benchmark saturation, and identify key challenges such as the sim-to-real gap, reproducibility, and communication constraints across domains like V2X, UAVs, and smart cities.
Entities (16)
Relation Signals (13)
Lei Zhang â authored â General Collaborative Intelligence
confidence 99% ¡ General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems Lei Zhang 1
Binglu Wang â affiliatedwith â Northwestern Polytechnical University
confidence 95% ¡ 1 School of Astronautics, Northwestern Polytechnical University, Xiâan, China. ... * Corresponding author: ... wbl921129@gmail.com
Hang Dai â affiliatedwith â Wuhan University
confidence 95% ¡ 2 School of Computer Science, Wuhan University, Wuhan, China. ... * Corresponding author: daihang@whu.edu.cn
General Collaborative Intelligence â appliesto â Industrial Logistics
confidence 95% ¡ We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities
General Collaborative Intelligence â appliesto â V2X
confidence 95% ¡ We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities
General Collaborative Intelligence â appliesto â Unmanned Aerial Systems
confidence 95% ¡ We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities
General Collaborative Intelligence â appliesto â Smart Cities
confidence 95% ¡ We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Multi-agent unmanned systems are moving from isolated, ego-centric sensing toward collaborative intelligence, in which distributed agents exchange compact features to overcome a local observation trap that no single agent can escape: occlusions, finite sensor range, and environmental degradation. The field has matured across architectural, communication, embodied, resilience, and trust dimensions, yet existing surveys examine these dimensions in isolation and rarely expose their dependencies. This review offers a unified synthesis through two complementary lenses. The first is a five-dimensional taxonomy spanning collaboration stage, communication paradigm, fusion architecture, learning strategy, and application domain. The second is three cognitive synergy conditions, Semantic Disambiguation, Pragmatic Information Exchange, and Proactive Informational Foraging, that turn cognitive synergy into operational criteria. Across these lenses we survey collaboration architectures and topologies, neural-communication co-design that treats the channel as a differentiable pipeline component, embodied action-perception loops via multi-agent reinforcement learning, and resilience mechanisms for synchronization, uncertainty quantification, and label-efficient learning. We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities, and onto the safety-privacy-utility triad. To counter benchmark saturation and evaluation fragmentation, we propose GCI-Bench, a five-pillar scoring protocol with a maturity model that makes the trade-offs of collaborative methods comparable across studies. A critical reflection on reproducibility, the sim-to-real gulf, and conditions under which collaboration degrades performance identifies open challenges and charts directions toward general collaborative intelligence under real-world uncertainty.
Tags
Links
- Source: https://arxiv.org/abs/2609.22967v1
- Canonical: https://arxiv.org/abs/2609.22967v1
Trouble viewing inline? Open PDF directly â
Full Text
215,107 characters extracted from source content.
Expand or collapse full text
General Collaborative Intelligence: Architecting Cognition for Resilient Multi-Agent Ecosystems Lei Zhang 1 , Chun Ye 2 , Le Yang 3 , Zhaozhong Wang 4 , Deng-Ping Fan 5 , Hang Dai 2* , and Binglu Wang 1* 1 School of Astronautics, Northwestern Polytechnical University, Xiâan, China. 2 School of Computer Science, Wuhan University, Wuhan, China. 3 School of Electronics and Control Engineering, Changâan University, Xiâan, China. 4 School of Automation, Northwestern Polytechnical University, Xiâan, China. 5 College of Computer Science, Nankai University, Tianjin, China. * Corresponding author: daihang@whu.edu.cn, wbl921129@gmail.com Abstract Multi-agent unmanned systems are moving from isolated, ego-centric sensing toward col- laborative intelligence, in which distributed agents exchange compact features to overcome a local observation trap that no single agent can escape: occlusions, finite sensor range, and envi- ronmental degradation. The field has matured across architectural, communication, embodied, resilience, and trust dimensions, yet existing surveys examine these dimensions in isolation and rarely expose the dependencies among them. This review offers a unified synthesis through two complementary lenses. The first is a five-dimensional taxonomy spanning collaboration stage, communication paradigm, fusion architecture, learning strategy, and application domain. The second is a set of three cognitive synergy conditions, Semantic Disambiguation, Pragmatic In- formation Exchange, and Proactive Informational Foraging, that turn the notion of cognitive synergy into operational criteria. Across these lenses we survey collaboration architectures and topologies, neural-communication co-design that treats the channel as a differentiable pipeline component, embodied action-perception loops via multi-agent reinforcement learning, and re- silience mechanisms for synchronization, uncertainty quantification, and label-efficient learning. We then map these advances onto four operational domains, V2X, unmanned aerial, industrial logistics, and smart cities, and onto the safety-privacy-utility triad. To counter benchmark satu- ration and evaluation fragmentation, we propose GCI-Bench, a five-pillar scoring protocol with a maturity model that makes the trade-offs of collaborative methods comparable across studies. A critical reflection on reproducibility, the sim-to-real gulf, and conditions under which collab- oration degrades performance identifies open challenges and charts directions toward general collaborative intelligence under real-world uncertainty. 1 arXiv:2609.22967v1 [cs.CV] 19 Sep 2026 Data FusionCollaborative PerceptionCognitive Synergy GCI Local Observation Trap Sensor Noise Limited Range Occlusion Fragmented Local Perception UAV UGV AV Warehouse Robot RSU / Edge Server Maritime / Aerial Sensor Node Semantic Messages (Compact & Abstract) Feature Tokens BEV Map Patches Uncertainty Heatmaps Intent Vectors Value-of- Information Scores Communication-Aware Fusion Uncertainty-Aware World Model Shared Latent Manifold Observe ShareFuse Reason Global Neural World Model Humans as Supervised Partners (Active Oversight & Goal Alignment) Open-World Adaptation Pragmatic Communication Embodied Information Foraging Trustworthy Synergy Isolated Autonomy 1 Collaborative Intelligence Layer 2General Collaborative Intelligence 3 Figure 1: Vision of general collaborative intelligence for multi-agent unmanned systems. The transition from isolated autonomy to GCI: heterogeneous agents exchange compact feature to- kens through communication-aware fusion, evolving from deterministic data fusion toward cognitive synergy in a distributed ecosystem supporting open-world adaptation, pragmatic communication, embodied information foraging, and trustworthy synergy. 1 Introduction Multi-agent unmanned systems operating across terrestrial, aerial, and maritime domains are under- going a fundamental transition: from isolated, ego-centric sensing toward networked intelligence [1â 6]. Single-agent perception, even when powered by large deep-learning models and high-fidelity sensors, remains bound by the local observation trap: physical occlusions, finite sensor range, and hardware-specific noise. These constraints impose an informational ceiling no single agent can shat- ter. Collaborative intelligence (CI) removes this ceiling by pooling distributed sensory, temporal, and computational resources into a shared world model, enabling a collective to execute missions that are physically and informationally impossible for any isolated agent. Figure 1 illustrates this transition from isolated autonomy to the broader vision of general collaborative intelligence (GCI). Historically, the field centered on deterministic data fusion, concerned primarily with rigid geo- metric alignment of raw sensory inputs, as surveyed in the multi-robot and SLAM literature [7]. Since approximately 2020, however, the field has shifted toward cognitive synergy [8], a collaborative state in which agents act as pragmatic informational gatekeepers of a shared semantic manifold, not as passive data broadcasters. This review treats GCI as a forward-looking systems target grounded in measurable capabilities; it does not claim that present systems already possess general intelligence, only that the conditions for cross-domain, task-relevant shared world modeling under heterogeneous sensing, constrained communication, agent churn, and safety and privacy requirements are begin- ning to be systematically characterized. Four converging trends drive this evolution: from geometric redundancy toward neural semantic consensus, from broadcast-driven sensing toward pragmatic in- 2 formational foraging, from passive observation toward proactive cyber-physical acquisition, and from task-specific alignment toward GCI. Each trend is examined in Section 3. Progress notwithstanding, the transition from benchmarks to deployment faces fundamental ob- stacles. Recent surveys [3, 9â12] consistently identify a communication gap exceeding two orders of magnitude between raw sensor data rates and practical C-V2X throughput, agent heterogeneity across sensors, models, and protocols that breaks plug-and-play interoperability, localization errors and temporal asynchrony that produce ghosting artifacts, limited scalability beyond a handful of agents owing to O(N 2 ) fusion costs, online robustness challenges documented by end-to-end coop- erative driving competitions [13], and under-addressed privacy and trust risks. These obstacles, analyzed in Section 9, set the research agenda for the coming decade. These challenges have prompted a wave of surveys, each distinct in scope. Wan et al. [9] provide a PRISMA-guided systematic review from a computer-vision standpoint. Song et al. [10] reframe wireless communication as an âinformation sensor.â Huang et al. [3] survey V2X cooperative per- ception across datasets, fusion methods, and privacy. Yazgan et al. [11] examine intermediate-fusion methods through the lens of real-world robustness, and Lyu et al. [12] focus on redundancy miti- gation. Among earlier studies, Han et al. [14] established the cooperative perception landscape of methods, datasets, and challenges, while Bai et al. [15] frame the field from heterogeneous single- tons toward hierarchical cooperation. Complementary reviews cover robotic-fleet perception [16] and multi-robot perception, planning, and collaboration [17]. An experimental study of V2X cooperative perception [18] and a broader survey on causal inference for robust deep learning [19] further enrich the landscape. Despite these contributions, four gaps motivate the present review. First, with the partial excep- tion of Wan et al. [9] and Bai et al. [15], existing surveys concentrate on vehicle-to-everything (V2X) systems, leaving aerial-ground heterogeneous systems (UxS), industrial warehouse logistics, and smart-city infrastructure under-represented. Second, communication is treated predominantly as an external constraint rather than as a differentiable, co-optimized pipeline component; the emerging paradigm of neural-communication co-design, including Deep JSCC, information-bottleneck-guided feature pruning, and cross-layer MAC-PHY orchestration, therefore remains unsystematized. Third, no prior survey offers a unified operational framework, grounded in formal definitions and operational conditions, that ties architectural choices, learning strategies, and domain deployments to common evaluative principles. Fourth, while individual challenges such as localization error, latency, and heterogeneity are cataloged, their structural drivers (i.e., benchmark saturation, the reproducibility gap, the sim-to-real performance gulf, and failure modes where collaboration degrades performance) have not been systematically examined. The present review addresses these structural dimensions in a dedicated critical reflection (Section 9). Table 1 provides a systematic comparison with repre- sentative prior surveys across four groups and nine dimensions of coverage. Against this background, the present review adopts an analytical lens introduced in Section 2 and applied throughout the paper. This lens combines a five-dimensional taxonomy (collabo- ration stage, communication paradigm, fusion architecture, learning strategy, application domain) with three cognitive synergy conditions: Semantic Disambiguation (C1), Pragmatic Information Exchange (C2), and Proactive Informational Foraging (C3). Our main contributions are: 3 Table 1: Systematic comparison of this review with representative prior surveys. A filled circle (â˘) denotes comprehensive coverage; an open circle (âŚ) denotes partial coverage; a dash (â) indicates the dimension is not addressed. Application DomainTechnical CoreTasks & RobustnessSystem & Reflection Ref.Year V2XUxS/ISCCo-Des.Formal.TasksChall.Embod.TrustRefl. Han et al. [14]2023 â˘ââ˘âŚâ Yazgan et al. [11]2024â˘ââŚââ˘âŚâ⌠Bai et al. [15]2024 â˘âŚââŚâ Song et al. [10]2025â˘ââ˘ââŚâ˘â Huang et al. [3]2025 â˘ââŚââŚâ˘ââŚâ Lyu et al. [12]2025â˘ââŚââŚâ Wan et al. [9]2026 â˘ââŚââ˘â⌠This review2026â˘âŚâ˘âŚâ˘ Abbreviations: Co-Des. = Communication Co-Design; Formal. = Formal Mathematical Framework; Tasks = Perception Tasks (detection, tracking, segmentation, prediction); Chall. = Practical Challenges (bandwidth, latency, localization error, heterogeneity, domain shift, etc.); Embod. = Embodied Synergy (MARL, active perception, sim-to-real); Trust = Trust & Privacy; Refl. = Critical Reflection & Reproducibility; UxS/ISC = Unmanned Systems, Industrial Logistics, Smart Cities. ⢠We operationalize cognitive synergy through the three operational conditions C1âC3, which jointly require that a collaborative system resolve entity identity beyond any single agentâs view, transmit only decision-relevant informational surprise, and actively reconfigure its sensing topology to reduce residual uncertainty. These conditions serve as the evaluative lens for the five-dimensional taxonomy and for the GCI-Bench scoring protocol. ⢠Unlike prior surveys that focus on V2X, we synthesize advances across four operational do- mains (V2X, UxS, industrial logistics, and smart cities) and five technical dimensions (archi- tectures, communication co-design, embodied synergy, resilience, and trust), while explicitly distinguishing mature benchmark-supported areas from emerging application domains. ⢠Beyond cataloging progress, we provide a structured critique of benchmark saturation, the re- producibility gap, the sim-to-real gulf, under-reported failure modes, and scalability challenges, offering a counterweight to the positive-results bias prevalent in the literature. ⢠We identify four research trajectories that chart the transition from task-specific coordina- tion to general collaborative intelligence: collaborative foundation models, pragmatic game- theoretic communication, hardware-agnostic semantics, and proactive swarm embodiment. Review scope and methodology. This review follows a structured scoping procedure rather than a bibliometric meta-analysis. We searched IEEE Xplore, ACM Digital Library, SpringerLink, ScienceDirect, Web of Science, Google Scholar, and arXiv for literature published primarily between 2019 and May 2026, retaining papers that propose collaborative sensing, fusion, or communication methods for autonomous vehicles, unmanned systems, or multi-robot platforms; introduce relevant datasets, simulators, or benchmarks; address deployment constraints (latency, pose error, bandwidth, heterogeneity, robustness, privacy, safety); or provide a recent survey defining the state of the field. Single-agent perception, purely network-level V2X studies without perceptual tasks, and application reports without reusable technical insight were excluded. 4 The remainder of this paper is organized as follows. Section 2 establishes the conceptual and mathematical foundations. Sections 3â6 examine four technical dimensions: collaboration archi- tectures (stage and topology), neural-communication co-design, embodied synergy, and resilience. Sections 7â8 map these advances onto application domains and the safetyâprivacyâutility triad. Sec- tion 9 provides a structured critical reflection on current limitations and charts future directions. Section 10 presents the GCI-Bench evaluation framework, and Section 11 concludes. 2 Foundations of Collaborative Intelligence Before surveying the technical landscape, we establish the conceptual and mathematical founda- tions that unify the diverse methods discussed in subsequent sections. This section formalizes the fundamental tension between perceptual fidelity and communication cost that governs all collabora- tive paradigms, introduces an operational definition of cognitive synergy as the evaluative lens used throughout the review, and situates the field within a multi-dimensional taxonomy that organizes the remainder of the paper. 2.1 The RateâFidelity Trade-off The structural organization of GCI is fundamentally governed by a multi-objective optimization problem: the tension between perceptual fidelity and the entropy of the communication substrate. Formally, let N agents each observe a local sensory field O i , encode it into a latent representation Z i = f i (O i ) with transmission rate R(Z i )â I(O i ; Z i ) (mutual information, information-bottleneck convention), and contribute to a fused estimate Ë Y = g(Z 1 ,..., Z N ) of the global world state Y. The collaborative architecture design problem is: max f i ,g I( Ë Y; Y) subject to N X i=1 R(Z i )⤠B,(1) where I(¡;¡) denotes mutual information and B is the total communication budget. This formulation captures the core architectural trade-off: increasing the information content of transmitted features improves perceptual fidelity at the cost of communication load. The three canonical paradigms (early, intermediate, and late collaboration) correspond to different operating points along this rateâfidelity frontier. Early collaboration maximizes I( Ë Y; Y) by setting Z i â O i (raw data), at the expense of maximal R(Z i ); late collaboration minimizes R(Z i ) by transmitting only sparse metadata, but incurs a substantial drop in mutual information due to the hard thresholding of local decisions; intermediate collaboration seeks a Pareto-optimal balance by learning a compressed neural code Z i that preserves task-relevant semantics while discarding redundancy [20â22]. To avoid notational drift across the technical sections that follow, we fix the shared symbol vocabulary introduced above and reuse it throughout the review: N denotes the number of col- laborating agents; O i the local observation of agent i; Z i = f i (O i ) its transmitted latent repre- sentation; R(Z i )â I(O i ; Z i ) the information-theoretic transmission rate; Ë Y = g(Z 1 ,..., Z N ) the fused collective estimate; and Y the underlying global world state. Operational communication 5 Table 2: Operational criteria for cognitive synergy. The three conditions translate the con- ceptual claim of GCI into observable requirements that can be evaluated experimentally. ConditionObservable CriterionTypical Technical Realization Operational Failure Test (metric; benchmark) C1 Semantic Disambiguation Resolve entity identity, spatial location, and trajectory intent beyond any single agentâs line-of-sight Cross-attention Transformers [23, 24]; generative map priors (CoGMP) [25] On a dynamic-occlusion split of OPV2V [26]: identity-switch or class-misattribution rate above a set threshold (e.g., >5%) as targets cross multi-agent occlusions C2 Pragmatic Exchange Bandwidth scales inversely with spatial confidence; high-entropy, high-surprise regions transmitted first Extended information bottleneck (InfoCom [27]); spatial confidence masking (Where2comm [21]) On OPV2V [26] or V2X-Sim [28]: communication volume scaling near-linearly with agent density (logâlog slopeâł 0.8), or a non-negligible share of redundant background bytes C3 Proactive Foraging Trajectory adjustments or sensor re-aiming triggered by localized state-uncertainty peaks Active perception loops; planning-integrated perception (Plan2comm [29], CooperDrive [30]) On an active-perception testbed (e.g., CSAOT [31]): no measurable trajectory or sensor reconfiguration, and hence no entropy reduction, in regions of high epistemic uncertainty cost (bandwidth plus latency, as measured in practice) is denoted C and is distinguished from the information-theoretic rate R; movement cost in embodied settings is written C move . Section-specific symbols (e.g., model parametersθ, agent poses p i ) are introduced locally where they arise. This rateâfidelity framework is not confined to architectural choices. It directly underpins the collaborative information bottleneck formulation (Eq. 2) and the joint perceptionâcommunication Lagrangian (Eq. 3) developed in Section 4, establishing a unified mathematical language that spans the architectural, communication, and learning dimensions of GCI. 2.2 Operationalization of Cognitive Synergy To ground the subsequent discussion, we define cognitive synergy operationally as a collaborative state characterized by three operationally necessary conditions; we treat these as design desiderata rather than a formal theorem, and note that each condition addresses a distinct failure mode that the others cannot compensate. (C1) Semantic Disambiguation: the collective resolves entity identity beyond any single agentâs local view, grounding synergy in semantic understanding rather than mere spatial occupancy. (C2) Pragmatic Information Exchange: agents transmit only decision-relevant surprise, ensuring communication carries information that reduces collective belief- state entropy. (C3) Proactive Informational Foraging: the swarm reconfigures its physical or attentional topology to actively acquire information that resolves residual uncertainty. When all three conditions hold, the swarm exhibits identity persistence, graceful degradation, and cross-modal invariance; systems satisfying any subset of the three conditions fall into regimes where synergy is incomplete, either lacking embodiment, semantic depth, or bandwidth discipline. The three conditions hold only within an operating envelope, and recognizing this envelope is part of the conceptâs definition rather than an afterthought: if the conditions are meant to characterize cognitive synergy, then the conditions under which collaboration should not be attempted belong to that definition. Collaboration should be withheld, or should fall back to single-agent operation, when any of the following obtains. (i) The end-to-end latency of encoding, transmission, and fusion exceeds the decision budget of the task, so shared features arrive too stale to help; this is a failure of C2âs timeliness and is the dominant regime in time-critical scenarios such as highway emergency braking. (i) The agents share a common blind spot or a homogeneous failure mode, so pooling reinforces a 6 General Collaborative Intelligence (GCI) When to Share? Collaboration Stage How to Aggregate? Fusion Architecture How to Train? Learning Strategy Where to Deploy? Application Domain Early: Raw Data Intermediate: Neural Features Late: Metadata Periodic: Broadcast Saliency-Aware: Where2comm, Which2comm Co-Designed: DeepJSCC, NTSCC Centralized: Cloud / Edge Server Decentralized: Peer-to-Peer Hierarchical: RSU-Anchored Fully Supervised: Human-labeled Data How to Communicate? Communication Paradigm Self-Supervised: Cross-View Consistency MADRL: Reinforcement Learning for Perception V2X: Connected and Automated Vehicles UxS: Aerial-Ground Heterogeneous Systems Industrial: Warehouse Logistics, Smart Prots Smart City: Crowd Management Figure 2: A multi-dimensional taxonomy of collaborative perception. The taxonomy orga- nizes the field along five orthogonal dimensions. Dimension 1 (Collaboration Stage) determines the abstraction level at which information is exchanged, directly governing the rateâfidelity trade-off formalized in Eq. 1. Dimension 2 (Communication Paradigm) spans the spectrum from periodic broadcasting to neural-communication co-design (Section 4). Dimension 3 (Fusion Architecture) specifies the topological structure of information aggregation. Dimension 4 (Learning Strategy) de- termines how the collaborative model acquires its parameters. Dimension 5 (Application Domain) captures the operational context that drives domain-specific design choices (Section 7). correlated error instead of disambiguating identity; this is a failure of C1. (i) A compromised or miscalibrated agent injects corrupted features faster than fusion can reject them, so the collective estimate becomes worse than the best local estimate; this is the error-propagation failure. (iv) The communication cost of resolving residual uncertainty exceeds the value of the information gained, so C3âs foraging consumes more resources than it returns. These four regimes, analyzed as the fieldâs documented failure modes in Section 9, mark the boundary at which synergy degrades into anti-synergy, and a system operating beyond it satisfies none of the three conditions (denoted none below). 2.3 A Multi-Dimensional Taxonomy of Collaborative Perception Existing surveys typically classify collaborative perception systems along a single axis, most com- monly the collaboration stage (early, intermediate, late) or the application domain. This one- dimensional view, however, obscures critical cross-cutting concerns: a late-fusion system deployed in a decentralized V2X topology faces fundamentally different design trade-offs than a late-fusion system in a centralized warehouse setting, yet both share the same âlate collaborationâ label under a stage-only taxonomy. A multi-dimensional taxonomy is therefore necessary to capture the design space accurately: each dimension represents an independent axis of variation, and the full charac- terization of a collaborative system requires specifying its position along all five axes simultaneously. Figure 2 visualizes this taxonomy and serves as the organizing framework for the remainder of the paper. Section 10 operationalizes this taxonomy into a quantitative multi-pillar scoring protocol (GCI-Bench). Dimension 1 (Collaboration Stage) and Dimension 3 (Fusion Architecture) 7 are examined together in Section 3, where we emphasize their orthogonality: any collaboration stage can in principle be combined with any topology, and conflating them is a common source of confusion in the literature. Dimension 2 (Communication Paradigm) is covered in Section 4. Dimension 4 (Learning Strategy) cuts across Sections 5 and 6. Dimension 5 (Application Domain) is the subject of Section 7. To demonstrate the five dimensions of Figure 2, each subsequent section opens with a taxonomy table that maps the methods discussed therein onto all five axes and the three cognitive synergy conditions (see Table 2). Synergy pillars are denoted as C1,C1C2, orC1C2C3according to which conditions each method satisfies; failure regimes that satisfy none of the conditions are markednone. These badges are assigned by a single adjudication rule: a method is credited with a condition only when its core technical contribution directly implements the corresponding observable criterion of Table 2, rather than benefiting from that condition incidentally; C1 is credited in a strong form when fusion resolves entity identity at the feature level and in a weak form when identity is resolved only through cross-view decision association. Applying this rule, we re-audited every assignment in Tables 3â11: DiscoNet, for example, is credited with C1alone, since its edge distillation compresses the collaboration graph rather than gating decision-relevant surprise (C2), whereas late fusion retains a weak-form C1through metadata association across agent decisions. Table 3 opens Section 3 by indexing 13 representative architecture methods; analogous tables appear at the start of Sections 4â 9 (Tables 4â11), collectively forming a distributed taxonomy index that covers the methodological landscape surveyed in this review. 3 Collaboration Architectures and Topologies This section examines two orthogonal design dimensions of collaborative architectures that must be decoupled in analysis. The first is the collaboration stage (Section 3.1), the abstraction level at which information is exchanged, which governs what is shared. The second is the fusion topology (Section 3.2), the physical and logical structure through which agents route and aggregate shared information, which governs to whom it is sent. The logical frontier of this paradigm lies in software- defined collaborative networks (SDCN) (Section 3.3), which adapt both dimensions dynamically in response to real-time mission constraints, wireless propagation environments, and computational loads. Table 3 provides a consolidated comparison of representative methods spanning these archi- tectural dimensions. This section covers Dimensions 1 and 3 of the taxonomy of Section 2, advancing C1(Semantic Disambiguation) andC2(Pragmatic Exchange). 3.1 Collaboration Stages The collaboration stage determines the abstraction level at which information is exchanged among agents, directly governing the rateâfidelity trade-off formalized in Eq. 1. Three canonical stages span the informational spectrum. Traditional collaboration paradigms represent the asymptotic boundaries of the collaborative spectrum, as illustrated in Figure 3. While they provide foundational benchmarks, they encounter 8 Table 3: Taxonomy of collaboration architectures and cognitive synergy conditions. Methods are mapped onto the proposed five-dimensional framework. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy Cooper [20]2019EarlyBroadcastCentr.SupervisedV2XC1 Late Fusion [32]2022LateMetadata-onlyDecentr.SupervisedV2XC1 V2VNet [33]2020Intermed.Broadcast (GNN)Decentr.SupervisedV2XC1 DiscoNet [34]2021Intermed.KD-drivenDecentr.Supervised + Distill.V2XC1 V2X-ViT [23]2022Intermed.Broadcast (Transf.)Centr.SupervisedV2XC1 Where2comm [21]2022Intermed.Saliency (spatial)Decentr.Supervised + AttentionV2XC1C2 CoBEVT [24]2023Intermed.Broadcast (Transf.)Centr.SupervisedV2XC1 Fusion2comm [35]2025Intermed.Saliency (occlusion)Decentr.Supervised + AttentionV2XC1C2 Which2comm [36]2025Intermed.Saliency (multi-scale)Decentr.Supervised + AttentionV2XC1C2 QuantV2X [37]2025Intermed.QuantizationDecentr.Supervised + Quant.V2XC1C2 CoGMP [25]2025Intermed.Gen. Reconstr.Centr.DiffusionV2XC1C2 V2XPnP [38]2025Intermed.SpatiotemporalCentr.SupervisedV2XC1 InfoCom [27]2026Intermed.IB-driven pruningDecentr.Supervised + IBV2XC1C2 Negative exemplars (failure regimes from Section 9, shown to make the criteria visibly discriminating): Latency-saturated early fusion âEarlyBroadcast (stale)Centr.â V2Xnone Byzantine-corrupted fusionâIntermed.CorruptedDecentr.âV2Xnone Abbreviations:Intermed.= Intermediate, Decentr. = Decentralized, Centr. = Centralized, Gen. = Generative, Reconstr. = Reconstruction, Distill. = Distillation, Quant. = Quantization, IB = Information Bottleneck, GNN = Graph Neural Network, Transf. = Transformer. Synergy Conditions:C1 = Semantic Disambiguation, C2 = Pragmatic Exchange, C3 = Proactive Foraging,none = satisfies none (anti-synergy failure regime). fundamental scaling limitations in large-scale, dynamic multi-agent ecosystems. 3.1.1 Early collaboration Early collaboration refers to raw data aggregation that functions as the upper informational bound of the system. In this paradigm, agents act as transparent conduits, transmitting uncompressed 3D point clouds or high-definition RAW video streams to a central aggregator. By preserving the full raw entropy of the environment, early collaboration allows for global joint optimization without the quantization loss inherent in local feature extraction, enabling the aggregator to perform fine- grained spatial reasoning when the communication link can sustain the raw data load [20]. Despite its theoretical appeal, however, early collaboration is often impractical for real-time mobile swarms. The communication load creates a latency penalty. In high-velocity scenarios such as highway platooning or agile aerial inspection, this induces temporal registration error: by the time the central node fuses the raw data, the physical state of the world may have already evolved, rendering the fused manifold a delayed estimate rather than a reliable guide for immediate action. Consequently, early collaboration is mainly suitable for short-range high-bandwidth links, tethered multi-robot systems, or offline mapping settings. 3.1.2 Late collaboration In contrast to early collaboration, late collaboration represents the limit of informational abstraction. Agents exchange only high-level metadata, such as 3D bounding boxes, semantic class labels, and localized trajectory coefficients [32]. The primary advantage of late collaboration is its hardware- agnostic nature: a LiDAR-equipped rover can easily collaborate with a low-cost monocular drone 9 Early Collaboration Intermediate CollaborationLate Collaboration Raw Data Feature Backbone Perception Head Local Output Raw Data Feature Backbone Perception Head Local Output Raw Data Feature Backbone Perception Head Local Output Single Agent Perception Pipeline Figure 3: Illustration of three primary collaboration strategies in multi-agent perception systems. The collaboration stage dictates the abstraction level at which information is exchanged. Early Collaboration (solid line) shares high-bandwidth raw data before the feature backbone. In- termediate Collaboration (dashed line) shares compressed features after the backbone, offering a balance between performance and communication cost. Late Collaboration (dotted line) shares low- bandwidth local outputs (e.g., object detections) after the perception head. Lower panels illustrate the fusion process within each strategy, where data from multiple agents (differentiated by color) is aggregated into a unified representation before being re-injected into the ego-agentâs pipeline. by simply comparing object lists, creating a highly scalable and resilient network that is immune to raw data heterogeneity. However, late collaboration usually suffers from the hard thresholding error. Because collaboration occurs after the local agent has made a final decision, it lacks the evidential depth to resolve the local observation trap. If an agentâs local detector fails due to severe sensor noise or adversarial occlusion, it broadcasts a signal with detection errors, and the fusion center has no access to the low-confidence feature signals that may allow a neighbor to correct the error. 3.1.3 Intermediate collaboration Intermediate collaboration redefines collaboration as task-oriented latent feature exchange, occupy- ing the Pareto-optimal region of the rateâfidelity frontier formalized in Eq. 1. Rather than exchang- ing explicit geometric primitives or sparse metadata, agents share compressed neural embeddings that preserve task-relevant semantics while discarding sensor-specific redundancy [23, 33, 39, 40]. Complementary strategies include region-based hybrid fusion that partitions the sensing field by spatial saliency [41], collective perception schemes that treat the swarm as a distributed sensor array [42], and adaptive architectures that dynamically adjust collaboration depth in response to channel quality and task criticality. Advanced frameworks such as V2X-ViT [23] and CoBEVT [24] utilize cross-attention in Trans- 10 formers to project disparate, multi-perspective features into a unified birdâs-eye-view (BEV) mani- fold. This architecture facilitates a generative process known as collaborative reconstruction [43], in which high-confidence features from one viewpoint are used to fill the semantic gaps of an occluded neighbor. Mathematically, this is equivalent to a probabilistic prior injection, where the collective knowledge of the swarm reconstructs the obscured features of an actor, effectively turning the swarm into a distributed panoramic sensor. The next frontier of intermediate collaboration involves the transition from periodic broadcasting to pragmatic informational foraging. The foundational step along this path was to ask who and when to communicate: Who2com [44] selects collaborators through a learnable handshake protocol, while When2com [45] groups the communication graph and activates message exchange only when it bene- fits the collective, recasting communication itself as a selective, learnable decision rather than a fixed broadcast. Frameworks such as Where2comm [21] and Which2comm [36] treat the communication channel as a strategic resource, utilizing spatial confidence maps and epistemic uncertainty mark- ers to identify feature patches that provide the maximum reduction in global world-model entropy. How2comm [46] extends this line with mutual information-driven spatial-channel message filtering and flow-guided temporal delay compensation, addressing communication redundancy, transmission latency, and heterogeneous agent features within a unified spatiotemporal collaborative Transformer. At the extreme of compression, InfoCom [27] reformulates collaborative perception through an ex- tended information bottleneck (IB) framework, employing information-aware encoding, sparse mask generation with 4-bit quantization, and multi-scale BEV decoding to achieve near-lossless percep- tion at kilobyte-scale transmission, a 440Ă reduction over Where2comm and over 4,000Ă reduction compared with standard collaborative perception baselines, as reported in [27]. By transmitting only high-entropy or mission-critical regions (e.g., an occluded pedestrian at a blind intersection), these architectures achieve extreme data reduction while maintaining the structural integrity of the collective model [22]. This pragmatic communication strategy ensures the swarm transmits only decision-relevant information, maximizing the utility of each bit under bandwidth constraints. Generative map priors (GMP) represent a paradigm shift from discriminative detection to gen- erative reconstruction in the collaborative manifold. As autonomous swarms operate in high-clutter environments, traditional fusion often fails when critical perspectives are missing. To bridge this gap, CI architectures leverage latent diffusion models (LDMs) to synthesize a high-fidelity, globally consistent world model by conditioning on sparse, distributed cues. Unlike standard pixel-level diffusion, collaborative LDMs operate within the compressed neural manifold to ensure real-time feasibility. Frameworks such as CoGMP [25] utilize a multi-agent diffusion prior to denoise the incomplete BEV features. When a swarm experiences a significant loss of perspective, the generative decoder treats the remaining latent features as sparse anchors. Through a forward diffusion process that injects Gaussian noise and a subsequent reverse denoising process, the model reconstructs the missing semantic geometry. The iterative refinement ensures that reconstructed regions are not merely random textures, but are topologically consistent with the observed spatial constraints of the collective. The generative capability of CI is further enhanced by integrating spatiotemporal memory banks. By conditioning the diffusion process on historical priors, the swarm can maintain the identity persis- 11 tence of an actor when it is occluded from all other perspectives, enabling the swarm to reconstruct the probable trajectory and semantic state of hidden objects based on their last known vectors and the collectiveâs shared understanding of environmental physics. To guard against the over-generation risk inherent in generative world models, reconstructed regions are paired with evidential uncertainty estimates so that high-uncertainty voxels are flagged for active verification, closing the loop between generation and sensing. Complementary evidential deep learning approaches assign Dirichlet distri- butions over shared voxels to parameterize this uncertainty without Monte Carlo sampling [47]. Generative map priors also reconcile heterogeneous sensor inputs. For instance, when a droneâs RGB camera is blinded by glare, the generative world model utilizes the sparse LiDAR pulses from a ground rover to synthesize the missing visual semantics. This cross-modal generative synthesis en- sures that the global manifold remains informationally saturated even under extreme sensor-specific degradation, effectively creating a weather-invariant and modality-agnostic collective sight [48, 49]. It should be noted, however, that the benefits of intermediate collaboration are not unconditional: when communication cost, generative over-generation risk, or correlated sensor failures dominate, collaborative perception can degrade below single-agent baselines; these failure modes are analyzed in Section 9. 3.2 Architecture Topologies Collaboration stages determine at what abstraction level information is exchanged; a second, or- thogonal design dimension is the physical topology through which that information is routed and aggregated. These topologies can in principle be combined with any collaboration stage; for instance, both early and intermediate fusion can be realized in centralized, edge-based, or decentralized con- figurations [15]. Figure 4 contrasts the three canonical topologies. Cloud-based centralized. In the cloud-based topology, a remote data center aggregates raw or processed sensor streams from all agents, enabling global-scale processing, HD map construction, and long-term learning across large fleets [50]. The fundamental limitation is round-trip latency, which typically amounts to hundreds of milliseconds over cellular backhaul and renders this topology unsuitable for time-critical safety applications such as collision avoidance. It is therefore primarily deployed in offline mapping, fleet analytics, and training-data curation pipelines rather than in real-time control loops. Edge/infrastructure-based. The edge-based topology deploys roadside units (RSUs) as local fusion centers, striking a balance between global coordination and local responsiveness. RSU-based architectures offer low local latency, simplified agent-side design (offloading fusion computation to infrastructure), and globally optimized pose alignment through fixed, calibrated sensor mounts [51, 52]. However, they introduce single-point-of-failure vulnerability at each RSU, high deployment and maintenance cost, and scalability bottlenecks as the number of agents within an RSUâs coverage area grows. The tension between coverage density and infrastructure cost remains an open challenge. Decentralized peer-to-peer. In the decentralized P2P topology, each agent performs fusion on- board using direct V2V or agent-to-agent links. This architecture achieves high resilience with no single point of failure, minimal end-to-end latency (no infrastructure relay), and inherent scalabil- 12 Centralized Collaborative Perception Architectures Decentralized (Peer-to-Peer, P2P) Collaborative Perception Architecture Core Advantages: Large-scale processing, HD map construction, long-term system learning Key Limitations: High round-trip latency, persistent high-bandwidth dependency, unsuitable for time-critical safety applications Dedicated Cloud Aggregator + High-Capacity Cloud Computing UAV UGV UUV Cloud-based Centralized Architecture AV Core Advantages: Low local latency, simplified agent design, global pose optimization Key Limitations: Single point of failure, infrastructure dependency, highdeployment cost, high-densityscalability bottleneck Local Edge Aggregator (Road Side Unit, RSU) + Edge Fusion Center Edge/Infrastructure (RSU-based) Centralized Architecture Core Advantages: High resilience, no single point of failure, low end-to-end latency, robust to unstable network coverage Key Limitations: High on-board compute requirement, cross-agent synchronization challenge, distributed data association difficulty, limited global context cohesion AV UAV UGVUUV Onboard Compute + Local Fusion UAV UGV UUVAV Figure 4: Canonical collaborative perception architecture topologies. (a) Cloud-based cen- tralized: remote data center aggregation, global coverage at high latency. (b) Edge/infrastructure- based: RSU local fusion, low latency with infrastructure dependency. (c) Decentralized P2P: on- board V2V fusion, high resilience at the cost of compute and synchronization overhead. The SDCN paradigm (Section 3.3) targets adaptive transitions among these topologies. ity through local neighborhood communication [33]. The trade-offs include substantial on-board compute requirements, challenging cross-agent synchronization without a central clock reference, and limited global context cohesion when the communication graph is sparse [14]. Decentralized topologies are particularly well-suited for high-mobility scenarios where infrastructure coverage is intermittent or unavailable. 3.3 Software-Defined Collaborative Networks (SDCN) A promising direction for CI architectures is the realization of the software-defined collaborative network (SDCN). In this paradigm, the structural organization of GCI is no longer a static choice but an adaptive meta-cognitive state [15, 53]. Cyber-Physical Context Awareness. In an SDCN, the parameters of collaboration, i.e., fusion depth, compression ratio, and feature saliency, are dynamically modulated by a meta-cognitive layer. This layer continuously monitors the cyber-physical health of the swarm, including the network state (jitter, bandwidth availability, and packet loss rates), the computational thermal limits (onboard energy reserves and FLOP availability), and the mission criticality (proximity to safety-critical hazards or the importance of the current objective) [54, 55]. 13 Table 4: Taxonomy of neural-communication co-design methods and cognitive synergy conditions. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy Deep JSCC [58, 59]2019Intermed.JSCC (SNR-adaptive)AnySupervised + JSCCGen.C2 NTSCC [60]2022Intermed.JSCC (nonlinear transform)AnySupervised + JSCCGen.C2 CoBEVFlow [61]2023Intermed.Flow-based temporal comp.Centr.SSL + Optical FlowV2XC1C2 HADCoP [62]2025Intermed.On-demand (DRL)Decentr.MARL + JSCCV2XC1C2 PragComm [22]2026Intermed.IB-driven (Lagrangian)AnyIB-optimizedMultiC1C2 Abbreviations: JSCC = Joint Source-Channel Coding, IB = Information Bottleneck, DRL = Deep Reinforcement Learning, SSL = Self-Supervised Learning, Centr. = Centralized, Decentr. = Decentralized, Gen. = general-purpose method not tied to a specific application domain. Synergy Conditions:C1= Semantic Disambiguation,C2= Pragmatic Exchange,C3= Proactive Foraging. Adaptive Fusion Elasticity. When the swarm operates in a low-risk, bandwidth-constrained environment (e.g., open-sea mapping), the SDCN autonomously shifts toward hyper-sparse late col- laboration to conserve energy. Conversely, when the swarm enters a high-risk zone (e.g., a congested, unsignalized urban intersection), the system undergoes phase transition, shifting toward dense neu- ral manifold synthesis. This elastic collaboration ensures that the swarm maintains a robust global semantic manifold in the most contested and resource-constrained physical environments [53, 56]. Self-Organizing Perceptual Topologies. In an SDCN, the communication graph can be dy- namically reconfigured, with perceptual hubs elected based on vantage point quality and available computational headroom. This represents the convergence of sensing, communication, and reason- ing into a unified architectural framework that improves resilience and adaptivity under changing network and mission conditions [57]. 4 Neural-Communication Co-Design The classical separation theorem of source and channel coding treats sensing, compression, and transmission as independent blocks. GCI in dynamic environments demands departure from this decoupled approach toward neural-communication co-design, which treats the channel as a differ- entiable pipeline component, ensuring bandwidth serves the features that maximize collective task performance [22, 59]. Neural-communication co-design spans a spectrum from information-theoretic encoding to real-time resource allocation at the physical layer, as illustrated in Figure 5. This section covers Dimension 2 (Communication Paradigm) and realizes C2(Pragmatic Exchange). 4.1 Deep Joint Source-Channel Coding Traditional V2X frameworks rely on a compress-then-transmit strategy, which is notoriously brittle under low signal-to-noise ratio (SNR) or high-interference conditions; recent 6G-era cooperative perception work [59, 63] re-examines this pipeline under tighter latency and fidelity targets. Deep joint source-channel coding (Deep JSCC) reimagines this by mapping high-dimensional sensory data directly into channel-modulated symbols, enabling the system to learn an optimal mapping from the source distribution to the channel input space without explicit quantization or entropy coding. 14 Neural Encoder f i Semantic Feature Extraction ¡ í í =í í (íś í ) compressed latent representation Multi-Agent Observations LiDAR point cloud Camera RGB Radar point cloud raw sensor field Information Bottleneck Gate íŚ ďż˝ í í°íż í ;í í âíˇďż˝í°í í ;í|í âí Relevance term penalizes transmitting redundant info rewards improving collective task given neighborsâ knowledge Agents suppress info already available through peers âpragmatic communication Channel Model (AWGN / Fading / Ray- Tracing) Deep JSCC Encoder Channel Encoder maps features directly to channel symbols stochastic layer in computational graph Differentiable Channel recovers transmitted semantics Graceful degradation (no cliff effect): SNRâ â noisier features, not connection loss Collaborative Fusion & Output í(í í ,âŻ,í íľ )â ďż˝ í Cross-Layer Resource Orchestration Detection / Tracking / Segmentation / Prediction Agent i: Agent k: Agent j: Compression term â˘5G-NR SPS Mode 2 with Perceptual QoS â˘Saliency-Aware MAC Scheduling â˘Collaborative mmWaveBeamforming Unified Lagrangian: í í +í í ďż˝ â í íší í +í í ďż˝í ííŹ ííŹ feature map sparse latent codes End-to-end gradient flow through channel â joint optimization of perception + communication íś í íś í íś í 1 3 2 4 5 Figure 5: Neural-communication co-design pipeline for collaborative perception. The pipeline transforms raw multi-agent observations into a collaborative perception output through five stages. (1) Multi-modal sensor observations from heterogeneous agents (LiDAR, camera, radar). (2) Neural feature encoding that compresses raw streams into compact latent representations. (3) An information bottleneck (IB) gate that enforces pragmatic communication by jointly minimiz- ing transmitted redundancy while maximizing task-relevant mutual information given neighborsâ knowledge (Eq. 2). (4) A differentiable channel model (Deep JSCC) that directly maps latent codes to channel-modulated symbols, enabling end-to-end gradient flow from the task loss back through the physical layer and thereby avoiding the cliff effect. (5) Collaborative fusion that produces the multi-agent BEV detection, tracking, segmentation, and prediction output. The top feedback loop encodes the unified joint perceptionâcommunication Lagrangian (Eq. 3), enabling the entire stack to be optimized as a single differentiable system. Information Bottleneck Formulation for Collaborative Perception. The theoretical foun- dation of Deep JSCC in collaborative settings can be formalized through the information bottleneck (IB) principle [22]. Using the shared notation of Section 2, let O i denote the raw sensory obser- vation of agent i, Z i the transmitted latent representation, and Y the global world state (or the downstream collaborative task derived from it, e.g., 3D object detection or semantic segmentation). The IB objective for the collective is: min X i h I(O i ; Z i )â β I(Z i ; Y |Z âi ) i ,(2) where I(¡;¡) denotes mutual information, Z âi is the set of latents received from other agents, and β controls the rateâdistortion trade-off. The first term penalizes transmitting redundant or task- irrelevant information (compression), while the second term rewards latents that improve the collec- tiveâs task performance given what neighbors already know (relevance). This conditional formulation is the key distinction from single-agent IB: an agent is encouraged to suppress information already available through its peers, naturally inducing a pragmatic communication policy where only infor- 15 mational surprise is transmitted. In practice, the conditional mutual information I(Z i ; Y | Z âi ) is intractable to compute exactly in high-dimensional feature spaces. Feasible approximations include variational IB, which replaces the intractable conditional distribution with a learned variational sur- rogate (e.g., a neural estimator of the mutual information gap), and contrastive estimation, where the relevance term is approximated by discriminating positive feature pairs (from agents observing the same scene) from negative pairs (from different scenes). These approximations follow stan- dard practice in deep IB and mutual-information neural estimation and are discussed further in the training methodology subsection below. SNR-Adaptive Neural Encoders. Unlike static compression algorithms (e.g., H.264 or JPEG), co-designed neural encoders utilize attention mechanisms to perform semantic power allocation. Ar- chitectures inspired by Deep JSCC [59] and nonlinear transform source-channel coding (NTSCC) [60] replace the traditional separate-source-channel-coding pipeline with a single, end-to-end optimized neural codec. When an agent detects a high-priority object, such as a pedestrian in a blind spot, the encoder dynamically scales the energy of the corresponding latent features. This ensures that even if the physical channel experiences deep fading, the critical semantic tokens remain decodable by the fusion center. This graceful degradation, known in the JSCC literature as cliff effect avoidance, allows the swarm to maintain situational awareness in weather conditions or urban canyons where traditional digital protocols would suffer from catastrophic packet loss [58, 60]. Task-Oriented Feature Pruning. In a co-designed network, the objective is not pixel-level recon- struction but downstream task performance. By integrating the IB principle (Eq. 2) directly into the training objective, the neural encoder learns to suppress background entropy that is irrelevant to the collective mission. Concretely, the encoder produces an extremely sparse feature manifold where only information that is both task-relevant and not already known to neighbors is transmitted. This prag- matic communication reduces the total bandwidth requirement by orders of magnitude compared to raw data sharing while maintaining near-identical perception accuracy [21, 22]. Saliency-guided transmission achieves over 90% communication volume reduction at near-identical accuracy [21, 36], and end-to-end quantization further reduces latency by 3.2Ă while improving mAP by 9.5 over full-precision baselines [37]. 4.2 Training Methodologies Training a neural-communication co-designed system presents unique challenges beyond standard deep learning, stemming from the need to jointly optimize perception and communication objectives across a distributed architecture with non-differentiable channel components. End-to-End Learning with Differentiable Channel Models. The core enabler of co-design is the differentiable channel model. During training, the physical channel (including modulation, fading, and noise) is represented as a stochastic layer within the computational graph. This allows gradients from the task loss (e.g., detection or segmentation error) to flow backward through the channel, jointly optimizing the neural encoder, power allocation, and downstream fusion modules. In practice, channel models range from simple additive white Gaussian noise (AWGN) approxima- tions for initial prototyping [58] to ray-tracing-based digital twins that capture environment-specific 16 multipath and blockage effects for deployment-grade training [64]. Alternating Optimization and Surrogate Gradients. When the channel is non-differentiable (e.g., in real-world over-the-air training or when using hardware-specific modulation), two strategies are commonly employed. Alternating optimization decouples the problem: the perception stack is trained with an idealized channel, then the communication policy (e.g., power allocation, scheduling) is optimized via reinforcement learning using the perception model as a fixed reward function [65]. Surrogate gradient methods replace the non-differentiable channel operations with smooth approxi- mations during the backward pass [66], enabling approximate end-to-end training without requiring an exact channel Jacobian. The choice between these strategies depends on the degree of channel variability: surrogate gradients excel in slowly fading channels, while alternating optimization is more robust under rapid fluctuation. Multi-Agent Credit Assignment in Communication. A further challenge is assigning credit for communication decisions: if the collective detection improves, which agentâs transmission is re- sponsible? Recent works address this via counterfactual communication gradients [67], where each agentâs contribution to the task loss is estimated by comparing the actual fused output against a counterfactual baseline [68] that excludes that agentâs transmission. This provides a per-agent train- ing signal that encourages agents to transmit only when their observation carries unique, decision- critical information. 4.3 Channel-Aware Adaptive Fusion The neural-communication synergy extends to the fusion architecture, which tends to be elastic enough to adapt to fluctuating network topologies and latencies. Dynamic Model Partitioning and Offloading. GCI architectures aim to resolve the tension be- tween onboard energy constraints and the need for high-fidelity global fusion. Co-designed systems utilize adaptive partitioning, where the cutoff point between local computation and shared process- ing is shifted in real-time [62]. Under high-throughput conditions, agents offload low-level feature extraction to an edge server or roadside unit to leverage multi-perspective Transformer blocks. Dur- ing network congestion, the agents autonomously shift toward late collaboration, performing more heavy-duty processing locally to minimize the informational payload. This cyber-physical elasticity ensures that CI remains functional when the communication fabric is partially compromised [53]. Heterogeneous Feature Alignment Under Jitter. Real-world communication is plagued by asynchronous packet arrivals and clock jitter. A co-designed system does not wait for all packets to arrive, which can induce unacceptable latency. Instead, it utilizes neural asynchrony compensation. The fusion block treats incoming feature tensors as spatiotemporal samples and uses learned motion cues to warp delayed features into the current timeframe [61]. This neural asynchrony compensation ensures that the global world model remains temporally consistent despite the underlying networkâs jitter or retransmission delays [69]. 17 4.4 Cross-Layer Resource Orchestration Another dimension of co-design involves the direct control of physical (PHY) and media access control (MAC) layer resources by the perceptual layer. Saliency-Aware Medium Access. Moving beyond data-agnostic MAC protocols, co-designed GCI links channel access to perceptual surprise: high-risk or novel detections receive elevated scheduling priority so safety-critical information is transmitted before routine updates, bridging the gap between existing 5G-NR QoS frameworks and perception-aware resource allocation. Collaborative Beamforming for Semantic Feature Exchange. When directional links are available, unmanned aerial vehicle (UAV) or vehicular collectives can align communication resources with sensing value. Agents that observe high-entropy zones (e.g., a complex intersection or disaster site) can be allocated stronger beams, more reliable links, or higher scheduling priority. In mmWave and sub-THz bands, where beam management is already a core 5G-NR function (SSB-based beam sweeping and CSI-RS beam refinement), the perception module can directly inform beam selection: rather than performing exhaustive spatial sweeping, the agent uses its onboard perception output to steer the communication beam toward the spatial sector where collaborating agents are expected to benefit most from the shared feature payload. This approximates a perception-aware distributed MIMO configuration in which physical and communication topology are optimized together [70]. 4.5 Synthesis While the co-design paradigm offers substantial gains, its practical deployment is bounded by the realism of the channel models and the stability of multi-agent training, as discussed in the critical reflection on sim-to-real limitations in Section 9. Across the integration levels surveyed above, a common mathematical theme emerges: the co-design optimization objective can be expressed as a joint perceptionâcommunication Lagrangian: L = L task (Y, Ë Y) | z Perception fidelity + Îť c X i R(Z i ) |z Communication cost + Îť s L safety ( Ë Y) | z Safety constraint ,(3) where L task is the downstream task loss, R(Z i ) the transmission rate of agent iâs latent code, and L safety a penalty encoding safety-critical constraints (e.g., minimum detection recall for vulnerable road users). The multipliers Îť c and Îť s are not fixed hyperparameters but are dynamically modulated by the meta-cognitive layer of a software-defined collaborative network (Section 3.3), adapting to real-time cyber-physical context. This unified calculus reveals three critical insights for scaling GCI systems. First, the perceptionâ communication boundary is a design choice, not a given. The optimal partition point between lo- cal computation and shared transmission shifts continuously with channel conditions and mission criticality. Second, the IB formulation (Eq. 2) provides a principled mechanism for pragmatic com- munication: agents learn to transmit only what their neighbors do not already know, naturally implementing the pragmatic information-exchange criterion in Table 2. Third, the integration of safety constraints (L safety ) directly into the co-design objective ensures that bandwidth allocation 18 Table 5: Taxonomy of embodied synergy methods and cognitive synergy conditions. MethodYearStageComm. ParadigmArchitecture Learning StrategyApplicationSynergy CooperNaut [71]2022Intermed.On-demandDecentr.MARL V2XC1C2C3 JFP [72]2023 Intermed. BroadcastDecentr.MARLV2XC1C2C3 Plan2comm [29]2024Intermed.Saliency + PlanningDecentr.MARL + SupervisedV2XC1C2C3 CoPnP [73]2024Intermed.On-demandDecentr.MARL V2XC1C2C3 CMP [74]2025 Intermed. SaliencyDecentr.MARL + SupervisedV2XC1C2C3 UniV2X [75]2025Intermed.On-demandHybridSupervised + MARLV2XC1C2C3 CSAOT [31]2025 Intermed. On-demand (VoI)Decentr.MARL + Attention UxSC1C2C3 CooperDrive [30]2026 Intermed. On-demandDecentr.MARLV2XC1C2C3 Abbreviations: VoI = Value of Information, MARL = Multi-Agent Reinforcement Learning, Decentr. = Decentralized. Synergy Conditions:C1 = Semantic Disambiguation, C2 = Pragmatic Exchange, C3 = Proactive Foraging. under congestion is safety-aware rather than merely throughput-optimal, a distinction that is critical for the trustworthy synergy discussed in Section 8. Key open challenges remain. The non-stationarity of multi-agent wireless channels, in which each agentâs transmission is interference to the others, introduces a complex co-adaptation prob- lem that can lead to training instability. Scaling differentiable channel models to capture the full richness of mmWave or THz propagation (including beam management and blockage prediction) remains an active research frontier. Finally, interoperable semantic payload descriptions are a pre- requisite for plug-and-play feature exchange across heterogeneous fleets. Resolving these challenges will transform the communication fabric from an external constraint into an integral, optimized dimension of the collaborative intelligence stack. From an engineering-realizability standpoint, the co-design Lagrangian of Eq. 3 is tractable only under explicit resource budgets: V2X field deploy- ments typically constrain end-to-end perception latency to 30â50 ms and per-link bandwidth to tens of KB/frame, which forces Îť c toward regimes where most candidate features are suppressed and only mission-critical patches survive the IB gate. Foundation-model-based collaboration sharpens this tension rather than relaxing it: autoregressive decoding and multi-round large language model (LLM) debate add latency orders of magnitude above the control loop budget, so practical systems must cache pretrained representations, quantize the shared backbone, and confine language-level reasoning to non-time-critical layers (e.g., mission replanning) while the perception-communication stack continues to operate at sub-second cadence. These deployable operating points, not the the- oretical optimum of the Lagrangian, define the realistic envelope within which GCI can be fielded today. 5 Embodied Synergy The methods surveyed in this section span collaborative active perception, multi-agent reinforcement learning for actuation synergy, and shared intent and predictive coordination, as organized in Table 5. The evolution of GCI is currently navigating a fundamental transition: moving from the passive synthesis of a global semantic manifold to the execution of coordinated actuation in unconstrained physical environments. This progression necessitates a shift from a perception-only paradigm toward a tightly coupled action-perception loop. In this context, embodied synergy refers to the collective 19 ability of a swarm to treat its physical movements and spatial configurations as strategic tools to actively reduce the entropy of its internal world model. By closing this loop, the swarm transforms from a group of distributed observers into an adaptive sensing-and-action system capable of purpose- ful environmental interaction. However, embodied coordination also introduces risks of cascading actuation errors and communication-induced instability, particularly when multi-agent reinforce- ment learning (MARL) policies trained in simulation are deployed without hardware-in-the-loop validation; these failure modes are examined in Section 9. This section examines the mechanisms that enable embodied synergy along three axes. We first formalize collaborative active percep- tion, where the swarm treats its physical distribution as a controllable variable for information gain. We then examine multi-agent reinforcement learning architectures that map the shared neural manifold to distributed control signals. Finally, we discuss shared intent prediction and hetero- geneous coordination, where agents jointly anticipate future states and exploit complementary physical niches. 5.1 Collaborative Active Perception Traditional collaborative systems are predominantly reactive, processing whatever sensory data the environment happens to provide. However, in complex or adversarial scenarios, sensing and moving cannot be decoupled. This subsection operationalizes the third condition of cognitive synergy, i.e., proactive informational foraging (Section 2), by treating the swarmâs physical distribution as a controllable variable to optimize information gain [76]. The formal objective of collaborative active perception is to select agent poses p i N i=1 that maximize the expected information gain about the world state Y: max p 1 ,...,p N I Y; O 1 (p 1 ),..., O N (p N ) â N X i=1 C move (p i , p curr i ),(4) where O i (p i ) is the observation that agent i collects at pose p i , and C move (¡) penalizes the movement cost from the current position p curr i . Equation 4 captures the dual nature of embodied synergy: the first term drives agents toward viewpoints that maximally resolve the collectiveâs residual uncertainty (e.g., peering behind an occluding structure), while the second term ensures that repositioning is energy-efficient. In practice, online optimization requires learned approximations: MARL policies that map the current collective belief state to viewpoint-optimizing actions [77, 78]. For instance, in a disaster response scenario, an aerial drone may detect a high-uncertainty region behind a collapsed structure and autonomously command a ground rover to move to a specific coordinate that maximizes the perceptual dividend [79]. Recent advances leverage MARL to train agents to act as active scouts. Frameworks like CSAOT [31] reward agents not for individual detection accuracy, but for their contribution to the collectiveâs uncertainty reduction. This leads to the emergence of complex, coordinated behaviors such as tracking evasive targets or conducting top-down scouting, in which UAVs hover at spe- cific altitudes to provide the optimal geometric prior for ground-based vehicles. This bidirectional flow, where perception guides movement, and movement optimizes perception, is the cornerstone of 20 embodied resilience [80]. 5.2 Multi-Agent Reinforcement Learning Closing the loop requires mapping the shared neural manifold directly to distributed control signals. This is facilitated by MARL architectures that utilize the shared world representation (e.g., fused BEV features in V2X settings) as a common observation space for policy optimization [81]. Policy-Aware Feature Fusion and Intent Negotiation. Unlike standard fusion which aims for generic reconstruction, policy-aware fusion prioritizes features that directly influence the value function of the collective mission [75]. In high-stakes environments like unsignalized intersections, agents exchange intent-encoded latent features [82] to support decentralized negotiation of passing order and speed profiles; the domain-specific deployment of such intent sharing is discussed in Section 7. Game-theoretic language is useful for formalizing these interactions, but practical systems still require explicit safety constraints, communication-delay handling, and fallback policies [83, 84]. End-to-End Cooperative Driving and Vision-Language Integration. A significant advance in closing the perception-action loop is the emergence of end-to-end cooperative driving frameworks that directly map shared sensory inputs to driving actions. Coopernaut [71] pioneers this direction by training an end-to-end model that fuses voxel-based LiDAR representations from multiple vehicles, demonstrating a 40% improvement in navigation success rate over egocentric baselines on accident- prone scenarios while requiring five times less bandwidth than conventional late-fusion methods. More recently, V2X-VLM [85] introduces large vision-language models (VLMs) into cooperative au- tonomous driving, transforming multi-agent coordination from reactive feature sharing to proactive semantic reasoning. By fusing vehicle-mounted camera views, infrastructure sensor data, and tex- tual position embeddings within a unified VLM, V2X-VLM enables agents to communicate explicit driving intentions, reasoning rationales, and coordination decisions in natural language, establishing a highly interpretable medium for collective decision-making that significantly enhances safety and operational throughput in dense urban environments. These end-to-end approaches complement the modular architectures discussed above by demonstrating that the perception, communication, and planning stages can be jointly optimized within a single differentiable pipeline. Beyond single-scene reasoning, vision-language-action (VLA) models extend the cooperative-driving pipeline to the ac- tuation layer, mapping shared perceptual tokens directly to decentralized control outputs so that perception, communication, and planning are optimized inside a single pre-trained policy [86]. In het- erogeneous V2X fleets, natural-language intent offers a modality-agnostic lingua franca that survives sensor asymmetry between, for example, a camera-equipped micro-car and an infrastructure-side Li- DAR node. The binding constraint in this driving setting is latency: autoregressive decoding of a multi-billion-parameter backbone is incompatible with the sub-second control loop required for col- lision avoidance, so deployable designs relegate language-level reasoning to non-time-critical layers such as mission replanning while a lightweight certified controller retains actuation authority. The broader question of how LLM-mediated multi-agent reasoning and hallucination control should be governed is taken up as a frontier topic in Section 9. MARL Algorithm Families for Collaborative Embodiment. The choice of MARL algorithm 21 significantly shapes the embodied behavior of the swarm [87]. Centralized training with decentralized execution (CTDE) is the dominant paradigm, as it allows agents to access global information during training while acting on local observations at deployment. Actor-critic methods such as MAPPO (multi-agent PPO) [88] extend single-agent proximal policy optimization to multi-agent settings by equipping each agent with a decentralized actor and a centralized critic, and have subsequently been applied to continuous-control cooperative tasks such as formation flight and coordinated navigation, complementing formal-methods-based multi-agent coordination under collaborative task specifica- tions [89]. Value-based methods such as QMIX [90] factorize the joint action-value function into per-agent utilities with a monotonic mixing network, enabling efficient decentralized execution in discrete action spaces, which makes them well-suited for intersection negotiation and channel ac- cess scheduling. MADDPG (multi-agent deep deterministic policy gradient) [91] extends DDPG to multi-agent domains with centralized critics, and has subsequently been applied to UAV cover- age optimization and active perception. In practice, the algorithm choice depends on the action space (continuous vs. discrete), the degree of inter-agent dependency, and the communication topol- ogy: actor-critic methods generally scale better to continuous high-dimensional action spaces, while value-decomposition methods offer stronger convergence guarantees in structured cooperative tasks. Perceptual Credit Assignment in Embodied Tasks. A major challenge in embodied synergy is the credit assignment that determines which agentâs observation is decisive for a successful collective action. Modern GCI motifs utilize counterfactual gradients [68] to reward agents whose shared data significantly shift the collective policy toward a safer or more efficient outcome [92]. This mechanism incentivizes agents to focus their sensing and movement on bottleneck regions of the environment, ensuring that collective actuation remains robust when individual agents have limited local visibility. 5.3 Shared Intent and Predictive Coordination An embodied swarm does not merely react to the current state; it collaboratively predicts future states to pre-emptively resolve conflicts and navigate dynamic obstacles [72]. Joint Future Prediction and Proactive Coordination. By sharing intent tokens within the shared latent manifold [74], agents can perform joint future prediction. Instead of predicting othersâ movements as independent stochastic processes, the swarm models the environment as a coupled dynamic system [73]. This allows for proactive coordination: an agent kilometers away can adjust its trajectory based on the predicted congestion or hazards reported by the swarmâs vanguard, reducing energy consumption and mission time [93, 94]. Generative Predictive Maintenance Under Disconnection. When the communication link is severed, the embodied CI utilizes generative world models to maintain synergy. The agents use learned predictive models to anticipate the missing neighborsâ actions based on historical trajectories and shared mission priors [38]. This ensures a level of graceful degradation where the swarm contin- ues its coordinated maneuver using predicted virtual peers until physical contact is re-established. This predictive loop is vital for operations in GPS-denied or high-interference zones where constant synchronization is impossible [79]. When such world models are grounded in large-scale multi-modal pre-training, they additionally supply language-grounded commonsense priors that fill perceptual 22 gaps no single sensor can resolve: a disconnected ground agent can query its internal model for the most likely class and affordance of an occluded obstacle inferred from partial cues, or roll out counterfactual futures to evaluate alternative maneuvers without live peer confirmation [25]. This reframes the world model not merely as a trajectory predictor but as a generative simulator that lets each agent rehearse coordinated actions against hypothesized swarm states, narrowing the gap between the disconnected sub-teamsâ internal beliefs until physical synchronization is restored. Topographic-Tactical Coupling in Heterogeneous Teams. The action-perception loop is par- ticularly powerful in heterogeneous teams where different agents occupy distinct physical niches. In these systems, synergy is achieved through a functional division of labor. Aerial agents (UAVs) provide a topographic perspective that serves as the long-range intent for the swarm, while ground agents (unmanned ground vehicles, UGVs) provide high-resolution tactical data for short-range exe- cution. The action-perception loop facilitates a hierarchy of control: the UAVâs wide-area perception dictates the UGVâs path-finding, while the UGVâs close-range encounters with obstacles update the UAVâs global occupancy map. This multi-layered synergy allows the team to navigate environments that are far too complex for any homogeneous swarm to handle, such as dense forests or multi-level urban ruins [79, 95]. 5.4 Synthesis Embodied synergy closes the loop between collective perception and multi-agent actuation, enabling swarms to actively shape their environment, resolve sensing uncertainties through strategic move- ment, and execute complex missions with high resilience. Key open challenges include scaling MARL policies to large agent populations without divergence, ensuring safety guarantees during emergent coordinated maneuvers, and bridging the gap between simulation-trained policies and real-world de- ployment with hardware-in-the-loop validation. This bidirectional coupling of âseeingâ and âdoingâ represents a critical dimension of the GCI roadmap outlined in Section 9. The realizability gap is sharpest where embodied synergy meets foundation models: end-to-end VLA policies that jointly output perception and control are hard to certify, their emergent coordinated maneuvers are not yet covered by formal safety analysis, and the compute budget for onboard inference on a micro-UAV is typically 10â30 W, far below what a full multi-billion-parameter backbone demands. Practical near-term deployments therefore favor a layered architecture in which a lightweight, certified reactive controller handles safety-critical actuation while a shared foundation model supplies only higher-level intent and scene understanding, keeping the unverifiable components outside the safety loop. 6 Frontiers of Resilience This section surveys spatiotemporal synchronization, uncertainty quantification, and label-efficient learning as the three pillars of resilient CI deployment. The representative methods and their synergy coverage are cataloged in Table 6. These mechanisms span Dimension 4 (Learning Strategy) and safeguard C1(Semantic Disambiguation), ensuring collaboration resolves rather than amplifies entity identity under real-world degradation. 23 1 Spatiotemporal Asynchrony A. Communication Delay Ît Ego (t)Peer (t-Ît) B. âGhostâ Vehicle in BEV BEV (Ego View) Ego (t)Peer (old state)Peer (current) C. Latent Motion Compensator Aligns Features D. Crisp BEV (Aligned) Ego (t)Peer (aligned) BEV (Ego View) Latent Motion Compensator (LMC) Asynchronous Multi-Agent Features Aligned Features í í íŹ í íିâí íˇ í í íŹ í í íˇ 2 Epistemic Uncertainty A. Occlusion by Large Vehicle B. Uncertainty Heatmap (BEV) Before RSU Assistance (High Variance) After RSU Assistance (Low Variance) High Uncertainty LowHigh Low Uncertainty (Safe) C. Trusted Belief Injection via Inverse-Variance Fusion Ego Belief (High Variance) Variance: í íŹ í RSU Belief (Low Variance) Variance: í íš í í í ŕľ í íŹ í íŹ í ŕľ í íš í íš í í í íŹ í ŕľ í í íš í D. Improved Confidence Safer Planning Fewer False Positives Graceful Degradation 3 Semantic Scarcity A. Unlabeled Cross-View Data B. CoDTS: Dual-Teacher Dual-Branch Student Framework C. Training Objective D. Outputs RSU Ego Camera Peer Camera Unlabeled Teacher íť í´ (Mainstream) Teacher íť íş (Supplementary) Mainstream Pseudo-Labels (í í´ ) Supplementary Pseudo-Labels (í íş ) Student íş (Dual-Branch) Adaptive Gating (Îť) Branch íş Branch í´ í í ŕľ í í í íŹ í ŕľ í í íš í íŕľí¡í í´ ŕľ áşíŕľíáťÂˇí íş + Consistency + Regularization Mainstream Prediction Supplementary Prediction Figure 6: The âthree shadowsâ of distributed collaborative perception and their corre- sponding structural resilience mechanisms. The taxonomy addresses three foundational sys- temic vulnerabilities in collective intelligence: (1) Spatiotemporal Asynchrony (The Temporal Shadow): Communication latency ât and coordinate misalignments inherently induce catastrophic ghosting artifacts and localization degradation. This is mitigated through proactive neural manifold warping or predictive motion compensation networks that dynamically project stale historical fea- tures onto the current temporal baseline. (2) Epistemic Uncertainty (The Spatial Shadow): Localized line-of-sight occlusions (e.g., dynamic obstacles or blind spots) result in high-variance, un- certified feature volumes. The framework counteracts this by quantifying evidential uncertainty dis- tributions and performing inverse-variance-weighted belief consensus to neutralize perceptual blind spots. (3) Semantic Scarcity (The Annotation Shadow): The high cost of multi-view coop- erative annotation creates a severe training bottleneck. This is structurally resolved via the Dual Teacher-Student (CoDTS) paradigm, which distills mainstream and supplementary pseudo-labels from massive unlabeled data streams to achieve label-efficient collaborative optimization. High-entropy real-world deployments necessitate a fundamental shift from static data fusion to resilient cyber-physical synthesis. In the open world, CI confronts extreme perceptual entropy induced by the âthree shadowsâ of distributed systems (see Figure 6): spatiotemporal asyn- chrony [69], epistemic uncertainty [99], and semantic scarcity [100]; the latter is a domain- general challenge that is amplified in collaborative settings by the combinatorial explosion of multi- agent, multi-view annotation, rather than a collaboration-specific shadow per se. Three interlocking mechanisms underpin resilient CI. Spatiotemporal synchronization, which encompasses neural mani- fold warping and latent motion compensation, aligns distributed observations across space and time. Uncertainty quantification serves as the architecture of trust (including Byzantine-robust aggrega- 24 Table 6: Taxonomy of resilience methods and cognitive synergy conditions. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy ROBOSAC [96]2023Intermed.Byzantine-awareDecentr.Supervised + Robust V2XC1 GevBEV [47]2023 Intermed. Periodic + EDLCentr.EDL + SupervisedV2XC1C2 MRCNet [97]2024Intermed.On-demand (motion)Decentr.Supervised + GRUV2XC1 V2X-INCOP [98]2024Intermed.Predictive recoveryDecentr.Supervised + KD V2XC1 MOT-CUP [99]2024 Intermed. Saliency (uncertainty)Decentr.EDL + BayesianV2XC1C2 MA-SUE [100]2024Intermed.PeriodicDecentr.SSL (Contrastive)V2XC1 Collab. NeRF [101]2024 Intermed. PeriodicDecentr.SSL (Photometric) UxSC1 CoDTS [102]2025 Intermed. PeriodicDecentr.Semi-supervised (KD)V2XC1 Abbreviations: LMC = Latent Motion Compensation, GRU = Gated Recurrent Unit, KD = Knowledge Distillation, EDL = Evidential Deep Learning, SSL = Self-Supervised Learning, Decentr. = Decentralized, Centr. = Centralized. Synergy Conditions: C1= Semantic Disambiguation,C2= Pragmatic Exchange,C3= Proactive Foraging. tion). Label-efficient learning, including consensual contrastive learning and domain generalization, opens the path toward autonomous semantic evolution when annotations are scarce. Each mecha- nism is examined in turn below. 6.1 Spatiotemporal Synchronization CI is inherently sensitive to the stochastic jitters of the physical and network layers. In high-mobility scenarios, such as V2X or high-speed UAV swarms, the latency can result in a multi-meter spatial deviation, rendering naive fusion catastrophic [69]. Neural Manifold Warping and Pose-Noise-Awareness. Geometric offsets between agents in- duced by individual odometric drift, IMU bias, or GPS-denied conditions often result in ghosting artifacts where the fused manifold contains duplicate or misaligned entities. Modern architectures, such as V2X-ViT [23] and CoBEVT [24], depart from rigid geometric registration, employing pose- noise-aware training (PNAT), which treats spatial calibration as a learned, soft-constrained opti- mization problem. By injecting synthetic spatial noise during the learning phase, the neural mani- fold develops an inherent spatial smoothness, allowing transformer-based attention mechanisms to conceptually align features when coordinate frames are misaligned by several meters. To resolve the non-linearities of odometric drift, recent works utilize spatial transformer network (STN) based intermediate modules [103] that predict a homography or affine transformation matrix in the fea- ture space, aligning the BEV representations of neighbors with the ego-vehicleâs frame through end-to-end backpropagation. Complementing these training-time and alignment-based strategies, CoAlign [104] has become a canonical framework for pose-error-robust intermediate fusion: it mod- els an agent-object pose graph to enhance cross-agent pose consistency and applies multi-scale data fusion, correcting unknown localization errors without requiring ground-truth poses during training. Temporal Latent Motion Compensation (LMC). Temporal discrepancies caused by network congestion or heterogeneous processing latencies are a primary source of fusion error. Rather than fusing stale information, modern frameworks utilize LMC to predict the future of received features. By utilizing a velocity-aware warping module [61], agents project received feature tensors into the current ego-timestamp, ensuring that the collective consensus is synchronized in the time domain. Frameworks such as SyncNet [69] utilize optical flow or latent flow estimation to reconstruct missing 25 temporal intermediate states, ensuring that the fused world model remains a high-fidelity represen- tation of the t-now state rather than a blurred mosaic of the t-past. Robust Communication Under Interruptions and Packet Loss. MRCNet [97] employs multi- scale robust fusion with GRU-based motion compensation for feature recovery during dropout; V2X- INCOP [98] uses communication-adaptive spatial-temporal prediction with knowledge distillation, achieving cooperative gains exceeding 12% across three benchmarks under high packet loss. 6.2 Uncertainty Quantification A critical capability for resilient CI is the ability to quantify what is not known. To prevent the poisoning of the global world model by a faulty, spoofed, or severely occluded agent, CI frameworks move beyond naive weighted averaging toward trust-centric Bayesian aggregation. Bayesian Epistemic Propagation and Conformal Prediction. Instead of sharing point es- timates that lack a measure of reliability, agents share probabilistic distributions. For a predictive model with parametersθ trained on dataset D, the total predictive uncertainty at a single query input x â decomposes into aleatoric and epistemic components as in Eq. 5 (we retain the standard per-input Bayesian notation here: x â is a single query, y â its model prediction, consistent with the world-state estimate Ë Y of Section 2 aggregated over all queries): Var[y â | x â ,D] | z Total Uncertainty =E θ [Var[y â | x â ,θ]] |z Aleatoric (sensor noise, irreducible) +Var θ [E[y â | x â ,θ]] |z Epistemic (model ignorance, reducible) .(5) In collaborative settings, epistemic uncertainty concentrates in regions occluded from the ego-agent but visible to neighbors, providing a principled basis for inverse-variance-weighted Bayesian aggre- gation [47, 99]. Conformal prediction layers add statistical coverage guarantees [105]. Adversarial Robustness and Error Isolation. In contested environments, a single compromised agent can inject phantom obstacles to paralyze the swarm. By monitoring the consensus entropy, the swarm can detect agents whose reported features significantly deviate from the collective belief manifold. CI systems utilize M-estimators and robust loss functions (e.g., Huber loss or Tukey loss) to automatically down-weight or quarantine outlier agents. Drawing from distributed computing theory, Byzantine-robust aggregation methods originally developed for distributed gradient SGD (e.g., Krum or Median-based fusion) [106] are being adapted to the neural feature space, ensuring that as long as a sufficient majority of agents are functional, the collective world model remains anchored in reliable perceptual evidence [96, 107, 108]. 6.3 Label-Efficient Learning The annotation bottleneck lies in the immense cost of manually labeling multi-agent, multi-modal datasets. This remains a primary barrier to scaling collaborative intelligence. Consensual Contrastive Learning (CCL). By exploiting the inherent redundancy of overlapping fields of view, agents can treat their neighborsâ perspectives as pseudo-labels for their own occluded views. MA-SUE [100] utilizes contrastive loss to align features from different agents observing 26 the same scene. For instance, if Agent A sees the front of a car and Agent B sees the back, the CCL objective forces the latent representations of both agents to be consistent with a unified 3D object concept, effectively teaching each agent to infer the complete structure of an object from a partial view without any human intervention. Recent advances in collaborative neural radiance field (NeRF) approaches [101] or Gaussian Splatting [109] allow agents to build a high-fidelity 3D radiance field collectively, where the photometric consistency between distributed viewpoints acts as a strong supervisory signal, enabling the swarm to learn geometry and semantics through the sheer volume of distributed observations. Dual Teacher-Student Frameworks. CoDTS [102] introduces a dual teacher-student paradigm with static and dynamic pseudo-label generation, maintaining robust detection with as few as 10% labeled data across V2X-Sim and OPV2V, demonstrating label-efficient collaborative perception without reliance on fully supervised training. Domain Generalization and the âSim-to-Realâ Bridge. To overcome the scarcity of real- world edge cases (e.g., accidents or extreme weather), researchers utilize high-fidelity simulated environments such as V2X-Sim [28]. Heterogeneous teams comprising high-end infrastructure, mid- tier autonomous vehicles, and low-cost micro-drones suffer from feature-level divergence; recent works [110] introduce domain adversarial neural networks (DANN) [111] to reconcile these discrep- ancies, ensuring semantic equivalence where the representation of a pedestrian remains invariant regardless of whether the data comes from a 128-beam LiDAR or a low-resolution monocular cam- era. Furthermore, by using diffusion models to synthesize adversarial weather (e.g., heavy fog or snow) on top of clear-day data, the swarm can be pre-trained to maintain perceptual stability in hostile environments [48]. 6.4 Synthesis Spatiotemporal synchronization, uncertainty quantification, and label-efficient learning, the three frontiers surveyed above, collectively advance CI from brittle, sensor-sharing configurations toward resilient, self-healing architectures. By integrating uncertainty-aware fusion with neural manifold warping, future GCI systems can maintain identity persistence and semantic clarity even in con- tested, degraded, and unpredictable operational environments. Label-efficient self-supervision closes the loop by reducing dependency on costly multi-agent annotations. Together, these mechanisms form the resilience backbone of the GCI roadmap, as organized in Table 7. 7 Domain-Specific Synergy The synergy methods surveyed in this section and their mapping to the five-dimensional taxonomy and C1âC3 conditions are listed in Table 8. The transition from deterministic data fusion to adaptive cognitive synergy is crystallized across four primary strategic domains: connected and automated vehicles (CAVs), UxS, industrial logistics, and smart cities, as illustrated in Figure 7. V2X is the only domain with routine cross-method comparison; UxS, industrial logistics, and smart-city CI remain at earlier maturity stages. 27 Table 7: The âThree Shadowsâ of collaborative resilience: systemic vulnerabilities, mech- anisms, and open challenges. Each shadow exposes a distinct failure surface in distributed per- ception; the corresponding mechanisms represent the current state of the art in addressing them. Systemic Vulnerability Root CauseKey MechanismsRepresentative MethodsOpen Challenges Spatiotemporal Asynchrony Communication latency, heterogeneous clocks, coordinate misalignment Neural manifold warping (PNAT), latent motion compensation (LMC), motion-aware robust communication V2X-ViT [23], CoBEVT [24], SyncNet [69], MRCNet [97], V2X-INCOP [98] Real-time inference under ms latency budgets; formal alignment guarantees for safety-critical settings Epistemic Uncertainty Sensor degradation, adversarial agents, occlusion Evidential deep learning (EDL), conformal prediction, inverse-variance Bayesian aggregation, Byzantine-robust fusion MOT-CUP [99], GevBEV [47], ROBOSAC [96], Krum/Median [106] Provable Byzantine resilience with formal convergence guarantees; runtime uncertainty calibration on embedded hardware Semantic Scarcity High multi-view annotation cost, domain shift across deployments Consensual contrastive learning (CCL), dual teacher-student (CoDTS), domain adversarial adaptation (DANN) MA-SUE [100], CoDTS [102], domain generalization [110] Closing the sim-to-real generalization gap; scaling to diverse real-world edge cases with minimal supervision Table 8: Taxonomy of domain-specific methods and cognitive synergy conditions. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy Collab. SLAM [112]2019Intermed.PeriodicDecentr.SLAMUxS+Log.C1 MRSLAM [113]2020 Intermed. PeriodicDecentr.SLAM + SupervisedUxS+Log.C1 BM2CP [114]2023Intermed.PeriodicEdge (RSU)SupervisedV2XC1C2 HM-CoPept [115]2025Intermed.PeriodicHybridSupervisedV2XC1C2 AccBEV [116]2025 Intermed. Gen. Reconstr. (CVAE)Decentr.Supervised + Gen. V2X C1C2 V2X-DGW [48]2025Intermed.PeriodicHybridSupervised + DGV2XC1 Abbreviations: RSU = Roadside Unit, CVAE = Conditional Variational Auto-Encoder, Gen. = Generative, DG = Domain Generalization, Decentr. = Decentralized. Synergy Conditions:C1= Semantic Disambiguation,C2= Pragmatic Exchange, C3= Proactive Foraging. 7.1 Connected and Automated Vehicular Networks (V2X) Autonomous driving represents the most mature and safety-critical application of collaborative intel- ligence. The V2X perception field benefits from a rich ecosystem of standardized, openly available benchmarks (OPV2V [26], DAIR-V2X [32], V2X-Sim [28], V2V4Real [117], and V2X-Seq [118]), with over a dozen methods evaluated under comparable conditions, making it the only CI domain where rigorous cross-method comparison on shared benchmarks is routinely feasible. The integration of vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communication creates a networked perception system that extends beyond the physical and computational limits of individual onboard sensor suites [15], a direction extended by parallel-driving foundation-model frameworks [119] and multidimensional self-driving interactive-cognition models [120]. Occlusion Resiliency and Perceptual Horizon Extension. In high-density urban environ- ments, failures in ego-centric perception are frequently induced by the dynamic occlusion paradox, where moving large-scale actors (e.g., buses, trucks) hide safety-critical entities. CI mitigates these risks by reconstructing the neural manifold from non-overlapping, distributed viewpoints. To main- tain robust situational awareness during sensor degradation, BM2CP [114] and HM-CoPept [115] utilize high-fidelity geometric priors from fixed roadside infrastructure to guide the feature ex- traction of mobile agents, enabling vehicles with low-cost sensor suites to achieve quasi-LiDAR spatial reasoning by borrowing the geometric certainty of roadside units (RSUs). To optimize the communication-fidelity trade-off, architectures such as Fusion2comm [35] dynamically prioritize bandwidth for occluded foreground features, while systems like AccBEV [116] employ conditional variational auto-encoders (CVAE) and normalizing flows to synthesize shared features in the BEV 28 Collaborative Intelligence Distributed Sensing Communication-aware Fusion Proactive Information Acquisition ďźInventory & Asset Tracking ďźCollaborative Robots & AGVs ďźSafety & Anomaly Detection ďźV2X Perception & Safety ďźDynamic Traffic Management ďźCooperative Decision-Making ďźAir/Water Quality Sensing ďźEcosystem & Habitat Monitoring ďźPollution Source Identification ďźCrowd & Event Monitoring ďźPublic Safety & Emergency Response ďźUrban Resource Optimization 1 Connected Mobility (CAVs) 2 Smart City Public Services 3 Industrial Logistics 4 Environmental Monitoring Figure 7: Domain-specific synergy across collaborative-intelligence deployments. The illustration links four application contexts (industrial logistics, connected mobility, smart-city pub- lic services, and environmental monitoring) to the shared requirement for distributed sensing, communication-aware fusion, and proactive information acquisition. manifold, effectively extending the perception horizon beyond the vehicleâs physical line-of-sight [41, 121]. Occluded object detection (see also the robustness discussion in Section 6) remains an active area, with dedicated reviews cataloging methods that leverage temporal consistency, contextual rea- soning, and multi-view fusion to recover objects hidden behind dynamic obstacles [122]. Real-world V2X communication also suffers from asynchronous clocks and network jitter; the spatiotemporal synchronization techniques detailed in Section 6 (e.g., latent motion compensation and velocity-aware feature warping) are especially critical in high-mobility V2X scenarios, where millisecond-level delays translate to meter-level spatial errors at highway speeds. Intersection Safety and Infrastructure-Augmented Coordination. Unsignalized intersec- tions represent high-risk zones where occlusions and unpredictable pedestrian movements converge 29 into dangerous corner cases [123, 124]. RSUs act as distributed anchor nodes, performing data as- sociation across heterogeneous sensor streams to resolve trajectory inconsistencies in real-time [51, 125], and provide an augmented global view that utilizes historical traffic flow priors and multi- modal fusion to offer localized driving strategies that preemptively resolve potential conflicts [55, 126]. To ensure system continuity during RSU downtime or network partitions, decentralized strate- gies leverage peer-to-peer V2V coordination. By sharing intent-encoded latent features, vehicles collaboratively optimize passing orders and speed profiles, shifting from reactive braking to proac- tive flow optimization and creating a fluid traffic state where throughput is maximized without the need for traditional signaling [83, 84]. Resilient Platooning and Adverse Weather Perception. Platooning uses high-speed V2V synchronization to bypass human reaction latencies, drastically reducing aerodynamic drag and energy consumption [93, 94]. This synergy is most critical during adverse weather operations (e.g., heavy rain, dense fog, or snow), where individual sensors suffer from severe signal scattering and optical attenuation [49, 127]. CI provides a redundant and weather-invariant informational layer: frameworks such as V2X-DGW [48] utilize adversarial domain adaptation to extract weather-proof features, correlating LiDAR returns with camera-based semantics from multiple agents to maintain clear collective sight when individual sensors are effectively blinded. Furthermore, systems can integrate uncertainty quantification, where each agent attaches a confidence score to its shared data based on localized weather intensity, allowing the fusion node to dynamically weight the most reliable sensor sources [128]. 7.2 Unmanned Aerial and Heterogeneous Systems (UxS) Unmanned aerial systems (UAS) introduce a critical vertical dimension to the collaborative man- ifold, acting as rapidly deployable aerial sensors that provide a topographic perspective difficult for ground agents to obtain [129, 130]. Compared with the V2X domain, the UxS collaborative perception literature is smaller in volume and less standardized: several collaborative-native bench- marks have recently emerged (including CoPerception-UAV [21], U2UData [131], UAV3D [132], Griffin [133], AGC-Drive [134], CoPeD [135], and AirCopBench [136]), yet reported results are still derived mostly from single-study simulation validations rather than multi-team benchmark com- parisons. The discussion below therefore reflects the state of an emerging rather than a mature subfield. Proactive Surveillance and Search-and-Rescue. UAV swarms utilize superior maneuverability to access GPS-denied or hazardous disaster zones where ground access is impossible [129, 130]. In search-and-rescue (SAR) missions, timely information acquisition is the decisive factor for survival: integrated air-ground networks, in which UGVs collect high-resolution ground data while UAVs provide wide-area detection, represent an effective form of heterogeneous synergy [137, 138], and swarms utilize collaborative SLAM to map debris and locate victims simultaneously under a unified coordinate frame [139]. In the active perception paradigm, agents do not merely observe; they co-optimize perception and actuation using multi-agent deep reinforcement learning (MADRL), with aerial agents dynamically adjusting their flight paths to minimize global estimation entropy 30 and strategically positioning themselves to peek behind rubble or through windows to maximize collective information gain [31, 95]. Precision Industrial Inspection and High-Resolution Photogrammetry. Collaborative UAS perform high-resolution photogrammetry and multi-spectral remote sensing for industrial au- tomation [140]. For critical infrastructure such as high-voltage powerlines and bridges, agents col- laboratively perform 3D reconstruction, eliminating the self-occlusion inherent in complex geometric structures by sharing viewpoints in real-time [141]. In precision agriculture, swarms exchange multi- spectral maps to monitor crop health, enabling synchronization of fertilization at the centimeter scale. In this scenario, one agent detects nitrogen deficiency and another autonomously triggers localized spraying, closing the perception-action loop across the entire swarm [142]. 7.3 Industrial Logistics and Warehouse Robotics The evidence base for collaborative perception in industrial logistics remains fragmented: research is distributed across application-specific systems and proprietary industrial deployments, and stan- dardized benchmarks comparable to OPV2V [26] or DAIR-V2X [32] do not yet exist for ware- house and logistics settings. Reported results often reflect single-vendor deployments rather than multi-team comparative evaluations. The discussion below therefore surveys emerging capabilities rather than mature, benchmark-validated systems [17]. With this caveat, the domain shows con- siderable promise: in the confined and dynamic environments of smart warehouses, collaborative intelligence enables coordinated operation from isolated robots toward synchronized, self-optimizing logistics [143, 144]. Swarms of micro-drones and ground-based autonomous mobile robots (AMRs) share motion states and feature descriptors to mitigate the odometric drift that plagues single-agent SLAM in feature-poor environments (e.g., long aisles of identical shelves) [112, 145], and advanced frameworks such as MRSLAM [113] reconcile extreme viewpoint disparities (aerial-to-ground) to ensure globally consistent mapping in utility tunnels and automated ports [79, 146]. Furthermore, AMRs maintain real-time communication with overhead assets to optimize sorting and inventory tracking [147]. This crowd-sourced perception enables global routing optimization in large-scale smart ports and deep mines, significantly reducing idle times, fuel consumption, and operational carbon emissions. The system acts as a distributed scheduler: perception of a blockage in one sector is instantly propagated to reroute the entire fleet [16, 144, 148, 149]. 7.4 Smart Cities The ultimate scaling of collaborative intelligence moves beyond physical navigation toward social and environmental intelligence, where the swarm acts as the distributed nervous system of the urban environment [130, 150]. It should be noted, however, that smart-city CI applications remain predominantly at the prototype and simulation stage, with limited large-scale, multi-city validation; the discussion below surveys emerging directions and conceptual prototypes rather than mature, benchmark-validated deployment practices. Crowd Management and Public Safety Ecosystems. ( C1C2 ) UAV-based monitoring networks provide a wide-area perspective for real-time crowd density estimation and emergency evacuation 31 planning [150]. By sharing and fusing thermal and optical data, swarms can reveal congestion levels in blind spots (e.g., behind stadium exits or subway entrances), enabling authorities to intervene with sub-minute latency during critical safety incidents. Modern urban swarms integrate Federated Learn- ing and Differential Privacy, allowing agents to collaborate on crowd analysis without transmitting identifiable facial data, thus aligning technological utility with global privacy mandates [130, 151]. Tiered Multi-modal Environmental Monitoring. ( C1C2) CI serves as a vital tool for large- scale environmental protection and pollution tracking [151]. UAV swarms perform multi-point coop- erative sensing for 3D air quality mapping. Unlike static sensors, the swarm can trace the 3D plume of a gas leak in real-time, identifying localized sources that would be missed by traditional monitor- ing stations [152]. In maritime domains, the integration of autonomous surface vehicles (ASVs) and UAVs allows for tiered monitoring: UAVs identify pollution belts (e.g., oil spills) from the air using hyper-spectral imaging, guiding ASVs to conduct close-range, high-resolution water measurements at the exact coordinates of the plume. This hierarchical approach ensures that environmental data are both wide in scope and high-fidelity in detail, enabling rapid response to ecological threats [153, 154]. Toward a Global Semantic Manifold. The domain-specific synergies described above will con- verge into a global semantic manifold. The distinction between car perception, drone mapping, and infrastructure sensing will dissolve. All autonomous agents can contribute to and draw from a shared, real-time digital twin of the physical world. This will require the resolution of significant open challenges in elastic fusion to dynamically scale its collaborative depth based on real-time mis- sion criticality and available bandwidth. This ensures that the collective sight of the swarm remains resilient in the face of the ever-increasing complexity of human-centric environments. 8 Trustworthy Synergy Trustworthy CI requires balancing functional safety under operational uncertainty with privacy preservation during sensitive data exchange. This section examines four axes: system safety and resilience, privacy-preserving collaboration, the safety-privacy-utility trade-off, and policy-aware GCI including liability, fairness, and standardization. A taxonomy of the representative methods is provided in Table 9. This section provides the trust guarantee for C1 â C3 , examining the safety, privacy, and accountability mechanisms that ensure collaboration introduces no new failure modes or unresolved liability. 8.1 System Safety and Resilience Ensuring the safety of a collaborative swarm is essential to its transition from controlled testbeds to open-world deployments. In the context of GCI, safety is redefined as a multilayer defense architecture that transcends individual reliability to ensure collective resilience across functional, data, and temporal dimensions. Functional Safety and Certified Robustness. The integration of collaborative perception into safety-critical pipelines necessitates compliance with international safety standards, e.g., ISO 26262 [159] and ISO 21448 (SOTIF) [160]. These standards require a rigorous quantification of 32 Table 9: Taxonomy of trustworthy CI methods and cognitive synergy conditions. Methods are mapped onto the proposed five-dimensional framework. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy TruPercept [107]2020Intermed.Trust-awareDecentr.Supervised + TrustV2XC1 Oblivious Fusion [155]2021Intermed.Periodic (secret-shared)Decentr. (SMPC)Supervised + SMPCV2XC1 FedDrive [156]2022Intermed.Periodic (gradients)Decentr. (FL)FL + SupervisedV2XC1 Byz.-Robust [108]2024Intermed.Byzantine-robustDecentr.Supervised + RobustV2XC1 FedCP [157]2024Intermed.Periodic (gradients)Decentr. (FL)FL + SupervisedV2XC1 Secure MKHE [158]2024Intermed.Periodic (encrypted)Centr. (HE)Supervised + HEV2XC1 Abbreviations: FL = Federated Learning, HE = Homomorphic Encryption, SMPC = Secure Multi-Party Computation, Decentr. = Decentralized, Centr. = Centralized. Synergy Conditions: C1= Semantic Disambiguation,C2= Pragmatic Exchange,C3= Proactive Foraging. safety of the intended functionality, where the swarm must mitigate risks arising from erroneous perception events, such as failing to detect a pedestrian due to shared data noise. To provide mathematical guarantees in high-stakes environments, modern research leverages cer- tified robustness via Randomized Smoothing [161]. Unlike empirical robustness, this method con- structs a smoothed classifier by injecting controlled Gaussian noise into the feature-sharing process. This ensures that the collective world model remains provably consistent under bounded L 2 pertur- bations in the input space, effectively insulating the swarm against environmental disturbances or so- phisticated adversarial attacks that might otherwise induce catastrophic decision-making errors [162]. Data Trustworthiness and Adversarial Resilience. In a decentralized swarm, the integrity of the shared world model is paramount [107]. The system must resolve the information credibility problem: how to distinguish between a genuine observation and a malicious or faulty signal. Trust- aware fusion frameworks address this by assigning time-varying reliability scores to each node based on latency, spatial consistency, and historical performance. To counter deliberate manipulation, such as the injection of phantom obstacles into the shared BEV manifold, the system employs methods such as ROBOSAC [96], accepting only detections confirmed by multiple independent viewpoints to filter out spoofed data and ensure that the collective belief is anchored in physical reality [108]. Fail-safe Fallback, Asynchrony, and Graceful Degradation. Runtime monitors detect tempo- ral inconsistency from heterogeneous clocks and network jitter, triggering conservative fallback before erroneous perception propagates to the planning stack [69]. When communication quality drops be- low safety-critical thresholds, DRL-optimized policies autonomously transition from collaborative to local perception mode, redistributing trust among local sensors based on epistemic uncertainty; in cases of total isolation, the agent maintains operation by relying on its local sensors [163]. 8.2 Privacy-Preserving Collaboration Sharing high-dimensional data across networks risks exposing personally identifiable information (PII), such as facial features, license plates, and movement trajectories [164, 165]. Data Exposure and Differential Privacy. To satisfy global privacy mandates (e.g., GDPR), researchers are integrating differential privacy (DP) into the perception pipeline. By applying DP to shared feature maps [166] and trajectories [167, 168], the system ensures that an adversary cannot reconstruct the specific identity of a vehicle or its passengers from the shared latent space. Further- 33 Table 10: Comparative overview of privacy-preserving techniques for collaborative per- ception. Each paradigm occupies a distinct position in the trade space between protection strength, communication overhead, and real-time feasibility. TechniqueProtection Granularity Comm. Overhead Accuracy Penalty Real-TimeRepresentative Work Differential Privacy (DP)Feature / trajectoryLowModerateHigh Feature-map DP [166], trajectory DP [168], DP-aware fusion [172] Federated Learning (FL)ModelModerateLowModerate FedDrive [156], FedCP [157], Hierarchical FL [170] Homomorphic Encryption (HE)Raw data / featureVery highNoneLowSecure MKHE [158] Secure Multi-Party Computation (SMPC)Raw data / featureHighNoneLowâMod. Oblivious Fusion [155], SMPC-based fusion [171] more, secure computation and privacy-preserving feature extraction methods [169] are integrated into the collaborative perception pipeline to prevent adversarial reconstruction of sensitive scene information while preserving the geometric features required for the navigation task. Privacy-Preserving Computation Architectures. The shift toward GCI necessitates archi- tectures that decouple utility from access. Federated learning (FL) for perception, exemplified by FedDrive [156], Hierarchical FL [170], and FedDWA [157], allows agents to collaborate on model training by sharing gradient updates instead of raw data. This data-local, model-global approach ensures that raw sensory streams never leave the individual agentâs hardware. High-level synergy is further enabled by homomorphic encryption (HE) and secure multi-party computation (SMPC): HE allows the fusion node to aggregate features while they are still in an encrypted state, ensuring that the central unit has no access to the plain text [158], while SMPC splits features into secret shares so that no single participant, including the aggregator, can reconstruct the private data of another [155, 171]. Recent work extends privacy-preserving collaboration to open-world settings with unknown collaborators, where agents that have not previously registered or shared keys must still be able to contribute securely to the collective perception task [172]. Table 10 provides a comparative overview of the principal privacy-preserving paradigms and their operational trade-offs. The Safety-Privacy-Utility Triad. The selection of a fusion level (see Section 3 for architectural taxonomy) is the primary driver of the balance across the reliability triangle, which we categorize into three paradigms. Raw data sharing provides the richest context for resolving occlusions but incurs prohibitive privacy risks and massive bandwidth costs, often conflicting with data minimization principles required by international regulations. Feature-level sharing represents the current state- of-the-art middle ground: by sharing compressed neural features rather than raw sensor data, agents preserve the majority of perception gains while reducing the surface area for privacy leakage, though intermediate features remain vulnerable to reconstruction attacks and therefore require explicit privacy-preserving mechanisms. Decision-level sharing offers the highest level of confidentiality by exchanging high-level metadata, but is stochastically brittle because it lacks the corrective power to resolve deep occlusions; agents cannot mutually refine their low-level perceptual hypotheses, leading to a substantial safety drop when local detectors fail. 34 8.3 Policy-Aware GCI As GCI transitions from isolated experimental testbeds to smart cities, its deployment is no longer a functional challenge but a regulatory and ethical one. The transition to a collective architecture necessitates a new framework for policy-aware GCI, where the algorithms are not only optimized for detection accuracy or latency but are also aligned with the principles of legal accountability, algorithmic fairness, and global industrial standards. Liability Attribution: From Neural Fusion to Auditable Traceability. A key legal chal- lenge in GCI is the responsibility gap: when a fused perceptual error leads to a catastrophic decision, identifying the causal contribution of each participant in a decentralized swarm is challenging. A practical traceability layer would log the source agent ID, timestamp, pose estimate, confidence score, communication state, and the compressed feature or decision payload consumed by the fusion module, enabling post-incident forensic reconstruction. Blockchain-based frameworks [173, 174] have been proposed for tamper-proof evidence preservation and reverse liability tracing in autonomous driving, though lighter authenticated logging with trust-modeling mechanisms may be more practical for latency-critical deployments [107]. The key requirement is forensic reconstructability: investiga- tors and runtime monitors must be able to determine whether a failure was dominated by corrupted features, stale packets, pose drift, or downstream planning assumptions. Algorithmic Fairness and Data Sovereignty. Collaborative intelligence must address the struc- tural inequities that arise in heterogeneous multi-agent settings. In a swarm with uneven sensor capabilities, agents with lower-quality sensors can be marginalized during fusion, leading to sys- temic blind spots in specific demographic or geographic zones. GCI envisions fairness-aware fusion that prevents the global manifold from over-indexing on high-end infrastructure data at the expense of mobile agents, countering a digital divide in perception where urban districts with dense RSUs achieve higher safety levels than resource-constrained rural environments [175]. Furthermore, the swarm must treat data as a sovereign asset: federated learning methods [156, 157] allow agents to contribute to the collective intelligence without forfeiting ownership of their raw sensory streams. Standardization Roadmap: Aligning AI Models with V2X Protocols. The widespread adoption of GCI is contingent upon the convergence of neural architectures and telecommunication standards, as exemplified by recent transformer-based V2X perception frameworks [23]. The stan- dardization gap between high-frequency AI iterations and slow-moving regulatory cycles remains a critical hurdle [14]. Current V2X standards (e.g., LTE-V2X, NR-V2X, BSM/CAM message fam- ilies, and the standardized 802.11bd [176] alongside emerging 6G discussions) were not designed for arbitrary neural feature tensors. Near-term interoperability would therefore depend on explicit metadata schemas for shared features (including coordinate frames, timestamps, compression for- mats, uncertainty descriptors, and security credentials), even before any common latent-feature representation becomes standardized. Benchmarks such as V2X-Sim [28] and OPV2V [26] provide useful testbeds, but they should be complemented by protocol-level conformance tests, real-world channel measurements, and alignment with broader robotics middleware and UAV communication standards. 35 Table 11: Taxonomy of open-world CI methods and cognitive synergy conditions. MethodYearStageComm. ParadigmArchitectureLearning StrategyApplicationSynergy Infinity-Driver [177]2024Intermed.On-demandDecentr.Contin. V2XC1C3 RACP [178]2025 Intermed. IB-drivenDecentr.Supervised + IBV2XC1C2 Multi-VLA [86]2025Intermed.On-demand (VLM)Decentr.Pre-trained + VLMMultiC1C2C3 MDrive [179]2026Intermed.PeriodicCentr.Supervised V2XC1C3 Abbreviations: VLM = Vision-Language Model, IB = Information Bottleneck, Contin. = Continual Learning, Decentr. = Decentralized, Centr. = Centralized. Synergy Conditions:C1 = Semantic Disambiguation, C2 = Pragmatic Exchange, C3 = Proactive Foraging. 8.4 Synthesis Trustworthy CI requires balancing safety, privacy, and utility, a triad that governs architectural deci- sions from the choice of fusion level to the design of communication protocols. The four axes surveyed above reveal a field in active tension: functional safety standards and certified robustness provide the regulatory foundation, privacy-preserving computation and differential privacy address the data exposure risks in multi-agent sharing, and policy-aware mechanisms around liability, fairness, and standardization define the socio-technical framework for deployment. Key open challenges include developing real-time Byzantine-robust aggregation with formal convergence guarantees, establish- ing interoperable neural payload standards across regulatory jurisdictions, and designing adaptive systems to navigate the safety-privacy-utility triad as conditions evolve. 9 Open Challenges and Future Directions The trajectory of GCI is currently traversing a fundamental inflection point: moving from task- specific fusion in controlled environments toward open-world cognitive synergy in human-centered environments. Beyond predefined datasets, technical feasibility meets socio-technical complexity. This section focuses on the future-facing pillars of open-world adaptation, pragmatic communication economics, semantic interoperability, embodied information foraging, and human-swarm cognitive integration. Figure 8 summarizes these directions as four converging technical trajectories that link the current collaborative-perception paradigm to the longer-term goal of GCI. Before exploring these trajectories, this section first confronts the fieldâs current limitations: the unresolved tensions and open problems that motivate the research agendas discussed below. The reflection below evaluates where current methods fall short on the five taxonomy dimensions and C1 â C3 , and the future directions chart how to close those gaps. 9.1 Limitations and Critical Reflections While the preceding sections survey the substantial progress in collaborative perception, a candid assessment of the fieldâs limitations is essential for guiding productive future research. We identify five interconnected problem areas that currently constrain the transition from laboratory benchmarks to robust real-world deployment. Benchmark Saturation and Evaluation Fragmentation. The dominant benchmarks [26, 28] 36 Toward General Collaborative Intelligence: Four Converging Research Trajectories 1 2 3 4 Current: 2026 Future: GCI General Collaborative Intelligence Task-Specific Architectures Distributed Foundation Models â˘Single-task 3D detection or segmentation â˘Separate models per domain (V2X, UxS, logistics) Saliency-Based Selection â˘Confidence maps, spatial attention gating â˘Where2comm, Which2comm, InfoCom Value-of-Information Auctions Calibration-Dependent Alignment Platform-Independent Interoperability Reactive Perception Collective Information Foraging â˘Pose-noise-aware training, STN-based registration â˘Domain adversarial adaptation per sensor pair â˘Passive fusion of available sensor streams â˘Open-loop perception â separate planning module â˘Cross-modal zero-shot recognition across swarm â˘Vision-Language-Action models as shared knowledge backbone â˘Universal semantic space for heterogeneous agents â˘Agents bid for bandwidth based on expected perceptual dividend â˘Game-theoretic Nash equilibria for communication scheduling â˘Safety-aware fairness constraints across participants â˘Legacy rover âżstate-of-the-art implicit neural fields â˘Modality-agnostic latent spaces without recalibration â˘DMEs: Deployable Matching Modules, universal alignment layers â˘Swarm autonomously reconfigures physical topology for info gain â˘entropy-driven viewpoint optimization â˘Distributed self-optimizing active sensor network Collaborative Foundation Models Pragmatic Game Theory & Info Economics Hardware-Agnostic Universal Semantics Proactive Swarm Embodiment Multi-modal pretraining, VLM alignment Strategic negotiation, Vol protocols Plug-and-play semantic translation Closing perception-action loop, MARL ďźcross-domain ďźplug-and-play ďźsafety-certified ďźprivacy-preserving Key challenge: Latency, hallucination risk, safety-critical calibration Key challenge: Real-time equilibrium computation, non-stationary environments Key challenge: Cross-manufacturer standardization, latency overhead Key challenge: Safety guarantee as during emergent maneuvers, sim-to- real domain gap Figure 8: Roadmap toward general collaborative intelligence. Four converging research tra- jectories, i.e., collaborative foundation models, pragmatic game-theoretic communication, hardware- agnostic universal semantics, and proactive swarm embodiment, connect the current state of collab- orative perception with the long-term vision of GCI. drive significant progress but now exhibit early signs of saturation: recent methods cluster within a narrow band of a few percentage points on standard average precision (AP) metrics [180], making it difficult to discern genuine advances from hyperparameter tuning and seed variance. Three concerns stand out. First, existing benchmarks involve only 2â5 agents, far below the tens to hundreds in realistic deployments (the scalability implications are discussed separately below). Second, the field relies overwhelmingly on detection-centric metrics (AP, NDS), neglecting communication efficiency, energy consumption, tail-latency, and graceful-degradation profiles. Third, inconsistent data splits, preprocessing, and hyperparameter reporting make cross-paper comparisons unreliable [181], and few works report seed variance. The Reproducibility Gap. A significant fraction of methods in the collaborative perception literature lack publicly available implementations, and among those that do release code, the docu- mentation and configuration files required to reproduce the exact reported results are often incom- plete [182]. This problem is compounded by the inherent training instability of multi-agent systems: small changes in the communication schedule or the order in which agents contribute gradients can lead to substantially different convergence outcomes [183]. Unlike single-agent perception, where architectures and training recipes are extensively documented, multi-agent collaborative training 37 introduces a combinatorial explosion of agent interaction dynamics that makes exact reproduction particularly fragile. Fields such as NLP and computer vision benefit substantially from initiatives like Papers with Code and standardized leaderboards with locked test sets; collaborative perception has yet to establish comparable infrastructure. The Sim-to-Real Gulf. With few exceptions, the empirical results reported in the collaborative perception literature are obtained within simulation environments or small-scale real-world V2X settings. While simulators such as CARLA and AirSim provide valuable controlled settings, the gap to physical deployment remains substantial and under-quantified [184]. Channel realism: wire- less channel models used in co-design training are predominantly AWGN or simple Rayleigh/Rician fading models; real mmWave and sub-6 GHz channels exhibit time-varying multipath, blockage ef- fects, and spatially correlated shadowing that are rarely modeled [185]. Sensor fidelity: simulated LiDAR and camera outputs lack the noise characteristics, calibration drift, and environmental degra- dation (e.g., lens flare, LiDAR crosstalk in rain) that plague physical sensors. Dataset realism: recent real-world datasets have improved coverage, but most standard protocols still involve two or three cooperating agents, limited weather diversity, and constrained geographic settings. The field still lacks a large-scale, densely annotated, multi-agent real-world benchmark with more than five simultaneously cooperating agents and synchronized ground truth across diverse conditions. Until such benchmarks mature, the true performance of collaborative methods in deployment remains fundamentally uncertain. Recent work on closed-loop cooperative driving benchmarks (MDrive) provides early evidence that while multi-agent perception outperforms single-agent baselines, shar- ing perception features does not always translate to improved planning outcomes, which underscores the need for end-to-end evaluation beyond perception-only metrics [179]. Negative Results and Failure Modes: When Collaboration Hurts. The literature exhibits a strong positive-results bias: systems that successfully leverage collaboration are published, while conditions under which collaboration degrades performance are rarely documented. Several known failure modes deserve explicit attention. Error propagation: when a malfunctioning or adver- sarially compromised agent injects corrupted features into the fusion process, the collective world model can become worse than what each agent would achieve independently: this phenomenon is documented in early work on Byzantine-resilient fusion [106] but is rarely evaluated as a benchmark metric. Correlated failures: homogeneous agents with identical perception models and similar viewpoints are susceptible to correlated failures, where all agents miss the same occluded entity; collaboration does not help when the collective shares a common blind spot. Communication- induced latency: in time-critical scenarios such as highway emergency braking, the end-to-end latency introduced by feature encoding, transmission, and fusion can exceed the available deci- sion budget, making collaborative perception actively detrimental compared to faster, albeit less informed, local-only inference [186]. Information cascades: in decentralized architectures, a pre- mature (and incorrect) semantic commitment by one agent can cascade through the swarm, with each agent reinforcing the error under the assumption that the collective belief is reliable. Systematic study of these failure modes, and of the conditions under which they dominate, remains an open research need. Scalability and the Agent-Churn Problem. Most current methods assume a fixed set of 38 Table 12: Open challenges in collaborative perception: severity, scope, and mitigation pathways. Challenges are ordered approximately by their impact on the fieldâs transition from laboratory benchmarks to robust real-world deployment. ChallengeSeverityScope Near-Term Solvability Representative EvidencePotential Mitigation Pathways Benchmark SaturationHighV2X domainModerate AP clustering within few percentage points [180]; unreliable cross-paper comparisons [181] Multi-dimensional metrics (accuracyâbandwidthâlatencyâenergy); benchmarks with 10+ agents Reproducibility GapHighAll domainsLow Missing code and incomplete training configurations; multi-agent training instability [183] Standardized protocols [182]; containerized implementations; locked test-set leaderboards Sim-to-Real GulfCriticalAll domainsLow AWGN channel models vs. real mmWave [185]; sensor fidelity gaps [184]; MDrive planning-perception gap [179] Domain randomization; hardware-in-the-loop; large-scale real-world multi-agent benchmarks Under-Reported Failure ModesModerateAll domainsModerate LE/CE error taxonomy [181]; Byzantine-robust fusion rarely benchmarked [106]; latency-induced degradation [186] Failure-analysis tracks; negative-result venues; standardized stress-test suites Scalability & Agent ChurnHigh Large-scale deploy. Low O(N 2 ) communication growth [187]; cold-start problem unaddressed [190] Hierarchical fusion [189]; sparse attention [191]; incremental onboarding protocols collaborating agents with stable connectivity, a condition that rarely holds in practical deployments. Real-world swarms experience agent churn: vehicles enter and exit V2X range, UAVs are reassigned to different missions, and sensors are temporarily disabled by power constraints or environmental damage. The theoretical O(N 2 ) growth of pairwise feature interactions in transformer-based fusion architectures becomes computationally prohibitive as N grows to moderate numbers of agents on current-generation automotive-grade hardware [187, 188]. Efficient approximations, such as learned sparsification of the attention graph [187] and hierarchical fusion topologies [189], are proposed but remain largely untested at the scales envisioned for smart-city or large-scale logistics deployment. Furthermore, the cold-start problem for newly joining agents (which lack the historical context shared by long-participating members) has received almost no attention in the literature [190]. Table 12 consolidates the five problem areas identified above, assessing their severity, scope, and near-term tractability to guide future research prioritization. 9.2 Toward General Collaborative Intelligence Current collaborative frameworks, while robust in high-fidelity simulations, are largely closed-world entities with architectures trained on static datasets that include predefined semantic categories. However, the physical world is characterized by a long-tail distribution of edge cases, where the safety-critical events are not encountered during training. Since GCI is a forward-looking systems target, we state here what observation would count against it, lest every shortfall of current systems be taken as evidence for GCIâs necessity rather than as evidence bearing on the conceptâs coherence. The GCI thesis rests on the premise that the local observation trap imposes a ceiling no single agent can shatter, so that pooling distributed observations yields capabilities unattainable alone under comparable sensing, communication, and compute. This thesis would be weakened if a single-agent foundation model, operating with zero col- laboration bandwidth, were shown to match the perceptual accuracy and robustness of collaborative systems across diverse benchmarks, since the collaborative gain that justifies the entire enterprise would then be negligible. It would likewise be called into question if cross-domain shared world mod- els proved fundamentally non-constructible, for instance if no common latent space could preserve 39 task-relevant semantics across heterogeneous sensor modalities. We do not regard either outcome as likely given current evidence, but stating them turns GCI from an unfalsifiable aspiration into a claim that can, in principle, be tested. Collaborative Foundation Models and World-Model Priors. Current collaborative frame- works are largely constrained to perception tasks, such as 3D object detection [26] or semantic occupancy prediction [192]. The next generation of GCI will be powered by distributed founda- tion models that possess world-model priors, serving as shared knowledge backbones across the swarm [193]. By leveraging large-scale multi-modal pre-training (e.g., Vision-Language-Action mod- els), a swarm can perform zero-shot identification of novel entities, from localized disaster debris to unconventional vehicles, through consensus-based latent reasoning [86]. In this paradigm, a drone observing a scene from above and a ground vehicle observing from the side do not merely match pix- els; they exchange high-level semantic concepts: if one agent identifies a hazardous obstruction using its language-aligned encoder, the entire swarm inherits this semantic label without prior exposure to that specific visual geometry. Collaborative foundation models also enable heterogeneous agents (e.g., a LiDAR-equipped truck and a low-cost camera-based micro-drone) to map their disparate observations into a universal semantic space, ensuring that semantic understanding remains invari- ant when sensory modality shifts significantly. This direction, however, requires rigorous validation of latency, calibration, hallucination risks, and safety-critical failure modes in deployment before foundation-model-based collaboration can be entrusted with real-world safety decisions. LLM-Driven Multi-Agent Reasoning and Verbal Coordination. Beyond serving as per- ception backbones, large language models open a qualitatively new coordination channel in which agents reason over a shared context and deliberate through structured natural-language exchange rather than implicit feature alignment. Multi-agent LLM collaboration, as studied in the agentic-AI literature [193], decomposes a collective mission through explicit role specialization, assigning each agent a distinct function such as scout, planner, or safety verifier, and lets agents critique, vote on, and revise one anotherâs proposals via multi-round debate. In a GCI setting this manifests as a cog- nitive layer atop the neural-communication stack: low-bandwidth semantic tokens summarizing each agentâs local belief are aggregated into a shared prompt, and the resulting language-level consensus is projected back into per-agent control priors. Such verbal coordination is especially powerful for long-tail events absent from training data, where pretrained commonsense can interpolate plausible joint plans that no single agent could infer from pixels alone. The mechanism, however, is double- edged: ungrounded language generation can fabricate collectively adopted beliefs, so trustworthy deployment hinges on consensus protocols that cross-validate LLM outputs against sensor evidence and bound disagreement through calibrated uncertainty [194]. Generative World Models as Counterfactual Simulators. A second convergence is the recast- ing of world models from passive predictors into generative simulators that support counterfactual rollout. A swarm can hypothesize alternative collective maneuvers, such as âwhat if the lead vehicle brakes instead of yielding?â, and evaluate each against a learned dynamics model before committing physical resources [25]. This closes part of the sim-to-real gap diagnosed above: rather than relying on a fixed offline simulator, the swarm rehearses against its own continually updated, perception- grounded world model, exposing failure modes that only emerge under multi-agent coupling. When 40 paired with LLM-based reasoning, the world model further supplies the hypothetical states over which language-level debate and verification operate, giving the cognitive layer a concrete, sensor- anchored substrate rather than free-form speculation. Consensus, Hallucination, and the Verification Gap. The integration of foundation models into safety-critical collaboration exposes a verification gap that current GCI-Bench-style evaluation does not yet cover. LLM hallucinations, distribution shift under rare scenes, and the compounding of per-agent errors through consensus voting can produce confidently wrong collective decisions. Closing this gap will require (i) cross-agent evidence grounding that ties every language-level claim to a supporting sensory token, (i) uncertainty-aware aggregation that down-weights agents whose perceptual confidence is low, and (i) formal or runtime-verification fallbacks that trigger conser- vative behavioral envelopes when the collective belief diverges beyond a calibrated threshold [193]. Without such guarantees, the very opacity that makes foundation models expressive also makes them a liability in adversarial or safety-critical regimes. Continual Collaborative Learning and Decentralized Self-Healing. Future swarms will need mechanisms for continual adaptation. As the collective navigates through new environments, it can perform decentralized self-labeling to update its internal representation without dense human annotation. A swarm can exploit viewpoint redundancy to perform real-time self-supervision [100], where a high-confidence perspective from an un-occluded agent acts as the pseudo-label for the low- confidence, occluded views of its neighbors. As the system learns, it can distill new environmental knowledge into local weights or shared adapters [177], improving robustness to seasonal changes, urban construction, or shifting traffic patterns. Hardware-Agnostic Interoperability and Universal Semantics. Real-world deployments will be characterized by agent heterogeneity [195]. Achieving platform independence, where a legacy robotic rover seamlessly interoperates with a state-of-the-art agent utilizing collaborative implicit neural fields [101], remains a core challenge. Future research can advance modality-agnostic latent spaces and universal alignment layers [110] that ensure semantic equivalence across disparate sen- sor resolutions and modalities, allowing heterogeneous agents to contribute to a unified geometric manifold without manual recalibration or task-specific retraining. The Economics of Pragmatic and Semantic Communication. In contested or resource-scarce environments, communication is not merely a bandwidth problem but a strategic game of information theory [22]. The trade-off between perception fidelity and communication overhead is evolving into a complex economics of information. Moving beyond simple saliency-based selection [21, 36], and beyond the earlier who/when-to-communicate protocols that first made inter-agent communication a learnable, selective decision [44, 45], future GCI will utilize VoI-driven protocols in which agents quantify the utility of a feature patch before committing energy and bandwidth to transmit it. An agent evaluates whether sharing a given latent vector will meaningfully reduce the swarmâs global entropy regarding a safety-critical object; if the information is redundant (e.g., observing a well- documented static building), it is suppressed [21, 35]. By treating communication as a resource- constrained strategic game [22], swarms negotiate over scarce bandwidth, energy, and compute, prioritizing the agent or viewpoint with the highest expected value of information while preserving safety constraints and fairness across participating agents [178]. This represents a deep integration 41 of information theory and deep learning, maximizing the perceptual dividend per bit. Human-Swarm Cognitive Integration. The long-term deployment of multi-agent systems is not in isolation but alongside human society, which necessitates a transition from black-box swarms to transparent cognitive partners. CI can be inherently explainable to its human stakeholders: in principle, a pedestrian in a smart city could query the collective belief and receive an interpretable response. Through generative synthesis (e.g., latent diffusion), the swarm can project its internal, high-dimensional world model back into a human-understandable visual or linguistic format [194], allowing operators to inspect the collectiveâs spatial reasoning and resolving the alienation typically felt toward distributed AI systems. When an LLM backbone mediates this projection, the swarm can additionally narrate its reasoning in natural language: it can explain why it classified an ambiguous object as a hazard, identify which agentâs evidence was decisive, and enumerate the alternative interpretations that were rejected. This turns the collective decision into an auditable chain of justification rather than a black-box verdict. By visualizing the swarmâs confidence levels and uncertainty heatmaps, human operators can calibrate their trust [196], intervening when the swarm signals a high-entropy perceptual conflict that requires human common-sense intervention. In this symbiotic relationship, humans and swarms further leverage their complementary strengths: humans offload the cognitive burden of low-level spatial monitoring to the swarm [197], while the swarm leverages human social common-sense to resolve high-level semantic ambiguities. Collaborative Embodiment. A central challenge for GCI is the coupling of perception with proactive actuation at collective scale [179]. Moving beyond passive observation, future swarms will exhibit emergent exploratory behaviors driven by the objective of collective entropy reduction: through proactive information foraging [31, 198], the swarm autonomously reconfigures its physical topology and viewing angles to actively resolve occlusions before they lead to perception failure. If the collective uncertainty in a specific sector rises, agents dynamically reposition to regain visual clar- ity, transforming the swarm into a distributed, self-optimizing active sensor. This represents a form of collective embodied intelligence that does not merely react to the world, but strategically probes it to maintain total situational clarity, pointing toward a future in which vehicles, infrastructure, and humans contribute to and draw from a shared, real-time global neural manifold. 10 GCI-Bench: A Unified Evaluation Framework The critical reflection in Section 9 diagnoses benchmark saturation and evaluation fragmentation as structural barriers to progress: current practice evaluates methods along narrowly defined axes (primarily detection AP on a single benchmark), ignores critical deployment dimensions such as com- munication cost and resilience, and reports results under inconsistent experimental conditions that preclude rigorous cross-method comparison. To address these limitations, we propose GCI-Bench, a unified evaluation framework that operationalizes the five-dimensional taxonomy of Figure 2 into a quantitative scoring protocol. GCI-Bench is designed to be applied to any collaborative perception method without requiring access to its internal implementation and to produce a standardized âGCI Scorecardâ that captures performance across the full design space. 42 0 20 40 60 80 100 PF CE RSSC TW Late FusionV2VNet V2X-ViTWhere2comm InfoComGCI Target (a) Scoring Pipeline (b) GCI Scorecard InputsFive Pillars (0-100)Aggregate & Gate Raw operating points: Method under test Benchmarks â˘AP@0.5 â˘KB/frame â˘Latency â˘AP under perturbations â˘AP vs. N, Îľ / ECE Composite = equal- weighted mean of pillars that carry a value ('--'excluded) PF<30 â ⤠L2 RS<20 â ⤠L3 TW unreported â no L5 PF unreported â provisional P1 Perception Fidelity (PF): P2 Communication Efficiency (CE): P3 Resilience (RS): P4 Scalability (SC): P5 Trustworthiness (TW): 100 Ă (í collab âí single ) (í oracle âí single ) 100 Ă max (0,1â íś method íś ref ) 100 Ă (1â( 1 íž )�ΣrelativeAP drop ) 100 Ă min (1, í í=10 í í=2 ) weightedÎľ+ ECE+ safety L1 Isolated / L2 Reactive / L3 Adaptive / L4 Proactive / L5 Cognitive <20 / 20-40 / 40-60 / 60-80 / 80-100 * Missing pillars (TW for all five methods; PF for InfoCom) are plotted at 0 purely to close the polygons; 0 here denotes "unreported"; GCI Target is an aspirational profile, not a measured method Figure 9: Overview of the GCI-Bench evaluation framework. (a) Scoring pipeline: raw operating points reported by a method on standard benchmarks are normalized into the five pillars of Table 13, each scored on a 0â100 scale against the disclosed single-agent and oracle anchors, and aggregated into a composite under the explicit missing-data rule and maturity caps. (b) Case-study scorecard: pillar profiles of the five representative methods of Table 15 together with the aspirational GCI Target profile; unreported pillars are plotted at 0 only to close the polygons and denote missing rather than measured values. 10.1 Five-Dimensional Evaluation System GCI-Bench defines five evaluation pillars, each scored on a 0â100 scale and normalized against a single-agent no-collaboration baseline (see Table 13 for the scoring protocol). The five pillars correspond to the taxonomy dimensions of Figure 2, ensuring that the evaluation framework is structurally aligned with the conceptual organization of the review. Figure 9 gives an overview of the framework: the scoring pipeline that turns reported operating points into pillar scores, and the case-study scorecard that the pipeline produces. Pillar 1: Perception Fidelity (PF). PF measures the core collaborative gain: the improvement in detection and tracking accuracy over a single-agent baseline. The oracle upper bound is defined as the performance when all agents share raw, lossless data under zero-latency conditions, representing the theoretical maximum of collaborative perception for a given architecture. Pillar 2: Communication Efficiency (CE). CE penalizes methods that achieve strong accuracy through indiscriminate data broadcasting. The operational cost C method aggregates bandwidth and end-to-end latency; it is the engineering counterpart of the information-theoretic transmission rate R(Z i ) defined in Section 2, measuring what is actually spent on the channel rather than the mutual information conveyed. The linear normalization reaches 0 when the cost equals the reference C ref and uses a single reference cost fixed across benchmarks, preserving the cross-benchmark comparability that a per-benchmark calibration constant would undermine. Pillar 3: Resilience (RS). RS measures average performance retention across a standardized suite 43 Table 13: GCI-Bench five-pillar evaluation system. Each pillar is scored on a 0â100 scale and normalized against a single-agent baseline. A weighted aggregate yields the GCI Composite Score. PillarWhat It MeasuresPrimary MetricsNormalization Benchmark Sources P1. Perception Fidelity (PF) Collaborative detection and tracking accuracy relative to single-agent baseline AP@0.5, AP@0.7, NDS, AMOTA PF = 100Ă (m collab â m single )/(m oracle â m single ) m = primary detection metric; oracle = perfect-communication upper bound OPV2V [26], V2XSet [23], DAIR-V2X [32], V2V4Real [117] P2. Communication Efficiency (CE) Perceptual gain per unit of communication cost Bandwidth (KB/frame), latency (ms), bits per AP gain CE = 100Ă max 0, 1â C method /C ref , clamped to [0, 100] C = communication cost; C ref = fixed reference cost, so CE = 0 at C ref All benchmarks with communication measurements P3. Resilience (RS) Performance degradation under adverse conditions AP drop under packet loss (10â50%), pose noise (Ď = 0.1â0.3 m), adversarial perturbation RS = 100Ă 1â 1 K P K k=1 δ k δ k = relative AP drop under perturbation type k; averaged over K types OPV2V [26], V2X-Sim [28], custom stress-test suites [181] P4. Scalability (SC) Performance retention as the number of collaborating agents grows AP at N = 2, 5, 10; O(N 2 ) communication growth factor SC = 100Ă min 1, m N=10 /m N=2 , clamped to [0, 100] accuracy retention as the agent count grows from N=2 to N=10 Benchmarks supporting 2â10 agents P5. Trustworthiness (TW) Privacy preservation, uncertainty calibration, and safety compliance Privacy budget Îľ, expected calibration error (ECE), ISO 26262/21448 [159, 160] compliance level TW = w Îľ TW Îľ + w ECE TW ECE + w safety TW safety w = domain-adjustable weights (summing to 1) DAIR-V2X [32], V2V4Real [117], protocol-level tests Note: All scores are normalized such that the single-agent no-collaboration baseline scores 0 on every pillar. An oracle system with perfect communication and full omniscience would score 100. All pillar scores are clamped to [0, 100]: negative scores (worse than no collaboration) and retention ratios above unity are truncated accordingly. Table 14: GCI maturity model. Five capability levels defined by composite score ranges, with representative method archetypes. LevelDesignationScore RangeCharacteristicsRepresentative Archetype L1Isolated< 20 No effective collaboration; performance indistinguishable from or worse than single-agent baseline Single-agent perception; naive late fusion that disregards neighborsâ raw features L2Reactive20â40 Basic information sharing without adaptivity; fixed communication schedule Broadcast-based intermediate fusion (V2VNet [33], F-Cooper [39]) L3Adaptive40â60 Communication-aware collaboration with selective information transmission Saliency-driven fusion (Where2comm, Which2comm) L4Proactive60â80 Embodied collaboration closing the perception-action loop; proactive information foraging MARL-driven embodied systems (CSAOT, Plan2comm, CoPnP) L5Cognitive80â100 Trustworthy, self-optimizing, cross-domain distributed cognitive system; plug-and-play interoperability across heterogeneous fleets Aspirational target for GCI; no current system fully achieves this level of K perturbation types (packet loss, pose noise, sensor degradation, adversarial perturbations), directly addressing the âwhen collaboration hurtsâ failure modes discussed in Section 9. Pillar 4: Scalability (SC). SC measures performance retention as the agent count N grows, penalizing methods whose O(N 2 ) communication growth dominates; it operationalizes the agent- churn and cold-start concerns raised in Section 9. The ratio is clamped to [0, 100] so that the score cannot exceed 100 for methods whose accuracy improves as more agents join. Pillar 5: Trustworthiness (TW). TW aggregates privacy preservation (differential privacy bud- get Îľ), uncertainty calibration (ECE), and safety compliance (ISO 26262/21448). The sub-weights w are domain-adjustable: a privacy-sensitive smart-city deployment may raise w Îľ , while a safety- critical V2X setting lets w safety dominate. 10.2 Maturity Model and Scoring Protocol The five pillar scores are aggregated into a GCI Composite Score (weighted arithmetic mean, with domain-configurable weights defaulting to equal weighting) that maps onto a five-level maturity model, as defined in Table 14. The standardized scoring protocol operates as follows. For each method under evaluation, pillar 44 scores are computed on each benchmark in the evaluation suite (currently OPV2V [26], V2XSet [23], DAIR-V2X [32], and V2V4Real [117]). The per-benchmark scores are then aggregated via a weighted mean, with weights reflecting benchmark realism (real-world datasets receive higher weight than simulation-only). The aggregation follows an explicit missing-data rule: a pillar for which the underlying data are not reported is marked as unreported (âââ) and excluded from the composite, which is then the equal-weighted mean of the pillars that carry a value; composites averaged over different numbers of pillars are annotated and are not directly comparable. Each pillar score is reported with a 95% confidence interval obtained through bootstrap resampling (1,000 iterations) over the test-set evaluation runs, where the resampling unit is the individual test-set scene (frame); such intervals are reported only under the unified re-evaluation protocol, because the per-scene runs required for resampling are unavailable when scores are computed from disclosed illustrative inputs, as in the case study of Section 10.3. The final output is a GCI Scorecard: a compact visual summary comprising a radar chart of the five pillar scores, the composite score with confidence bounds, and the assigned maturity level. Three maturity caps refine the level assignment. A method with PF < 30 cannot exceed L2, since a system that fails to outperform single-agent perception does not exhibit genuine collaboration. A method with RS < 20 cannot exceed L3, since it does not retain accuracy under mild perturbation. A method whose TW pillar is unreported cannot be assigned L5, since trustworthiness is a necessary condition for cognitive maturity. A method whose Perception Fidelity pillar is unreported receives a provisional level, since fidelity anchors the composite and determines whether genuine collaboration is present at all; unreported complementary pillars such as Trustworthiness are instead excluded from the composite under the missing-data rule above. 10.3 Case Study: Benchmarking Representative Methods To demonstrate the frameworkâs operation, we apply GCI-Bench to five representative methods spanning the collaboration spectrum: Late Fusion [32] (decision-level baseline), V2VNet [33] (broad- cast intermediate fusion), V2X-ViT [23] (Transformer-based intermediate fusion), Where2comm [21] (saliency-driven communication), and InfoCom [27] (information-bottleneck-driven extreme com- pression). All five are 3D object detection methods evaluated on OPV2V-class benchmarks. To make the demonstration auditable, we disclose below every constant and every raw input used to produce the scores of Table 15, and we distinguish three kinds of cells: (i) scores computed from the disclosed illustrative operating points through the disclosed formulas (PF and CE); (i) illustrative estimates that cannot yet be computed from a unified public suite (RS and SC); and (i) pillars for which no underlying data are reported, marked as unreported (âââ) and excluded from the composite (TW for all five methods, and PF for InfoCom [27]). For this demonstration we fix the following reference points, stated explicitly so that every score can be recomputed: for OPV2V (AP@0.5) we take the single-agent baseline m single = 70 and the perfect-communication oracle m oracle = 90; for V2XSet we take m single = 75 and m oracle = 95; and for the CE pillar we fix the reference cost at C ref = 64 KB/frame, the cost of broadcasting an uncompressed intermediate feature map, applied uniformly across benchmarks. These values are 45 consistent with the no-collaboration and early-fusion operating points of the OPV2V benchmark (AP@0.5 = 0.679 and 0.891 [26]); they are illustrative rather than definitive, since unified reference values can only come from the controlled re-evaluation called for below. To show that every computed cell of Table 15 is reproducible, we work one method end to end. Where2comm [21] is assigned the illustrative operating point AP@0.5 = 82.5 with an average uplink of 5 KB/frame. Its Perception Fidelity is PF = 100Ă 82.5â70 90â70 = 62.5 â 63. Its Communication Efficiency is CE = 100Ă max 0, 1â 5 64 = 92.2 â 92. Its Resilience (40) and Scalability (45) are illustrative estimates, because no unified public stress-test or agent-scaling suite yet reports the required perturbation and N-scaling curves; this absence is itself the evaluation gap identified in Section 9. Its Trustworthiness is unreported (âââ). The composite is the equal-weighted mean of the four valued pillars, 63+92+40+45 4 = 60, corresponding to maturity level L3. The PF and CE scores of the remaining methods are produced by the same formulas from their assumed AP@0.5 and communication cost. Figure 9(b) overlays the resulting pillar profiles of all five case-study methods and of the GCI Target row. No comparable AP@0.5 operating point is available for InfoCom [27] under the demonstrationâs accounting, so its PF is marked unreported and its composite is averaged over the three remaining valued pillars (CE, RS, SC); its maturity level is therefore provisional. Late Fusion is assigned AP@0.5 = 75, which yields PF = 25 and triggers the PF < 30 maturity cap. The GCI Target row is an aspirational profile scored on all five pillars and is visually separated from the five real methods; because its composite is averaged over five pillars whereas the real methods are averaged over four or fewer, the two are not directly comparable. Published results illustrate how far current practice is from the unified accounting that the pillars presuppose. The OPV2V benchmark reports AP@0.5 = 0.858 for late fusion and 0.908 for attentive intermediate fusion on its default split, with no communication accounting of any kind [26]. Where2comm re-evaluates the competing methods, itself included, under a dedicated protocol with a different AP scale and expresses communication as log 2 -transformed bytes (5.67â22.71 across its operating points) [21]. The two sources share neither an AP protocol nor a communication unit, so no pillar score can be computed for any method from published numbers alone; the case study therefore relies on disclosed illustrative inputs, and closing this accounting gap is precisely what the unified re-evaluation outlined below must deliver. Several patterns emerge from the case study. First, communication-efficient methods achieve higher composite scores than broadcast-based methods despite slightly lower raw perception fidelity (Where2comm, InfoCom), because the CE pillar rewards bandwidth discipline. Second, no current method reports comprehensive data across all five pillars: fidelity and cost are reported widely enough to compute PF and CE, but RS and SC can only be estimated illustratively and TW is unreported for every method, confirming the evaluation gap identified in Section 9. Third, the maturity levels suggest that the field currently operates predominantly at L2âL3 (reactive to adaptive collaboration), with L4 (proactive embodied collaboration) demonstrated only in research prototypes and L5 (cognitive) remaining aspirational; InfoComâs level is provisional because its PF pillar is unreported. The GCI Target row in Table 15 defines the aspirational performance profile that a mature GCI system would need to achieve. 46 Table 15: GCI-Bench case study: pillar scores and reported operating points for five representative methods. Normalised pillar scores (PF/CE/RS/SC/TW, 0â100) are derived from the disclosed illustrative operating points under the protocol of Table 13; the three right-hand columns list the assumed raw operating points of the demonstration. Scores illustrate the framework rather than provide definitive rankings. âââ indicates that the original publication did not report data for that pillar. MethodStageComm.PFCERSSCTWComp.AP@.5KB/fLat. Late Fusion [32]LateMetadata25992075â 55 (L2) â 75< 1Low V2VNet [33]Intermed.Broadcast62593025â44 (L3)82.426Med V2X-ViT [23]Intermed.Broadcast6663530â34 (L2) 88.2 ⥠60Med Where2comm [21]Intermed.Saliency63924045â60 (L3)82.55Med InfoCom [27]Intermed.IB-prunedâ983550â 61 (prov.) § ââź 1Med GCI Targetâ959090858589 (L5)> 95< 5Low Note: PF = Perception Fidelity, CE = Communication Efficiency, RS = Resilience, SC = Scalability, TW = Trustworthiness, Comp. = composite, Lat. = latency class. AP@.5 = AP@0.5 IoU on the methodâs native benchmark (OPV2V unless otherwise noted); KB/f = average uplink per agent per frame; âââ = not reported in the original publication. PF and CE are computed from the disclosed formulas of Table 13 using the reference constants stated in the text (m single , m oracle , C ref ) together with each methodâs assumed AP@0.5 and communication cost; RS and SC are illustrative estimates rather than values computed from a unified public suite (see text); TW is unreported for all five methods. Per the missing-data rule, each composite is the equal-weighted mean of the pillars carrying a value. ⥠V2X-ViTâs AP@0.5 is reported on its native V2XSet benchmark rather than OPV2V, and its PF and CE use the corresponding V2XSet reference points. InfoComâs PF is marked âââ because no comparable AP operating point is available under the demonstrationâs accounting; its composite is averaged over the three valued pillars (CE, RS, SC) and its maturity level is provisional ( § ). The raw operating points are disclosed illustrative values spanning the stageâcommunication design space rather than transcribed measurements; published sources share neither an AP protocol nor a communication unit (see text), so the scores should not be read as a controlled cross-method ranking. The GCI Target row is an aspirational profile scored on all five pillars and is not directly comparable to the real-method composites, which are averaged over four or fewer pillars. â A maturity cap applies: methods with PF < 30 cannot exceed L2 regardless of composite score, since a system that fails to outperform single-agent perception is not considered to exhibit genuine collaboration. 10.4 Limitations of the Framework and Community Adoption Path GCI-Bench is a conceptual framework and its practical deployment faces several challenges. First, the pillar scores computed in the case study are derived from heterogeneous experimental conditions across original publications (different data splits, hyperparameters, hardware platforms); definitive cross-method comparison requires unified re-evaluation under controlled conditions. Second, the pillar weights and the maturity-level thresholds are initial proposals that should be refined through community consensus, for instance via a dedicated workshop or challenge track at a major venue. Third, the trustworthiness pillar (TW) is the least developed, as most current methods do not report privacy budgets, calibration errors, or safety compliance data; populating this pillar will require the community to adopt standardized reporting practices for these dimensions. Fourth, the oracle upper bound used for PF normalization is architecture-dependent and may not be attainable for all method classes. Fifth, the three cognitive synergy conditions (C1âC3) are formulated as operational design desiderata rather than a formal theorem; establishing their near-necessity, for instance via an information-theoretic impossibility result showing that no proper subset of the conditions can achieve cognitive synergy, remains an open theoretical question beyond the scope of this review. We are explicit about the sense in which the framework is and is not validated. The C1âC3 badge assignments, although now governed by the adjudication rule of Section 2, remain author judgments and have not been independently re-labeled; the case-study scores are computed from disclosed illus- trative operating points rather than measured under a unified protocol; and the reference constants used for the demonstration (m single , m oracle , C ref ) are illustrative rather than unified. Consequently, the case study demonstrates internal consistency and reproducibility of the scoring chain, not the external validity of any particular ranking. An external re-labeling of the badge assignments and a controlled re-evaluation of the case-study methods under the unified protocol would strengthen validity, and we leave both to the community effort outlined below. A natural alternative to GCI-Bench is to strengthen the reporting norms of existing leaderboards, 47 for example locking test splits and mandating bandwidth and latency columns on OPV2V and DAIR- V2X. We regard such norms as complementary rather than sufficient: they improve comparability within a single benchmark, but they cannot express the dimensions that differentiate collaborative systems across benchmarks and domains, since a bandwidth column captures neither a resilience degradation curve nor a scalability slope nor a trustworthiness profile, and locked splits do not penalize a method that achieves accuracy through profligate broadcasting. GCI-Bench is intended to be adopted alongside existing leaderboards, and we acknowledge the adoption cost it asks of the community, namely shared compute for unified re-evaluation, converged perturbation suites, and reporting practices that do not yet exist; the staged path below therefore begins with reporting norms and evolves toward the full apparatus. Finally, the frameworkâs relevance does not depend on collaboration always winning: if single-agent foundation models shrink the collaborative gain that PF measures, the remaining pillars still quantify what a strong single agent cannot obtain alone, namely bandwidth discipline (CE), degradation behavior (RS), scaling retention (SC), and trustworthiness (TW), so the framework degrades gracefully rather than becoming irrelevant. We recommend three steps toward community adoption. (1) Benchmark integration: exist- ing benchmarks (OPV2V [26], V2X-Sim [28], DAIR-V2X [32], V2V4Real [117]) should adopt the five-pillar reporting template as a supplementary evaluation protocol alongside their current met- rics. (2) Standardized stress-test suites: the community should converge on a shared set of perturbation configurations for the RS pillar (packet loss rates, pose noise levels, adversarial attack types) to ensure comparability. (3) Annual GCI-Bench challenge: a community-organized chal- lenge modeled on established benchmarks (e.g., nuScenes tracking challenge, Waymo Open Dataset challenge) would provide a neutral platform for unified re-evaluation and incentivize comprehensive reporting across all five pillars. The GCI-Bench framework, by making the evaluation dimensions of Figure 2 quantitatively operational, provides the scaffolding for such a community effort. Looking forward, the framework must also accommodate emerging foundation-model-driven collaborative sys- tems discussed in Section 9. The PF and CE pillars extend naturally to VLM/VLA-based agents, but two gaps remain: (i) the RS pillar currently perturbs only the perceptual channel, whereas foundation-model collaboration introduces a new failure surface, i.e., LLM hallucination and un- grounded consensus, that calls for a dedicated âcognitive resilienceâ sub-metric measuring belief drift under adversarial or out-of-distribution queries; and (i) the TW pillar should be augmented with a verifiability component that scores whether a collective decision can be traced to support- ing sensory evidence rather than fabricated reasoning. Extending GCI-Bench along these axes is a natural prerequisite for scoring methods toward L5 (Cognitive) maturity. 11 Conclusion This review has charted the evolution of multi-agent collaborative intelligence from deterministic data fusion toward cognitive synergy, organized around a five-dimensional taxonomy and three operational synergy conditions (C1âC3) that together span the design and evaluation space of the field. The GCI-Bench framework operationalizes this taxonomy into a multi-pillar scoring protocol, and the critical reflection on benchmark saturation, reproducibility, the sim-to-real gulf, and failure 48 modes where collaboration degrades performance offers a counterweight to the positive-results bias prevalent in the literature. The technical arc traced across architectures, neural-communication co- design, embodied synergy, resilience, domains, and trust points toward a convergence of collaborative foundation models, pragmatic communication, hardware-agnostic semantics, and proactive swarm embodiment, with the software-defined collaborative network providing the substrate through which the C1âC3 conditions can be jointly realized. Collaborative intelligence is more than an enhancement of robotic sensing: it enables distributed systems that perceive, reason, and act with resilience exceeding the sum of their parts. As these capabilities mature and integrate into smart cities, logistics networks, and environmental monitoring, the boundary between ego-centric perception and collective cognition will continue to blur, and the central challenge for the coming decade will be turning these converging trajectories into cohesive, deployable general collaborative intelligence. Acknowledgments This work was supported by the National Natural Science Foundation of China under Grant 62401447, and by the Natural Science Basic Research Program of Shaanxi under Grants 2026JC-YXQN-127 and 2026JC-YXQN-124. References [1] K. Goldberg. âRobots and the return to collaborative intelligenceâ. In: Nature Machine In- telligence 1.1 (2019), p. 2â4. [2] M. Dorigo, G. Theraulaz, and V. Trianni. âReflections on the future of swarm roboticsâ. In: Science Robotics 5.49 (2020), eabe4385. [3] T. Huang, J. Liu, X. Zhou, D. C. Nguyen, M. R. Azghadi, Y. Xia, Q.-L. Han, and S. Sun. âVehicle-to-everything cooperative perception for autonomous drivingâ. In: Proceedings of the IEEE 113.5 (2025), p. 443â477. [4] A. Billard, A. Albu-Schaeffer, M. Beetz, W. Burgard, P. Corke, M. Ciocarlie, R. Dahiya, D. Kragic, K. Goldberg, Y. Nagai, et al. âA roadmap for AI in roboticsâ. In: Nature Machine Intelligence 7.6 (2025), p. 818â824. [5] A. Nitti, M. D. de Tullio, I. Federico, and G. Carbone. âA collective intelligence model for swarm robotics applicationsâ. In: Nature Communications 16.1 (2025), p. 6572. [6] V. Strobel, M. Dorigo, and M. Fritz. âHow foundation models will revolutionize robot swarmsâ. In: Science Robotics 11.113 (2026), eadz1543. [7] W. Chen, X. Wang, S. Gao, G. Shang, C. Zhou, Z. Li, C. Xu, and K. Hu. âOverview of multi- robot collaborative SLAM from the perspective of data fusionâ. In: Machines 11.6 (2023), p. 653. 49 [8] M. Zhuge, H. Liu, F. Faccio, D. R. Ashley, R. CsordĂĄs, A. Gopalakrishnan, A. Hamdi, H. A. A. K. Hammoud, V. Herrmann, K. Irie, et al. âMindstorms in natural language-based societies of mindâ. In: Computational Visual Media 11.1 (2025), p. 29â81. [9] L. Wan, J. Zhao, A. Wiedholz, M. Bied, M. M. De Lucena, A. D. Jagtap, A. Festag, A. A. FrĂśhlich, H. E. Keen, and A. Vinel. âA Systematic Literature Review on Vehicular Collab- orative PerceptionâA Computer Vision Perspectiveâ. In: IEEE Transactions on Intelligent Transportation Systems 27.1 (2026), p. 81â118. [10] Z. Song, T. Xie, F. Wen, and J. Li. âWireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Surveyâ. In: arXiv preprint arXiv:2505.00747 (2025). doi: 10.48550/arXiv.2505.00747. [11] M. Yazgan, T. Graf, M. Liu, T. Fleck, and J. M. ZĂśllner. âA survey on intermediate fusion methods for collaborative perception categorized by real world challengesâ. In: 2024 IEEE Intelligent Vehicles Symposium (IV). IEEE. 2024, p. 2226â2233. [12] T. Lyu, D. Pesch, A. OâDriscoll, et al. âA survey and tutorial of redundancy mitigation for vehicular cooperative perception: Standards, strategies and open issuesâ. In: arXiv preprint arXiv:2501.01200 (2025). doi: 10.48550/arXiv.2501.01200. [13] R. Hao, H. Yu, J. Zhong, C. Wang, J. Wang, Y. Kan, W. Yang, S. Fan, H. Yin, J. Qiu, et al. âResearch challenges and progress in the end-to-end v2x cooperative autonomous driving competitionâ. In: IEEE/CVF International Conference on Computer Vision. 2025, p. 1828â 1839. [14] Y. Han, H. Zhang, H. Li, Y. Jin, C. Lang, and Y. Li. âCollaborative perception in autonomous driving: Methods, datasets, and challengesâ. In: IEEE Intelligent Transportation Systems Magazine 15.6 (2023), p. 131â151. [15] Z. Bai, G. Wu, M. J. Barth, Y. Liu, E. A. Sisbot, K. Oguchi, and Z. Huang. âA survey and framework of cooperative perception: From heterogeneous singleton to hierarchical coopera- tionâ. In: IEEE Transactions on Intelligent Transportation Systems 25.11 (2024), p. 15191â 15209. [16] A. Singh, G. Raut, and A. Choudhary. âMulti-agent collaborative perception for robotic fleet: A systematic reviewâ. In: European Conference on Computer Vision. Springer. 2024, p. 1â 15. [17] W. Chen, W. Chi, S. Ji, H. Ye, J. Liu, Y. Jia, J. Yu, and J. Cheng. âA survey of autonomous robots and multi-robot navigation: Perception, planning and collaborationâ. In: Biomimetic Intelligence and Robotics 5.2 (2025), p. 100203. [18] F. Hawlader, F. Robinet, and R. Frank. âCooperative perception using v2x communications: An experimental studyâ. In: 2024 IEEE 100th Vehicular Technology Conference (VTC2024- Fall). IEEE. 2024, p. 1â7. [19] L. Jiao, Y. Wang, X. Liu, L. Li, F. Liu, W. Ma, Y. Guo, P. Chen, S. Yang, and B. Hou. âCausal Inference Meets Deep Learning: A Comprehensive Surveyâ. In: Research 7 (2024), p. 0467. 50 [20] Q. Chen, S. Tang, Q. Yang, and S. Fu. âCooper: Cooperative perception for connected au- tonomous vehicles based on 3d point cloudsâ. In: IEEE International Conference on Dis- tributed Computing Systems. IEEE. 2019, p. 514â524. [21] Y. Hu, S. Fang, Z. Lei, Y. Zhong, and S. Chen. âWhere2comm: Communication-efficient collaborative perception via spatial confidence mapsâ. In: Advances in Neural Information Processing Systems 35 (2022), p. 4874â4886. [22] Y. Hu, X. Pang, X. Qin, Y. C. Eldar, S. Chen, P. Zhang, and W. Zhang. âPragmatic commu- nication in multi-agent collaborative perceptionâ. In: IEEE Transactions on Pattern Analysis and Machine Intelligence 48.8 (2026), p. 9279â9296. [23] R. Xu, H. Xiang, Z. Tu, X. Xia, M.-H. Yang, and J. Ma. âV2x-vit: Vehicle-to-everything co- operative perception with vision transformerâ. In: European Conference on Computer Vision. Springer. 2022, p. 107â124. [24] R. Xu, Z. Tu, H. Xiang, W. Shao, B. Zhou, and J. Ma. âCoBEVT: Cooperative Birdâs Eye View Semantic Segmentation with Sparse Transformersâ. In: Conference on Robot Learning. PMLR. 2023, p. 989â1000. [25] J. Fu, Y. Gong, L. Wang, S. Zhang, X. Zhou, and S. Liu. âGenerative Map Priors for Collab- orative BEV Semantic Segmentationâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2025, p. 11919â11928. [26] R. Xu, H. Xiang, X. Xia, X. Han, J. Li, and J. Ma. âOpv2v: An open benchmark dataset and fusion pipeline for perception with vehicle-to-vehicle communicationâ. In: IEEE International Conference on Robotics and Automation. IEEE. 2022, p. 2583â2589. [27] Q. Wei, P. Dai, W. Li, B. Liu, and X. Wu. âInfoCom: Kilobyte-scale communication-efficient collaborative perception with information bottleneckâ. In: AAAI Conference on Artificial Intelligence. Vol. 40. 35. 2026, p. 29731â29739. [28] Y. Li, D. Ma, Z. An, Z. Wang, Y. Zhong, S. Chen, and C. Feng. âV2X-Sim: Multi-agent collaborative perception dataset and benchmark for autonomous drivingâ. In: IEEE Robotics and Automation Letters 7.4 (2022), p. 10914â10921. [29] Q. Xie, X. Zhou, T. Hong, W. Hu, W. Qu, and T. Qiu. âTowards communication-efficient co- operative perception via planning-oriented feature sharingâ. In: IEEE Transactions on Mobile Computing 24.4 (2024), p. 2551â2563. [30] D. Qu, Q. Chen, T. Shimizu, and O. Altintas. âCooperDrive: Enhancing Driving Decisions Through Cooperative Perceptionâ. In: arXiv preprint arXiv:2604.14454 (2026). doi: 10 . 48550/arXiv.2604.14454. [31] H. Nguyen, B. Pham, H. Du, S. Thudumu, R. Vasa, and K. Mouzakis. âCSAOT: Cooperative multi-agent system for active object trackingâ. In: arXiv preprint arXiv:2501.13994 (2025). doi: 10.48550/arXiv.2501.13994. 51 [32] H. Yu, Y. Luo, M. Shu, Y. Huo, Z. Yang, Y. Shi, Z. Guo, H. Li, X. Hu, J. Yuan, et al. âDair-v2x: A large-scale dataset for vehicle-infrastructure cooperative 3d object detectionâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, p. 21361â 21370. [33] T.-H. Wang, S. Manivasagam, M. Liang, B. Yang, W. Zeng, and R. Urtasun. âV2vnet: Vehicle- to-vehicle communication for joint perception and predictionâ. In: European Conference on Computer Vision. Springer. 2020, p. 605â621. [34] Y. Li, S. Ren, P. Wu, S. Chen, C. Feng, and W. Zhang. âLearning distilled collaboration graph for multi-agent perceptionâ. In: Advances in Neural Information Processing Systems 34 (2021), p. 29541â29552. [35] H. Chu, H. Liu, J. Zhuo, J. Chen, and H. Ma. âOcclusion-guided multi-modal fusion for vehicle-infrastructure cooperative 3D object detectionâ. In: Pattern Recognition 157 (2025), p. 110939. [36] D. Yu, J. You, X. Pei, A. Qu, D. Wang, and S. Jia. âWhich2comm: An efficient collaborative perception framework for 3d object detectionâ. In: arXiv preprint arXiv:2503.17175 (2025). doi: 10.48550/arXiv.2503.17175. [37] S. Z. Zhao, H. Zhang, Z. Li, J. Peng, A. Chui, Z. Zhou, Z. Meng, H. Xiang, Z. Huang, F. Wang, et al. âQuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perceptionâ. In: arXiv preprint arXiv:2509.03704 (2025). doi: 10.48550/arXiv.2509.03704. [38] Z. Zhou, H. Xiang, Z. Zheng, S. Z. Zhao, M. Lei, Y. Zhang, T. Cai, X. Liu, J. Liu, M. Bajji, et al. âV2xpnp: Vehicle-to-everything spatio-temporal fusion for multi-agent perception and predictionâ. In: IEEE/CVF International Conference on Computer Vision. 2025, p. 25399â 25409. [39] Q. Chen, X. Ma, S. Tang, J. Guo, Q. Yang, and S. Fu. âF-cooper: Feature based coopera- tive perception for autonomous vehicle edge computing system using 3D point cloudsâ. In: Proceedings of the 4th ACM/IEEE Symposium on Edge Computing. 2019, p. 88â100. [40] L. Zhang, B. Wang, Y. Zhao, Y. Yuan, T. Zhou, and Z. Li. âCollaborative multimodal fu- sion network for multiagent perceptionâ. In: IEEE Transactions on Cybernetics 55.1 (2024), p. 486â498. [41] P. Liu, Z. Wang, G. Yu, B. Zhou, and P. Chen. âRegion-based hybrid collaborative perception for connected autonomous vehiclesâ. In: IEEE Transactions on Vehicular Technology 73.3 (2023), p. 3119â3128. [42] C. Pilz, P. Sammer, E. Piri, U. Grossschedl, G. Steinbauer-Wagner, L. Kuschnig, A. Stein- berger, and M. Schratter. âCollective perception: A delay evaluation with a short discussion on channel loadâ. In: IEEE Open Journal of Intelligent Transportation Systems 4 (2023), p. 506â526. [43] B. Wang, L. Zhang, Z. Wang, Y. Zhao, and T. Zhou. âCore: Cooperative reconstruction for multi-agent perceptionâ. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, p. 8710â8720. 52 [44] Y.-C. Liu, J. Tian, C.-Y. Ma, N. Glaser, C.-W. Kuo, and Z. Kira. âWho2com: Collaborative perception via learnable handshake communicationâ. In: 2020 IEEE International Conference on Robotics and Automation (ICRA). IEEE. 2020, p. 6876â6883. [45] Y.-C. Liu, J. Tian, N. Glaser, and Z. Kira. âWhen2com: Multi-agent perception via commu- nication graph groupingâ. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. 2020, p. 4105â4114. [46] D. Yang, K. Yang, Y. Wang, J. Liu, Z. Xu, R. Yin, P. Zhai, and L. Zhang. âHow2comm: Communication-efficient and collaboration-pragmatic multi-agent perceptionâ. In: Advances in Neural Information Processing Systems 36 (2023), p. 25151â25164. [47] Y. Yuan, H. Cheng, M. Y. Yang, and M. Sester. âGenerating evidential BEV maps in contin- uous driving spaceâ. In: ISPRS Journal of Photogrammetry and Remote Sensing 204 (2023), p. 27â41. [48] B. Li, J. Li, X. Liu, R. Xu, Z. Tu, J. Guo, Q. Zou, X. Li, and H. Yu. âV2x-dgw: Domain generalization for multi-agent perception under adverse weather conditionsâ. In: IEEE Inter- national Conference on Robotics and Automation. IEEE. 2025, p. 974â980. [49] W.-B. Kou, G. Zhu, R. Ye, J. Lei, S. Wang, Q. Lin, M. Tang, and Y.-C. Wu. âAdverse Weather-Independent Framework Towards Autonomous Driving Perception through Tempo- ral Correlation and Unfolded Regularizationâ. In: arXiv preprint arXiv:2508.01583 (2025). doi: 10.48550/arXiv.2508.01583. [50] B. Gao, J. Liu, H. Zou, J. Chen, L. He, and K. Li. âVehicle-road-cloud collaborative per- ception framework and key technologies: A reviewâ. In: IEEE Transactions on Intelligent Transportation Systems 25.12 (2024), p. 19295â19318. [51] C. Zhang, J. Wei, S. Qu, X. She, J. Dai, S. Ou, and Z. Wang. âA roadside cooperative percep- tion system with multi-camera fusion at an intersectionâ. In: 2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC). IEEE. 2023, p. 642â649. [52] R. Hao, S. Fan, Y. Dai, Z. Zhang, C. Li, Y. Wang, H. Yu, W. Yang, J. Yuan, and Z. Nie. âRcooper: A real-world large-scale dataset for roadside cooperative perceptionâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024, p. 22347â22357. [53] J. Xu, Y. Zhang, Z. Cai, and D. Huang. âCosdh: communication-efficient collaborative per- ception via supply-demand awareness and intermediate-late hybridizationâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2025, p. 6834â6843. [54] Z. Xue, C. Liu, F. Wen, and G. Han. âJoint optimization of task offloading and resource allocation for cooperative perception in vehicular edge computing systemsâ. In: IEEE Trans- actions on Vehicular Technology 74.12 (2025), p. 19237â19251. [55] Z. Xiao, J. Shu, H. Jiang, G. Min, H. Chen, and Z. Han. âPerception task offloading with collaborative computation for autonomous drivingâ. In: IEEE Journal on Selected Areas in Communications 41.2 (2023), p. 457â473. 53 [56] B. Liu, J. Teng, H. Xue, E. Wang, C. Zhu, P. Wang, and L. Wu. âmmcooper: A multi- agent multi-stage communication-efficient and collaboration-robust cooperative perception frameworkâ. In: IEEE/CVF International Conference on Computer Vision. 2025, p. 28396â 28406. [57] Z. Zhang, B. He, B. Cheng, and G. Li. âBridging training and execution via dynamic directed graph-based communication in cooperative multi-agent systemsâ. In: AAAI Conference on Artificial Intelligence. Vol. 39. 22. 2025, p. 23395â23403. [58] E. Bourtsoulatze, D. B. Kurka, and D. GĂźndĂźz. âDeep joint source-channel coding for wireless image transmissionâ. In: IEEE Transactions on Cognitive Communications and Networking 5.3 (2019), p. 567â579. [59] J. Yao, Q. Mao, S. Qiao, Y. Xie, and Z. Lyu. â6G-enabled autonomous vehicle clusters in ex- pressways: A collaborative perception approachâ. In: IEEE Transactions on Intelligent Trans- portation Systems 26.10 (2025), p. 17666â17674. [60] J. Dai, S. Wang, K. Tan, Z. Si, X. Qin, K. Niu, and P. Zhang. âNonlinear transform source- channel coding for semantic communicationsâ. In: IEEE Journal on Selected Areas in Com- munications 40.8 (2022), p. 2300â2316. [61] S. Wei, Y. Wei, Y. Hu, Y. Lu, Y. Zhong, S. Chen, and Y. Zhang. âAsynchrony-robust collab- orative perception via birdâs eye view flowâ. In: Advances in Neural Information Processing Systems 36 (2023), p. 28462â28477. [62] S. Thornton, N. Santhanam, R. Chhajer, and S. Dey. âReal-time heterogeneous collaborative perception in edge-enabled vehicular environmentsâ. In: IEEE Open Journal of Vehicular Technology 6 (2025), p. 471â486. [63] M. Chen, M. Liu, C. Wang, X. Song, Z. Zhang, Y. Xie, and L. Wang. âCross-Modal Graph Semantic Communication Assisted by Generative AI in the Metaverse for 6Gâ. In: Research 7 (2024), p. 0342. [64] L. Cazzella, F. Linsalata, M. Magarini, M. Matteucci, and U. Spagnolini. âA multi-modal simulation framework to enable digital twin-based V2X communications in dynamic environ- mentsâ. In: 2024 IEEE 100th Vehicular Technology Conference (VTC2024-Fall). IEEE. 2024, p. 1â6. [65] I. Ghnaya, M. Mosbah, H. Aniss, and T. Ahmed. âMulti-agent advantage actor-critic learn- ing for message content selection in cooperative perception networksâ. In: NOMS 2023-2023 IEEE/IFIP Network Operations and Management Symposium. IEEE. 2023, p. 1â9. [66] T.-Y. Tung, D. B. Kurka, M. Jankowski, and D. GĂźndĂźz. âDeepJSCC-Q: Constellation con- strained deep joint source-channel codingâ. In: IEEE Journal on Selected Areas in Information Theory 3.4 (2022), p. 720â731. [67] J. Su, S. Adams, and P. A. Beling. âCounterfactual multi-agent reinforcement learning with graph convolution communicationâ. In: arXiv preprint arXiv:2004.00470 (2020). doi: 10. 48550/arXiv.2004.00470. 54 [68] J. Foerster, G. Farquhar, T. Afouras, N. Nardelli, and S. Whiteson. âCounterfactual multi- agent policy gradientsâ. In: AAAI Conference on Artificial Intelligence. Vol. 32. 1. 2018. [69] Z. Lei, S. Ren, Y. Hu, W. Zhang, and S. Chen. âLatency-aware collaborative perceptionâ. In: European Conference on Computer Vision. Springer. 2022, p. 316â332. [70] Y. Guo, W. Qin, Y. Xu, Y. Gu, C. Yin, and B. Xia. âPredictive beam tracking and power allocation with cooperative sensing for V2I communicationâ. In: IEEE Open Journal of the Communications Society 5 (2024), p. 6048â6063. [71] J. Cui, H. Qiu, D. Chen, P. Stone, and Y. Zhu. âCoopernaut: End-to-end driving with coop- erative perception for networked vehiclesâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2022, p. 17252â17262. [72] W. Luo, C. Park, A. Cornman, B. Sapp, and D. Anguelov. âJfp: Joint future prediction with interactive multi-agent modeling for autonomous drivingâ. In: Conference on Robot Learning. PMLR. 2023, p. 1457â1467. [73] S. Ren, S. Chen, and W. Zhang. âCollaborative joint perception and prediction for au- tonomous drivingâ. In: Sensors 24.19 (2024), p. 6263. [74] Z. Wang, Y. Wang, Z. Wu, H. Ma, Z. Li, H. Qiu, and J. Li. âCmp: Cooperative motion prediction with multi-agent communicationâ. In: IEEE Robotics and Automation Letters 10.4 (2025), p. 3876â3883. [75] H. Yu, W. Yang, J. Zhong, Z. Yang, S. Fan, P. Luo, and Z. Nie. âEnd-to-end autonomous driving through V2X cooperationâ. In: AAAI Conference on Artificial Intelligence. Vol. 39. 9. 2025, p. 9598â9606. [76] H. Dhami, V. D. Sharma, and P. Tokekar. âMap-nbv: Multi-agent prediction-guided next-best- view planning for active 3d object reconstructionâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2024, p. 5724â5731. [77] J. Westheider, J. RĂźckin, and M. PopoviÄ. âMulti-UAV adaptive path planning using deep reinforcement learningâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2023, p. 649â656. [78] T. SelimoviÄ, M. Peti, and S. Bogdan. âMulti-agent active perception based on reinforcement learning and pomdpâ. In: IEEE Access 12 (2024), p. 48004â48016. [79] Y. Yue, C. Zhao, Y. Wang, Y. Yang, and D. Wang. âAerial-ground robots collaborative 3d mapping in gnss-denied environmentsâ. In: IEEE International Conference on Robotics and Automation. IEEE. 2022, p. 10041â10047. [80] K. Suresh, A. Rauniyar, M. Corah, and S. Scherer. âGreedy perspectives: Multi-drone view planning for collaborative perception in cluttered environmentsâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2024, p. 10990â10997. [81] R. Zhang, J. Hou, F. Walter, S. Gu, J. Guan, F. RĂśhrbein, Y. Du, P. Cai, G. Chen, and A. Knoll. âMulti-agent reinforcement learning for autonomous driving: A surveyâ. In: arXiv preprint arXiv:2408.09675 (2024). doi: 10.48550/arXiv.2408.09675. 55 [82] L. Parada, H. Tian, J. Escribano, and P. Angeloudis. âAn end-to-end collaborative learning approach for connected autonomous vehicles in occluded scenariosâ. In: 2023 IEEE 26th In- ternational Conference on Intelligent Transportation Systems (ITSC). IEEE. 2023, p. 5548â 5554. [83] W. Pan, B. Lin, Y. Wang, Z. Yu, X. Zhao, X. He, and J. Ye. âCooperative Driving at Multiple Unsignalized Intersections in Fully Autonomous Driving Scenariosâ. In: IEEE Transactions on Intelligent Transportation Systems 26.12 (2025), p. 23298â23313. [84] H. Pei, Y. Zhang, Q. Tao, S. Feng, and L. Li. âDistributed cooperative driving in multi- intersection road networksâ. In: IEEE Transactions on Vehicular Technology 70.6 (2021), p. 5390â5403. [85] J. You, Z. Jiang, Z. Huang, H. Shi, R. Gan, K. Wu, X. Cheng, X. Li, and B. Ran. âV2x-vlm: End-to-end v2x cooperative autonomous driving through large vision-language modelsâ. In: Transportation Research Part C: Emerging Technologies 183 (2026), p. 105457. [86] S. Shriram, S. Perisetla, A. Keskar, H. Krishnaswamy, T. E. W. Bossen, A. Møgelmose, and R. Greer. âTowards a multi-agent vision-language system for zero-shot novel hazardous object detection for autonomous driving safetyâ. In: 2025 IEEE 21st International Conference on Automation Science and Engineering (CASE). IEEE. 2025, p. 1511â1518. [87] C. Fan, L. Yao, J. Zhang, Z. Zhen, and X. Wu. âAdvanced Reinforcement Learning and Its Connections with Brain Neuroscienceâ. In: Research 6 (2023), p. 0064. [88] C. Yu, A. Velu, E. Vinitsky, J. Gao, Y. Wang, A. Bayen, and Y. Wu. âThe surprising ef- fectiveness of ppo in cooperative multi-agent gamesâ. In: Advances in Neural Information Processing Systems 35 (2022), p. 24611â24624. [89] Z. Liu, M. Guo, W. Bao, and Z. Li. âFast and Adaptive Multi-Agent Planning under Collab- orative Temporal Logic Tasks via Poset Productsâ. In: Research 7 (2024), p. 0337. [90] T. Rashid, M. Samvelyan, C. S. De Witt, G. Farquhar, J. Foerster, and S. Whiteson. âMono- tonic value function factorisation for deep multi-agent reinforcement learningâ. In: Journal of Machine Learning Research 21.178 (2020), p. 1â51. [91] R. Lowe, Y. I. Wu, A. Tamar, J. Harb, O. Pieter Abbeel, and I. Mordatch. âMulti-agent actor- critic for mixed cooperative-competitive environmentsâ. In: Advances in Neural Information Processing Systems 30 (2017). [92] H. Fu, M. You, H. Zhou, and B. He. âClosely cooperative multi-agent reinforcement learning based on intention sharing and credit assignmentâ. In: IEEE Robotics and Automation Letters 9.12 (2024), p. 11770â11777. [93] J. Hu, X. Yan, G. Wang, M. Tu, X. Zhang, H. Wang, D. Gruyer, and J. Lai. âA simulation platform for truck platooning evaluation in an interactive traffic environmentâ. In: IEEE Transactions on Intelligent Transportation Systems 25.10 (2024), p. 13785â13804. 56 [94] K. Li, J. Wang, and Y. Zheng. âCooperative formation of autonomous vehicles in mixed traffic flow: Beyond platooningâ. In: IEEE Transactions on Intelligent Transportation Systems 23.9 (2022), p. 15951â15966. [95] Y. Zhou, Z. Jin, H. Shi, L. Shi, N. Lu, and M. Dong. âEnhanced emergency communication services for postâdisaster rescue: Multi-IRS assisted air-ground integrated data collectionâ. In: IEEE Transactions on Network Science and Engineering 11.5 (2024), p. 4651â4664. [96] Y. Li, Q. Fang, J. Bai, S. Chen, F. Juefei-Xu, and C. Feng. âAmong us: Adversarially robust collaborative perception by consensusâ. In: IEEE/CVF International Conference on Com- puter Vision. 2023, p. 186â195. [97] S. Hong, Y. Liu, Z. Li, S. Li, and Y. He. âMulti-agent collaborative perception via motion- aware robust communication networkâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024, p. 15301â15310. [98] S. Ren, Z. Lei, Z. Wang, M. Dianati, Y. Wang, S. Chen, and W. Zhang. âInterruption- aware cooperative perception for V2X communication-aided autonomous drivingâ. In: IEEE Transactions on Intelligent Vehicles 9.4 (2024), p. 4698â4714. [99] S. Su, S. Han, Y. Li, Z. Zhang, C. Feng, C. Ding, and F. Miao. âCollaborative multi-object tracking with conformal uncertainty propagationâ. In: IEEE Robotics and Automation Letters 9.4 (2024), p. 3323â3330. [100] W. Su, L. Chen, Y. Bai, X. Lin, G. Li, Z. Qu, and P. Zhou. âWhat makes good collaborative views? contrastive mutual information maximization for multi-agent perceptionâ. In: AAAI Conference on Artificial Intelligence. Vol. 38. 16. 2024, p. 17550â17558. [101] H. Zhao, B. Ivanovic, and N. Mehr. âDistributed nerf learning for collaborative multi-robot perceptionâ. In: arXiv preprint arXiv:2409.20289 (2024). doi: 10.48550/arXiv.2409.20289. [102] Y. Han, H. Zhang, H. Zhang, J. Wang, and Y. Li. âCoDTS: Enhancing sparsely supervised collaborative perception with a dual teacher-student frameworkâ. In: AAAI Conference on Artificial Intelligence. Vol. 39. 3. 2025, p. 3366â3373. [103] M. Jaderberg, K. Simonyan, A. Zisserman, et al. âSpatial transformer networksâ. In: Advances in Neural Information Processing Systems 28 (2015). [104] Y. Lu, Q. Li, B. Liu, M. Dianati, C. Feng, S. Chen, and Y. Wang. âRobust Collaborative 3D Object Detection in Presence of Pose Errorsâ. In: 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE. 2023, p. 4812â4818. [105] Z. Mei, A. Dixit, M. Booker, E. Zhou, M. Storey-Matsutani, A. Z. Ren, O. Shorinwa, and A. Majumdar. âPerceive with confidence: Statistical safety assurances for navigation with learning-based perceptionâ. In: The International Journal of Robotics Research 45.6 (2026), p. 938â967. [106] P. Blanchard, E. M. El Mhamdi, R. Guerraoui, and J. Stainer. âMachine learning with adver- saries: Byzantine tolerant gradient descentâ. In: Advances in Neural Information Processing Systems 30 (2017). 57 [107] B. Hurl, R. Cohen, K. Czarnecki, and S. Waslander. âTrupercept: Trust modelling for au- tonomous vehicle cooperative perception from synthetic dataâ. In: 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE. 2020, p. 341â347. [108] J. Gamerdinger, G. Volk, S. Teufel, A. von Bernuth, S. MĂźller, D. Hospach, and O. Bring- mann. âRobust Local and Cooperative Perception Under Varying Environmental Conditionsâ. In: Cooperatively Interacting Vehicles: Methods and Effects of Automated Cooperation in Traf- fic. Springer, 2024, p. 113â157. [109] J. Zeng, Q. Ye, T. Liu, Y. Xu, J. Li, J. Xu, L. Li, and J. Chen. âMulti-robot autonomous 3D reconstruction using Gaussian splatting with Semantic guidanceâ. In: IEEE Robotics and Automation Letters 10.6 (2025), p. 5617â5624. [110] S. Hu, Z. Fang, Y. Deng, X. Chen, Y. Fang, and S. Kwong. âToward full-scene domain gen- eralization in multi-agent collaborative birdâs eye view segmentation for connected and au- tonomous drivingâ. In: IEEE Transactions on Intelligent Transportation Systems 26.2 (2024), p. 1783â1796. [111] Y. Chen, W. Li, C. Sakaridis, D. Dai, and L. Van Gool. âDomain adaptive faster r-cnn for object detection in the wildâ. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2018, p. 3339â3348. [112] D. Zou, P. Tan, and W. Yu. âCollaborative visual SLAM for multiple agents: A brief surveyâ. In: Virtual Reality & Intelligent Hardware 1.5 (2019), p. 461â482. [113] C. A. V. HernĂĄndez and F. A. P. Ortiz. âA real-time map merging strategy for robust collab- orative reconstruction of unknown environmentsâ. In: Expert Systems with Applications 145 (2020), p. 113109. [114] B. Zhao, W. Zhang, and Z. Zou. âBM2CP: Efficient Collaborative Perception with LiDAR- Camera Modalitiesâ. In: Conference on Robot Learning. PMLR. 2023, p. 1022â1035. [115] Y. Zha, W. Shangguan, J. Chen, L. Chai, W. Qiu, and A. M. LĂłpez. âHeterogeneous multiscale cooperative perception for connected autonomous vehicles via V2X interactionâ. In: IEEE Internet of Things Journal 12.14 (2025), p. 26633â26645. [116] J. Shi, J. Zhao, L. Zhuo, X. Wang, X. Zhan, and H. Liu. âV2V cooperative perception with adaptive communication loss for autonomous drivingâ. In: IEEE Transactions on Intelligent Transportation Systems 26.10 (2025), p. 14866â14878. [117] R. Xu, X. Xia, J. Li, H. Li, S. Zhang, Z. Tu, Z. Meng, H. Xiang, X. Dong, R. Song, et al. âV2v4real: A real-world large-scale dataset for vehicle-to-vehicle cooperative perceptionâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, p. 13712â13722. [118] H. Yu, W. Yang, H. Ruan, Z. Yang, Y. Tang, X. Gao, X. Hao, Y. Shi, Y. Pan, N. Sun, et al. âV2x-seq: A large-scale sequential dataset for vehicle-infrastructure cooperative perception and forecastingâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, p. 5486â5495. 58 [119] X. Wang, J. Huang, Y. Tian, C. Sun, L. Yang, S. Lou, C. Lv, C. Sun, and F.-Y. Wang. âParallel Driving with Big Models and Foundation Intelligence in CyberâPhysicalâSocial Spacesâ. In: Research 7 (2024), p. 0349. [120] N. Ma, Z. Wu, K. Li, G. Xu, Q. Xia, and C. Xu. âInteractive Cognition of Self-driving: A Multidimensional Analysis Model and Implementationâ. In: Research 8 (2025), p. 0903. [121] H. Ngo, H. Fang, and H. Wang. âCooperative perception with V2V communication for au- tonomous vehiclesâ. In: IEEE Transactions on Vehicular Technology 72.9 (2023), p. 11122â 11131. [122] J. Ruan, H. Cui, Y. Huang, T. Li, C. Wu, and K. Zhang. âA review of occluded objects detection in real complex scenarios for autonomous drivingâ. In: Green Energy and Intelligent Transportation 2.3 (2023), p. 100092. [123] H. Su, S. Arakawa, and M. Murata. âOcclusion-aware planning for connected and automated vehicles with cooperative perception at unsignalized intersectionâ. In: 2025 IEEE Intelligent Vehicles Symposium (IV). IEEE. 2025, p. 950â957. [124] E. Y. Bejarbaneh, H. Du, and F. Naghdy. âExploring shared perception and control in coop- erative vehicle-intersection systems: A reviewâ. In: IEEE Transactions on Intelligent Trans- portation Systems 25.11 (2024), p. 15247â15272. [125] G. Liu, L. Liang, C. Guo, H. Ye, and S. Jin. âRSU-Assisted Resource Allocation for Collabo- rative Perceptionâ. In: arXiv preprint arXiv:2509.17691 (2025). doi: 10.48550/arXiv.2509. 17691. [126] K. Wang, K. Nonomura, Z. Li, T. Yu, K. Sakaguchi, O. Hashash, W. Saad, C. She, and Y. Li. âAugmented intelligence in smart intersections: Local digital twins-assisted hybrid autonomous drivingâ. In: IEEE Transactions on Intelligent Vehicles (2024), p. 1â15. [127] M. Nanda Kumar, H. Sharma, R. Kakkar, T. Naha, Atul, R. Yadav, and Naveen. âThe Influence of Adverse Weather on the Reliability and Performance of Autonomous Vehiclesâ. In: International Conference on Smart Trends for Information Technology and Computer Communications. Springer. 2025, p. 349â358. [128] M. Ning, Y. Yang, K. Shu, S. Huang, J. Zhong, M. Salehi, M. Rahmani, Y. Lu, C. Sun, A. Saleh, et al. âCoInfra: A Large-Scale Cooperative Infrastructure Perception System and Dataset in Adverse Weatherâ. In: arXiv preprint arXiv:2507.02245 (2025). doi: 10.48550/ arXiv.2507.02245. [129] J. Fan, L. Lei, S. Cai, G. Shen, P. Cao, and L. Zhang. âArea surveillance with low detection probability using UAV swarmsâ. In: IEEE Transactions on Vehicular Technology 73.2 (2023), p. 1736â1752. [130] T. Ahmad, A. Morel, N. Cheng, K. Palaniappan, P. Calyam, K. Sun, and J. Pan. âFuture UAV/drone systems for intelligent active surveillance and monitoringâ. In: ACM Computing Surveys 58.2 (2025), p. 1â37. 59 [131] T. Feng, X. Wang, F. Han, L. Zhang, and W. Zhu. âU2udata: A large-scale cooperative perception dataset for swarm uavs autonomous flightâ. In: ACM International Conference on Multimedia. 2024, p. 7600â7608. [132] H. Ye, R. Sunderraman, and S. Ji. âUav3d: A large-scale 3d perception benchmark for un- manned aerial vehiclesâ. In: Advances in Neural Information Processing Systems 37 (2024), p. 55425â55442. [133] J. Wang, X. Cao, J. Zhong, Y. Zhang, Z. Han, H. Yu, C. Zhang, L. He, S. Xu, and J. Wang. âGriffin: Aerial-ground cooperative detection and tracking dataset and benchmarkâ. In: AAAI Conference on Artificial Intelligence. Vol. 40. 12. 2026, p. 9867â9875. [134] Y. Hou, B. Zou, M. Zhang, S. Yang, Y. Zhang, J. Zhuo, S. Chen, J. Chen, and H. Ma. âAgc- drive: A large-scale dataset for real-world aerial-ground collaboration in driving scenariosâ. In: Advances in Neural Information Processing Systems 38 (2026). [135] Y. Zhou, L. Quang, C. Nieto-Granda, and G. Loianno. âCoped-advancing multi-robot collab- orative perception: A comprehensive dataset in real-world environmentsâ. In: IEEE Robotics and Automation Letters 9.7 (2024), p. 6416â6423. [136] J. Zha, Y. Fan, T. Zhang, G. Chen, Y. Chen, C. Gao, and X. Chen. âAircopbench: A bench- mark for multi-drone collaborative embodied perception and reasoningâ. In: AAAI Conference on Artificial Intelligence. Vol. 40. 2. 2026, p. 1507â1515. [137] Z.-T. Hao, B. Guo, K.-X. Zhao, L. Wu, Y.-S. Ding, Z.-T. Li, S.-C. Liu, and Z.-W. Yu. âFrom rule-driven to collective intelligence emergence: A review of research on multi-robot air-ground collaborationâ. In: Acta Automatica Sinica 50.10 (2024), p. 1877â1905. [138] Y. Huang, Y. Zheng, P. Wu, Y. Zhang, J. Liu, and Y. Liu. âMulti-Scale Oriented Detection with Shared Convolution for UAV-Enabled Maritime Safety Surveillanceâ. In: Research 8 (2025), p. 0920. [139] E. Ngo, J. Ramirez, M. Medina-Soto, S. Dirksen, E. D. Victoriano, and S. Bhandari. âUAV platforms for autonomous navigation in GPS-denied environments for search and rescue mis- sionsâ. In: 2022 International Conference on Unmanned Aircraft Systems (ICUAS). IEEE. 2022, p. 1481â1488. [140] T. Li, S. Leng, Z. Wang, K. Zhang, and L. Zhou. âIntelligent resource allocation schemes for UAV-swarm-based cooperative sensingâ. In: IEEE Internet of Things Journal 9.21 (2022), p. 21570â21582. [141] M. Zhang, C. Feng, Z. Li, G. Zheng, Y. Luo, Z. Wang, J. Zhou, S. Shen, and B. Zhou. âSOAR: Simultaneous exploration and photographing with heterogeneous UAVs for fast autonomous reconstructionâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2024, p. 10975â10982. [142] D. C. Tsouros, S. Bibi, and P. G. Sarigiannidis. âA review on UAV-based applications for precision agricultureâ. In: Information 10.11 (2019), p. 349. 60 [143] I. F. Priyanta, J. Freytag, C. Reining, M. Roidl, and A. Kirchheim. âTowards 6g-driven coop- erative robot framework for unified sensing in smart warehousesâ. In: 2024 IEEE Conference on Standards for Communications and Networking (CSCN). IEEE. 2024, p. 389â395. [144] D. M. Geetha, A. C. Arunachalam, K. Deepikarani, and K. B. Shanmugam. âAutonomous Cargo Drone with Collision Avoidance and Warehouse Management IoTâ. In: 2023 2nd Inter- national Conference on Automation, Computing and Renewable Systems (ICACRS). IEEE. 2023, p. 1611â1617. [145] X. Zhao, S. Shao, T. Wang, C. Fang, J. Zhang, and H. Zhao. âA review of multi-robot col- laborative simultaneous localization and mappingâ. In: 2023 IEEE International Conference on Unmanned Systems (ICUS). IEEE. 2023, p. 900â905. [146] Q. Wang, P. Lyu, J. Lai, S. Bai, W. Fang, J. Li, L. Zeng, and Y. Chen. âResearch Progress on Collaborative Perception and Localization Technologies of Clustered Unmanned Systems in Underground Sheltered Spaces: A Surveyâ. In: IEEE Transactions on Instrumentation and Measurement 74 (2025), p. 1â27. [147] F. Pratissoli, R. Brugioni, N. Battilani, and L. Sabattini. âHierarchical traffic management of multi-AGV systems with deadlock prevention applied to industrial environmentsâ. In: IEEE Transactions on Automation Science and Engineering 21.3 (2024), p. 3155â3169. [148] W. Xie, X. Peng, Y. Liu, J. Zeng, L. Li, and T. Eisaka. âConflict-free coordination planning for multiple automated guided vehicles in an intelligent warehousing systemâ. In: Simulation Modelling Practice and Theory 134 (2024), p. 102945. [149] B. R. Nair. âCollaborative perception in multi-robot systems: Case studies in household clean- ing and warehouse operationsâ. In: 2024 6th International Conference on Robotics and Com- puter Vision (ICRCV). IEEE. 2024, p. 195â200. [150] A. Hamrouni, H. Ghazzai, H. Menouar, and Y. Massoud. âMulti-rotor UAVs in crowd man- agement systems: Opportunities and challengesâ. In: IEEE Internet of Things Magazine 6.4 (2023), p. 74â80. [151] P. Chhikara, R. Tekchandani, N. Kumar, S. Tanwar, and J. J. Rodrigues. âFederated learning for air quality index prediction using UAV swarm networksâ. In: 2021 IEEE global communi- cations conference (GLOBECOM). IEEE. 2021, p. 1â6. [152] P. Chhikara, R. Tekchandani, N. Kumar, M. Guizani, and M. M. Hassan. âFederated learning and autonomous UAVs for hazardous zone detection and AQI prediction in IoT environmentâ. In: IEEE Internet of Things Journal 8.20 (2021), p. 15456â15467. [153] E. Pinto, P. Santana, and J. Barata. âOn collaborative aerial and surface robots for environ- mental monitoring of water bodiesâ. In: Doctoral Conference on Computing, Electrical and Industrial Systems. Springer. 2013, p. 183â191. [154] W. Bi, M. Zhang, H. Chen, and A. Zhang. âCooperative task allocation method for air- sea heterogeneous unmanned system with an application to ocean environment information monitoringâ. In: Ocean Engineering 309 (2024), p. 118496. 61 [155] W. E. Curran, C. A. Rojas, L. Bobadilla, and D. A. Shell. âOblivious sensor fusion via secure multi-party combinatorial filter evaluationâ. In: 2021 60th IEEE Conference on Decision and Control (CDC). IEEE. 2021, p. 5620â5627. [156] L. Fantauzzo, E. Fan, D. Caldarola, A. Tavera, F. Cermelli, M. Ciccone, and B. Caputo. âFeddrive: Generalizing federated learning to semantic segmentation in autonomous driv- ingâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2022, p. 11504â11511. [157] Z. Zhang, J. Liu, X. Zhou, T. Huang, Q.-L. Han, J. Liu, and H. Liu. âOn the federated learning framework for cooperative perceptionâ. In: IEEE Robotics and Automation Letters 9.11 (2024), p. 9423â9430. [158] W. Yang, Z. Guan, L. Wu, and Z. He. âA Secure Neural Network Inference Framework for Intelligent Connected Vehiclesâ. In: IEEE Network 38.6 (2024), p. 120â127. [159] International Organization for Standardization. ISO 26262:2018 Road vehicles â Functional safety. ISO, Geneva, Switzerland. 2018. url: https://w.iso.org/standard/68383.html. [160] International Organization for Standardization. ISO/PAS 21448:2019 Road vehicles â Safety of the intended functionality (SOTIF). ISO, Geneva, Switzerland. 2019. url: https://w. iso.org/standard/70939.html. [161] J. Cohen, E. Rosenfeld, and Z. Kolter. âCertified adversarial robustness via randomized smoothingâ. In: International Conference on Machine Learning. PMLR. 2019, p. 1310â1320. [162] J. Jeong, S. Park, M. Kim, H.-C. Lee, D.-G. Kim, and J. Shin. âSmoothmix: Training confidence-calibrated smoothed classifiers for certified robustnessâ. In: Advances in Neural Information Processing Systems 34 (2021), p. 30153â30168. [163] J. Li, R. Xu, X. Liu, J. Ma, Z. Chi, J. Ma, and H. Yu. âLearning for vehicle-to-vehicle cooperative perception under lossy communicationâ. In: IEEE Transactions on Intelligent Vehicles 8.4 (2023), p. 2650â2660. [164] S. Liu, C. Gao, Y. Chen, X. Peng, X. Kong, K. Wang, R. Xu, W. Jiang, H. Xiang, J. Ma, et al. âTowards vehicle-to-everything autonomous driving: A survey on collaborative perceptionâ. In: arXiv preprint arXiv:2308.16714 (2023). doi: 10.48550/arXiv.2308.16714. [165] M. Yazgan, M. V. Akkanapragada, and J. M. ZĂśllner. âCollaborative perception datasets in autonomous driving: A surveyâ. In: 2024 IEEE Intelligent Vehicles Symposium (IV). IEEE. 2024, p. 2269â2276. [166] M. Seif, Y. Nie, A. J. Goldsmith, and H. V. Poor. âOver-the-Air Collaborative Inference with Feature Differential Privacyâ. In: 2024 58th Asilomar Conference on Signals, Systems, and Computers. IEEE. 2024, p. 684â688. [167] S. Takagi, Y. Cao, Y. Asano, and M. Yoshikawa. âGeo-graph-indistinguishability: Location privacy on road networks with differential privacyâ. In: IEICE TRANSACTIONS on Infor- mation and Systems 106.5 (2023), p. 877â894. 62 [168] T. Ma and F. Song. âA trajectory privacy protection method based on random sampling differential privacyâ. In: ISPRS International Journal of Geo-Information 10.7 (2021), p. 454. [169] T. Bai, S. Fu, and Q. Yang. âPrivacy-preserving object detection with secure convolutional neural networks for vehicular edge computingâ. In: Future Internet 14.11 (2022), p. 316. [170] R. Song, L. Zhou, V. Lakshminarasimhan, A. Festag, and A. Knoll. âFederated learning framework coping with hierarchical heterogeneity in cooperative itsâ. In: 2022 IEEE 25th In- ternational Conference on Intelligent Transportation Systems (ITSC). IEEE. 2022, p. 3502â 3508. [171] C. Zhao, S. Zhao, M. Zhao, Z. Chen, C.-Z. Gao, H. Li, and Y.-a. Tan. âSecure multi-party computation: theory, practice and applicationsâ. In: Information Sciences 476 (2019), p. 357â 372. [172] B. Lu, X. Xiao, C. Zhang, Y. Zhou, Z. Xiang, H. Shan, and E. Liu. âPrivacy-preserving V2X collaborative perception integrating unknown collaboratorsâ. In: AAAI Conference on Artificial Intelligence. Vol. 39. 6. 2025, p. 5802â5810. [173] S. Gupta and J. K. Verma. âReverse traceability framework for identifying liability of crashes for self-driving vehicles using blockchainsâ. In: Journal of Global Information Management (JGIM) 31.7 (2023), p. 1â21. [174] Q. Yao, T. Li, C. Yan, and Z. Deng. âAccident responsibility identification model for Inter- net of Vehicles based on lightweight blockchainâ. In: Computational Intelligence 39.1 (2023), p. 58â81. [175] X. Gao, Y. Wu, F. Yang, X. Luo, K. Wu, X. Chen, Y. Wang, C. Liu, Y. Zhou, and Z. Tu. âAirv2x: Unified air-ground vehicle-to-everything collaborationâ. In: arXiv preprint (2025). arXiv:2506.19283. doi: 10.48550/arXiv.2506.19283. [176] IEEE Std 802.11bd-2022: Enhancements for Next Generation V2X. IEEE Standards Associ- ation. 2023. [177] L. Lai, E. Ohn-Bar, S. Arora, and J. S. K. Yi. âUncertainty-guided never-ending learning to driveâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024, p. 15088â15098. [178] Z. Fang, J. Wang, Y. Ma, Y. Tao, Y. Deng, X. Chen, and Y. Fang. âR-ACP: Real-time adaptive collaborative perception leveraging robust task-oriented communicationsâ. In: IEEE Journal on Selected Areas in Communications (2025). doi: 10.1109/JSAC.2025.3623179. [179] M. Coscoy, Z. Zhou, S. Z. Zhao, H. Wei, A. Magtoto, J. Liu, R. Song, W. Zimmer, Z. Huang, C. Tang, et al. âMDrive: Benchmarking Closed-Loop Cooperative Driving for End-to-End Multi-agent Systemsâ. In: arXiv preprint arXiv:2605.10904 (2026). doi: 10.48550/arXiv. 2605.10904. [180] J. Zhang, Y. Wang, L. Qian, P. Sun, Z. Li, S. Jiang, M. Liu, and L. Song. âDSRC: Learning density-insensitive and semantic-aware collaborative representation against corruptionsâ. In: AAAI Conference on Artificial Intelligence. Vol. 39. 9. 2025, p. 9942â9950. 63 [181] A. Guo, S. Zhang, E. Tang, X. Gao, H. Pang, H. Tian, Y. Mu, W. Wen, C. Fang, and Z. Chen. âWhen Autonomous Vehicle Meets V2X Cooperative Perception: How Far Are We?â In: 2025 40th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE. 2025, p. 1169â1181. [182] J. Pineau, P. Vincent-Lamarre, K. Sinha, V. Larivière, A. Beygelzimer, F. dâAlchĂŠ-Buc, E. Fox, and H. Larochelle. âImproving reproducibility in machine learning research (a report from the neurips 2019 reproducibility program)â. In: Journal of Machine Learning Research 22.164 (2021), p. 1â20. [183] P. Henderson, R. Islam, P. Bachman, J. Pineau, D. Precup, and D. Meger. âDeep reinforce- ment learning that mattersâ. In: AAAI Conference on Artificial Intelligence. Vol. 32. 1. 2018. [184] J. Li, R. Xu, X. Liu, B. Li, Q. Zou, J. Ma, and H. Yu. âS2R-ViT for multi-agent cooperative perception: Bridging the gap from simulation to realityâ. In: IEEE International Conference on Robotics and Automation. IEEE. 2024, p. 16374â16380. [185] H. Zhou, E. Xie, W. Shao, D. Gao, M. Dong, and J. Zhang. âEi-drive: A platform for cooper- ative perception with realistic communication modelsâ. In: IEEE Internet of Things Journal 12.13 (2025), p. 22934â22944. [186] D. Shenkut and B. V. Kumar. âImpact of latency and bandwidth limitations on the safety per- formance of collaborative perceptionâ. In: 2024 33rd International Conference on Computer Communications and Networks (ICCCN). IEEE. 2024, p. 1â8. [187] S. Huang, J. Zhang, Y. Li, and C. Feng. âActformer: Scalable collaborative perception via active queriesâ. In: IEEE International Conference on Robotics and Automation. IEEE. 2024, p. 14716â14723. [188] Y. Li, Q. Yuan, G. Luo, X. Fu, X. Zhu, Y. Yang, R. Pan, and J. Li. âCollamamba: Effi- cient collaborative perception with cross-agent spatial-temporal state space modelâ. In: arXiv preprint arXiv:2409.07714 (2024). doi: 10.48550/arXiv.2409.07714. [189] J. Li, Y. Zhang, J. Han, P. Han, and K. Luo. âSemantic Scene Completion in Autonomous Driving: A Two-Stream Multi-Vehicle Collaboration Approachâ. In: Sensors 24.23 (2024), p. 7702. [190] Y. R. Wang, S. Chen, Z. Song, and S. Zhou. âWhales: A multi-agent scheduling dataset for enhanced cooperation in autonomous drivingâ. In: IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE. 2025, p. 20487â20493. [191] D. Han, T. Ye, Y. Han, Z. Xia, S. Pan, P. Wan, S. Song, and G. Huang. âAgent attention: On the integration of softmax and linear attentionâ. In: European Conference on Computer Vision. Springer. 2024, p. 124â140. [192] R. Song, C. Liang, H. Cao, Z. Yan, W. Zimmer, M. Gross, A. Festag, and A. Knoll. âCol- laborative semantic occupancy prediction with hybrid feature fusion in connected automated vehiclesâ. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2024, p. 17996â18006. 64 [193] J. Wu, B. Gao, J. Gao, J. Yu, H. Chu, Q. Yu, X. Gong, Y. Chang, H.-H. Tseng, H. Chen, et al. âProspective Role of Foundation Models in Advancing Autonomous Vehiclesâ. In: Research 7 (2024), p. 0399. [194] X. Hou, W. Wang, L. Yang, H. Lin, J. Feng, H. Min, and X. Zhao. âDriveagent: Multi-agent structured reasoning with llm and multimodal sensor fusion for autonomous drivingâ. In: IEEE Robotics and Automation Letters (2025). [195] H. Xiang, R. Xu, and J. Ma. âHM-ViT: Hetero-modal vehicle-to-vehicle cooperative percep- tion with vision transformerâ. In: IEEE/CVF International Conference on Computer Vision. 2023, p. 284â295. [196] Y. Guo, Y. Pang, J. Lyons, M. Lewis, K. Sycara, and R. Liu. âTrust-aware reflective control for fault-resilient dynamic task response in humanâswarm cooperationâ. In: AI 5.1 (2024), p. 446â464. [197] G. Diaz Alfaro, S. M. Fiore, and K. Oden. âExternalized and extended cognition: cognitive of- floading for human-machine teamingâ. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Vol. 68. 1. SAGE Publications Sage CA: Los Angeles, CA. 2024, p. 290â293. [198] Y. Zhou, Y. Yue, B. Yan, L. Li, J. Xiao, and Y. Yao. âCollaborative Target Tracking Algorithm for Multi-Agent Based on MAPPO and BCTDâ. In: Drones 9.8 (2025), p. 521. 65