Paper deep dive
Know the Shape, Find the Fault: Topology-Conditioned Diagnosis of Multi-Agent LLM Failures
Xinwen Liu, Zhuocheng Pan, Isabella Zhu, Jawei Zhang, Xudong Liu, Tianyu Wo
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 91%
Last extracted: 10/11/2026, 3:49:33 AM
Summary
The paper introduces MAScope, a two-stage framework for diagnosing failures in multi-agent LLM systems by leveraging communication topology. The first stage, Trace Structural Extractor (TSE), recovers communication topology from heterogeneous execution traces. The second stage, Topology-Conditioned Judge (TC-Judge), classifies failures using the trace, predicted topology, and empirical failure priors. Experiments on the MAST-clean dataset demonstrate that incorporating topology significantly improves diagnostic accuracy (Macro-F1) for smaller models like gpt-mini, approaching the performance of larger models like gpt-5.4, while reducing deployment costs.
Entities (12)
Relation Signals (9)
MAScope → consistsof → Trace Structural Extractor
confidence 95% · MAScope... Its Trace Structural Extractor TSE recovers communication topology... The Topology-Conditioned Judge TC-Judge then classifies failures
MAScope → consistsof → Topology-Conditioned Judge
confidence 95% · The Topology-Conditioned Judge TC-Judge then classifies failures using the trace, predicted topology...
Communication Topology → correlateswith → Failure Patterns
confidence 92% · Experimental results show a statistically significant association between communication topology and failure type
MAScope → evaluatedon → MAST-clean
confidence 92% · On the 851 MAST-clean traces... Experimental results show
Topology Context → improves → gpt-mini Macro-F1
confidence 90% · ground-truth topology context raises gpt-mini's Macro-F1 from 0.173 to 0.350.
Centralized → associatedwithfailure → Verification Misalignment
confidence 88% · In Centralized topologies, Verification Misalignment involves... hub’s global verification criterion gradually becomes misaligned
Decentralized → associatedwithfailure → Coordination Stall
confidence 88% · In the supplementary corpora’s Decentralized traces, Coordination Stall manifests as role violations
Shared Message Pool → →
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Multi-agent LLM systems coordinate task execution through exchanges of information among agents. When coordination breaks down, similar symptoms in execution traces can reflect different problems in how information is passed, used, or verified. Communication topology captures how agents exchange information and provides structural cues for distinguishing coordination failure modes. Using these cues for diagnosis requires establishing how topology relates to failure patterns and recovering the relevant structure from execution traces that lack explicit topology labels. We analyze the relationship between communication topology and failure patterns and introduce MAScope, a two-stage framework for topology-conditioned diagnosis. Its Trace Structural Extractor TSE recovers communication topology from heterogeneous execution traces by grounding an interaction graph in message evidence. The Topology-Conditioned Judge TC-Judge then classifies failures using the trace, predicted topology, an empirical failure prior estimated from separate labeled traces, and a short description of topology-specific failure patterns. Under a fixed orchestration structure, the recovered topology can be reused across executions. Experimental results show a statistically significant association between communication topology and failure type, with $\chi^2 = 409.9$ and $p = 1.2 \times 10^{-70}$. On the \num{851} MAST-clean traces, ground-truth topology context raises gpt-mini's Macro-F1 from $0.173$ to $0.350$. With predicted topology, the pipeline achieves $0.346$, approaching the trace-only gpt-5.4 baseline of $0.372$. For \num{1000} traces under a fixed orchestration structure, the projected pipeline cost, including one topology extraction, is approximately $6\%$ of repeated gpt-5.4 diagnosis cost. These results show that topology-conditioned context improves failure diagnosis and supports lower-cost deployment.
Tags
Links
- Source: https://arxiv.org/abs/2610.10126v1
- Canonical: https://arxiv.org/abs/2610.10126v1
Trouble viewing inline? Open PDF directly →
Full Text
59,624 characters extracted from source content.
Expand or collapse full text
Know the Shape, Find the Fault: Topology-Conditioned Diagnosis of Multi-Agent LLM Failures Xinwen Liu email: liuxw24@buaa.edu.cn Affiliation: Beihang University, Beijing, China , Zhuocheng Pan email: zhuochengPan@buaa.edu.cn Affiliation: Beihang University, Beijing, China , Isabella Zhu email: zhunini@buaa.edu.cn Affiliation: Beihang University, Beijing, China , Jiawei Zhang email: jw_zhang@buaa.edu.cn Affiliation: Beihang University, Beijing, China , Xudong Liu email: liuxd@buaa.edu.cn Affiliation: Beihang University, Beijing, China and Tianyu Wo email: woty@buaa.edu.cn Affiliation: Beihang University, Beijing, China Abstract. Multi-agent LLM systems coordinate task execution through exchanges of information among agents. When coordination breaks down, similar symptoms in execution traces can reflect different problems in how information is passed, used, or verified. Communication topology captures how agents exchange information and provides structural cues for distinguishing coordination failure modes. Using these cues for diagnosis requires establishing how topology relates to failure patterns and recovering the relevant structure from execution traces that lack explicit topology labels. We analyze the relationship between communication topology and failure patterns and introduce MAScope, a two-stage framework for topology-conditioned diagnosis. Its Trace Structural Extractor TSE recovers communication topology from heterogeneous execution traces by grounding an interaction graph in message evidence. The Topology-Conditioned Judge TC-Judge then classifies failures using the trace, predicted topology, an empirical failure prior estimated from separate labeled traces, and a short description of topology-specific failure patterns. Under a fixed orchestration structure, the recovered topology can be reused across executions. Experimental results show a statistically significant association between communication topology and failure type, with χ2=409.9χ^2=409.9 and p=1.2×10−70p=1.2× 10^-70. On the 851851 MAST-clean traces, ground-truth topology context raises gpt-mini’s Macro-F1 from 0.1730.173 to 0.3500.350. With predicted topology, the pipeline achieves 0.3460.346, approaching the trace-only gpt-5.4 baseline of 0.3720.372. For 10001000 traces under a fixed orchestration structure, the projected pipeline cost, including one topology extraction, is approximately 6%6\% of repeated gpt-5.4 diagnosis cost. These results show that topology-conditioned context improves failure diagnosis and supports lower-cost deployment. Keywords: multi-agent systems; LLM agents; failure diagnosis; communication topology; topology-conditioned prior; MAST taxonomy; runtime observability 1. Introduction Figure 1. Shared message pool context guides checks of feedback use and task verification. In this trace, the reviewer’s feedback was not acted upon and the requested verification was not performed.A shared-message-pool execution in which a reviewer requests interrupted-transfer handling and verification, but the tester instead checks an unrelated square function and the next review accepts it. The topology view highlights the unaddressed feedback and missing task verification. LLM multi-agent systems distribute complex tasks among agents that plan, execute, and verify one another’s work (Li et al., 2023). Frameworks such as AutoGen, MetaGPT, and ChatDev support this division of labour (Wu et al., 2024; Hong et al., 2024; Qian et al., 2024). Successful execution depends on how these agents coordinate as well as on their individual capabilities. A requirement may be understood by one agent yet disappear during a handoff, or several agents may complete their subtasks while the final result remains unchecked. Diagnosing such failures requires interpreting individual actions within the relationships through which information is passed and verified. Existing research analyses failures in multi-agent collaboration and explores ways to improve collaborative performance. MAST organises recurring problems into fourteen failure modes (Cemri et al., 2025), while Who&When and A2P examine which agents and execution steps contribute to task failure (Zhang et al., 2025c; West et al., 2025). Other studies focus on the organisation of collaboration and use graph-based methods to optimise communication topology for better task performance and efficiency (Zhuge et al., 2024; Zhang et al., 2025d). These studies motivate examining the value of communication topology as context for diagnosing collaboration failures. Communication topology describes information transfer relationships among agents. Research on human organisations views coordination as the management of dependencies among activities and links organisational structure to the information processing required for collaboration (Galbraith, 1974; Malone and Crowston, 1994), while organisational structures in multi-agent systems likewise influence agents’ division of labour and information exchange (Horling and Lesser, 2004). Recent work further shows that agents that adhere rigidly to specialised roles may form a collaboration topology composed of isolated groups, turning local specialisation into bottlenecks at the system level (Panny et al., 2026). Communication topology can provide structural context for diagnosing collaboration failures, helping to relate individual actions to information transfer among agents and shared task requirements. Figure 1 illustrates this perspective with a representative execution from MAST-clean. In a task to build a command-line file-transfer tool, the reviewer requests support for interrupted transfers and verification of incomplete files. The tester instead adds tests for an unrelated square function, and the next review accepts those tests as correct. In the shared message pool, the reviewer’s feedback is available to the tester and specifies the task’s verification requirements. The final exchange is locally coherent, but accepting an unrelated test neither addresses the feedback nor verifies the shared task’s requirements. To incorporate communication structure into the diagnosis of failures in multi-agent collaboration, we introduce MAScope, a two-stage diagnostic framework. Our empirical analysis finds that failure-type distributions differ across topologies, motivating topology-specific failure patterns as diagnostic context. In the first stage, the Trace Structural Extractor, TSE, recovers communication relations and topology labels from message evidence, providing structural context that heterogeneous logs may not explicitly record. In the second stage, the Topology-Conditioned Judge, TC-Judge, uses a lower-cost model to diagnose failures from the trace, recovered topology, and associated failure patterns. When communication structure remains stable, reusing topology across executions reduces repeated diagnosis cost. To evaluate MAScope’s diagnostic performance and deployment cost, we assemble MAScope-Bench from natural execution traces, traces with controlled fault injections, and traces from different topologies within a single framework. On MAST-clean, supplying ground-truth topology context raises gpt-mini’s Macro-F1 from 0.1730.173 to 0.3500.350. Using topology recovered by TSE, the complete gpt-mini pipeline achieves a Macro-F1 of 0.3460.346, close to the 0.3720.372 achieved by gpt-5.4 using only the trace. The controlled corpus shows topology recovery with framework identity fixed, while injected traces extend diagnostic gains to additional frameworks and topologies. For 10001000 traces under a fixed topology, the projected gpt-mini pipeline cost, including one structural extraction, is approximately 6%6\% of repeated gpt-5.4 diagnosis cost. These results show that topology context can narrow diagnostic gaps between models while reducing cost. The contributions of this work are as follows: • We develop MAScope, a two-stage framework that recovers communication topology from execution traces and uses the recovered topology and its associated failure patterns to guide a lower-cost model in diagnosing failures. • We establish an empirical association between communication topology and failure patterns, identifying the failure types that are more prevalent under each topology. • We construct MAScope-Bench with 22202220 execution traces and supporting audit materials to evaluate topology recovery, failure diagnosis, transfer to unseen frameworks, and deployment cost. 2. Related Work 2.1. Failure Diagnosis in LLM Multi-Agent Systems Existing work on LLM multi-agent failure diagnosis mainly examines what types of failures occur and which agents or execution steps are responsible for them (Barke et al., 2026; Li et al., 2026). Taxonomy-oriented work organizes recurring failure modes into structured categories. MAST (Cemri et al., 2025) develops a taxonomy of 14 failure modes through expert analysis of execution traces and uses an LLM judge for scalable annotation. Other works categorize failures across agent modules (Zhu et al., 2025b) and explore formal dialogue verification (Nieves et al., 2026) and distributed constraint reasoning for LLM agents (Picard et al., 2026). Localisation-oriented work focuses on identifying the agents and steps responsible for failures (Liu et al., 2026). Who&When (Zhang et al., 2025c) formalises this task and provides annotated failure logs. A2P (West et al., 2025) structures counterfactual reasoning for failure attribution, while AgenTracer (Zhang et al., 2026b) trains an 8B tracer on trajectories annotated through counterfactual replay and fault injection. Other approaches use spectrum analysis (Ge et al., 2026), hierarchical context (Banerjee et al., 2025), or iterative judging (Zhu et al., 2026) for failure attribution. Related MARL work (Shefin et al., 2026) analyses failure sources and propagation pathways. LumiMAS (Solomon et al., 2026) combines system-level anomaly detection with vulnerability classification and root-cause analysis. These LLM-MAS diagnosis methods primarily rely on execution traces, without explicitly incorporating communication topology into the diagnostic input. 2.2. Communication Topology of LLM MAS Communication topology describes how agents are connected and exchange information in LLM-MAS. Guo et al. (Guo et al., 2024) distinguish four typical communication structures, namely layered, centralized, decentralized, and shared message pool. Existing research mainly constructs or adapts communication topologies to improve task performance and efficiency. GPTSwarm (Zhuge et al., 2024) optimises agent graphs at the node and edge levels, while DyLAN (Liu et al., 2024) adapts agent participation to each query. AgentPrune (Zhang et al., 2025d) prunes redundant communication links to reduce token costs. MaAS (Zhang et al., 2025a) and AFlow (Zhang et al., 2025b) automate architecture and workflow search, respectively. HyperAgent (Zhang et al., 2026a) optimises communication topology using hypergraphs. Generative approaches (Jiang et al., 2026; Leong et al., 2025) produce task-specific topologies using graph diffusion or trained graph designers. G2CP (Ben Khaled and Monticolo, 2026) encodes messages as typed operations over a shared knowledge graph, while ROUTER-HGC (Xiao et al., 2026) selects collaboration modes and agent roles using a heterogeneous graph. In MARL, ACORN (Xie et al., 2025) reduces communication redundancy through acyclic coordination. These studies show how communication design can improve task performance and efficiency (Zhu et al., 2025a). 2.3. From Execution Traces to Topology Labels Recovering communication topology from execution traces remains underexplored in LLM-MAS. Classical process mining recovers workflow models from structured event logs (van der Aalst, 2016), whereas LLM-MAS traces come from heterogeneous frameworks such as AutoGen, MetaGPT, ChatDev, LangGraph, CrewAI and Magentic. Their native logging formats differ, and communication topology may not be explicitly recorded. AutoGen Studio (Dibia et al., 2024) and LangSmith support trace inspection and debugging. MAST (Cemri et al., 2025) and Who&When (Zhang et al., 2025c) provide failure annotations rather than communication topology labels. AgentPrune (Zhang et al., 2025d) prunes communication graphs to reduce token costs rather than label coordination structures. When the orchestration configuration is unavailable, topology must instead be inferred from observed agent interactions. The remaining challenge is to recover reliable topology labels across frameworks from raw traces and ground those labels in message-level evidence. 3. Empirical Foundation: Topology × Failure Correlation In this section, we examine the association between communication topology and failure patterns in LLM-MAS. 3.1. Setting Table 1. MAScope-Bench composition. Lay., Cen., Dec., and SMP denote Layered, Centralized, Decentralized, and Shared Message Pool, based on each declared orchestration graph. Corpus # traces Lay. Cen. Dec. SMP MAST-clean 851851 256256 165165 00 430430 LG-Ctrl 408408 102102 102102 102102 102102 Inject-Mix 961961 170170 284284 507507 00 A raw multi-agent execution trace is a tuple T=(A,M,R,S)T=(A,M,R,S), where A is the set of agents with declared roles, M is the time-stamped message stream (ti,senderi,receiveri,contenti)(t_i, sender_i, receiver_i, content_i), R collects tool and retrieval returns, and S carries external state. From T we derive a canonical DAG G(T)=(V,E)G(T)=(V,E), whose vertices are agent turns and whose edges are evidence-carrying parent–child dependencies. The associated topology label τ∈Layered,Centralized,Decentralized,SharedMessagePoolτ∈\Layered, Centralized, Decentralized, SharedMessagePool\ follows Guo et al.’s four-class taxonomy (Guo et al., 2024). Failure annotations are represented by ∈0,114y∈\0,1\^14 using the MAST taxonomy (Cemri et al., 2025), which covers Agent-Level Specification, Inter-Agent Misalignment, and Task Verification. A trace may have multiple failure codes. For descriptive analysis, we group withheld or ignored information as Information Loss, role violations as Coordination Stall, and specification violations, inconsistency, or reasoning–action mismatch as Semantic Drift. Task-verification failures form the Verification Misalignment group. 3.2. Corpora and Ground Truth We use three corpora summarised in Table 1, with construction and auditing detailed in Section 5.1. MAST-clean contains 851851 traces from the MAST release (Cemri et al., 2025), retaining the original MAST-14 failure annotations, and we independently relabel a stratified subset of 200 traces. Inject-Mix contains 961961 traces constructed using controlled fault injection across Layered, Centralized, and Decentralized orchestration variants, covering the Decentralized topology absent from MAST-clean and providing external validation across runtimes. The 408408 traces in LG-Ctrl are controlled end to end by a single LangGraph harness in which all four topologies share the same StateGraph codebase and topology-agnostic agent identifiers, so any observed topology–failure association cannot be attributed to framework fingerprints. Across all three corpora the topology label τ is obtained from the original framework-declared orchestration graph and used as ground truth for evaluating topology extraction. Figure 2. Topology–failure association on MAST-clean (851851 traces). Cells show standardised Pearson residuals for the 4×144× 14 contingency table, with |r|≥2|r|\!≥\!2 annotated. The independence test gives χ2=409.9χ^2=409.9, dof=39dof=39, and p<10−70p<10^-70.A four-by-fourteen heat map of standardized Pearson residuals between communication topology and MAST failure codes. Each topology row has a different cluster of positive residuals, with Layered associated with information loss, Centralized with verification misalignment, Decentralized with coordination stall, and Shared Message Pool with semantic drift. A two-stage pipeline. The first stage adapts and compacts a heterogeneous trace, extracts and validates evidence-grounded relations, and assigns a topology label. The second stage combines the original trace with the topology label, a topology-specific prior, and a failure signature to produce a fourteen-bit MAST diagnosis. Figure 3. MAScope pipeline. TSE converts a heterogeneous trace into an evidence-grounded relation graph and topology label τ τ. TC-Judge combines the trace, predicted topology, frozen topology prior, and failure signature to output a MAST-14 diagnosis.A two-stage pipeline. The first stage adapts and compacts a heterogeneous trace, extracts and validates evidence-grounded relations, and assigns a topology label. The second stage combines the original trace with the topology label, a topology-specific prior, and a failure signature to produce a fourteen-bit MAST diagnosis. 3.3. Independence Test and Per-Topology Anchors We construct a contingency table of topology and MAST failure annotations on MAST-clean to test their independence. As shown in Figure 2, the test yields χ2=409.9χ^2=409.9 and p=1.2×10−70p=1.2× 10^-70, indicating a significant association between topology and failure distributions. The standardised Pearson residuals further show that positive residuals concentrate on different failure types across topologies, revealing characteristic failure patterns for each topology. In Layered pipelines, Information Loss involves 2.42.4 and 2.52.5 for information withholding and ignored input, as upstream facts are lost before reaching downstream stages along the forward-only communication path. In Centralized topologies, Verification Misalignment involves 3.13.1 through 3.33.3, as the hub’s global verification criterion gradually becomes misaligned with its workers. In the supplementary corpora’s Decentralized traces, Coordination Stall manifests as role violations under 2.12.1, with symmetric peers responsible for coordination entering cycles of mutual waiting or role confusion. In Shared Message Pool topologies, Semantic Drift involves 2.22.2, 2.32.3, and 2.62.6 for specification violations, inconsistency, and reasoning–action mismatch. The blackboard accumulates context with ambiguous scope, and later readers silently reinterpret earlier intent. These structural failure anchors provide a common basis for cross-corpus comparison. The associations between the four topologies and their characteristic failure patterns remain qualitatively consistent across MAST-clean, LG-Ctrl, and Inject-Mix. The leave-one-framework-out evaluation further shows that the diagnostic method retains 82%82\% of its in-distribution Macro-F1. Along with the independence test and residual analysis, these results inform the inclusion of topology in TC-Judge’s zero-shot prompt. 4. Two-Stage Diagnosis Pipeline MAScope follows the two-stage pipeline shown in Figure 3, first recovering the collaboration topology and then using topology information to diagnose failures in execution traces. We make this separation because topology τ and failure labels y change at different rates. For example, a deployed layered LangGraph pipeline retains the same topology across thousands of runs, while failure labels vary with each execution. These two stages are implemented by the Trace Structural Extractor TSE and the Topology-Conditioned Judge TC-Judge, respectively. TSE recovers a canonical relation graph G(T)G(T) and the Guo topology label τ τ from a heterogeneous framework trace T, and TC-Judge combines the original trace T with this label τ τ to produce the MAST-14 binary failure vector ^∈0,114 y∈\0,1\^14. Reusing the recovered topology within a fixed deployment amortises extraction across its executions, leaving TC-Judge as the marginal runtime cost for each trace. 4.1. Stage 1. TSE, Trace Structural Extraction TSE recovers the relation graph G(T)G(T) and topology label τ τ from trace T by grounding relations and topology labels in identifiable trace evidence. Its four processing stages cover compaction, relation extraction, validation with repair, and structural labelling. Deterministic rules support speaker attribution over long distances and recovery of implicit shared-channel reads, giving the LLM explicit evidence for relations that require context across a long trace. All stages use a common schema consisting of a speaker-tagged message stream and optional shared-channel markers. A thin format adapter connects each framework to this schema, and we provide adapters for LangGraph, AutoGen, CrewAI, ChatDev, MetaGPT, Magentic, and Simple Chain. This shared representation lets the extraction process begin with the same evidence preparation across all seven frameworks. Table 2. Zero-shot diagnostic results on MAST-clean. No method uses its failure labels for fitting. The final column reports the gain from M0M_0 to M4M_4 on the same model. Family Method Setting Macro-F1 Gain over matched M0M_0 External protocol MAST-Judge gpt-mini 0.131 – External protocol MAST-Judge gpt-5.4 0.363 – Matched control M0M_0 gpt-mini 0.173 Reference Matched control M0M_0 gpt-5.4 0.372 Reference Ours M4M_4 gpt-mini with true topology 0.350 +0.177+0.177 and +102%+102\% Ours M4M_4 gpt-5.4 with true topology 0.399 +0.027+0.027 and +7.3%+7.3\% TSE runs four stages per trace. (i) Compact and anonymize. Compaction prepares a bounded evidence view while preserving the participants and local cues needed for relation extraction. We parse T into a speaker-tagged message stream and replace participant names with placeholders P01,P02,…P_01,P_02,… in order of first appearance. Sentence-level spans are scored using named co-mentions, interaction verbs, shared-channel markers, and words indicating independent initiation. The selected spans form a view of approximately 4k tokens, each retaining a stable identifier EiE_i for citing relation evidence. (i) Extract. Relation extraction turns the retained evidence into a compact set of interaction candidates. The LLM returns at most 24 relations, each assigned one of the five types control, use, feedback, _ pool\_read, and independent. Each candidate cites one or two spans EiE_i that identify the speaker and, where applicable, the counterpart and store. (i) Validate and recover relations. Validation and recovery assemble the relation set used for structural labelling. A rule-based validator checks each candidate against its cited span for JSON schema conformance, direction, grounding within the same message, a named counterpart, and a named store. If the rejection rate exceeds a threshold or shared-channel markers accompany a sparse graph, one bounded LLM repair call retries the rejected candidates through the same validator. A regular expression with a narrow context then supplements free-form generation by recovering implicit pool reads. (iv) Assign the topology label. Structural labelling converts these relations into a Guo topology label through a classifier and a positive-evidence gate. Relations are aggregated from message speakers PiP_i to graph nodes NjN_j and serialised into a table consisting entirely of these aggregated relations. This table is the complete input to the structural-labelling LLM, which assigns one of the four Guo classes or abstains. A deterministic gate resolves the final label by giving highest priority to _ pool\_read relations with a named producer. Independent or mutual activity comes next, followed by a persistent delegation chain and then unidirectional information flow. TSE returns the canonical DAG G(T)G(T) and τ τ together, with every relation and the final label linked to named spans in the retained evidence. 4.2. Stage 2. TC-Judge, Topology-Conditioned LLM-Judge TC-Judge uses the recovered topology to interpret failure evidence in each execution trace. Given T and τ τ, it produces ^∈0,114 y∈\0,1\^14 in one structured JSON call, with one independently assigned bit for each MAST failure code. Topology enters its prompt through the label τ τ, a per-topology empirical prior πτ _ τ, and a short failure signature describing characteristic interactions. With this topology context, the judge performs zero-shot diagnosis with fixed model parameters. TC-Judge operates in two steps. (i) Topology context preparation. For each topology τ, we prepare an empirical prior and a short failure-signature paragraph. For each of the fourteen MAST codes c, the occurrence rate is computed as πτ(c)=Nτ,cNτ _τ(c)= N_τ,cN_τ, where NτN_τ counts traces with topology τ and Nτ,cN_τ,c counts those also labelled with code c. Using a 400-trace exploration slice drawn from an earlier data release, we estimate these rates once and then freeze them. The 851-trace MAST-clean evaluation set comes from a later release and is disjoint from the exploration slice. The failure-signature paragraph describes characteristic roles and interaction patterns under τ. Together with the topology label, the prior and signature form the context used in the diagnostic prompt. (i) Topology-conditioned diagnosis. The diagnostic prompt combines the trace T with the recovered topology label τ τ, the corresponding prior πτ _ τ, and the failure-signature paragraph. The prior component consists entirely of the aggregate rate for each code under τ τ, with all fourteen rates presented together. A soft-prior calibration instruction directs the judge to check each code independently against the trace evidence and then assign its corresponding bit. The judge returns the resulting fourteen-bit vector y in one structured JSON call. Remark 1. Zero-shot design. The zero-shot design supports diagnosis under the uneven label coverage of MAST-clean. Its 851 traces include several failure codes with fewer than twenty positive examples. Supervised training on these annotations for failure-code prediction would lead the judge to learn framework fingerprints as shortcuts and tie its predictions to the framework mix represented in training. The performance drop of the supervised structural classifier under leave-one-framework-out evaluation in Section 5.5 illustrates this dependence. We therefore keep the judge’s parameters fixed and express topology knowledge through aggregate failure frequencies and structural signatures in the prompt. Remark 2. Role of topology context. Failure signatures complement historical frequencies with explanations based only on topology-level roles and interactions. Examples include role dialectic loops in Layered systems, verifier bottlenecks in Centralized systems, unclaimed verification duties in Shared Message Pool systems, and peer critique drift in Decentralized systems. 5. Experiments This section evaluates how the topology signal established in Section 3 supports failure diagnosis through the two-stage pipeline of Section 4. We first describe the evaluation corpora and comparison protocol in Sections 5.1 and 5.2, then assess topology recovery in Section 5.3. The diagnostic gain from topology conditioning is measured in Section 5.4, and cross-framework performance is examined in Section 5.5. Finally, Section 5.6 evaluates the complete pipeline with predicted topology and analyses its deployment cost. 5.1. MAScope-Bench Construction and Audits MAScope-Bench11 1 Code and reproducibility artifacts are available at https://anonymous.4open.science/r/mascope-anonymous-artifact-6F61. The datasets are available at https://huggingface.co/datasets/mascope/mascope-bench. combines the three corpora introduced in Section 3.2 and uses a shared schema for all 22202220 traces. MAST-clean supports the main evaluation, Inject-Mix broadens coverage, while LG-Ctrl isolates topology within one framework. Their composition is summarised in Table 1. MAST-clean is selected under a uniform protocol whose pre-registered admission rule requires agreement among framework papers, the Guo survey mapping, and independent per-trace LLM voting. The admitted traces are deduplicated by task, framework, and trajectory hash, with a stratified subset independently relabelled. These traces retain the original MAST-14 failure annotations and provide reliable topology labels for the main diagnostic comparison. Inject-Mix uses three types of executable orchestrators spanning Layered, Centralized, and Decentralized topologies. Twelve deterministic code-level injectors cover four failure categories by modifying shared state through runtime hooks with fixed MAST-code mappings. The injected traces are then filtered by their targeted health scores, retaining only those with scores below the pre-set threshold of 0.550.55. The additional orchestrators and Decentralized traces extend coverage beyond MAST-clean to test whether topology conditioning remains useful in these settings. Because its failure labels are injection-derived, diagnostic scores are compared only within Inject-Mix. LG-Ctrl generates four topology variants within one LangGraph codebase, keeping the state schema, log format, and agent identifiers fixed while varying only graph edges and iteration patterns. Its design grid samples eight LLM models, seven injectors, and a normal baseline near-uniformly, yielding 102102 traces per topology. Since MAST-clean pairs each framework with only one topology, LG-Ctrl tests recovery with framework identity held fixed. 5.2. Comparison Methods and Evaluation Setup We compare TC-Judge with the five baselines in Table 3, namely B1 Opus-Direct, B2 M0M_0, B3 MAST-Judge, B4 Flat-GBM, and B5 Neural-Trace. B1, B2, and B3 provide LLM references, while B4 and B5 learn from execution graphs and trace text. Who&When (Zhang et al., 2025c), A2P (West et al., 2025), and LumiMAS (Solomon et al., 2026) are discussed qualitatively in Section 2.1 because they output failure locations or free-text causes rather than MAST-14 vectors. Table 3. Baselines used in the main and cross-framework comparisons. All inputs are constructed from the same raw traces. Baseline Construction and comparison role B1 Opus-Direct Complete trace, zero-shot model-capacity reference B2 M0M_0 Trace with MAST-14 schema, zero-shot matched control B3 MAST-Judge (Cemri et al., 2025) Trace with MAST-14 schema, original MAST judge prompt B4 Flat-GBM (Ke et al., 2017) Seventeen topology and shallow trace features, five-fold learner B5 Neural-Trace (Xiao et al., 2024) Frozen BGE trace embedding, five-fold textual learner A grouped bar chart comparing MAST-Judge, the topology-free M-zero judge, and the topology-conditioned M-four judge on gpt-mini and gpt-5.4. M-four raises Macro-F1 from 0.173 to 0.350 for gpt-mini and from 0.372 to 0.399 for gpt-5.4. Figure 4. Controlled diagnostic gains from M0M_0 to M4M_4 on MAST-clean. Each comparison fixes the traces, prompt scaffolding, output space, and model. Both models improve, with gpt-mini gaining 102%102\%.A grouped bar chart comparing MAST-Judge, the topology-free M-zero judge, and the topology-conditioned M-four judge on gpt-mini and gpt-5.4. M-four raises Macro-F1 from 0.173 to 0.350 for gpt-mini and from 0.372 to 0.399 for gpt-5.4. The comparison uses the 851851 MAST-clean traces, which pair original MAST-14 failure annotations with audited, stable topology labels. Macro-F1 over fourteen codes gives tail modes weight under label imbalance. The zero-shot judges TC-Judge, M0M_0, and MAST-Judge require no fitting. Flat-GBM and Neural-Trace use deterministic five-fold GroupKFold by task_id, keeping each task in one fold. Cross-framework evaluation reports leave-one-framework-out results, denoted LOFO, for each held-out framework. LG-Ctrl and Inject-Mix provide separate structural and diagnostic validation, respectively. Each baseline derives its inputs from the same raw traces and predicts the same MAST-14 label vector. B1 sends the complete trace to an Opus-tier model in one call. B2, M0M_0, matches M4M_4 in traces, prompt scaffolding, output format, and model, but receives no topology context. This paired comparison isolates gains from topology conditioning. B3 reproduces the original MAST prompt (Cemri et al., 2025), adapts its output to MAST-14, and uses the same model as M0M_0. B4 fits LightGBM (Ke et al., 2017) to eight topology descriptors and nine shallow trace statistics, including trace length, line count, and six keyword indicators. B5 embeds concatenated traces with frozen BGE-small-en-v1.5 (Xiao et al., 2024) and trains a two-layer MLP on MAST-14 labels. Cross-method scores measure overall diagnostic utility because representations, training, and evaluation settings differ. The internal comparison uses five nested configurations. M0M_0 receives no topology context, M1M_1 adds the topology tag, M2M_2 adds the prior instead, M3M_3 combines the tag and prior, and M4M_4 further adds the failure signature. We conduct the paired M0M_0–M4M_4 comparison separately with gpt-mini and gpt-5.4 to examine whether the gain differs between the two judge models. The combined gain from M0M_0 to M4M_4 for each model is reported in Table 2. We define Oracle-topology as the matched M4M_4 judge supplied with ground-truth topology. The same M4M_4 judge is evaluated with ground-truth topology and with topology predicted by TSE to assess the effect of topology recovery errors on diagnosis. 5.3. Topology Recovery Before evaluating topology-conditioned diagnosis, we first verify whether TSE can recover the structural input required by the judge. Recovery is evaluated in two complementary settings summarised in Table 4, with MAST-clean measuring recovery on natural traces from three frameworks against their declared orchestration graphs and LG-Ctrl providing the framework-controlled setting described in Section 5.1. The MAST-clean evaluation uses TSE with gpt-5.4 on all traces. On LG-Ctrl, the released full-set TSE evaluation uses Sonnet 4.6 and is supplemented by a matched TSE replication with gpt-5.4 on a balanced 4040-trace subset. On MAST-clean, TSE correctly recovers 798798 of 851851 topologies for 93.8%93.8\% accuracy and abstains on four traces. Errors concentrate on ChatDev, where a Layered chain is occasionally classified as Centralized when the first agent takes a stronger coordinating role than the framework specification suggests. On LG-Ctrl, the full-set TSE evaluation recovers 312312 of 408408 topologies for 76.5%76.5\% accuracy, remaining above the 25%25\% balanced chance level after framework cues are controlled, with Shared Message Pool the most difficult controlled class at 56.9%56.9\%. A matched TSE replication recovers 3131 of 4040 traces for 77.5%77.5\% accuracy, supporting the conclusion that topology remains recoverable without framework identity, although the task becomes harder. Table 4. Topology recovery by framework and controlled topology. C, W, and A denote correct, wrong, and abstained predictions. Evaluation slice N C, W, A Accuracy MAST-clean by framework ChatDev 256 211, 44, 1 82.4% Magentic 165 160, 5, 0 97.0% MetaGPT 430 427, 0, 3 99.3% MAST-clean overall 851 798, 49, 4 93.8% LG-Ctrl by construction topology Layered 102 89, 1, 12 87.3% Centralized 102 91, 11, 0 89.2% Decentralized 102 74, 12, 16 72.5% Shared Message Pool 102 58, 26, 18 56.9% LG-Ctrl overall 408 312, 50, 46 76.5% 5.4. Zero-Shot Diagnostic Performance The evaluation of TC-Judge examines whether topology context improves failure diagnosis. On MAST-clean, ground-truth topology context improves both judge models, with a larger gain for gpt-mini, as shown in Figure 4. From M0M_0 to M4M_4, gpt-mini’s Macro-F1 rises from 0.1730.173 to 0.3500.350, a relative gain of 102%102\%, while gpt-5.4 rises from 0.3720.372 to 0.3990.399. The gpt-mini result reaches 94%94\% of the trace-only gpt-5.4 score. Under the matched protocol in Section 5.2, these differences isolate topology conditioning. M4M_4 also exceeds MAST-Judge on the same traces and models by 0.2190.219 and 0.0360.036, respectively, as reported in Table 2. These oracle results provide the reference for Section 5.6. Supervised learners’ in-distribution and cross-framework results are reported together in Section 5.5. A dumbbell chart comparing in-distribution and leave-one-framework-out Macro-F1. Flat-GBM falls from 0.490 to 0.226 and Neural-Trace from 0.296 to 0.127, while descriptive zero-shot slices for M-zero and M-four retain 63 percent and 82 percent respectively. Figure 5. Cross-framework scores on MAST-clean. Flat-GBM and Neural-Trace use strict LOFO retraining. M0M_0 has no fitted component. M4∗M_4^* uses a full-corpus topology prior and is a descriptive framework slice rather than a strict LOFO result. Right labels report retention.A dumbbell chart comparing in-distribution and leave-one-framework-out Macro-F1. Flat-GBM falls from 0.490 to 0.226 and Neural-Trace from 0.296 to 0.127, while descriptive zero-shot slices for M-zero and M-four retain 63 percent and 82 percent respectively. 5.5. Cross-Framework Generalisation Cross-framework evaluation tests whether supervised diagnostic models transfer to deployments on an unseen framework. Most public LLM-MAS traces come from a small set of frameworks and carry distinctive signatures, such as LangGraph node names, AutoGen (Wu et al., 2024) tool-call ordering, and ChatDev (Qian et al., 2024) role prefixes. These framework fingerprints provide distribution-specific cues to a classifier. Building on existing taxonomy and attribution benchmarks (Cemri et al., 2025; Zhang et al., 2025c; West et al., 2025), we use LOFO evaluation to measure robustness under this change in distribution. Each LOFO fold evaluates one complete framework family and trains the supervised baseline on the other two families, with all traces from the held-out framework excluded from fitting. In MAST-clean, each framework is paired with one topology, so the protocol introduces a joint framework and topology shift rather than isolating either factor. The mean across the ChatDev, Magentic, and MetaGPT folds and retention, defined as LOFO Macro-F1 divided by in-distribution Macro-F1, are reported in Figure 5. The learned baselines show substantial score reductions: Flat-GBM falls from 0.4900.490 to 0.2260.226, a relative decrease of 54%54\%, while Neural-Trace falls from 0.2960.296 to 0.1270.127, retaining 43%43\% of its in-distribution Macro-F1. Flat-GBM’s released confusion matrix shows that predictions on the held-out framework concentrate on the two failure modes most frequent in the retained folds. Thus, when the framework and topology change together, the strong in-distribution fit of both learned representations does not transfer reliably. The two zero-shot rows provide descriptive references and are excluded from the strict LOFO conclusion. The diagnostic comparison on Inject-Mix covers framework and topology settings not covered by MAST-clean. Compared with the matched M0M_0, M4M_4 raises Macro-F1 on gpt-mini from 0.3040.304 to 0.3210.321 and on gpt-5.4 from 0.3200.320 to 0.3560.356. These results show that the diagnostic benefit of topology context extends to the additional framework and topology settings in Inject-Mix. 5.6. End-to-End Diagnosis and Deployment Cost The end-to-end experiment assesses diagnostic performance when the topology predicted by TSE is passed to TC-Judge. On MAST-clean, the gpt-mini pipeline reaches Macro-F1 0.3460.346 compared with 0.3500.350 when the same judge receives ground-truth topology, giving Δoracle=−0.004 _oracle=-0.004. This small gap indicates that topology-recovery error has little effect on downstream diagnosis at the current evaluation scale. Deployment cost is determined by the different call frequencies of structural extraction and runtime diagnosis. The cost comparison in Figure 6 uses measured gpt-5.4 diagnosis cost and the gpt-mini estimate based on normalized token counts. Under a fixed orchestration structure, deployment cost comprises one TSE extraction per MAS and one gpt-mini TC-Judge call per trace. Reusing topology amortises extraction costs, so the cost advantage over repeated gpt-5.4 diagnosis grows with deployment volume. Two cost charts. The upper bar chart compares 8.73 dollars for gpt-5.4 raw-trace diagnosis with 0.52 dollars for gpt-mini using topology on 851 traces. The lower log-scale line chart shows that reusing one extracted topology costs 0.63 dollars for one thousand gpt-mini diagnoses versus 10.26 dollars for gpt-5.4. Figure 6. Cost comparison in USD. The upper panel reports measured gpt-5.4 cost and the normalized-token gpt-mini estimate on 851851 traces without TSE. The lower panel adds one TSE call and shows deployment cost when the extracted topology is reused.Two cost charts. The upper bar chart compares 8.73 dollars for gpt-5.4 raw-trace diagnosis with 0.52 dollars for gpt-mini using topology on 851 traces. The lower log-scale line chart shows that reusing one extracted topology costs 0.63 dollars for one thousand gpt-mini diagnoses versus 10.26 dollars for gpt-5.4. 6. Analysis This section discusses why topology provides diagnostic information, why it helps gpt-mini more than gpt-5.4, and how this benefit lowers deployment cost. Q1. Why is topology informative beyond framework-specific trace patterns? Communication topology plays a role analogous to organizational structure in human teamwork. Organization theory views structure as a means of coordinating interdependent tasks and processing information, while coordination theory defines coordination through the management of dependencies among activities (Galbraith, 1974; Malone and Crowston, 1994). MAS research similarly describes an agent organization through the roles and relationships that guide interaction and data flow (Horling and Lesser, 2004). Consider a project that omits a requirement. Diagnosing the problem requires knowing who collected the requirement, who should have passed it on, and who was responsible for checking it. Topology gives the judge a reference for assessing messages against the collaboration’s information flows and responsibilities. This reference directs attention to successive handoffs in Layered workflows and to the hub’s aggregation and verification in Centralized coordination. The judge can then use trace evidence to check whether agents fulfilled these responsibilities and determine the corresponding failure types. Q2. Why does topology help gpt-mini more than gpt-5.4? Without topology, the judge must first infer the collaboration structure before deciding whether a message violates an agent’s role or interrupts an information path. Topology conditioning supplies this intermediate structure directly. Its label identifies the coordination pattern, while its prior and failure signature direct attention to vulnerable responsibilities. The judge can therefore focus on verifying evidence in the trace instead of reconstructing the collaboration scheme. gpt-5.4 can infer more structural context from the raw trace, whereas gpt-mini benefits more when that context is explicit. Section 5.4 reports the paired diagnostic results for both judge models. Q3. Why does this design reduce deployment cost? Structural extraction and failure judgement occur at different frequencies. A deployed MAS usually retains one orchestration graph across many executions, so TSE runs once and its topology is reused. Each new trace then requires only one gpt-mini TC-Judge call. The total cost for n traces is therefore one extraction plus n lower-cost judge calls, rather than n gpt-5.4 calls. Section 5.6 presents the deployment-cost comparison for this reuse setting. As more traces share the fixed extraction cost, the average cost per trace decreases. 7. Conclusion In this paper, we establish an empirical association between communication topology and failure patterns in LLM-based multi-agent systems. Building on this finding, we propose the two-stage diagnosis framework MAScope, which recovers topology from heterogeneous traces and combines it with empirical failure priors to guide failure judgement. In addition, we construct and release MAScope-Bench, which combines natural, injected, and framework-controlled traces for evaluating topology recovery and failure diagnosis. Experiments show that topology conditioning improves diagnostic performance, allowing a lower-cost judge to approach the diagnostic performance of a stronger trace-only model, while structural reuse reduces deployment cost. References Banerjee et al. (2025) Adi Banerjee, Anirudh Nair, and Tarik Borogovac. 2025. Where Did It All Go Wrong? A Hierarchical Look into Multi-Agent Error Attribution. Poster at the NeurIPS 2025 LLM Evaluation Workshop. arXiv:2510.04886 https://openreview.net/forum?id=0MyUdq7wLe Barke et al. (2026) Shraddha Barke, Arnav Goyal, Alind Khare, Avaljot Singh, Suman Nath, and Chetan Bansal. 2026. AgentRx: Diagnosing AI Agent Failures from Execution Trajectories. Accepted to Findings of EMNLP 2026. arXiv:2602.02475 https://arxiv.org/abs/2602.02475 Ben Khaled and Monticolo (2026) Karim Ben Khaled and Davy Monticolo. 2026. G2CP: A Graph-Grounded Communication Protocol for Verifiable and Efficient Multi-Agent Reasoning. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Extended Abstract. IFAAMAS, Paphos, Cyprus, 3486–3488. doi:10.65109/JHFW8307 Cemri et al. (2025) Mert Cemri, Melissa Z. Pan, Shuyi Yang, Lakshya A. Agrawal, Bhavya Chopra, Rishabh Tiwari, Kurt Keutzer, Aditya Parameswaran, Dan Klein, Kannan Ramchandran, Matei A. Zaharia, Joseph E. Gonzalez, and Ion Stoica. 2025. Why Do Multi-Agent LLM Systems Fail?. In Advances in Neural Information Processing Systems, Vol. 38. Curran Associates, Inc. Datasets and Benchmarks Track. doi:10.52202/085713-4082 Dibia et al. (2024) Victor Dibia, Jingya Chen, Gagan Bansal, Suff Syed, Adam Fourney, Erkang Zhu, Chi Wang, and Saleema Amershi. 2024. AutoGen Studio: A No-Code Developer Tool for Building and Debugging Multi-Agent Systems. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics, Miami, Florida, USA, 72–79. doi:10.18653/v1/2024.emnlp-demo.8 Galbraith (1974) Jay R. Galbraith. 1974. Organization Design: An Information Processing View. Interfaces 4, 3 (1974), 28–36. doi:10.1287/inte.4.3.28 Ge et al. (2026) Yu Ge, Linna Xie, Zhong Li, Yu Pei, and Tian Zhang. 2026. Spectrum-Based Failure Attribution for Multi-Agent Systems. Proceedings of the ACM on Software Engineering 3, FSE (2026), 1888–1909. doi:10.1145/3797113 Guo et al. (2024) Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V. Chawla, Olaf Wiest, and Xiangliang Zhang. 2024. Large Language Model Based Multi-Agents: A Survey of Progress and Challenges. In Proceedings of the 33rd International Joint Conference on Artificial Intelligence (IJCAI), Survey Track. International Joint Conferences on Artificial Intelligence Organization, Jeju, South Korea, 8048–8057. doi:10.24963/ijcai.2024/890 Hong et al. (2024) Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2024. MetaGPT: Meta Programming for a Multi-Agent Collaborative Framework. In International Conference on Learning Representations (ICLR). OpenReview.net, Vienna, Austria. Oral. arXiv:2308.00352. https://openreview.net/forum?id=VtmBAGCN7o Horling and Lesser (2004) Bryan Horling and Victor Lesser. 2004. A Survey of Multi-Agent Organizational Paradigms. The Knowledge Engineering Review 19, 4 (2004), 281–316. doi:10.1017/S0269888905000317 Jiang et al. (2026) Eric Hanchen Jiang, Levina Li, Frank Wan, Xiao Liang, Sophia Yin, Yuchen Wu, Xinfeng Li, Yizhou Sun, Wei Wang, Kai-Wei Chang, and Ying Nian Wu. 2026. Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, San Diego, California, United States, 38042–38060. doi:10.18653/v1/2026.acl-long.1764 Ke et al. (2017) Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. LightGBM: A Highly Efficient Gradient Boosting Decision Tree. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc., Red Hook, NY, USA. https://proceedings.neurips.c/paper_files/paper/2017/file/6449f44a102fde848669bdd9eb6b76fa-Paper.pdf Leong et al. (2025) Hui Yi Leong, Yuheng Li, Yuqing Wu, Wenwen Ouyang, Wei Zhu, Jiechao Gao, and Wei Han. 2025. AMAS: Adaptively Determining Communication Topology for LLM-based Multi-agent System. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing: Industry Track. Association for Computational Linguistics, Suzhou, China, 2061–2070. doi:10.18653/v1/2025.emnlp-industry.144 Li et al. (2023) Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, Dmitrii Khizbullin, and Bernard Ghanem. 2023. CAMEL: Communicative Agents for “Mind” Exploration of Large Language Model Society. In Advances in Neural Information Processing Systems, Vol. 36. Curran Associates, Inc. Poster. https://openreview.net/forum?id=3IyL2XWDkG Li et al. (2026) Jiazheng Li, Emine Yilmaz, Bei Chen, and Thu Le. 2026. Towards Self-Improving Error Diagnosis in Multi-Agent Systems. In Findings of the Association for Computational Linguistics: ACL 2026. Association for Computational Linguistics, San Diego, California, United States, 2063–2077. doi:10.18653/v1/2026.findings-acl.98 Liu et al. (2026) Jiale Liu, Huajun Xi, Shaokun Zhang, Yifan Zeng, Tianwei Yue, Chi Wang, Jian Kang, Qingyun Wu, and Huazheng Wang. 2026. Who&When Pro: Can LLMs Really Attribute Failures in AI Agents? arXiv:2607.09996 https://arxiv.org/abs/2607.09996 Liu et al. (2024) Zijun Liu, Yanzhe Zhang, Peng Li, Yang Liu, and Diyi Yang. 2024. A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaboration. In Conference on Language Modeling (COLM). OpenReview.net, Philadelphia, Pennsylvania, USA. https://openreview.net/forum?id=XII0Wp1XA9 Malone and Crowston (1994) Thomas W. Malone and Kevin Crowston. 1994. The Interdisciplinary Study of Coordination. Comput. Surveys 26, 1 (1994), 87–119. doi:10.1145/174666.174668 Nieves et al. (2026) Juan Carlos Nieves, Andreas Brännström, and Esteban Guerrero. 2026. No Future for LLM-based Agents Without Formal Dialogue Verification. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Blue Sky Ideas Track. IFAAMAS, Paphos, Cyprus, 3921–3926. doi:10.65109/JFKY8456 Panny et al. (2026) Benjamin Panny, Shashank Mehrotra, Zahra Zahedi, Teruhisa Misu, and Kumar Akash. 2026. Too Many Specialists: Emergent Inefficiencies and Bottlenecks for Multi-Agent Ad-Hoc Collaboration. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). IFAAMAS, Paphos, Cyprus, 3609–3611. doi:10.65109/CYXP1261 Picard et al. (2026) Gauthier Picard, William Yeoh, and Roie Zivan. 2026. Agentic LLMs and Distributed Constraint Reasoning: A Symbiotic Perspective for Neurosymbolic Multi-Agent Systems. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Blue Sky Ideas Track. IFAAMAS, Paphos, Cyprus, 3858–3863. doi:10.65109/YNZM5391 Qian et al. (2024) Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, Juyuan Xu, Dahai Li, Zhiyuan Liu, and Maosong Sun. 2024. ChatDev: Communicative Agents for Software Development. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics, Bangkok, Thailand, 15174–15186. doi:10.18653/v1/2024.acl-long.810 Shefin et al. (2026) Risal Shahriar Shefin, Debashis Gupta, Thai Le, and Sarra Alqahtani. 2026. Interpretable Failure Analysis in Multi-Agent Reinforcement Learning Systems. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). IFAAMAS, Paphos, Cyprus, 2347–2355. doi:10.65109/GWFE6009 Solomon et al. (2026) Ron Solomon, Yarin Yerushalmi Levi, Lior Waknin, Eran Aizikovich, Amit Baras, Etai Ohana, Amit Giloni, Shamik Bose, Chiara Picardi, Yuval Elovici, and Asaf Shabtai. 2026. LumiMAS: A Comprehensive Framework for Real-Time Monitoring and Enhanced Observability in Multi-Agent Systems. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). IFAAMAS, Paphos, Cyprus, 3749–3757. doi:10.65109/PNWL9707 van der Aalst (2016) Wil M. P. van der Aalst. 2016. Process Mining: Data Science in Action (2 ed.). Springer Berlin, Heidelberg. doi:10.1007/978-3-662-49851-4 West et al. (2025) Alva West, Yixuan Weng, Minjun Zhu, Zhen Lin, Zhiyuan Ning, and Yue Zhang. 2025. Abduct, Act, Predict: Scaffolding Causal Inference for Automated Failure Attribution in Multi-Agent Systems. arXiv:2509.10401 https://arxiv.org/abs/2509.10401 Wu et al. (2024) Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Hassan Awadallah, Ryen W. White, Doug Burger, and Chi Wang. 2024. AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversations. In Conference on Language Modeling (COLM). OpenReview.net, Philadelphia, Pennsylvania, USA. https://openreview.net/forum?id=BAakY1hNKS Xiao et al. (2024) Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighoff, Defu Lian, and Jian-Yun Nie. 2024. C-Pack: Packed Resources For General Chinese Embeddings. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). Association for Computing Machinery, New York, NY, USA, 641–649. doi:10.1145/3626772.3657878 Xiao et al. (2026) Yitao Xiao, Shaoyong Guo, Guoming Yang, Qingnan Wang, Yinlin Ren, Xuesong Qiu, and Feng Qi. 2026. RouterHGC: Optimized Router for LLM-based Multi-Agent Systems via Heterogeneous Graph Contrastive Learning. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Extended Abstract. IFAAMAS, Paphos, Cyprus, 3313–3316. doi:10.65109/PGWI7290 Xie et al. (2025) Yi Xie, Ziqing Zhou, Chun Ouyang, Siao Liu, Linqiang Hu, and Zhongxue Gan. 2025. ACORN: Acyclic Coordination with Reachability Network to Reduce Communication Redundancy in Multi-Agent Systems. In Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). International Foundation for Autonomous Agents and Multiagent Systems, Richland, South Carolina, 2190–2198. https://w.ifaamas.org/Proceedings/aamas2025/pdfs/p2190.pdf Zhang et al. (2025a) Guibin Zhang, Luyang Niu, Junfeng Fang, Kun Wang, Lei Bai, and Xiang Wang. 2025a. Multi-agent Architecture Search via Agentic Supernet. In Proceedings of the 42nd International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research, Vol. 267). PMLR, Vancouver, Canada, 75834–75852. Oral. https://proceedings.mlr.press/v267/zhang25bi.html Zhang et al. (2026b) Guibin Zhang, Junhao Wang, Junjie Chen, Wangchunshu Zhou, Kun Wang, and Shuicheng Yan. 2026b. AgenTracer: Who Is Inducing Failure in the LLM Agentic Systems?. In International Conference on Learning Representations (ICLR). OpenReview.net. Poster. https://openreview.net/forum?id=l05DseqvuD Zhang et al. (2025d) Guibin Zhang, Yanwei Yue, Zhixun Li, Sukwon Yun, Guancheng Wan, Kun Wang, Dawei Cheng, Jeffrey Xu Yu, and Tianlong Chen. 2025d. Cut the Crap: An Economical Communication Pipeline for LLM-based Multi-Agent Systems. In International Conference on Learning Representations (ICLR). OpenReview.net, Singapore. Poster. arXiv:2410.02506. https://openreview.net/forum?id=LkzuPorQ5L Zhang et al. (2026a) Heng Zhang, Yuling Shi, Xiaodong Gu, Zijian Zhang, Haochen You, Lubin Gan, Yilei Yuan, and Jin Huang. 2026a. HyperAgent: Leveraging Hypergraphs for Topology Optimization in Multi-Agent Communication. In Proceedings of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS). IFAAMAS, Paphos, Cyprus, 3087–3096. doi:10.65109/QTVF9552 Zhang et al. (2025b) Jiayi Zhang, Jinyu Xiang, Zhaoyang Yu, Fengwei Teng, Xionghui Chen, Jiaqi Chen, Mingchen Zhuge, Xin Cheng, Sirui Hong, Jinlin Wang, Bingnan Zheng, Bang Liu, Yuyu Luo, and Chenglin Wu. 2025b. AFlow: Automating Agentic Workflow Generation. In International Conference on Learning Representations (ICLR). OpenReview.net, Singapore. Oral. https://openreview.net/forum?id=z5uVAKwmjf Zhang et al. (2025c) Shaokun Zhang, Ming Yin, Jieyu Zhang, Jiale Liu, Zhiguang Han, Jingyang Zhang, Beibin Li, Chi Wang, Huazheng Wang, Yiran Chen, and Qingyun Wu. 2025c. Which Agent Causes Task Failures and When? On Automated Failure Attribution of LLM Multi-Agent Systems. In Proceedings of the 42nd International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research, Vol. 267). PMLR, Vancouver, Canada, 76583–76599. Spotlight. https://proceedings.mlr.press/v267/zhang25cq.html Zhu et al. (2026) Chenyang Zhu, Spencer Hong, Jingyu Wu, Kushal Chawla, Yuhui Tang, Youbing Yin, Nathan Wolfe, Erin Babinsky, and Daben Liu. 2026. RAFFLES: Reasoning-based Attribution of Faults for LLM Systems. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Rabat, Morocco, 7659–7688. doi:10.18653/v1/2026.eacl-long.359 Zhu et al. (2025a) Kunlun Zhu, Hongyi Du, Zhaochen Hong, Xiaocheng Yang, Shuyi Guo, Zhe Wang, Zhenhailong Wang, Cheng Qian, Xiangru Tang, Heng Ji, and Jiaxuan You. 2025a. MultiAgentBench: Evaluating the Collaboration and Competition of LLM Agents. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Vienna, Austria, 8580–8622. doi:10.18653/v1/2025.acl-long.421 Zhu et al. (2025b) Kunlun Zhu, Zijia Liu, Bingxuan Li, Muxin Tian, Yingxuan Yang, Jiaxun Zhang, Pengrui Han, Qipeng Xie, Fuyang Cui, Weijia Zhang, Xiaoteng Ma, Xiaodong Yu, Gowtham Ramesh, Jialian Wu, Zicheng Liu, Pan Lu, James Zou, and Jiaxuan You. 2025b. Where LLM Agents Fail and How They Can Learn From Failures. arXiv:2509.25370 https://arxiv.org/abs/2509.25370 Zhuge et al. (2024) Mingchen Zhuge, Wenyi Wang, Louis Kirsch, Francesco Faccio, Dmitrii Khizbullin, and Jürgen Schmidhuber. 2024. GPTSwarm: Language Agents as Optimizable Graphs. In Proceedings of the 41st International Conference on Machine Learning (ICML) (Proceedings of Machine Learning Research, Vol. 235). PMLR, Vienna, Austria, 62743–62767. Oral. https://proceedings.mlr.press/v235/zhuge24a.html