Paper deep dive
SelfGraphRAG: Bridging the Supervision Gap in Graph-Based RAG with Synthetic QA Generation
Ben Lagnese, Manas Gaur
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 92%
Last extracted: 8/27/2026, 4:44:22 AM
Summary
SelfGraphRAG is a framework that addresses the lack of labeled data for supervised graph retrieval in Retrieval-Augmented Generation (RAG) by generating synthetic question-answer pairs directly from knowledge graph structures. It uses an LLM to create multi-hop and node-summarization QA pairs from a knowledge graph extracted via Doc2Graph, which are then used to train a graph retrieval model (G-Retriever). This approach improves retrieval precision and downstream reasoning performance over embedding-based baselines without requiring manual annotation.
Entities (10)
Relation Signals (8)
SelfGraphRAG â uses â SynthGen
confidence 95% ¡ SelfGraphRAG operates in three sequential stages: Doc2Graph... SynthGen... and GraphLM
SynthGen â generates â Multi-hop questions
confidence 92% ¡ SynthGen generates two classes of question-answer pairs... Multi-hop questions
SynthGen â generates â Node-summarization questions
confidence 92% ¡ SynthGen generates two classes of question-answer pairs... Node-summarization questions
G-Retriever â isusedby â SelfGraphRAG
confidence 92% ¡ G-Retriever... is the GraphLM backbone employed in SelfGraphRAG
SelfGraphRAG â uses â G-Retriever
confidence 92% ¡ G-Retriever... is the GraphLM backbone employed in SelfGraphRAG
SelfGraphRAG â buildson â GraphRAG
confidence 90% ¡ SelfGraphRAG builds directly on the Doc2Graph stage of GraphRAG
SelfGraphRAG â improves â retrieval precision
confidence 90% ¡ SelfGraphRAG improves retrieval precision and downstream reasoning performance over embedding-based baselines
LightRAG â iscomparedagainst â SelfGraphRAG
confidence 85% ¡ SelfGraphRAG... outperform both standard RAG and LightRAG on multi-hop and classification benchmarks
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Retrieval-augmented generation (RAG) improves large language models by incorporating external knowledge without retraining, but existing methods often underuse the relational structure encoded in knowledge graphs. Graph-based RAG can capture entity relationships, yet supervised graph retrieval typically requires labeled question-answer data that may not be available for newly constructed graphs. We address this limitation with SelfGraphRAG, a framework that generates question-answer pairs directly from knowledge graph structure and uses them to train a query-conditioned graph retriever. The generated questions capture multi-hop paths and local neighborhoods, providing relational supervision without manual annotation. Experiments on multi-hop question answering and classification benchmarks show that SelfGraphRAG improves retrieval precision and downstream reasoning performance over embedding-based baselines. These results suggest that knowledge graph structure can provide useful supervision for training graph retrievers when labeled data are unavailable.
Tags
Links
- Source: https://arxiv.org/abs/2608.25123v1
- Canonical: https://arxiv.org/abs/2608.25123v1
Trouble viewing inline? Open PDF directly â
Full Text
52,234 characters extracted from source content.
Expand or collapse full text
SelfGraphRAG: Bridging the Supervision Gap in Graph-Based RAG with Synthetic QA Generation Ben Lagnese Manas Gaur Affiliation: University of Maryland, Baltimore County (UMBC), Baltimore, MD, USA https://kai2.umbc.edu E-mail blagnese, mgaur@umbc.edu Abstract Retrieval-augmented generation (RAG) enhances large language models by incorporating external knowledge without retraining, yet existing approaches fail to fully exploit relational structure in knowledge graphs. While graph-based RAG captures entity relationships, its effectiveness is limited by the lack of labeled data needed for supervised graph retrieval. We study whether synthetic supervision derived from the graph itself can enable effective learning of query-conditioned subgraph retrieval. We propose SelfGraphRAG, a framework that generates questionâanswer pairs from knowledge graph structures to induce training signals for a graph retrieval model. We hypothesize that multi-hop and neighborhood-based synthetic queries encode sufficient relational constraints to approximate real task distributions. Empirical results across multi-hop and classification benchmarks demonstrate that models trained with such synthetic supervision improve retrieval precision and reasoning performance over embedding-based baselines. These findings suggest that graph-structured data can serve as a self-contained source of supervision, enabling scalable learning of structured retrieval without manual annotation. 1 Introduction Large language models (LLMs) have demonstrated remarkable language understanding and generation capabilities, yet they remain fundamentally limited by their parameterized knowledge; they cannot efficiently incorporate new information, are prone to hallucination, and have fixed context windows that cannot accommodate large private corpora [10]. Retrieval-augmented generation (RAG) addresses these limitations by indexing an external knowledge base and supplying relevant context at inference time, improving both accuracy and transparency [10][4]. Standard RAG, however, operates on flat document chunks. This representation is ill-suited for questions that require reasoning across entity relationships, precisely the queries that arise in complex, knowledge-intensive domains. A natural remedy is to extract a knowledge graph from the corpus during indexing, making entity relationships explicitly retrievable [2][4]. Entity-level strategies retrieve local neighborhoods of topic nodes and pass the surrounding edges as context, while corpus-level strategies partition the graph into communities, summarize each community with an LLM, and produce global answers. Both approaches, however, are limited: entity-level retrieval relies on embedding similarity with fixed hop sizes, risking both redundancy and incomplete multi-hop coverage; corpus-level summarization sacrifices the granularity of individual triples, degrading answer precision. Graph retrieval models, which learn to score and extract task-relevant subgraphs from a knowledge graph, can overcome these limitations, but they introduce a new requirement: a question-answer dataset labeled against the target graph for supervised training [8][11]. When an LLM constructs the graph from private documents, no such labeled data exists. This creates a fundamental gap between the expressiveness of graph retrieval models and their practical applicability to knowledge-graph-augmented RAG pipelines. We propose SelfGraphRAG, a pipeline that closes this gap through synthetic data generation. Given an automatically extracted knowledge graph, SelfGraphRAG prompts an LLM to construct two complementary types of question-answer pairs: multi-hop questions that require reasoning across non-adjacent nodes, and node-summarization questions that require integrating evidence from a nodeâs immediate neighborhood, to produce a labeled training set. We then train a graph retrieval model on this synthetic corpus and use it for inference, replacing the embedding-based similarity retrieval used in standard graph RAG methods. SelfGraphRAGâs contributions are threefold. First, we demonstrate that synthetic QA generation from extracted knowledge graphs produces a training signal sufficient to outperform both standard RAG and LightRAG on multi-hop and classification benchmarks. Second, we show that the inference-time gain is achieved with a compact, locally runnable model stack, without reliance on proprietary APIs. Third, we provide a reusable pipeline that can be applied to any domain with unlabeled document corpora and prohibitively expensive annotation. 2 Related Work 2.1 Retrieval-Augmented Generation Retrieval-augmented generation (RAG) augments LLM outputs by retrieving relevant passages from an indexed external corpus and prepending them as context at inference time [10]. This approach directly mitigates key failure modes of parametric LLMs, including hallucination, stale knowledge, and the inability to accommodate private corpora, without requiring costly retraining [10, 4, 20]. Standard RAG systems operate in three stages: offline indexing of chunked documents into a vector store, query-time retrieval of relevant chunks via embedding similarity, and context-conditioned generation [15]. While effective for surface-level factual recall, flat chunk retrieval cannot support reasoning over entity relationships or corpus-wide synthesis, since inter-entity dependencies are fragmented across independently indexed chunks [4, 2, 18, 6, 14]. SelfGraphRAG directly addresses this limitation: by replacing chunk-level retrieval with a graph retrieval model trained on synthetically generated supervision, it preserves the core RAG architecture while enabling multi-hop relational reasoning that flat-retrieval systems fundamentally cannot support, a natural extension to ISEEQ [3]. 2.2 Knowledge Graph Extraction and Graph-Based RAG To address the relational limitations of standard RAG, a family of methods constructs a knowledge graph from the document corpus during indexing and uses the graph structure to guide retrieval [2, 4]. GraphRAG supports both entity-level retrieval, retrieving local neighborhoods of topic nodes, and corpus-level retrieval via community detection and LLM-based summarization of each community, enabling global sensemaking over large corpora. LightRAG [4] simplifies this pipeline with dual-level retrieval but similarly relies on embedding similarity for entity matching. Both systems inherit a fundamental limitation: embedding-based retrieval assigns relevance based on surface-level semantic similarity to the query, which fails for multi-hop questions whose relevant nodes may be semantically distant from the query string [11]. SelfGraphRAG builds directly on the Doc2Graph stage of GraphRAG, reusing its entity and relation extraction pipeline without modification. It then departs from both GraphRAG and LightRAG by replacing embedding-similarity retrieval with a supervised graph retrieval model, targeting precisely the multi-hop failure mode that neither summarization nor embedding-based approaches can resolve. A complementary line of work proposes recursive abstractive summarization over retrieved text hierarchies. RAPTOR [13] constructs a tree of progressively abstracted summaries and retrieves at multiple levels of granularity, improving coverage of corpus-level questions. Unlike community summarization, RAPTOR preserves original passage text at leaf nodes, partially mitigating granularity loss. However, neither RAPTOR nor summarization-based GraphRAG approaches learn to retrieve based on question structure; their retrieval quality is bounded by embedding similarity regardless of the complexity of the query. SelfGraphRAG works in the direction of RAPTORâs motivation, retaining fine-grained evidence while supporting broad query coverage, but achieves this through trained graph retrieval rather than hierarchical summarization, avoiding the information loss that accompanies any abstractive step. HippoRAG [5] takes a structurally motivated alternative by modeling graph retrieval as personalized PageRank over the extracted knowledge graph, simulating associative memory recall without any training. While training-free, HippoRAGâs retrieval quality is directly bound by the quality of the extracted graph structure and cannot be improved through labeled supervision or task-specific fine-tuning. SelfGraphRAG improves upon HippoRAGâs core intuition that graph traversal should drive retrieval, but replaces the fixed PageRank heuristic with a learned scoring function. This allows SelfGraphRAG to adapt retrieval behavior to the question type, multi-hop inference versus neighborhood summarization, in a way that a training-free traversal strategy cannot. 2.3 Graph Retrieval Models Graph retrieval models learn to identify question-relevant subgraphs from a knowledge graph, replacing heuristic traversal with trained scoring [8][11]. G-Retriever [8] combines a graph transformer with a frozen LLM, training end-to-end on graph question-answer datasets to score and retrieve question-relevant subgraphs; it is the GraphLM backbone employed in SelfGraphRAG. SelfGraphRAG directly builds upon G-Retriever, preserving its architecture while solving the core barrier to its application: the absence of labeled QA data for privately extracted knowledge graphs. Rather than requiring hand-annotated data, SelfGraphRAG generates the training set that G-Retriever needs from the extracted graph itself, making the model applicable to any unlabeled corpus without additional annotation effort. SubgraphRAG [11] extends the graph retrieval paradigm with a lightweight MLP-based triple scorer and a parallel triple-scoring mechanism for efficient, flexible subgraph retrieval, but it requires both labeled QA pairs and topic entity annotations to initialize retrieval. GNN-RAG [12] trains a GNN to score answer candidate nodes and extracts shortest-path reasoning chains for LLM consumption, achieving state-of-the-art on WebQSP and CWQ; it similarly requires pre-specified question entities and labeled QA data tied to the target graph. SelfGraphRAG works in the direction of both SubgraphRAG and GNN-RAG, learning to retrieve structurally meaningful subgraphs rather than relying on embedding similarity, but removes their shared dependency on external supervision. The synthetic QA pairs generated by SelfGraphRAGâs SynthGen stage provide the labeled signal that SubgraphRAG and GNN-RAG assume is given, extending the applicability of supervised graph retrieval to the unlabeled, self-constructed graph setting [19]. The critical barrier shared by all graph retrieval models is the need for a labeled question-answer dataset aligned to the target knowledge graph[3]. When the graph is constructed by automated extraction from private documents, as in GraphRAG and LightRAG, no such dataset exists. SynthKG [1] independently proposes synthetic data generation for the complementary task of training the graph extractor rather than the graph retriever, demonstrating that LLM-generated supervision can match or exceed the quality of human annotation for structured extraction tasks. SelfGraphRAG applies the same self-supervised philosophy to the retrieval stage, treating SynthKG as a proof of concept that synthetic graph-derived data can substitute for human annotation, and extending it to produce training signal for the downstream graph retrieval model rather than for graph construction. 3 SelfGraphRAG Figure 1: The SelfGraphRAG process. Indexing mirrors GraphRAG through knowledge graph summarization. SynthGen then generates a question-answer dataset to train a graph retrieval model, which retrieves information from the graph at inference time. Task Definition: We consider the open-domain question answering task over a private, unlabeled document corpus. This setting is the deployment scenario motivating SelfGraphRAG: an organization holds a set of internal documents - clinical notes, technical reports, or similar, and wants a system that can answer natural language questions against that corpus, but has no pre-existing question-answer pairs tied to it and no practical way to produce them by hand at the scale required to train a supervised retriever. Formally, let =D1,D2,âŚ,DdD=\D_1,D_2,âŚ,D_d\ denote a collection of d text documents. Given a natural language query q, the goal is to produce a natural language answer a intended to be grounded in D, in the sense that the content of a should be traceable to facts stated somewhere in D rather than drawn from the answering modelâs own parametric knowledge. We assume D is unlabeled: no question-answer pairs annotated against D are assumed to exist prior to indexing, and no ground-truth supervision is provided to any system at index time. This assumption is what rules out directly training a supervised graph retriever on D and is the premise the rest of this section formalizes. The core challenge SelfGraphRAG addresses is a mismatch between what the best-performing retrieval strategy needs and what the unlabeled setting provides, graph retrieval models learn to score question-relevant subgraphs, but training them requires a labeled question-answer dataset grounded in the target graph, and by assumption no such dataset exists for D. One way to avoid this requirement altogether is to fall back on embedding-based retrieval, which needs no labeled data - but, as discussed in Section 2, embedding-based retrieval systematically under-serves multi-hop questions whose answer-relevant nodes are not lexically similar to the query, which is precisely the failure mode graph retrieval is meant to correct. SelfGraphRAG does not take this route. Instead, it self-supervises: rather than relying on an external labeled dataset, it uses the corpus graphâs own structure to determine what to ask, and an auxiliary LLM call to generate the question-answer pairs themselves, so that a supervised retriever becomes trainable even though no human-annotated data exists for D. Problem Formulation: Let MâĄ(â ,Ď)M(¡\,;\,Ď) denote a call to a large language model conditioned on system prompt Ď, taking a text input and returning a text output. We use this notation uniformly for all LLM invocations throughout the pipeline, with the prompt Ď distinguishing each distinct role (extraction, summarization, question generation); the notation is deliberately role-agnostic because every stage of SelfGraphRAG - indexing, synthetic data generation, and answer generation - is implemented as a differently-prompted call to the same class of underlying model. Let =(V,E)G=(V,E) denote a knowledge graph extracted from D. Each node vâVvâ V is a textual description of an entity mentioned in the corpus (for example, a clinical procedure, a person, or a condition), and each directed edge e=(vi,vj,r)âEe=(v_i,\,v_j,\,r)â E encodes a labeled relation r from entity viv_i to entity vjv_j, with vi,vjâVv_i,v_jâ V. The graph is thus a structured, queryable proxy for the relational content of D: information that in the source documents is scattered across sentences and chunks becomes, after extraction, a set of explicit entity-to-entity edges that a retriever can traverse. We write eiâje_ij as shorthand for the edge (vi,vj,r)âE(v_i,v_j,r)â E directed from viv_i to vjv_j; when the relation label r is needed explicitly, we write râĄ(vi,vj)r(v_i,v_j). For any subgraph ^=(V^,E^)â G=( V, E) - the hat distinguishing a subgraph selected out of G from the full graph itself - let VerbalizeâĄ(^)Verbalize( G) denote a linearization of G into a natural language string, formed by converting each triple (vi,vj,r)âE^(v_i,v_j,r)â E into the sentence âviv_i [r] vjv_jâ and concatenating the resulting sentences in edge-insertion order. This procedure is deterministic: the sentence template and the edge-insertion ordering are both fixed, so the same subgraph always maps to the same string, with no sampling or model call involved. We define VerbalizeVerbalize generically over any subgraph because it is applied twice later in this section to two different kinds of subgraph: once to the retrieved subgraph ^q G_q that a trained retriever returns for a query q (Equation 3, below), and once to the small induced subgraphs used to construct synthetic training questions in Stage 2. Determinism matters here: it lets us attribute any variability in downstream answers to which subgraph was retrieved, rather than to inconsistency in how the subgraph was described. Supervised graph retrieval. Let fθ:(q,)â^qf_θ:(q,\,G)â G_q denote a parameterized graph retrieval model with learnable parameters θ that, given query q and graph G, returns a retrieved subgraph ^qâ G_q . Unlike embedding-based retrieval, which scores nodes independently by similarity to q, fθf_θ is trained to score entire substructures of G jointly, which is what in principle allows it to recover relevant nodes that are several hops from any term in q. Let LMLM denote a large language model with frozen parameters used solely for answer generation, distinct from the extraction and generation LLMs used during indexing; freezing LMLM isolates the object being learned to fθf_θ alone, so that any change in answer quality across training runs can be attributed to the retriever rather than to drift in the answering model. The answer to query q is produced as: a=LMâĄ(q,VerbalizeâĄ(^q)).a\;=\;LM\! (q,\;Verbalize( G_q) ). Training fθf_θ requires a dataset =(qi,ai)i=1NT=\(q_i,\,a_i)\_i=1^N of N question-answer pairs grounded in G: without such pairs, there is no signal by which fθf_θ can learn to distinguish a relevant subgraph from an irrelevant one. Since D is unlabeled, T is unavailable. SelfGraphRAG synthesizes T directly from G, replacing manual annotation with structured LLM-driven question generation over graph substructures - the mechanism detailed in the SynthGen stage below. Three Stages of SelfGraphRAG: SelfGraphRAG operates in three sequential stages: Doc2Graph, which constructs G from D; SynthGen, which generates the synthetic training set T from G; and GraphLM, which trains fθf_θ on T and deploys it for inference. Figure 1 shows a high level overview of the steps involved. Stage 1: Doc2Graph. Let Lââ¤+L ^+ denote the maximum number of tokens per chunk. For each document DiâD_i , the chunking function ChunkTextâĄ(Di,L)=[Ci,1,Ci,2,âŚ,Ci,ki]ChunkText(D_i,\,L)\;=\;[C_i,1,\;C_i,2,\;âŚ,\;C_i,k_i] partitions DiD_i into kiâĽ1k_i⼠1 contiguous, non-overlapping text segments, where each chunk Ci,jC_i,j satisfies lenâĄ(Ci,j)â¤Llen(C_i,j)⤠L tokens. The global chunk set is: =âi=1dChunkTextâĄ(Di,L).C\;=\; _i=1^d\;ChunkText(D_i,\,L). Entity and relation extraction proceeds in two explicitly separate steps per chunk. Let Ďext _ext be the extraction prompt and Ďsumm _summ be the summarization prompt. For each chunk CâC : Step 1: Extraction. The LLM identifies raw entity mentions â°C=Îľ1,âŚ,ÎľpE_C=\ _1,âŚ, _p\ and raw relation mentions âC=Ď1,âŚ,ĎqR_C=\ _1,âŚ, _q\ from C: (â°C,âC)=MâĄ(C,Ďext).(E_C,\,R_C)\;=\;M(C\,;\, _ext). Step 2: Summarization. Each raw mention is independently condensed into a canonical node or edge label. Ďsumm _summ is parameterized by a mention_type field (entity or relation), so that entity and relation mentions receive type-appropriate canonicalization instructions despite sharing one prompt symbol. The chunk-level node and edge sets are: VC=MâĄ(Îľ,Ďsumm)âŁÎľââ°C,EC=MâĄ(Ď,Ďsumm)âŁĎââC.V_C= \\,M( \,;\, _summ)\; \; _C\, \,E_C= \\,M(Ď\,;\, _summ)\; \;Ď _C\, \. The global graph is the union over all chunks: =(âCâVC,âCâEC).G\;=\; ( _C V_C,\;\; _C E_C ). This stage reuses the GraphRAG indexing pipeline [2] without modification. The union above merges chunk-level node and edge sets without a deduplication or coreference step. When the same real-world entity is mentioned in two different chunks and independently canonicalized by Ďsumm _summ into two different node labels, G retains two disconnected nodes for one entity, and any relation that should connect them across chunks is not captured. We inherit this design directly from the unmodified GraphRAG indexing pipeline [2]; LightRAG addresses the same gap with an explicit de-duplication step, which is one reason we treat entity resolution as an open direction for strengthening Gâs coverage rather than a solved part of Doc2Graph. Stage 2: SynthGen. Figure 2: The SynthGen process. From the knowledge graph, two sets are formed: one of two-hop-connected nodes and another of 3 edges connected by singular nodes. The LLM is prompted to generate question-answer pairs from these sets, forming the SynthGen dataset. SynthGen generates two classes of question-answer pairs from G using generation prompts ĎQhop _Q^hop and ĎQsum _Q^sum (full templates in Appendix ), targeting distinct retrieval skills. Both prompt templates are fixed before training and applied uniformly across the graph. Multi-hop questions. These pairs train fθf_θ to retrieve non-adjacent nodes connected through intermediate entities. For each two-hop path in G - that is, for each tuple (vp,vo,vs)(v_p,v_o,v_s) such that epâoâEe_poâ E and eoâsâEe_osâ E, where vp,vo,vsâVv_p,v_o,v_sâ V are distinct and epâo=(vp,vo,r1)e_po=(v_p,v_o,r_1), eoâs=(vo,vs,r2)e_os=(v_o,v_s,r_2) for some relations r1,r2r_1,r_2, the LLM generates a question about the relationship between the endpoint nodes vpv_p and vsv_s mediated by vov_o: (qhop,ahop)(q^hop,\;a^hop) =MâĄ(VerbalizeâĄ(vp,epâo,vo,eoâs,vs),ĎQhop),\;=\;M\! (\,Verbalize(\v_p,e_po,v_o,e_os,v_s\)\,;\, _Q^hop ), where VerbalizeVerbalize is applied to the induced two-hop subgraph as defined above. We enumerate two-hop paths as they occur in G rather than sampling among them; in densely connected regions of G this can produce a large number of candidate paths, and we do not apply an additional filtering step beyond the tuple constraints given here. We restrict hopT^hop to two-hop paths, following established efforts in knowledge-graph question answering that frame reasoning chains within a two-hop scope [yih2016value],[talmor2018web], [12]. Bounding path length in this way keeps two-hop enumeration tractable regardless of the branching factor of G. This is a hyperparameter of SynthGen rather than a fixed constraint of the method, and can be extended to longer paths to capture relational chains beyond two hops. Node-summarization questions. These pairs train fθf_θ to aggregate evidence from a target nodeâs immediate neighborhood. For each node vpâVv_pâ V and a sampled set of three distinct in-neighbors vo,vs,vrâV\v_o,v_s,v_r\ V such that eoâp=(vo,vp,ro)âEe_op=(v_o,v_p,r_o)â E, esâp=(vs,vp,rs)âEe_sp=(v_s,v_p,r_s)â E, and erâp=(vr,vp,r)âEe_rp=(v_r,v_p,r_r)â E for some relations ro,rs,r_o,r_s,r_r, the LLM generates a question about vpv_p using only the information carried by its incoming edges: (qsum,asum)(q^sum,\;a^sum) =MâĄ(VerbalizeâĄ(eoâp,esâp,erâp),ĎQsum).=\;M\! (\,Verbalize(\e_op,e_sp,e_rp\)\,;\, _Q^sum ). Nodes with fewer than three in-neighbors do not admit a sample of the required size and are excluded from sumT^sum. We fix the in-neighbor sample size to three, following established efforts that bound neighborhood aggregation to a fixed size for tractable, well-formed context construction [7]. Fixing the size in this way keeps the verbalized neighborhood short enough for the LLM to reason over reliably, while still supplying more than a single edge of supporting evidence. This is a hyperparameter of SynthGen rather than a fixed constraint of the method, and can be increased to supply richer neighborhood context for nodes whose local structure warrants it. The complete synthetic training dataset as seen in Figure 2 is the union of both types: =hopâŞsum,||=N,T\;=\;T^hop\;âŞ\;T^sum, |T|=N, where hop=(qihop,aihop)T^hop=\(q_i^hop,a_i^hop)\ and sum=(qjsum,ajsum)T^sum=\(q_j^sum,a_j^sum)\ collect all generated pairs of each type, and N=|hop|+|sum|N=|T^hop|+|T^sum| is the total number of training examples. Stage 3: GraphLM. The graph retrieval model fθf_θ is trained on T with the frozen language model LMLM held fixed throughout. Formally, let â:ĂâââĽ0 :YĂY _⼠0 denote the token-level cross-entropy loss over the vocabulary Y, defined for a predicted token distribution y y and gold token sequence y as â(y^,y)=ââtlogPy^(yt) ( y,y)=- _t P_ y(y_t). The training objective is: θâ=argâĄminθâ(q,a)âźâ[ââĄ(LMâĄ(q,VerbalizeâĄ(fθâ(q,))),a)], splitθ^*\;=\; _θ\;E_(q,\,a)\, \,T\! [\, ~\! (LM (q,\,Verbalize(f_θ(q,G)) ),\;a ) ], split where gradients are propagated through fθf_θ only; the parameters of LMLM receive no gradient updates â a design choice that, as discussed in the faithfulness remark of Section 7, decouples whether a matches the gold answer aia_i from whether a is actually grounded in the retrieved subgraph. At inference time, the trained retrieval model supplies a query-specific subgraph to the same frozen LMLM: a^=LMâĄ(q,VerbalizeâĄ(fθââ(q,))). a\;=\;LM\! (q,\;Verbalize\! (f_θ^*(q,G) ) ). We instantiate fθf_θ as G-Retriever [8], a graph transformer trained end-to-end, and LMLM as a frozen Llama2-7b model, matching the backbone used across the RAG, GraphRAG, and LightRAG baselines in Section 4.2 so that retrieval method remains the primary variable of comparison. MoreHopQA: Retrieval â Reasoning â Answer Question. What is the square of the sum of the digits of the birth year of the person who wrote and illustrated a Japanese manga series based on a 16-year-old high school student, Ichitaka Seto? Retrieved relational evidence. Ichitaka SetoâIâsâMasakazu Katsuraâ1962Ichitaka SetoâIâ˛s Katsura 1962 SelfGraphRAG Justification. Iâs is written and illustrated by Masakazu Katsura, whose birth year is 1962. The sum of its digits is 1+9+6+2=181+9+6+2=18; therefore 182=32418^2=324. Prediction: 324 Gold: 324 Correct This formulation trains fθf_θ on the union hopâŞsumT^hop ^sum without isolating the contribution of either synthetic QA type, or of the G-Retriever architecture choice, to downstream performance. 4 Experimental Setup 4.1 Datasets We evaluate on three datasets selected to stress-test different dimensions of graph-based multi-hop retrieval. MoreHopQA is a multi-hop question answering benchmark constructed to require reasoning across multiple documents and entity relationships, with diverse answer types including yes/no, numerical, date, and named-entity responses [16]. It directly exercises the multi-hop retrieval capability that SelfGraphRAGâs SynthGen component is designed to train. MultiHop-RAG is a benchmark designed specifically to evaluate RAG systems on questions that require synthesizing information from multiple retrieved passages [17]. Its constrained answer format (yes/no or named entity) makes token-based precision and recall well-defined, enabling crisp comparison across retrieval strategies. PubMedQA is a biomedical question answering dataset requiring yes/no/maybe classification over research abstracts [9]. Its inclusion tests whether SelfGraphRAGâs graph-retrieval approach generalizes to domain-specific, classification-framed queries. For all three datasets, each row of source data is written to its own text document (or grouped into documents of 5-10 contexts for datasets with short, fragmented entries) to simulate the unlabeled fragmented corpora that SelfGraphRAG is designed for. Ground-truth question-answer pairs from each dataset are used exclusively for evaluation. SynthGen draws on the same per-benchmark document set described above. For each of MoreHopQA, MultiHop-RAG, and PubMedQA, T is generated from the identical G used at evaluation time, with no separate or held-out corpus. This matches the deployment scenario in Section 3, where only one private, unlabeled corpus exists to draw both training signal and evaluation queries from. 4.2 Baselines We compare SelfGraphRAG against four systems spanning four points in the retrieval design space: flat chunk retrieval, corpus-level community summarization, entity-level embedding retrieval, and trained graph retrieval. RAG (RoBERTa-Large embedder, Llama2-7b generator) is the flat-retrieval baseline, chunking and embedding documents with RoBERTa-Large so that the top-k chunks can be retrieved by cosine similarity and passed to Llama2-7b for generation. Run directly through PyTorch, this baseline establishes the performance floor achievable without any graph structure. GraphRAG (Mistral-7b generator, Snowflake-arctic-embed2-568m embedder) implements the community-detection and LLM-summarization pipeline of [2], run through a local Ollama API. As SelfGraphRAGâs immediate predecessor, it shares the Doc2Graph stage and instantiates the corpus-level summarization paradigm that SelfGraphRAG replaces with a trained retriever. LightRAG [4] (Mistral-7b generator, Snowflake-arctic-embed2-568m embedder) extracts a knowledge graph similar to GraphRAGâs, but adds a de-duplication step and retrieves via embedding similarity over low- and high-level entity descriptions rather than community summaries. Like GraphRAG, it runs through a local Ollama API and serves here as the entity-level, embedding-based baseline. SelfGraphRAG (Mistral-7b for Doc2Graph; Llama2-7b for G-Retriever training and inference) is the proposed system: it shares the Doc2Graph stage with GraphRAG but replaces embedding-based retrieval with a G-Retriever model trained on the SynthGen dataset. Like RAG, it runs directly through PyTorch. All four systems use locally hosted models rather than proprietary APIs, matching the private-corpus deployment setting this paper targets and keeping the comparison reproducible. Table 4 reports indexing and per-query inference time separately, isolating the overhead SynthGen and G-Retriever training add relative to the other systemsâ indexing costs. 4.3 Evaluation Metrics MoreHopQA and MultiHop-RAG are evaluated with token-level precision, recall, and F1 following standard open-domain QA practice, where answers are tokenized and matched against gold tokens. PubMedQA is evaluated as a three-class classification problem (yes/no/maybe), with per-class and macro-averaged accuracy, precision, recall, and F1 reported to account for class imbalance. 5 Results and Analysis Tables 1â4 report performance across all three benchmarks. We discuss the three main findings below. Method Accuracy Precision Recall F1 RAG 1.611.61 6.906.90 7.427.42 6.916.91 GraphRAG 3.853.85 9.189.18 10.5610.56 9.249.24 LightRAG 3.943.94 9.209.20 11.1411.14 9.239.23 SelfGraphRAG 4.61 12.49 13.56 12.59 Table 1: Results on MoreHopQA. Answers include yes/no, numerical, date, and named-entity types. Precision and recall are token-level. Best result per metric is bolded. Method Accuracy Precision Recall F1 RAG 1.021.02 1.871.87 26.6726.67 2.602.60 GraphRAG 0.000.00 0.000.00 0.160.16 0.010.01 LightRAG 0.000.00 0.500.50 25.5325.53 0.980.98 SelfGraphRAG 21.02 23.65 31.48 24.62 Table 2: Results on MultiHop-RAG. Answers are constrained to âYesâ, âNoâ, or a named entity. Token-level precision and recall are reported. Best result per metric is bolded. 5.1 SelfGraphRAG Consistently Outperforms Embedding-Based Baselines Across all three benchmarks, SelfGraphRAG outperforms both standard RAG and LightRAG on precision, recall, and F1 (Tables 1â4). The gain is most pronounced on MultiHop-RAG (Table 2), where SelfGraphRAG achieves an F1 of 24.62 versus 2.60 for RAG and 0.98 for LightRAG. This gap is attributable to the datasetâs requirement for multi-hop synthesis: RAGâs flat chunk retrieval surfaces individually relevant passages but fails to connect entities across documents, while LightRAGâs embedding-based graph retrieval assigns near-zero precision to queries whose answer nodes are semantically distant from the query string. SelfGraphRAGâs trained retrieval model, by contrast, learns to follow two-hop relational paths regardless of surface-level lexical overlap, directly addressing this failure mode. On MoreHopQA (Table 1), the gains are more modest (F1: 12.59 vs. 9.23 for LightRAG) but consistent across all metrics. The smaller margin reflects the datasetâs more diverse answer types - including numerical, date, and yes/no responses - which introduce variability that benefits all token-comparison-based systems equally. 5.2 LightRAGâs Recall Advantage Does Not Translate to Precision On MultiHop-RAG, LightRAG achieves a recall of 25.53 while returning near-zero precision (0.50) and F1 (0.98). This pattern is consistent with known failure modes of embedding-based graph retrieval: the system retrieves a broad neighborhood of nodes around the query embedding, producing high recall but flooding the LLM context with irrelevant triples that suppress answer extraction precision. SelfGraphRAG avoids this by training the retrieval model to score subgraph relevance discriminatively, producing subgraphs that are both sufficiently complete (recall: 31.48) and substantially more precise (precision: 23.65). A similar pattern appears on MoreHopQA, where LightRAGâs recall (11.14) exceeds RAGâs (7.42) but its precision (9.20) remains 3 points below SelfGraphRAGâs (12.49). This precision-recall imbalance across LightRAGâs results suggests that embedding-based graph retrieval consistently over-retrieves, and that the primary value of SelfGraphRAGâs supervised retrieval lies in improving precision rather than recall. 5.3 Domain-Specific Classification: PubMedQA On PubMedQA (Table 4), SelfGraphRAG achieves an overall accuracy of 55.2%, compared to 51.6% for RAG and 25.6% for LightRAG. The per-class breakdown reveals an important pattern. SelfGraphRAG substantially improves over RAG on the No class (accuracy: 29.4 vs. 0.0) and the Maybe class (accuracy: 36.6 vs. 0.6), both of which require integrating nuanced evidence across multiple result sections of biomedical abstracts - precisely the multi-hop reasoning that SelfGraphRAGâs retrieval is trained to support. RAGâs near-zero accuracy on No and Maybe reflects a known bias of flat-retrieval systems toward affirmative responses when retrieved passages are noisy. LightRAGâs surprisingly poor overall accuracy (25.6%) on PubMedQA, despite its reasonable recall on the other benchmarks can be attributed to the domain shift between its embedding model (Snowflake-arctic-embed2) and the specialized biomedical vocabulary of PubMed abstracts. This suggests that embedding-based graph retrieval is more sensitive to domain mismatch than trained retrieval, which encodes questionâsubgraph relevance through fine-tuning rather than cosine similarity in a fixed embedding space. 5.4 SelfGraphRAG Achieves Competitive Inference On MultiHop-RAG, LightRAG achieves a recall of 25.53 while returning near-zero precision (0.50) and F1 (0.98). This pattern is consistent with known failure modes of embedding-based graph retrieval: the system retrieves a broad neighborhood of nodes around the query embedding, producing high recall but flooding the LLM context with irrelevant triples that suppress answer extraction precision. SelfGraphRAG avoids this by training the retrieval model to score subgraph relevance discriminatively, producing subgraphs that are both sufficiently complete (recall: 31.48) and substantially more precise (precision: 23.65). A similar pattern appears on MoreHopQA, where LightRAGâs recall (11.14) exceeds RAGâs (7.42) but its precision (9.20) remains 3 points below SelfGraphRAGâs (12.49). This precisionârecall imbalance across LightRAGâs results suggests that embedding-based graph retrieval consistently over-retrieves, and that the primary value of SelfGraphRAGâs supervised retrieval lies in improving precision rather than recall. Method Overall Yes No Maybe Acc. Prec. Rec. F1 Acc. Prec. Rec. F1 Acc. Prec. Rec. F1 Acc. Prec. Rec. F1 RAG 51.6051.60 51.6051.60 51.6051.60 51.6051.60 51.0051.00 54.7254.72 92.3992.39 68.73 0.000.00 0.000.00 0.000.00 0.000.00 0.600.60 8.828.82 5.465.46 6.746.74 GraphRAG 28.2028.20 28.2028.20 28.2028.20 28.2028.20 20.0020.00 58.82 36.2336.23 44.8444.84 0.800.80 66.67 2.372.37 4.574.57 7.407.40 11.4211.42 67.27 19.53 LightRAG 25.6025.60 25.6025.60 25.6025.60 25.6025.60 18.4018.40 58.2358.23 33.3333.33 42.4042.40 0.800.80 57.1457.14 2.372.37 4.554.55 7.007.00 10.4510.45 63.6463.64 17.9517.95 SelfGraphRAG 55.20 55.20 55.20 55.20 78.80 58.5358.53 80.80 67.8867.88 29.40 49.4649.46 27.22 35.12 36.60 26.92 12.7312.73 17.2817.28 Table 3: Qualitative comparison on representative MoreHopQA and PubMedQA examples. Method Response MoreHopQA: What is the date one day after when Prince Nikolai of Denmarkâs mother was born? Gold: 1964-07-01 RAG June 30, 1964 GraphRAG Prince Nikolai of Denmarkâs mother, Alexandra, was born on June 30, 1964. Therefore, the answer is June 30, 1964. LightRAG Prince Nikolaiâs mother is Alexandra, Countess of Frederiksborg, who was born on June 30, 1964. Therefore, the requested date is June 30, 1964. SelfGraphRAG 1964-07-01. Prince Nikolaiâs mother, Alexandra, was born on June 30, 1964; applying the requested one-day offset gives July 1, 1964. PubMedQA: Is intrapartum vibroacoustic stimulation an effective predictor of fetal acidosis? Gold: Yes RAG Yes GraphRAG No; repeatedly qualifies VAS as not a definitive predictor. LightRAG Uncertain; describes the evidence as inconclusive. SelfGraphRAG Yes; correct label, but the justification introduces unsupported conditions. Table 4: Results on PubMedQA evaluated as a three-class classification problem (Yes / No / Maybe). Overall results report macro-averaged metrics. Per-class results report class-specific metrics. Best result per metric and class is bolded. Method MoreHopQA MultiHopRAG PubMedQA Index (h) Infer. (s) Index (h) Infer. (s) Index (h) Infer. (s) RAG 1.2931.293 5.2965.296 9.0169.016 7.0127.012 2.3022.302 4.1034.103 GraphRAG 4.3074.307 12.57112.571 23.20623.206 12.52412.524 6.1086.108 21.60021.600 LightRAG 2.0142.014 1.9871.987 15.84915.849 2.5452.545 3.4933.493 8.1198.119 SelfGraphRAG 4.6974.697 3.1773.177 23.11223.112 4.4554.455 6.4806.480 2.2662.266 Table 5: Performance comparison across datasets. Index time is reported in hours (h), and inference time is reported in seconds (s) per query. 5.5 Error Analysis Token-comparison metrics. Precision and recall on MoreHopQA and MultiHop-RAG are computed by token overlap between predicted and gold answer strings. This metric is well-calibrated for short, factoid answers (entity names, dates, yes/no) but penalizes paraphrase and partial answers equally. The low accuracy of all systems in Tables 1 and 2 relative to their F1 scores reflects the strictness of exact-match accuracy against diverse answer types; token-level F1 remains the primary metric for these datasets. PubMedQA class imbalance. The PubMedQA test set is heavily skewed toward Yes responses, inflating RAGâs raw accuracy relative to its near-zero performance on No and Maybe (Section 5.3). SelfGraphRAGâs more balanced per-class performance suggests its retrieval encodes richer evidential signal than a flat-retrieval baseline; the aggregate comparison between systems on this benchmark is subject to the Overall-row caveat noted in Section 5.3. Qualitative differences. Table 4 shows that the performance difference is not merely a consequence of response length or generation style. In the MoreHopQA example, answering correctly requires three dependent operations: resolving Prince Nikolaiâs mother, retrieving her birth date, and applying the requested one-day temporal transformation. SelfGraphRAG preserves this evidence chain through the final reasoning step, whereas the competing methods fail at specific intermediate stages of the chain. This provides a mechanistic explanation for the multi-hop improvement observed in the aggregate results. The PubMedQA example exposes a different limitation: SelfGraphRAG obtains the correct label but generates a justification containing conditions unsupported by the retrieved evidence. The failure therefore occurs after successful retrieval, at evidence-grounded generation, rather than at answer retrieval itself. Graph extraction flaws. SelfGraphRAG inherits the Doc2Graph stage from GraphRAG [2] without modification, including its absence of cross-chunk entity resolution. Errors introduced at this stage propagate through SynthGen into the synthetic training data itself, and through G-Retriever into retrieval at inference time. 6 Conclusion SelfGraphRAG addresses a central bottleneck in graph-based retrieval-augmented generation: graph retrieval models require labeled QA supervision, but automatically extracted knowledge graphs from private corpora provide none. By generating synthetic QA pairs directly from graph structure, SelfGraphRAG enables supervised graph retrieval without human annotation, bridging the gap between expressive graph reasoning and practical deployment on unlabeled data. Empirically, SelfGraphRAG outperforms embedding-based baselines on multi-hop reasoning and domain-specific classification, supporting the claim that learned structural retrieval better handles complex queries than surface-level semantic similarity. Future work should focus on (i) improving graph construction fidelity, (i) developing more semantically aligned evaluation metrics, (i) scaling to larger and standard multi-hop benchmarks, and (iv) exploring tighter integration between retrieval and generation. More broadly, this work suggests that synthetic supervision derived from structured representations can serve as a general paradigm for unlocking the full potential of graph-based reasoning in large language model systems. 7 Limitations SynthGen coverage and hyperparameters. The quality and diversity of SynthGenâs synthetic QA data may not match real-world query distributions, which may bias the trained retriever toward graph-local reasoning patterns and limit generalization to natural user queries. Two of SynthGenâs governing hyperparameters â the two-hop restriction on hopT^hop and the three-neighbor sample size for sumT^sum â are motivated by standard practice in KGQA benchmarking and GNN training respectively (Section 3), but neither was ablated against alternative values in this work; the extent to which retrieval quality is sensitive to either choice remains untested. Doc2Graph entity resolution. Doc2Graph performs no cross-chunk deduplication or coreference resolution: the same real-world entity mentioned in separate chunks can be canonicalized into distinct, disconnected nodes, silently dropping the relations that should connect them. This gap is inherited unmodified from GraphRAGâs indexing pipeline [2]; LightRAG addresses the same problem with an explicit de-duplication step, and closing this gap is a natural direction for improving Gâs coverage independent of any change to retrieval or training. Backbone choice and ablation scope. All systems in Section 4.2 share Llama2-7b or Mistral-7b as their generator; we did not evaluate SelfGraphRAG with a more recent open-weight backbone, so whether the reported gains persist, grow, or shrink under a stronger frozen LM is untested. Separately, our comparisons isolate retrieval method cleanly only within the RAG/SelfGraphRAG and GraphRAG/LightRAG pairs that share generator, embedder, and inference stack; cross-pair comparisons vary more than retrieval method alone. Within SelfGraphRAG itself, we report performance on the union hopâŞsumT^hop ^sum without isolating either QA typeâs individual contribution, or comparing G-Retriever against an alternative retriever architecture (Section 3, Remark on ablations). Datasets. Evaluation is limited to three benchmarks due to the computational cost of graph extraction and G-Retriever training, which prevented direct comparison against additional standard multi-hop datasets. For all three benchmarks, SynthGen is trained on the same corpus graph used at evaluation time, with no held-out document split (Section 4.1); this matches the single-corpus deployment scenario the method targets, but means we have not tested SynthGenâs behavior when the training and query-time corpora diverge. Out of scope. The problem definition requires a set of unlabeled documents as input. This precludes models that depend on pre-specified topic entities or labeled QA data tied to the target graph, e.g., SubgraphRAG and GNN-RAG, as candidate GraphLM instantiations under this formulation. 8 Ethical Considerations Private-corpus exposure. Our deployment setting (Section 3) assumes a private, unlabeled document corpus. To preserve data locality, all pipeline stages, extraction, summarization, question generation, and answer generation, use locally hosted models (Section 4.2). This reduces, but does not eliminate, exposure risk: replacing any Doc2Graph or SynthGen component with a hosted or proprietary LLM may transmit private document content, including sensitive extracted entities, beyond organizational boundaries. Compounding model bias. Doc2Graph, SynthGen, and answer generation each involve one or more separate LLM calls, meaning biases present in any of these modelsâ training data can enter the pipeline at multiple, compounding points â in what gets extracted as an entity or relation, in what questions SynthGen chooses to ask, and in how the frozen answering model phrases a response. We did not audit for such bias in this work, and its extent and downstream effect on retrieval or answer quality is a direction we leave open rather than a risk we can currently characterize. Acknowledgements This work was supported in part by a gift award from NeuralNest LLC, USISTEF Endowment Fund, and Faculty Startup Award. References [1] Choubey, P.K., Su, X., Luo, M., Peng, X., Xiong, C., Le, T., Rosenman, S., Lal, V., Mui, P., Ho, R., et al.: Scaling knowledge graph construction through synthetic data generation and distillation. In: International Conference on Learning Representations. vol. 2026, p. 109022â109042 (2026) [2] Edge, D., Trinh, H., Newman Cheng, J.B., Chao, A., Mody, A., Truitt, S., Metropolitansky, D., Ness, R.O., Larson, J.: From local to global: A graph rag approach to query-focused summarization, 2025. URL https://arxiv. org/abs/2404.16130 2404 (2025) [3] Gaur, M., Gunaratna, K., Srinivasan, V., Jin, H.: Iseeq: Information seeking question generation using dynamic meta-information retrieval and knowledge graphs. In: Proceedings of the AAAI conference on artificial intelligence. vol. 36, p. 10672â10680 (2022) [4] Guo, Z., Xia, L., Yu, Y., Ao, T., Huang, C.: Lightrag: Simple and fast retrieval-augmented generation. In: EMNLP (Findings). p. 10746â10761 (2025) [5] GutiĂŠrrez, B.J., Shu, Y., Gu, Y., Yasunaga, M., Su, Y.: Hipporag: Neurobiologically inspired long-term memory for large language models. Advances in neural information processing systems 37, 59532â59569 (2024) [6] Guttal, P., Magotra, V., Mahavishnu, V., Chanto, N., Sivaprasad, S., Gaur, M.: Structure-aware chunking for tabular data in retrieval-augmented generation. arXiv preprint arXiv:2605.00318 (2026) [7] Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. Advances in neural information processing systems 30 (2017) [8] He, X., Tian, Y., Sun, Y., Chawla, N.V., Laurent, T., LeCun, Y., Bresson, X., Hooi, B.: G-retriever: Retrieval-augmented generation for textual graph understanding and question answering. Advances in Neural Information Processing Systems 37, 132876â132907 (2024) [9] Jin, Q., Dhingra, B., Liu, Z., Cohen, W., Lu, X.: Pubmedqa: A dataset for biomedical research question answering. In: Proceedings of EMNLP-IJCNLP. p. 2567â2577 (2019) [10] Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., KĂźttler, H., Lewis, M., Yih, W.t., Rocktäschel, T., et al.: Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing systems 33, 9459â9474 (2020) [11] Li, M., Miao, S., Li, P.: Simple is effective: The roles of graphs and large language models in knowledge-graph-based retrieval-augmented generation. In: International Conference on Learning Representations. vol. 2025, p. 6061â6089 (2025) [12] Mavromatis, C., Karypis, G.: Gnn-rag: Graph neural retrieval for large language model reasoning. arXiv preprint arXiv:2405.20139 (2024) [13] Sarthi, P., Abdullah, S., Tuli, A., Khanna, S., Goldie, A., Manning, C.: Raptor: Recursive abstractive processing for tree-organized retrieval. In: International Conference on Learning Representations. vol. 2024, p. 32628â32649 (2024) [14] Saxena, Y., Gaur, M.: Neurosymbolic retrievers for retrieval-augmented generation. IEEE Intelligent Systems 41(1), 96â104 (2026) [15] Saxena, Y., Padia, A., Chaudhary, M.S., Gunaratna, K., Parthasarathy, S., Gaur, M.: Ranking free rag: Replacing re-ranking with selection in rag for sensitive domains. arXiv preprint arXiv:2505.16014 (2025) [16] Schnitzler, J., Ho, X., Huang, J., Boudin, F., Sugawara, S., Aizawa, A.: Morehopqa: More than multi-hop reasoning. arXiv preprint arXiv:2406.13397 (2024) [17] Tang, Y., Yang, Y.: Multihop-rag: Benchmarking retrieval-augmented generation for multi-hop queries. arXiv preprint arXiv:2401.15391 (2024) [18] Tilwani, D., Saxena, Y., Mohammadi, A., Raff, E., Sheth, A., Parthasarathy, S., Gaur, M.: Reasons: A benchmark for retrieval and automated citations of scientific sentences using public and proprietary llms. arXiv e-prints p. arXivâ2405 (2024) [19] Tilwani, D., Saxena, Y., Padia, A., Parthasarathy, S., Gaur, M.: Neurosymbolic ai for legal ai-trism: Trustworthy, reliable, interpretable, safe models. Neurosymbolic AI: Foundations and Applications p. 429â454 (2026) [20] Tilwani, D., Venkataramanan, R., Sheth, A.P.: Neurosymbolic ai approach to attribution in large language models. IEEE Intelligent Systems 39(6), 10â17 (2024)