Paper deep dive
When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation
Haolin Jin, Pengyue Yang, Huaming Chen
Intelligence
Status: succeeded | Model: Gemma-4-26B-A4B | Prompt: intel-v1 | Confidence: 93%
Last extracted: 8/23/2026, 2:19:20 AM
Summary
The paper introduces Intent-Guided Decoding (IGD), a framework for Retrieval-Augmented Generation (RAG) that arbitrates between retrieved context and parametric memory based on user intent. IGD addresses the trade-off between factuality and faithfulness by using answer-level filtering and token-level correction to steer decoding. It evaluates performance on faithful and factual-conflict benchmarks, showing significant improvements in factual recovery over Direct RAG while maintaining context-following behavior when required.
Entities (8)
Relation Signals (6)
Intent-Guided Decoding → improves → factual recovery
confidence 95% · IGD substantially improves factual recovery, achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG
Direct RAG → isoutperformedby → Intent-Guided Decoding
confidence 95% · achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG
Intent-Guided Decoding → uses → Token-Level Correction
confidence 95% · IGD uses answer-level filtering and token-level correction to steer the final decoding trajectory
Intent-Guided Decoding → uses → Answer-Level Memory Filter
confidence 95% · First, an Answer-Level Memory Filter handles high-confidence cases by routing to a stable memory answer
FaithEval → evaluates → contextual faithfulness
confidence 90% · FaithEval formalizes this issue as contextual faithfulness evaluation
Retrieval-Augmented Generation → suffersfrom → source trust problem
confidence 90% · it also introduces a source trust problem: retrieved context may be useful, irrelevant, or even misleading.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Retrieval-augmented generation (RAG) improves large language models by grounding generation in external evidence, but it also introduces a source trust problem: retrieved context may be useful, irrelevant, or even misleading. Existing RAG systems often apply a fixed trust policy toward retrieved evidence, which can either over-trust incorrect context or underuse context when the user explicitly asks for context-following behavior. Therefore, we propose Intent-Guided Decoding (IGD), a framework that arbitrates between retrieved context and parametric memory according to user intent. IGD uses answer-level filtering and token-level correction to steer the final decoding trajectory between retrieved context and parametric memory. We evaluate IGD on three faithful QA benchmarks and three factual-conflict benchmarks across five LLMs, IGD substantially improves factual recovery, achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG, while preserving or improving strict context-following behavior, this findings highlight the importance of balancing factuality and faithfulness in RAG.
Tags
Links
- Source: https://arxiv.org/abs/2608.16515v1
- Canonical: https://arxiv.org/abs/2608.16515v1
Trouble viewing inline? Open PDF directly →
Full Text
58,693 characters extracted from source content.
Expand or collapse full text
When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation Haolin Jin, Pengyue Yang, Huaming Chen Affiliation: School of Electrical and Computer Engineering The University of Sydney Sydney, NSW, Australia haolin.jin, pengyue.yang, huaming.chen@sydney.edu.au Abstract Retrieval-augmented generation (RAG) improves large language models by grounding generation in external evidence, but it also introduces a source trust problem: retrieved context may be useful, irrelevant, or even misleading. Existing RAG systems often apply a fixed trust policy toward retrieved evidence, which can either over-trust incorrect context or underuse context when the user explicitly asks for context-following behavior. Therefore, we propose Intent-Guided Decoding (IGD), a framework that arbitrates between retrieved context and parametric memory according to user intent. IGD uses answer-level filtering and token-level correction to steer the final decoding trajectory between retrieved context and parametric memory. We evaluate IGD on three faithful QA benchmarks and three factual-conflict benchmarks across five LLMs, IGD substantially improves factual recovery, achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG, while preserving or improving strict context-following behavior, this findings highlight the importance of balancing factuality and faithfulness in RAG. Index Terms: Retrieval-Augmented Generation, Large Language Models, Factuality, Faithfulness I Introduction Retrieval-augmented generation (RAG) has become a widely adopted paradigm for connecting large language models (LLMs) with external knowledge. By retrieving relevant evidence at inference time, retrieval-augmented generation extends the static parametric knowledge of LLMs with updatable non-parametric memory [25]. This design improves performance on knowledge-intensive tasks such as open-domain question answering, where models require access to facts beyond their internal parametric knowledge [11, 16, 13]. However, the effectiveness of RAG depends not only on whether useful evidence is retrieved, but also on whether the model can ground the generation in the retrieved evidence appropriately. In practice, RAG systems may still generate statements that are unsupported by, or even contradictory to, the provided context. RAGTruth systematically annotates nearly 18K RAG responses, and finds that non-factual statements remain common under standard RAG pipelines [34]. On the other hand, retrieval introduces a source-trust problem. Standard RAG pipelines often implicitly treat retrieved context as authoritative, which content may be false, adversarially corrupted, or inconsistent with stable world knowledge [41]. FaithEval formalizes this issue as contextual faithfulness evaluation, and constructs 4.9K high-quality examples across unanswerable, inconsistent, and counterfactual settings, showing that even strong contemporary LLMs often fail to maintain an appropriate degree of faithfulness to given context [32]. More broadly, situated faithfulness argues that models should dynamically calibrate their trust in external context against internal knowledge, rather than blindly following either source [12]. These findings suggest that a central challenge in RAG is not only how to retrieve useful evidence, but also how to decide whether the retrieved evidence should dominate generation [40, 9]. Fig. 1: The figure illustrates two truth mode examples: a faithful QA case where the retrieved context correctly supports the answer, and a factual-conflict case where the retrieved context is misleading. For each case, IGD first obtains branch-level previews and top-K token distributions, then applies token-level correction only when the context and memory branches exhibit distributional conflict. The correction direction is determined by entropy-based branch confidence and the prompt-mode prior, while the intervention strength is scaled by the reliability of the selected source. This issue exposes a fundamental trade-off between faithfulness and factuality in RAG generation. In some settings, the user explicitly expects the model to follow the provided context, for example when answering questions about a document, policy, or passage [33]. In other settings, the user expects the model to use retrieved context only as auxiliary evidence and remain skeptical when that context is misleading or conflicts with world knowledge [40, 9]. A fixed RAG behavior is therefore insufficient: always trusting context may improve contextual faithfulness but can harm factual correctness under misleading retrieval. Conversely, always discounting retrieved context may recover factuality against corrupted evidence but undermine user intent in strict context-following scenarios [7]. Practical RAG systems therefore require an intent-aware mechanism that can follow context when the user asks for contextual grounding, while resisting context when the user seeks factual robustness against unreliable retrieval. To address this challenge, we argue that RAG requires not only retrieval and grounding with external evidence, but also an explicit decoding-time arbitration mechanism that decides when generation should be controlled by retrieved context and when it should rely on parametric memory. In this work, we propose Intent-Guided Decoding (IGD), a decoding-time framework to address both factuality and faithfulness in RAG. In Figure 1, IGD decomposes generation into three conditional branches: a user branch conditioned on the original user prompt, a context branch that explicitly follows the retrieved context, and a memory branch that answers in a closed-book manner. IGD then performs source arbitration at two granularities. First, an Answer-Level Memory Filter handles high-confidence cases by routing to a stable memory answer when the retrieved context is likely misleading. Second, for the remaining cases, we propose a novel Token-Level Correction mechanism to adjust the user branch decoding distribution only when intervention is needed. Specifically, we leverage an activation gate to detect context-memory conflict, a confidence measurement to decide whether generation should move toward context or memory, and reliability scaling to determine the strength of the intervention. As a result, IGD pulls decoding toward memory when retrieved context is unreliable, while still pulling decoding toward context when the user explicitly requests faithful context following. Our method IGD introduces a novel decoding-time control layer for RAG, which shifts the focus from retrieving better evidence to arbitrating which knowledge source should steer generation. Unlike retrieval-centric methods that improve what or when to retrieve [17, 2, 42], IGD assumes retrieval has already occurred and addresses downstream conflict between retrieved context and parametric memory. Also, unlike context-faithfulness alignment methods that generally encourage stronger adherence to retrieved evidence [3, 45], IGD performs bidirectional trust calibration. It adapts the source preference according to user intent. Moreover, unlike prompt-based confidence reasoning or multi-agent evidence aggregation, IGD performs lightweight logit arbitration during generation. Its token-level correction is activated only when the context and memory branches exhibit distributional conflict, enabling local, conservative and intent-aware intervention without retraining the model or replacing the retrieval pipeline. Our contributions are summarized as follows. First, we formulate the factuality and faithfulness trade-off in RAG as an intent-conditioned source arbitration problem, where the appropriate trust policy depends on whether the user requests truth seeking robustness or strict context following. Second, we introduce IGD, a decoding-time framework that combines answer-level memory filtering with conservative token-level correction over user, context, and memory branches. Third, we evaluated and analysis the performance of IGD on three faithful benchmark settings and three factual-conflict benchmark settings. Fourth, we compare IGD against Direct RAG, confidence reasoning baselines such as SCR/RCR, and a multi-agent baseline in strict mode, and further test whether IGD preserves context-following behavior when the user explicitly asks to follow the provided context. Lastly, we release the replication package in 1. I Related Work Retrieval-augmented generation combines parametric language models (LM) with external evidence to improve knowledge intensive generation [25, 46]. Early and representative RAG systems differ in how they retrieve, encode, and consume evidence. Fusion-in-Decoder conditions generation on multiple retrieved passages and fuses evidence inside the decoder [13]. Atlas jointly trains a retrieval-augmented model for few-shot knowledge intensive learning [14]. In-Context RALM shows that LMs can benefit from retrieved documents inserted directly into the prompt [37]. Recent work has made retrieval more adaptive, with most remaining retrieval-centric by improving the retriever or training retrieval-aware generators. FLARE retrieves during generation based on predicted future content [17], Self-RAG trains models to retrieve and critique the outputs using reflection tokens [2], and CRAG evaluates retrieval quality and corrects low-confidence retrieved evidence [42]. Other works study hallucination, contextual faithfulness, and knowledge conflict in RAG. RAGTruth provides a corpus to analyze hallucinations in RAG and shows that retrieved evidence does not eliminate unsupported generation [34]. FaithEval evaluates whether models remain faithful under unanswerable, inconsistent, and counterfactual contexts [32]. ClashEval studies conflicts between an LLM’s internal prior and external evidence, showing that models can adopt incorrect retrieved content even when their internal knowledge is correct [41]. Context-DPO improves context faithfulness through preference optimization [3], while FaithfulRAG models fact-level conflicts between retrieved context and parametric knowledge to improve context-faithful generation [45]. Work on situated faithfulness further argues that LLMs should calibrate trust in external context based on both contextual evidence and internal confidence [12]. Our method shares this motivation of trust calibration, but targets a different control point. Instead of uniformly enforcing stronger adherence to retrieved context, IGD performs intent-aware source arbitration directly in the decoding distribution, allowing the model to favor either context or memory according to the prompt mode. I Method Intent-Guided Decoding (IGD) addresses context memory conflict by separating source arbitration into two decision granularities. Our method first applies an answer-level memory filter, which performs hard replacement only for high-confidence cases, all remaining examples are handled by token-level correction, which continuously adjusts the decoding distribution around the original user prompt. Figure 1 illustrates this token-level stage: IGD compares the context and memory branch distributions to activate correction only under meaningful conflict, estimates which branch is more reliable through entropy based confidence and source specific reliability, and then applies a signed logit correction that shifts the user branch distribution toward either the context or memory source. I-A Conditioned Branches At decoding step t, let puser,t(v)p_user,t(v) denote the next token distribution induced by the original user prompt for candidate token v. In a standard RAG prompt, this distribution already reflects the interaction between the user instruction, the question, and the retrieved context. IGD augments this original branch with two conditional branches: • pctx,t(v)p_ctx,t(v): a context-following branch explicitly instructed to answer according to the supplied context. • pmem,t(v)p_mem,t(v): a memory branch instructed to answer in a closed-book manner, independent of the supplied context. The user branch is the unmodified RAG branch: it conditions on the original instruction, question, and retrieved context. In contrast, the context branch is a deliberately source specific branch, we instantiate it with a support snippet selected from the retrieved context, rather than the full context, so that pctx,tp_ctx,t represents the local evidence most relevant to the question. The support snippet is selected using a lightweight IDF-based lexical localizer over context segments, following the classical term-specificity weighting idea of inverse document frequency [38]. The context branch therefore estimates what the model would generate under a strict context-following prompt, while the memory branch estimates what the model’s parametric knowledge supports when the retrieved context is removed. To reduce prompt sensitivity in closed-book decoding, we implement the memory branch as an ensemble of M prompt variants, following the common use of ensembling to stabilize model predictions [6]. In our implementation, M=3M=3, corresponding to a base memory prompt, an explicitly closed-book prompt, and a best-guess memory prompt: pmem,t(v)=1M∑i=1Mpmem,t(i)(v).p_mem,t(v)= 1M _i=1^Mp_mem,t^(i)(v). (1) I-B Answer-Level Memory Filter The first stage of IGD performs answer-level filtering before decoding, particularly for high-confidence cases in which the memory branch assigns substantially higher likelihood to the memory answer than to the context answer, while the original user branch does not prefer the context answer over the memory answer. Let y^ctx y_ctx denote a short preview answer generated by the context branch, and let y^mem y_mem denote the memory preview selected from the memory ensemble. For a candidate answer y=(y1,…,yL)y=(y_1,…,y_L) and branch b, we define the length-normalized answer likelihood, and for the memory ensemble we average this likelihood across memory views: ℓb(y) _b(y) =1L∑ℓ=1Llogpb(yℓ∣y<ℓ), = 1L _ =1^L p_b(y_ y_< ), (2) ℓmem-ens(y) _mem-ens(y) =1M∑i=1Mℓmem(i)(y). = 1M _i=1^M _mem^(i)(y). The filter evaluates the memory candidate against the context candidate under two distributions: mM m_M =ℓmem-ens(y^mem)−ℓmem-ens(y^ctx), = _mem-ens( y_mem)- _mem-ens( y_ctx), (3) mU m_U =ℓuser(y^mem)−ℓuser(y^ctx). = _user( y_mem)- _user( y_ctx). (4) Here, mMm_M measures whether the memory branch itself strongly prefers the memory candidate, while mUm_U checks whether the same candidate remains compatible with the full user prompt. This second condition prevents the filter from overriding the user instruction with a memory answer that the original prompt distribution strongly disfavors. Since this stage performs hard replacement, IGD uses a conservative dominance test rather than an averaged routing score: Dmem=min(mM−logρM,mU−logρU),D_mem= \! (m_M- _M,\;m_U- _U ), (5) where ρM _M and ρU _U are likelihood-ratio thresholds. Since mMm_M and mUm_U are differences of length-normalized log likelihoods, exp(mM) (m_M) and exp(mU) (m_U) can be interpreted as length-normalized candidate-level likelihood ratios. IGD routes directly to the memory preview only if validmem _mem =1, =1, (6) y^ctx y_ctx ≢y^mem, ≡ y_mem, Amem A_mem ≥0.67, ≥ 0.67, Dmem D_mem ≥0. ≥ 0. When these conditions hold, IGD sets y^final=y^mem y_final= y_mem; otherwise, decoding falls back to token-level correction. We use ρM=3.0 _M=3.0 and ρU=1.0 _U=1.0 by default, requiring the memory branch to prefer the memory candidate by at least a factor of three while the user branch must not prefer the context candidate. I-C Token-Level Correction IGD performs token-level source arbitration around the original user distribution, the goal is not to replace the distribution, but to gently adjust it when the context and memory branches disagree. This follows the general intuition of decoding time control, where generation is steered by modifying next token scores rather than updating model parameters [23, 29, 27]. pfinal,t(v)∝puser,t(v)(pctx,t(v)pmem,t(v))λtp_final,t(v) p_user,t(v) ( p_ctx,t(v)p_mem,t(v) ) _t (7) The scalar λt _t controls both the direction and magnitude of the intervention, positive values favor the context branch, negative values favor the memory branch, and values near zero leave decoding close to the original user distribution. IGD computes λt _t in three steps: activation, direction, and reliability scaling. I-C1 Activation IGD should intervene only when context and memory provide meaningfully different next token distribution. We therefore measure distributional conflict at step t between the context and memory branches using Jensen-Shannon divergence [28]: δt=JSD(pctx,t∥pmem,t) _t=JSD (p_ctx,t\,\|\,p_mem,t ) (8) For efficiency, JSD(⋅∥⋅)JSD(·\|·) is computed over a renormalized top-K token set rather than the full vocabulary we use K=16K=16. The conflict score is converted into a soft activation gate: at=[clip(δt−τlowτhigh−τlow,0,1)]γa_t= [clip ( _t- _low _high- _low,0,1 ) ]^γ (9) with τlow=0.10 _low=0.10, τhigh=0.35 _high=0.35, and γ=2.0γ=2.0. This gate suppresses correction when the two branches already agree and gradually activates intervention as source conflict increases. I-C2 Confidence Direction Conditioned on activation, IGD determines which source should be favored. We combine two signals: an instruction mode and branch level confidence, the instruction encodes the user’s intended trust policy or hard context-follow policy, while the branch confidence estimates how concentrated each branch’s next token distribution is. We use entropy-based confidence, which is a standard proxy for predictive uncertainty and calibration behavior in neural models, for each branch b∈ctx,memb∈\ctx,mem\, we define: rb,t=1−H(topK(pb,t))logKr_b,t=1- H(topK(p_b,t)) K (10) where H(⋅)H(·) is the entropy of the renormalized top-K distribution, and lower entropy corresponds to higher confidence. Let dmode∈(0,1)d_mode∈(0,1) denote the prior probability of trusting context under the current instruction mode, we use dstrict=0.9d_strict=0.9, and dtruth=0.3d_truth=0.3. The resulting context preference is: πctx,t=σ(logit(dmode)+log(rctx,t)−log(rmem,t)) _ctx,t=σ (logit(d_mode)+ (r_ctx,t)- (r_mem,t) ) (11) and the corresponding signed base coefficient is: λbase,t=λmaxat(2πctx,t−1) _base,t= _ \,a_t\, (2 _ctx,t-1 ) (12) This parameterization induces a intent consistent intervention direction: strict context following prompts start with a strong context prior, truth seeking prompts start with a memory prior, and the final direction can still change when one branch is substantially more confident than the other. I-C3 Reliability Scaling The base coefficient determines the direction of intervention, IGD then rescales its magnitude by the reliability of the source being favored. This prevents confident but poorly supported context from exerting excessive influence, and similarly prevents unstable memory predictions from overriding context. Context reliability When λbase,t>0 _base,t>0, IGD favors the context branch and estimates whether the selected snippet genuinely supports the context preview. Let y^ctx y_ctx be the context preview and xctxx_ctx be the selected support snippet, we define: sctx=0.7⋅Supp(y^ctx,xctx)+0.3⋅Qual(xctx) s_ctx=0.7·Supp( y_ctx,x_ctx)+0.3·Qual(x_ctx) (13) where Supp(⋅,⋅)Supp(·,·) measures local textual support for the preview answer and Qual(⋅)Qual(·) captures the evidential quality of selected snippet. Let validctx∈0,1valid_ctx∈\0,1\ indicate whether the context preview is a valid short-form answer, the context reliability is: qctx=qctxmin+(1−qctxmin)validctxsctxq_ctx=q_ctx +(1-q_ctx )valid_ctxs_ctx (14) Memory reliability When λbase,t<0 _base,t<0, IGD favors the memory branch and scales the intervention by the stability of the closed-book memory previews. qmem=qmemmin+(1−qmemmin)validmemAmemq_mem=q_mem +(1-q_mem )valid_memA_mem (15) We use qctxmin=0.35q_ctx =0.35 and qmemmin=0.55q_mem =0.55. Here, AmemA_mem is computed as the average pairwise answer consistency among the M closed-book memory previews: Amem A_mem =2M(M−1)∑1≤i<j≤M = 2M(M-1) _1≤ i<j≤ M (16) AnsCons(y^mem(i),y^mem(j)) ( y_mem^(i), y_mem^(j) ) where AnsCons(⋅,⋅)∈[0,1]AnsCons(·,·)∈[0,1] measures whether two short-form memory previews are equivalent answers. Final coefficient The final token-level coefficient is: λt=λbase,tqctx,λbase,t>0,λbase,tqmem,λbase,t<0,0,λbase,t=0. _t= cases _base,t\,q_ctx,& _base,t>0,\\[4.0pt] _base,t\,q_mem,& _base,t<0,\\[4.0pt] 0,& _base,t=0. cases (17) Thus, IGD intervenes only under source conflict, chooses the direction according to user intent and branch confidence, and scales the update by the reliability of the favored source. 11 1 Github Repository IV Experiment Setup IV-A Evaluation Design We evaluate IGD in retrieval-augmented short form answering questions. Each example consists of a question, a document-tagged context, and a prompt mode. We consider two prompt modes that represent different user intents. In strict mode, the model is instructed to answer strictly according to the provided context. In truth mode, the model is instructed to treat the context as potentially noisy or misleading and to prioritize the factually correct answer when context and world knowledge conflict. The two modes use the same question and context, only the user instruction changes. Direct RAG and IGD are evaluated under identical prompts, to isolate the effect of source arbitration during the decoding phase. We organize the evaluation into two groups. The faithful group contains standard QA settings where the context supports the gold answer, to test whether IGD preserves the benefits of retrieval. The factual-conflict group contains examples where the context answer conflicts with the world answer, to test whether IGD follows the context in strict mode while recovering the world-knowledge answer in truth mode. IV-B Benchmarks We evaluate on six QA benchmarks, grouped into three faithful QA benchmarks and three factual-conflict QA benchmarks, each contains 500 samples. The faithful group includes KILT-NQ, TriviaQA, and SQuAD. KILT-NQ is based on Natural Questions and the KILT Wikipedia corpus [24, 35]; TriviaQA contains trivia style open-domain questions with answer aliases and Wikipedia/web evidence [19]; and SQuAD is a paragraph level reading comprehension dataset built from Wikipedia [36]. For KILT-NQ and TriviaQA, we construct multi-document contexts by selecting an answer bearing passage and adding distractors; for SQuAD, we use the original paragraph as support and add distractor paragraphs from other examples. The factual-conflict group includes ConflictBank, NQ-Swap, and CounterFact. ConflictBank contains Wikidata-derived knowledge conflicts with generated misleading evidence [39]; NQ-Swap is constructed from Natural Questions/MRQA by replacing the original answer in the context with a substituted answer [24, 8]; and CounterFact is adapted from the factual association editing benchmark in ROME [31]. In these factual-conflict benchmarks, the original answer is treated as the world answer, while the misleading or substituted answer supported by the context is treated as the context answer. We apply alias cleaning and semantic filtering to remove ambiguous cases where the world and context answers are equivalent. IV-C Models and Baselines We evaluate five instruction-tuned LLMs: Qwen3-32B [44], Qwen2.5-14B-Instruct [43], Llama-3-8B-Instruct [10], Mistral-7B-Instruct-v0.3 [15], and Phi-4 14B [1]. These models cover different families and scales, allowing us to test whether IGD generalizes across models with different parametric knowledge and instruction-following behavior. Experiments were conducted on local GPU servers equipped with NVIDIA RTX A6000 GPU and two NVIDIA GeForce RTX 5090 GPUs. We compare IGD with six baselines. Closed-book Q-only receives only the question and no context, it is a diagnostic reference for parametric knowledge rather than a context using RAG method. Direct RAG receives the same question, context, and prompt-mode instruction as IGD, but generates directly from the original prompt without source arbitration. We also include confidence reasoning baselines from situated faithfulness work [12]: ExplicitSCR, which asks the model to explicitly reason about whether to trust the context or its internal knowledge, and three rule-based confidence reasoning variants, RCR-InternalEval, RCR-ContextEval, and RCR-InternalConf, which extract confidence or evaluation signals for internal and context-based answers and then select a final answer according to predefined rules. In addition, we compare with MADAM-RAG, a multi-agent RAG framework designed to aggregate and resolve conflicting retrieved evidence [40]. IV-D Evaluation Metrics We evaluate the answer accuracy using normalized alias matching, following standard QA evaluation practice [36, 19]. For faithful benchmarks, predictions are always matched against gold answers. For factual-conflict benchmarks, the target depends on the prompt mode: strict mode reports context accuracy, while truth mode reports world accuracy. Our main aggregate metric is the Intent-Aligned Score (IA), defined as the macro-average over the faithful and factual-conflict benchmark groups: IAm=∑d∈faithAccdgold+∑d∈confAccdm|faith|+|conf|.IA^m= _d _faithAcc^gold_d+ _d _confAcc^m_d|D_faith|+|D_conf|. (18) Here, m∈strict,truthm∈\ strict, truth\. For d∈confd _conf, AccdmAcc^m_d denotes context accuracy in strict mode and world accuracy in truth mode, IA therefore measures whether the model behavior matches the user’s intended trust policy rather than rewarding a single fixed preference for either context or memory. V Results TABLE I: Truth-mode comparison across three faithful benchmarks and three factual-conflict benchmarks. IA is the macro-average over the six benchmark columns. Bold marks the best context-using method in each column, and underline marks the second-best. IGD also reports deltas against Direct RAG under the same model and benchmark. Model Method IA Faithful benchmarks Factual-conflict benchmarks KILT-NQ TriviaQA SQuAD ConflictBank NQ-Swap CounterFact Qwen3-32B Closed-book Q-only† 56.8 35.4 62.0 32.4 56.4 70.0 84.6 Direct RAG 51.0 74.8 88.8 90.4 15.0 27.0 10.0 ExplicitSCR 12.9 16.0 18.4 15.8 4.0 3.0 20.2 RCR-InternalEval 62.1 58.2 74.6 47.8 47.8 70.5 73.6 RCR-ContextEval 53.6 68.8 80.0 83.2 21.0 37.0 31.4 RCR-InternalConf 59.9 50.0 69.0 41.8 46.6 77.5 74.8 MADAM-RAG 65.0 62.6 82.4 66.2 44.0 61.0 73.8 IGD 74.0 ↑ 23.0 72.2 ↓ 2.6 84.8 ↓ 4.0 89.8 ↓ 0.6 50.2 ↑ 35.2 71.5 ↑ 44.5 75.4 ↑ 65.4 Qwen2.5-14B Closed-book Q-only† 63.3 37.2 65.6 31.2 61.2 91.5 92.8 Direct RAG 58.1 74.2 90.2 94.2 12.0 42.0 36.0 ExplicitSCR 10.8 13.0 16.4 14.2 4.8 9.5 6.6 RCR-InternalEval 63.5 64.8 80.6 65.0 39.2 57.0 74.6 RCR-ContextEval 59.6 57.8 76.4 69.8 26.4 57.5 69.8 RCR-InternalConf 65.0 54.8 75.6 49.2 55.0 67.0 88.2 MADAM-RAG 59.7 57.4 71.8 61.0 38.2 63.0 66.6 IGD 77.6 ↑ 19.5 70.8 ↓ 3.4 85.6 ↓ 4.6 87.8 ↓ 6.4 55.4 ↑ 43.4 77.0 ↑ 35.0 89.4 ↑ 53.4 Llama-3-8B Closed-book Q-only† 55.7 37.8 69.8 26.8 55.6 68.5 75.8 Direct RAG 59.6 73.2 88.4 89.4 27.6 49.0 30.2 ExplicitSCR 11.2 9.8 8.8 8.8 2.4 16.0 21.2 RCR-InternalEval 59.7 59.8 81.0 58.8 41.0 55.0 62.8 RCR-ContextEval 53.3 42.6 68.6 33.2 42.2 61.5 71.6 RCR-InternalConf 52.1 45.0 75.2 40.6 32.2 56.0 63.8 MADAM-RAG 45.9 51.6 64.6 60.4 28.0 40.0 30.6 IGD 69.3 ↑ 9.6 68.4 ↓ 4.8 85.8 ↓ 2.6 85.0 ↓ 4.4 46.8 ↑ 19.2 62.0 ↑ 13.0 67.6 ↑ 37.4 Mistral-7B Closed-book Q-only† 51.8 39.2 66.2 24.2 39.4 68.5 73.0 Direct RAG 42.7 61.4 77.4 77.0 11.4 17.5 11.4 ExplicitSCR 26.6 23.2 32.0 22.6 17.6 21.0 43.2 RCR-InternalEval 45.7 50.0 72.8 41.4 26.2 44.0 40.0 RCR-ContextEval 47.0 57.0 76.4 72.8 10.6 22.5 42.4 RCR-InternalConf 50.1 49.6 74.2 38.2 36.6 40.5 61.4 MADAM-RAG 44.4 50.6 59.6 58.6 19.2 52.5 25.6 IGD 54.2 ↑ 11.5 58.4 ↓ 3.0 76.0 ↓ 1.4 73.0 ↓ 4.0 37.0 ↑ 25.6 43.0 ↑ 25.5 47.8 ↑ 36.4 Phi-4 14B Closed-book Q-only† 51.8 32.6 66.6 28.2 41.8 60.0 81.4 Direct RAG 56.9 71.0 87.2 85.8 15.8 35.5 46.2 ExplicitSCR 6.1 11.8 14.6 3.0 2.6 2.0 2.8 RCR-InternalEval 55.8 58.8 77.6 49.2 30.8 47.5 70.8 RCR-ContextEval 57.5 65.8 81.8 66.8 21.6 45.5 63.4 RCR-InternalConf 55.7 54.0 76.2 45.8 32.8 53.0 72.4 MADAM-RAG 61.1 61.6 79.8 59.0 32.2 57.0 77.2 IGD 67.1 ↑ 10.2 63.8 ↓ 7.2 85.8 ↓ 1.4 82.2 ↓ 3.6 34.8 ↑ 19.0 59.0 ↑ 23.5 77.0 ↑ 30.8 Fig. 2: Parametric recovery rate (PRR) of IGD on factual-conflict benchmarks, the dashed line denotes full recovery relative to the closed-book reference. V-A Closed-Book Performance Reveals the Recoverable Parametric Signal We first evaluate each model in the closed-book Q-only setting, where the model receives only the question without any retrieved context. It is important to interpret IGD because factual recovery from a misleading context is only possible when the underlying model can access the correct answer from its parametric memory, if the closed-book model cannot recover the world answer, the upper bound of any memory oriented correction is naturally limited [30, 21]. The closed-book results in Table I show that the difficulty of the six benchmarks differs substantially. Among the faithful benchmarks, closed-book accuracy is generally low on KILT-NQ and SQuAD, indicating that these datasets rely heavily on the provided context [24, 35, 36]. Across the five models, KILT-NQ closed-book accuracy remains around the mid 30% range, and SQuAD is even lower, mostly around 25-32%. This is expected: KILT-NQ is derived from open-domain queries grounded in Wikipedia evidence, while SQuAD questions are written against specific paragraphs and often require access to the original passage. In contrast, TriviaQA is substantially easier in the closed-book setting, with all models reaching above 60%, suggesting that many trivia-style answers are already encoded in the models’ parameters. For the factual-conflict benchmarks, closed-book performance is much higher overall, especially on CounterFact and NQ-Swap. CounterFact is the easiest factual-conflict benchmark under closed-book evaluation: all models achieve between 73.0% and 92.8%, suggesting that many subject relation facts remain accessible from parametric memory. NQ-Swap is also highly recoverable for several models, with Qwen2.5-14B reaching 91.5% and Phi-4 reaching 60.0%. ConflictBank is more challenging, with closed-book accuracy ranging from 39.4% to 61.2%. Overall, Qwen2.5-14B-Instruct shows the strongest closed-book IA score, while Qwen3-32B also exhibits strong recoverability on the factual-conflict benchmarks. These diagnostics suggest that IGD is evaluated in a meaningful regime: the factual-conflict examples are difficult for Direct RAG because the context is misleading, but many of their correct answers are still recoverable from model memory. V-B Truth Prompting Alone Does Not Calibrate Context Trust Table I shows that explicit truth seeking instructions alone are insufficient to prevent RAG models from being misled by incorrect context. In truth mode, the prompt explicitly instructs the model to prioritize the correct answer and to treat the provided context with skepticism when it may be misleading [41, 12]. Nevertheless, Direct RAG performs poorly on factual-conflict benchmarks across all models, this failure is most visible when comparing Direct RAG with the closed-book diagnostic. For example, Qwen2.5-14B answers NQ-Swap correctly 91.5% of the time in the closed-book setting, but drops to 42.0% once the misleading context is provided. The same model reaches 92.8% closed-book accuracy on CounterFact, but Direct RAG falls to 36.0%. The additional baselines further clarify that this problem is not fully solved by answer-level reasoning or confidence-based source selection. ExplicitSCR and RCR variants are designed to improve situated faithfulness by reasoning over, or extracting confidence from, internal and context-based answers [12], while MADAM-RAG uses multi-agent aggregation to handle conflicting retrieved evidence [40]. These methods often improve over Direct RAG on factual-conflict benchmarks, confirming that explicit source comparison is useful. However, their improvements are uneven: some variants recover more world answers but substantially reduce faithful QA accuracy, while others preserve context grounded performance but remain weak under misleading context. In contrast, IGD achieves the best IA score for every evaluated backbone in Table I. This suggests that the key difficulty is not only detecting whether context or memory is correct at the answer level, but also controlling how strongly each source should influence decoding. the desired behavior is not to simply suppress context, but to preserve context grounded accuracy on faithful examples while resisting misleading evidence in factual conflict cases. TABLE I: Strict context following prompt. Factual-conflict benchmarks are evaluated by context accuracy, testing whether IGD preserves user intent when the user explicitly asks to follow the provided context. Model Method IA Faithful benchmarks Factual-conflict benchmarks KILT-NQ TriviaQA SQuAD ConflictBank NQ-Swap CounterFact Qwen3-32B Direct RAG 83.0 72.6 89.4 91.0 83.2 63.0 99.0 IGD 84.3 69.4 ↓ 3.2 86.8 ↓ 2.6 90.0 ↓ 1.0 87.2 ↑ 4.0 72.5 ↑ 9.5 99.6 ↑ 0.6 Qwen2.5-14B Direct RAG 84.2 74.6 89.2 94.0 84.4 63.0 100.0 IGD 88.1 76.4 ↑ 1.8 88.6 ↓ 0.6 93.6 ↓ 0.4 89.2 ↑ 4.8 81.0 ↑ 18.0 100.0 ↔ 0.0 Llama-3-8B Direct RAG 80.8 73.0 88.0 88.4 85.4 50.0 99.8 IGD 82.0 71.0 ↓ 2.0 86.4 ↓ 1.6 87.6 ↓ 0.8 88.0 ↑ 2.6 59.0 ↑ 9.0 100.0 ↑ 0.2 Mistral-7B Direct RAG 77.1 64.0 79.6 80.8 82.6 59.5 96.0 IGD 77.6 60.6 ↓ 3.4 79.2 ↓ 0.4 82.0 ↑ 1.2 84.4 ↑ 1.8 62.5 ↑ 3.0 97.0 ↑ 1.0 Phi-4 14B Direct RAG 81.3 73.2 84.0 86.6 82.4 63.0 98.4 IGD 82.5 71.6 ↓ 1.6 83.2 ↓ 0.8 87.0 ↑ 0.4 85.6 ↑ 3.2 68.5 ↑ 5.5 99.2 ↑ 0.8 V-C IGD Balances Factuality and Faithfulness Truth mode: recovering world answers under misleading context. Table I shows that IGD substantially improves truth mode factual recovery while largely preserving faithful QA accuracy. Compared with Direct RAG, IGD improves the IA score for every model, with gains of 23.0 points for Qwen3-32B, 19.5 for Qwen2.5-14B, 9.6 for Llama-3-8B, 11.5 for Mistral-7B, and 10.2 for Phi-4. These gains are driven primarily by large improvements on factual-conflict benchmarks, where IGD consistently shifts generation away from misleading context and toward recoverable world knowledge. The comparison with external baselines provides a more informative view of this trade-off. Confidence-reasoning and multi-agent baselines can be strong on individual factual-conflict columns, but they often sacrifice accuracy on faithful benchmarks. For instance, RCR-style methods may recover more world-knowledge answers on a particular conflict set, but their faithful accuracy drops sharply because they rely on a global answer-level source decision. Similarly, MADAM-RAG improves some conflict cases, but its aggregation strategy does not consistently preserve original context-grounded behavior. The factual gains are large and systematic. Across all models, IGD improves every factual-conflict benchmark over Direct RAG, with the largest gain reaching 65.4 percentage points on Qwen3-32B CounterFact. Importantly, these gains do not come from discarding retrieval altogether. On faithful benchmarks, IGD remains close to Direct RAG, with moderate drops that are much smaller than the factual-conflict gains. This pattern suggests that token-level correction is more conservative than answer-level rerouting alone: it can weaken misleading context when necessary, while still preserving useful retrieved evidence when the context is correct. To better quantify how much of the recoverable parametric signal is restored, Figure 2 reports the parametric recovery rate (PRR), defined as the fraction of the gap between Direct RAG and closed-book Q-only that IGD recovers on factual-conflict benchmarks: PRR=AccIGD−AccDirectAccClosed−AccDirect.PRR= Acc_IGD-Acc_DirectAcc_Closed-Acc_Direct. (19) The PRR results show that IGD recovers a large portion of the available parametric knowledge for stronger models. For example, Qwen3-32B recovers most of performance gap on NQ-Swap and CounterFact, whereas Mistral-7B exhibits weaker recovery. This indicates that IGD’s factual correction is bounded by both the model’s accessible parametric knowledge and the reliability of the memory branch. The pattern in Figure 2 therefore reinforces the interpretation that IGD is not hallucinating new facts, but recovering parametric answers that are otherwise suppressed by misleading context. Strict mode: preserving context-following intent Table I evaluates the complementary setting: the user explicitly asks the model to follow the provided context. In this mode, factual-conflict benchmarks are evaluated by context accuracy rather than world accuracy, because the desired behavior is to follow the supplied evidence even when it conflicts with world knowledge. Since the external baselines in Table I are designed primarily for truth-seeking or correctness-oriented source selection, we keep the strict-mode comparison focused on Direct RAG and IGD. The results show that IGD preserves, and in many cases improves, strict context-following behavior. These strict prompt’s mode results are central to the claim that IGD balances factuality and faithfulness rather than optimizing only one side of the trade-off [7]. A method that simply discounts retrieved context would improve truth mode factual accuracy but damage strict context following [3, 45]. In contrast, IGD uses the prompt mode to determine the direction of intervention: under truth-seeking prompts it can pull decoding toward memory, while under strict context-following prompts it preserves or strengthens context guided decoding. VI Factuality and Faithfulness Trade-off TABLE I: Core ablations of IGD on Qwen2.5-14B. Values are macro-averaged percentages over the three faithful benchmarks and the three factual-conflict benchmarks. Shaded cells mark notable changes relative to IGD full: light red indicates drops of roughly 3–10 percentage points, darker red indicates drops larger than 10 points, and light green indicates improvements over IGD full. Variant Removed / changed component Strict mode Truth mode Faithful Gold Factual Ctx Faithful Gold Factual World IGD full none 86.2 90.1 81.4 73.7 w/o Answer Filter answer-level memory filter 85.8 86.0 81.3 63.0 w/o Token Correction token-level correction 86.9 83.1 82.7 52.8 w/o Activation Gate JSD conflict gate 85.9 86.2 77.5 70.5 w/o Mode Prior instruction-mode prior 86.6 83.4 82.7 63.1 w/o Reliability Gate qctx/qmemq_ctx/q_mem scaling 85.0 85.5 76.1 68.6 Single Memory View memory ensemble 86.1 85.8 85.5 54.5 We further analyze how IGD balances factual recovery and context faithfulness through component ablations and hyperparameter sensitivity. This analysis is motivated by the central tension in RAG, stronger reliance on parametric memory can recover world answers but may undermine strict context following [32, 12]. We conduct ablations on Qwen2.5-14B-Instruct over the same six-benchmark suite used in the main experiments, reporting macro averaged results over the three faithful benchmarks and the three factual-conflict benchmarks. Table I ablates six core components of IGD: the answer level memory filter, token-level correction, activation gate, instruction-mode prior, reliability scaling, and memory ensemble, we choose these ablations because each component directly affects the trade-off rather than merely changing implementation details. Table I shows that IGD’s gains arise from coordinated source arbitration rather than a single heuristic. Removing token-level correction causes the largest degradation, reducing truth-mode factual world accuracy from 73.7 to 52.8 and strict-mode factual context accuracy from 90.1 to 83.1. This indicates that token-level correction is not merely a memory side intervention, but the main mechanism for steering: it pulls decoding toward memory under misleading context while preserving context-following behavior when required. The answer-level memory filter provides a complementary high precision route for stable factual-conflict cases; removing it drops factual world accuracy to 63.0 while leaving faithful accuracy nearly unchanged, suggesting that the filter is conservative enough not to disrupt ordinary context-grounded QA. The remaining ablations explain how IGD avoids over-intervention, a single memory view sharply reduces factual recovery to 54.5, showing that memory side correction requires a stable closed-book signal; removing the activation or reliability gate degrades both faithful and factual columns, indicating that intervention must be triggered only under meaningful conflict and scaled by source reliability. Finally, removing the mode prior lowers both truth-mode factual recovery and strict-mode context accuracy, confirming that context and memory conflicts cannot be resolved with a fixed source preference, whereas the full IGD model provides a stable balance between factual recovery and context faithfulness. Fig. 3: Sensitivity of truth mode performance to token-level steering hyperparameters on Qwen2.5-14B-Instruct. Figure 3 further exposes the limitation of using fixed global steering hyperparameters. As λmax _ increases, factual world accuracy on factual-conflict benchmarks generally improves, but faithful accuracy on faithful benchmarks decreases. Similarly, smaller dtruthd_truth values make the router more memory biased and improve factual recovery, but they also make the model more likely to deviate from correct retrieved evidence. This creates a clear tuning trade-off: aggressive correction helps resist misleading context, whereas conservative correction better preserves faithful context use, this is a core limitation of the current framework. Future work could reduce this limitation by learning example adaptive intervention strengths, calibrating the router with validation feedback, or estimating source reliability at a finer granularity. Fig. 4: Answer distribution on factual-conflict benchmarks under truth mode. Beyond aggregate accuracy, we further analyze what models output on factual-conflict benchmarks. Main results report whether an answer matches the target, but they do not distinguish whether errors come from copying the misleading context, refusing to answer, or producing an unrelated alternative. We therefore categorize each output into four types: correct answer, misleading-context answer, unknown/refusal, and other answer. As shown in Figure 4, Direct RAG is dominated by misleading context answers: 57.9% of its outputs follow the incorrect context, while only 25.8% recover the correct world answer, IGD reverses this pattern, increasing correct answers to 58.3% and reducing misleading-context answers to 22.5%. At the same time, IGD does not convert all misleading context answers into correct answers, some mass moves into the other answer category. We interpret this as a residual uncertainty effect under source conflict: once decoding is pushed away from the misleading context, the model may still fail to land on the gold world answer if the memory branch is unstable, if competing aliases are plausible, or if the evidence conflict is not cleanly resolved. This is consistent with recent work showing that RAG models remain vulnerable under conflicting or noisy evidence and that models often generate plausible incorrect answers rather than abstaining when uncertainty is not explicitly rewarded [9, 4, 20]. Thus, IGD substantially mitigates context over-trust, but factual-conflict resolution remains imperfect when memory evidence is ambiguous or insufficiently calibrated. Fig. 5: Snippet localization accuracy versus downstream IGD performance. Figure 5 highlights a surprising mismatch between snippet localization quality and downstream IGD performance. The GPT-5 localizer substantially improves standalone snippet support accuracy, increasing faithful snippet accuracy from 83.0% to 99.0% and factual snippet accuracy from 79.0% to 87.0%. Intuitively, one might expect a better support localizer to improve IGD, since IGD uses snippet reliability to scale context-side intervention. However, the downstream results show the opposite: replacing the IDF localizer slightly reduces faithful accuracy, factual world accuracy, and IAS. This suggests that IGD does not only need a snippet that is semantically supportive under human or LLM judgment, it needs a snippet whose evidence is useful for the specific downstream generator and reliability function. The IDF localizer may select shorter, lexically concentrated spans that align better with answer-bearing tokens and IGD’s support heuristics, while the GPT-5 localizer may prefer semantically richer snippets that are correct in isolation but less discriminative for logit-level source arbitration [5, 22]. The result also aligns with evidence that robust RAG depends on preserving fine-grained textual details, not only high-level semantic support [18]. More broadly, LLM-based scoring or localization can introduce its own judgment biases and objective mismatch [26]. VII Conclusion We presented Intent-Guided Decoding (IGD), a decoding-time framework for resolving the factuality and faithfulness trade-off in retrieval-augmented generation. Rather than treating retrieved context as either universally authoritative or inherently suspect, IGD performs intent-conditioned source arbitration across the user prompt, retrieved context, and parametric memory. Experiments on faithful and factual-conflict benchmarks show that IGD improves intent-aligned generation across multiple LLMs, while ablations confirm that its gains arise from coordinated routing, conflict activation, reliability scaling, and memory stabilization. References [1] M. Abdin et al. (2024) Phi-4 technical report. arXiv preprint arXiv:2412.08905. Cited by: §IV-C. [2] A. Asai, Z. Wu, Y. Wang, A. Sil, and H. Hajishirzi (2024) Self-rag: learning to retrieve, generate, and critique through self-reflection. In The Twelfth International Conference on Learning Representations, Cited by: §I, §I. [3] B. Bi, S. Huang, Y. Wang, T. Yang, Z. Zhang, et al. (2024) Context-dpo: aligning language models for context-faithfulness. arXiv preprint arXiv:2412.15280. Cited by: §I, §I, §V-C. [4] J. Chen, B. Bi, W. Zhang, J. Sui, X. Zhu, et al. (2025) Rethinking all evidence: enhancing trustworthy retrieval-augmented generation via conflict-driven summarization. arXiv preprint arXiv:2507.01281. Cited by: §VI. [5] J. Deng, Y. Shen, Z. Pei, Y. Chen, and L. Huang (2025) Influence guided context selection for effective retrieval-augmented generation. arXiv preprint arXiv:2509.21359. Cited by: §VI. [6] T. G. Dietterich (2000) Ensemble methods in machine learning. In Multiple Classifier Systems, Lecture Notes in Computer Science, Vol. 1857, p. 1–15. Cited by: §I-A. [7] E. Fadeeva, A. Rubashevskii, R. Vashurin, S. Dhuliawala, A. Shelmanov, T. Baldwin, P. Nakov, M. Sachan, and M. Panov (2025) Faithfulness-aware uncertainty quantification for fact-checking the output of retrieval augmented generation. arXiv preprint arXiv:2505.21072. Cited by: §I, §V-C. [8] A. Fisch, A. Talmor, R. Jia, M. Seo, E. Choi, and D. Chen (2019) MRQA 2019 shared task: evaluating generalization in reading comprehension. In Proceedings of the 2nd Workshop on Machine Reading for Question Answering, p. 1–13. Cited by: §IV-B. [9] Z. Ge, Y. Wu, D. W. K. Chin, R. K. Lee, and R. Cao (2025) Resolving conflicting evidence in automated fact-checking: a study on retrieval-augmented llms. arXiv preprint arXiv:2505.17762. Cited by: §I, §I, §VI. [10] A. Grattafiori et al. (2024) The llama 3 herd of models. arXiv preprint arXiv:2407.21783. Cited by: §IV-C. [11] Y. Hu and Y. Lu (2024) RAG and rau: a survey on retrieval-augmented language model in natural language processing. arXiv preprint arXiv:2404.19543. Cited by: §I. [12] Y. Huang, S. Chen, H. Cai, and B. Dhingra (2024) Enhancing large language models’ situated faithfulness to external contexts. arXiv preprint arXiv:2410.14675. Cited by: §I, §I, §IV-C, §V-B, §V-B, §VI. [13] G. Izacard and E. Grave (2021) Leveraging passage retrieval with generative models for open domain question answering. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics, p. 874–880. Cited by: §I, §I. [14] G. Izacard, P. Lewis, M. Lomeli, L. Hosseini, F. Petroni, et al. (2022) Atlas: few-shot learning with retrieval augmented language models. arXiv preprint arXiv:2208.03299. Cited by: §I. [15] A. Q. Jiang, A. Sablayrolles, A. Mensch, C. Bamford, D. S. Chaplot, et al. (2023) Mistral 7b. arXiv preprint arXiv:2310.06825. Cited by: §IV-C. [16] P. Jiang, S. Ouyang, Y. Jiao, M. Zhong, R. Tian, and J. Han (2025) Retrieval and structuring augmented generation with large language models. In Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V. 2, p. 6032–6042. Cited by: §I. [17] Z. Jiang, F. Xu, L. Gao, Z. Sun, Q. Liu, J. Dwivedi-Yu, Y. Yang, J. Callan, and G. Neubig (2023) Active retrieval augmented generation. In Proceedings of the 2023 Conference on EMNLP, Singapore, p. 7969–7992. External Links: Document, Link Cited by: §I, §I. [18] Y. Jin, K. Sharma, V. Rakesh, Y. Dou, M. Pan, M. Das, and S. Kumar (2025) SARA: selective and adaptive retrieval-augmented generation with context compression. arXiv preprint arXiv:2507.05633. Cited by: §VI. [19] M. Joshi, E. Choi, D. S. Weld, and L. Zettlemoyer (2017) TriviaQA: a large scale distantly supervised challenge dataset for reading comprehension. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, p. 1601–1611. Cited by: §IV-B, §IV-D. [20] A. T. Kalai, O. Nachum, S. S. Vempala, and E. Zhang (2025) Why language models hallucinate. arXiv preprint arXiv:2509.04664. Cited by: §VI. [21] N. Kandpal, H. Deng, A. Roberts, E. Wallace, and C. Raffel (2023) Large language models struggle to learn long-tail knowledge. In Proceedings of the 40th International Conference on Machine Learning, Cited by: §V-A. [22] T. E. Kim and F. Diaz (2025) LTRR: learning to rank retrievers for llms. arXiv preprint arXiv:2506.13743. Cited by: §VI. [23] B. Krause, A. D. Gotmare, B. McCann, N. S. Keskar, S. Joty, R. Socher, and N. F. Rajani (2021) GeDi: generative discriminator guided sequence generation. In Findings of the Association for Computational Linguistics: EMNLP 2021, Punta Cana, Dominican Republic, p. 4929–4952. External Links: Document, Link Cited by: §I-C. [24] T. Kwiatkowski, J. Palomaki, O. Redfield, M. Collins, A. Parikh, et al. (2019) Natural questions: a benchmark for question answering research. Transactions of the Association for Computational Linguistics 7, p. 452–466. External Links: Document, Link Cited by: §IV-B, §V-A. [25] P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, et al. (2020) Retrieval-augmented generation for knowledge-intensive nlp tasks. In Advances in Neural Information Processing Systems, Vol. 33, p. 9459–9474. Cited by: §I, §I. [26] Q. Li, S. Dou, K. Shao, C. Chen, and H. Hu (2025) Evaluating scoring bias in llm-as-a-judge. arXiv preprint arXiv:2506.22316. Cited by: §VI. [27] X. L. Li, A. Holtzman, D. Fried, P. Liang, J. Eisner, T. Hashimoto, L. Zettlemoyer, and M. Lewis (2022) Contrastive decoding: open-ended text generation as optimization. arXiv preprint arXiv:2210.15097. Cited by: §I-C. [28] J. Lin (1991) Divergence measures based on the shannon entropy. IEEE Transactions on Information Theory 37 (1), p. 145–151. Cited by: §I-C1. [29] A. Liu, M. Sap, X. Lu, S. Swayamdipta, C. Bhagavatula, N. A. Smith, and Y. Choi (2021) DExperts: decoding-time controlled text generation with experts and anti-experts. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Cited by: §I-C. [30] A. Mallen, A. Asai, V. Zhong, R. Das, D. Khashabi, et al. (2023) When not to trust language models: investigating effectiveness of parametric and non-parametric memories. arXiv preprint arXiv:2212.10511. Cited by: §V-A. [31] K. Meng, D. Bau, A. Andonian, and Y. Belinkov (2022) Locating and editing factual associations in gpt. In Advances in Neural Information Processing Systems, Vol. 35. Cited by: §IV-B. [32] Y. Ming, S. Purushwalkam, S. Pandit, Z. Ke, X. Nguyen, et al. (2025) Faitheval: can your language model stay faithful to context, even if" the moon is made of marshmallows". In International Conference on Learning Representations, Vol. 2025, p. 29430–29456. Cited by: §I, §I, §VI. [33] X. Nguyen, S. Pandit, S. Purushwalkam, A. Xu, H. Chen, Y. Ming, Z. Ke, S. Savarese, C. Xiong, and S. Joty (2024) SFR-rag: towards contextually faithful llms. arXiv preprint arXiv:2409.09916. Cited by: §I. [34] C. Niu, Y. Wu, J. Zhu, S. Xu, K. Shum, R. Zhong, J. Song, and T. Zhang (2024) RAGTruth: a hallucination corpus for developing trustworthy retrieval-augmented language models. arXiv preprint arXiv:2401.00396. Cited by: §I, §I. [35] F. Petroni, A. Piktus, A. Fan, P. Lewis, M. Yazdani, et al. (2021) KILT: a benchmark for knowledge intensive language tasks. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online, p. 2523–2544. External Links: Document, Link Cited by: §IV-B, §V-A. [36] P. Rajpurkar, J. Zhang, K. Lopyrev, and P. Liang (2016) SQuAD: 100,000+ questions for machine comprehension of text. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, p. 2383–2392. Cited by: §IV-B, §IV-D, §V-A. [37] O. Ram, Y. Levine, I. Dalmedigos, D. Muhlgay, A. Shashua, K. Leyton-Brown, and Y. Shoham (2023) In-context retrieval-augmented language models. arXiv preprint arXiv:2302.00083. Cited by: §I. [38] K. Sparck Jones (1972) A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28 (1), p. 11–21. External Links: Document Cited by: §I-A. [39] Z. Su, J. Zhang, X. Qu, T. Zhu, Y. Li, J. Sun, J. Li, M. Zhang, and Y. Cheng (2024) ConflictBank: a benchmark for evaluating the influence of knowledge conflicts in llm. arXiv preprint arXiv:2408.12076. Cited by: §IV-B. [40] H. Wang, A. Prasad, E. Stengel-Eskin, and M. Bansal (2025) Retrieval-augmented generation with conflicting evidence. arXiv preprint arXiv:2504.13079. Cited by: §I, §I, §IV-C, §V-B. [41] K. Wu, E. Wu, and J. Zou (2024) ClashEval: quantifying the tug-of-war between an llm’s internal prior and external evidence. arXiv preprint arXiv:2404.10198. Cited by: §I, §I, §V-B. [42] S. Yan, J. Gu, Y. Zhu, and Z. Ling (2024) Corrective retrieval augmented generation. arXiv preprint arXiv:2401.15884. Cited by: §I, §I. [43] A. Yang et al. (2024) Qwen2.5 technical report. arXiv preprint arXiv:2412.15115. Cited by: §IV-C. [44] A. Yang et al. (2025) Qwen3 technical report. arXiv preprint arXiv:2505.09388. Cited by: §IV-C. [45] Q. Zhang, Z. Xiang, Y. Xiao, L. Wang, J. Li, X. Wang, and J. Su (2025) FaithfulRAG: fact-level conflict modeling for context-faithful retrieval-augmented generation. arXiv preprint arXiv:2506.08938. Cited by: §I, §I, §V-C. [46] X. Zhang, J. Zhang, F. Mo, D. K. Chandra, Y. Chen, F. Xie, and K. Liu (2025) Retrieval-augmented feature generation for domain-specific classification. In 2025 IEEE International Conference on Data Mining (ICDM), p. 943–952. Cited by: §I.