Paper deep dive
Enhancing LLMs in Predictive Political QA with Semi-Structured Data
Yinan Liu, Zihan Zhou, Zichun Jin, Xinyu Wang, Bin Wang, Xiaochun Yang
Intelligence
Status: not_run | Model: - | Prompt: - | Confidence: 0%
Entities (0)
Relation Signals (0)
No relation signals yet.
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Predictive political question answering (QA), such as predicting how a political actor will vote, goes beyond factual lookup. External political resources offer rich historical evidence, but rarely contain the answer itself. Existing LLM augmentation methods, including actor-profile-based simulation and knowledge graph evidence injection, improve political reasoning but largely treat external resources as knowledge-based evidence, leaving prediction-relevant signals under-modeled. We identify two complementary signals for predictive political QA: actor stances that capture issue-specific preferences, and high-order structure signals that capture indirect dependencies among political actors. We propose PSL, a dual-view framework that converts semi-structured political records into inference-oriented evidence for LLMs. PSL extracts stance signals from question-relevant actor records in a semantic view, and learns structure-aware actor representations from an actor interaction graph in a vector view. Across three real-world datasets and multiple LLMs, PSL consistently outperforms baselines, with ablations confirming the complementary gains of stance and structure signals.
Tags
Links
- Source: https://arxiv.org/abs/2608.21218v1
- Canonical: https://arxiv.org/abs/2608.21218v1
Trouble viewing inline? Open PDF directly →
Full Text
55,266 characters extracted from source content.
Expand or collapse full text
Enhancing LLMs in Predictive Political QA with Semi-Structured Data Yinan Liu *,† Zihan Zhou † Zichun JinXinyu WangBin WangXiaochun Yang School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China † Equal contribution. * Corresponding author. Abstract Predictive political question answering (QA), such as predicting how a political actor will vote, goes beyond factual lookup. External po- litical resources offer rich historical evidence, but rarely contain the answer itself. Exist- ing LLM augmentation methods, including actor-profile-based simulation and knowledge graph evidence injection, improve political rea- soning but largely treat external resources as knowledge-based evidence, leaving prediction- relevant signals under-modeled. We identify two complementary signals for predictive politi- cal QA: actor stances that capture issue-specific preferences, and high-order structure signals that capture indirect dependencies among po- litical actors. We propose PSL, a dual-view framework that converts semi-structured polit- ical records into inference-oriented evidence for LLMs. PSL extracts stance signals from question-relevant actor records in a semantic view, and learns structure-aware actor repre- sentations from an actor interaction graph in a vector view. Across three real-world datasets and multiple LLMs, PSL consistently outper- forms baselines, with ablations confirming the complementary gains of stance and structure signals. 1 Introduction Political question answering (QA) serves diverse information needs about political actors, policies, and events. Large language models (LLMs) pro- vide a powerful foundation for political QA, but their knowledge is often incomplete and unreli- able in specialized, long-tail settings (Sahoo et al., 2024). Augmenting LLMs with external political resources is therefore a natural direction (Cuconasu et al., 2024). The political domain contains abun- dant external data, including social background information 1 , electoral records 2 , and legislative vot- 1 https://w.wikipedia.org/ 2 https://ballotpedia.org/ ing records 3 , much of which is semi-structured or structured. However, many political QA tasks are not simple factual queries but predictive questions, such as predicting how a political actor will vote or respond to a future event (Yang et al., 2020; Galla and Burke, 2018). For these questions, external re- sources provide valuable records but rarely contain the answer directly, because the relevant behavior has not yet occurred and existing records serve only as indirect facts. Therefore, predictive political QA cannot be solved by direct factual retrieval alone. To the best of our knowledge, the closest recent studies are PAA (Li et al., 2025) and PEG (Mou et al., 2024), which enhance LLMs’ political rea- soning with external resources. PAA uses actor- profile-based simulation, organizing actors’ back- grounds and past behavior into textual profiles and prompting LLMs to simulate their decisions through role-playing. PEG uses knowledge-graph- based evidence injection, converting external re- sources into a knowledge graph (KG) and retriev- ing relevant structured evidence to augment LLMs. Both show the value of external resources for po- litical reasoning, but still largely treat them as knowledge-based evidence (e.g. Political Behav- ior Profiles in Fig. 1). Moreover, profile-based methods struggle to capture implicit group-level influence among political actors (Sowden et al., 2018), whereas KG-based methods often lose fine- grained context when extracting raw resources into triples (Wang and Han, 2025). What remains miss- ing is an evidence representation suited to predic- tive political reasoning, beyond treating external resources merely as knowledge-based evidence. In this work, we identify two complementary sig- nals encoded in political data. i) Actor stance sig- nals, i.e., their subjective attitudes toward specific issues, which reflect their values, ideology, or par- tisan interests (Burnham, 2025). Although implicit 3 https://legiscan.com/ arXiv:2608.21218v1 [cs.AI] 21 Aug 2026 in complex contexts, these signals possess greater reasoning potential compared to factual knowledge. i) High-order structure signals, i.e., the indirect dependencies within political actor interaction net- works, which aim to characterize group influence. Political actors are connected not only by direct ties but also through higher-order relational pat- terns. For example, an actor’s stance may influ- ence others through intermediary organizations or decision-makers, forming an indirect network of policy influence. Such network-embedded depen- dencies are difficult to express in natural language, often leading to verbose descriptions and noise. Semi-structured data formats provide a suitable ba- sis for modeling these two signals, as they preserve contextual detail while retaining the interactions among political actors encoded in the structure. In this work, we propose PSL, a dual-view frame- work that uses semi-structured political data to en- hance LLMs for predictive political QA. PSL ex- tracts and integrates two complementary types of signals: i) actor stance signals from a semantic view and i) high-order structure signals from a vector view. Specifically, PSL constructs an ac- tor profile in JSON format for each political actor from abundant records, and links actors via shared records to build an interaction graph. In the seman- tic view, PSL retrieves question-relevant records from profiles and infers extensible stance signals to capture an actor’s preference on a specific issue. In the vector view, PSL propagates information over the interaction graph to obtain actor representa- tions that encode high-order neighborhood signals. PSL then co-embeds the actor representation with the question-focus embedding, producing mutually refined vectors, and equips the LLM with structure- aware reasoning through lightweight fine-tuning. Finally, PSL integrates stances from the semantic view with collaborative representations from the vector view and injects them into the LLM, pro- viding stronger inferential evidence for predictive political QA. This work makes three contributions. First, we identify two complementary signals in semi- structured political records: actor stances and high- order structure signals. The former capture actors’ preferences on specific issues, whereas the latter characterize group influence revealed by shared po- litical behavior. Second, we propose PSL, a dual- view framework for these two signals: a seman- tic view extracts actor-stance signals, and a vector view models high-order structure signals, jointly enhancing LLMs’ predictive reasoning. Third, we conduct comprehensive experiments on three real- world datasets across different LLMs. The results demonstrate that PSL significantly outperforms all the baseline methods. Ablations verify the comple- mentary benefits of semantic stance evidence and vectorized structure signals. 2 The PSL Framework As illustrated in Figure 1, PSL derives inference- friendly evidence from semi-structured data through a dual-view strategy. The semi-structured format provides foundational support for this de- sign. Compared with KG triples, it preserves finer- grained context for stance extraction, while its structured fields support more precise retrieval and naturally enable the construction of an actor interac- tion graph. On this basis, PSL models political evi- dence from two views. Actor stances are expressed as natural-language judgments in the semantic view, whereas high-order structure signals are expressed as actor embeddings in the vector view. To enable joint use of these complementary signals, PSL in- troduces two levels of synergy. Within the vector view, inspired by collaborative filtering (Schafer et al., 2007), PSL co-embeds the actor and the ques- tion representations to produce mutually refined vectors, allowing the LLM to exploit structure sig- nals in downstream reasoning. Across the semantic and vector views, it injects stance and structure signals through a hybrid prompt. 2.1 Actor Stance Acquisition Political Behavior Profiles. We construct human- centered, domain-specific, and semi-structured po- litical behavior profiles that encapsulate factual knowledge related to U.S. politics, aiming to fa- cilitate political understanding without excessively compressing the underlying information. We first collect politically relevant data sourced from leg- islative and diplomatic records. Specifically, we obtain legislative data via the LegiScan API, which contains legislators’ voting records and bill descrip- tions. For diplomatic events, we extract interaction records involving political actors, particularly those pertinent to U.S. politics (Boschee et al., 2015). We reorganize these raw data into a human-centered structure (i.e.,file(P )). Based on these data, we extract a set of political actors, denoted byP. For each actorp ∈ P, we construct a corresponding political behavior profile, denoted byfile(p)in The features of [actor] are encoded in The features of the record are encoded in Collaborative encoding Question: What will Chip Roy vote on the bill : “ Respect for Marriage Act To repeal the Defense of...?” [] · · · Graph High-Order Structure Signals Acquisition Actor Stance Acquisition PSL Answer: Nay Question: What will Chip Roy vote on the bill... The stance of Chip Roy: [Stance] The features of Chip Roy are encoded in The features of the bill are encoded in LLM Reasoning with Hybrid Prompt Collaborative encoding ... ...... Maximize ... Similar with question focus ... ... ... ... ... ... 3-hop neighbor Initial embedding ... ... ... Retrieval (attribute 1) Retrieval (attribute 2) Chosen political actor Each record’s i-th attributeThe positive record’s embeddingThe negative record’s embedding Inner product ProfileAttribute Record ... Learning MLP Training LoRATuning The features of [actor] are encoded in The features of the record are encoded in Positive Negative Collaborative embeddings Ladder Retrieval Political Behavior Profiles Actor Interaction GraphNeighbor-Aware Actor Representation Construction Concatenate 2-hop neighbor 1-hop neighbor Chip Roy LLM LoRA SLM ... ... ... LLM LoRA Question focus Political actor Graph convolution Graph convolution Graph convolution LoRA Knowledge Distillation LLM Minimize The stance token sequence SLM LoRA Figure 1: Overview of our framework PSL. JSON format. The set offile(p)is denoted as file(P ). Each profilefile(p)consists of a set of records, where each recordr p ∈ file(p)is an object containing multiple attributes, and each at- tribute is expressed asa r p ∈ r p , which is a key- value pair describing the actor’s political behavior. For legislative events, each recordr p corresponds to a specific voting instance (i.e., voting record), with attributes such as the bill’s title, description, and the actor’s vote. For diplomatic events,r p de- notes a concrete interaction event, with attributes detailing the action type and involved parties. We summarize bill descriptions with a summarization model (Lewis et al., 2020a) and add them as an additional attribute to reduce token consumption. Ladder Retrieval. Given a questionq, we aim to retrieve the most relevant records fromfile(P ). We first utilize an LLM to decomposeqintop ∗ (the primary political actor) andq ∗ (the question focus conveying the essential semantic content needed to infer an appropriate response (Moldovan et al., 1999)). For instance, in “What vote will the po- litical actor cast on a description of a bill?”,q ∗ corresponds to the bill description. This decom- position is formalized asq LLM −→ (p ∗ ,q ∗ ). Once p ∗ is obtained, we match it to its corresponding political actorp s and retrieve a set of highly rele- vant records fromfile(p s ). Since eachr p contains multiple attributes, traditional embedding-based You will be provided with background informa- tion. Your task is to extract stance-relevant de- tails that might influencepoliticalactor’s vote on the bill:billcontent. Your goal is not to answer the question directly, but to identify and list the specific details that are most relevant to understanding howpoliticalactor might vote. Keep it concise. Take your time to consider. Background:R (n) Figure 2: The prompt template of stance inference for distillation. retrieval methods (Karpukhin et al., 2020; Khat- tab and Zaharia, 2020) often struggle to effectively exploit such structural attribute information and may introduce noise. Inspired by (Siddiquie et al., 2011; Macdonald and Tonellotto, 2021), we pro- pose ladder retrieval, an iterative retrieval strategy formalized as follows: R (i) = LR(R (i−1) ,q ∗ ,k i ).(1) This iterative process begins by initializing the record setR (0) asfile(p s ). During thei-th iter- ation, the retrieval function LR selectsk i records fromR (i−1) to generateR (i) . The selection is based on the semantic similarity betweenq ∗ and thei-th attribute of each record inR (i−1) . After niterations, this process yieldsR (n) , the topk n records most relevant to q. Stance Inference. Factual political records pro- vide indirect clues rather than explicit answers. We therefore extract their implicit preferences as con- cise, readable stance evidence. Compared with raw facts, such evidence is more issue-aligned and ex- poses cues such as behavioral consistency and ideo- logical orientation, providing a more targeted basis for LLM reasoning. To reduce overhead, we distill a large teacher model into a SLM via task-specific knowledge distillation (Gou et al., 2021). We con- struct political questions from behavior profiles by casting each record as a question, then retrieve the associated record setR (n) using ladder retrieval (Formula(1)). We prompt the teacher to extract stance-relevant information fromR (n) , yielding high-quality task data (template in Figure 2). Dur- ing training, the SLM takes the same inputs as the teacher and is optimized with a cross-entropy loss between its logits and the teacher’s tokenized out- puts, aligning its stance extraction behavior. Thus, qandR (n) can be input into the trained SLM via a predefined template as follows: R (n) ,q SLM −→S,(2) whereSis the question-related stance (detailed in Appendix). 2.2High-Order Structure Signals Acquisition Actor Interaction Graph. Although political be- havior profiles are independent, their actor-centered semi-structured format naturally supports an inter- action graph, where political actors are linked by shared records. This allows PSL to mine structural influence implicit in the data. Specifically, we con- struct a node for each actor and record. Forr p ∈ file(p), we construct an edge between the actorp and the recordr p . We represent the resulting inter- action graph asG I =(p,e pr ,r)⊆ P × E× R, wherePis the actor set,Ris the record set, and Eis the set of edges representing interactions be- tween actors and records. For each edgee pr ∈ E connectingpandr, its weight is defined as follows: for a voting record, the weight is set to1ifpvoted “Yea” onr, and−1otherwise. For a diplomatic record, the weight is set to1, indicating the ex- istence of an interaction betweenpandr. In this case, the absence of an interaction is denoted by the non-existence ofe pr rather than being assigned a weight of−1. For example,p 1 e p 1 r 5 −→ r 5 e p 3 r 5 ←− p 3 shows how a shared record connects two actors. Neighbor-Aware Actor Representation Con- struction. To obtain actor representations that cap- ture structural influence, we propagate information overG I . Similar to prior work (He et al., 2020), our main goal is to extract structure signals from G I . We therefore adopt a simple weighted-sum ag- gregator that iteratively smooths node embeddings over the graph: e (i+1) p = X r∈N p e pr 1 p |N p ||N r | e (i) r , e (i+1) r = X p∈N r e pr 1 p |N p ||N r | e (i) p . (3) Here,thesymmetricnormalizationterm 1/ p |N p ||N r |follows the standard GCN de- sign (Kipf and Welling, 2017), whereN p (resp. N r ) denotes the first-hop neighbors ofp(resp.r) and|N p |(resp.|N r |) denotes the size ofN p (resp. N r ). For each recordr, we initialize its embedding ase r via a frozen pre-trained embedding model (Reimers and Gurevych, 2019).The initial embeddings of political actors can be calculated by aggregating their neighbors as follows: e (0) r =e r , e (0) p = X r∈N p e pr 1 p |N p | p |N r | e r . (4) Afterlpropagation layers, we obtain multi- layerrepresentationsofp,denotedas (e (0) p ,e (1) p ,...,e (l) p ).Inspired by (Xu et al., 2018), we adopt a layer-aggregation mechanism to generate the political actor’s final representation by concatenating the first and last embeddings as ˆe p =e (0) p ||e (l) p , where||denotes the concatenation operation. 2.3 Synergistic Enhancement of LLM Reasoning To enable joint use of actor-stance and high-order structure signals, PSL introduces two levels of syn- ergy. Within the vector view, actor representations reside outside the LLM’s language space and are difficult to use directly. Inspired by prior work showing that LLMs can exploit collaborative vec- tors (Schafer et al., 2007; Zhang et al., 2024), we innovatively treat the actor as a user-like entity and the question focus as an item-like entity, and model their interaction through the actor and question- focus embeddings. The co-embedding module does more than reduce dimensionality into a shared latent space. By modeling actor–question inter- actions, it makes actor representations question- conditioned and acts as an implicit structural filter, highlighting relevant neighbors while suppressing structural noise. Specifically, since the dimension of the corresponding actor embeddingˆe p s is twice that of the question focus embeddinge q ∗ , we first align them by duplicating and concatenatinge q ∗ with itself, yieldingˆe q ∗ =e q ∗ ||e q ∗ to ensure di- mensional consistency. Here,q ∗ andp s are ob- tained from§2.1, ande q ∗ ande p s are their em- beddings, respectively. The computation ofˆe p s is provided in§2.2. Then, we feedˆe p s andˆe q ∗ into the co-embedding module (i.e., a trained MLP) separately to generate their collaborative represen- tation: ˆe p s ,ˆe q ∗ MLP −→ˆe ∗ p s ,ˆe ∗ q ∗ .(5) This process enables the LLM to more efficiently leverage their collaborative relationship to capture and utilize the high-order structure signals encoded in the actor representation. Next, to achieve synergy across the seman- tic and vector views, we integrate political actor stances with collaborative embeddings to support the LLM’s reasoning. This is achieved by populat- ing a predefined instruction templateTwith both explicit and implicit signals, and then injecting the filled template into the LLM to generate final an- swers that are grounded in the associated external knowledge: T (q,S, ˆ e ∗ p s , ˆ e ∗ q ∗ ) LLM Φ+Φ ′ −→ Answer,(6) whereLLM Φ+Φ ′ denotes the LLM slightly fine- tuned with LoRA (Hu et al., 2022). The tuning process will be detailed in the next section. 2.4 Learning MLP Training. To co-embed neighbor-aware po- litical actor representations with question repre- sentations, we leverage the records of political ac- tors asq ∗ to train the MLP defined by Formula (5). We design an objective function based on the Bayesian personalized ranking loss, which encour- ages the model to assign higher prediction scores to observed (positive) records than to unobserved (negative) ones: L =− X p∈P X r + ∈N + p X r − ∈N − p lnσ(y pr + − y pr − )+λ∥Θ∥ 2 , (7) wherey pr = ( ˆ e ∗ p ) T ˆ e ∗ r denotes the inner product between ˆ e ∗ p and ˆ e ∗ r ,λcontrols theL 2 regulariza- tion strength,Θdenotes the parameters of the MLP, N + p denotes the set of positive (observed) records, referring to those records for which the weight of e pr is 1,N − p denotes the set of negative (unob- served) records, including explicit negative voting records (the weight ofe pr is -1) and unobserved diplomatic records (e pr does not exist). More de- tails are provided in Appendix. LoRA Tuning. We randomly select800pairs of ˆ e p and ˆ e r , where ˆ e r is uniformly sampled from N + p andN − p . These pairs are processed by the trained MLP to produce collaborative embeddings ˆ e ∗ p and ˆ e ∗ r . Based on collaborative embeddings, we construct instructional samples via the natural lan- guage concatenation of ˆ e ∗ p and ˆ e ∗ r as input, and the relation betweenpandr, that is, the corresponding relation labele pr as output. These instructional samples are then used to fine-tune the LLM using LoRA (detailed in Appendix). 3 Experiments 3.1 Experimental Setting Datasets. We conduct experiments on three avail- able datasets (Mou et al., 2024) covering differ- ent political scenarios: (1) RCVP; (2) ICEWS; (3) StaId. The source code and datasets used in our paper are publicly available 4 . Evaluation Metrics. Following (Mou et al., 2024), we adopt the macro F1 score as the evaluation met- ric for the binary classification tasks (i.e., RCVP and StaId). For the multiple-choice task in ICEWS, we report accuracy. Setting Details. To assess the effectiveness of PSL, we employ Llama-3.1-8B-Instruct (Grattafiori et al., 2024), Mistral-7B-Instruct (Jiang et al., 2023), Deepseek-7B-Chat (Bi et al., 2024), and GPT-3.5-Turbo 5 as backbone models, with all ex- periments conducted under this default configu- ration unless otherwise noted. In the distillation stage, Flan-T5-Small (Chung et al., 2024) is used as the student SLM, while GPT-4o-mini 6 serves as the teacher model. The number of iterations in the ladder retrieval process, retrieved candi- datesk n , and propagation layerslare set to3,5, and2, respectively. The data used to train the MLP is entirely from the profile set. The net- 4 https://github.com/zhouzihan-liu/PSL 5 https://platform.openai.com/docs/models/gpt-3.5-turbo 6 https://platform.openai.com/docs/models/gpt-4o-mini Method RCVPICEWSStaId Llama-8B Mistral-7B Deepseek-7B Llama-8B Mistral-7B Deepseek-7B Llama-8B Mistral-7B Deepseek-7B Vanilla27.3627.3328.0318.4219.1819.6735.0033.3629.59 GKP (ACL’22)23.0726.2924.287.0914.379.6538.26 33.0434.76 RECITE (ICLR’23)25.0823.3814.9014.8916.9511.8131.8829.4727.49 LangChain31.1035.5224.378.0618.0619.0627.7129.5130.07 InstructRAG (ICLR’25)29.8421.6426.8111.577.7118.2131.5328.3032.97 KAPING (ACL’23)23.1523.9623.5920.5222.52 15.3636.2030.2834.22 MindMap route (ACL’24)20.5725.3622.3513.5419.2314.8934.9832.3131.76 MindMap lang (ACL’24)21.3724.1921.9112.6919.0411.6135.6931.5132.51 MindMap (ACL’24)18.6623.0221.5412.7022.0121.7034.7231.9731.51 PAA (AAAI’25)44.3541.7842.3531.3518.9924.5336.3427.4139.89 PSL55.9250.3043.5957.8154.6953.4248.5048.8350.58 Table 1: Experimental results of PSL with baselines. The best results are highlighted in bold, and the second best results are underlined. work architecture of the MLP is configured as 1536 −→ 1024 −→ 512 −→ 256 −→ 64 −→ 32. The regularization coefficientλis set to1× 10 −4 , and dropout is applied during training to improve gen- eralization. Following (Zheng et al., 2024), we fine-tune Llama using800samples for3epochs, with all other hyperparameters kept at their default settings. 3.2 Effectiveness Study We compare PSL with the following12methods. Vanilla, i.e., directly inputs questions into the LLM without any additional knowledge. GKP (Liu et al., 2022) prompts the LLM to generate knowledge relevant to the question and then appends these generated statements into the prompt to improve reasoning. RECITE (Sun et al., 2023) prompts the LLM to “recite” self-sampled memory-like pas- sages before answering, leveraging internalized knowledge for better QA performance. LangChain (Chase, 2022) retrieves political documents based on semantic similarity and uses them as prompts to improve answer generation. InstructRAG (Wei et al., 2025) prompts the LLM to generate rea- soning steps before answering, helping it better use the retrieved political documents. KAPING (Baek et al., 2023) retrieves political knowledge from KG based on semantic similarity and for- mats them as triples in prompts. MindMap (Wen et al., 2024) generates both the answer and a rea- soning path in a tree-like format for interpretabil- ity. MindMap route structures retrieved triples into paths, such as “climate policy debate−→related politicians−→John Smith, Emily Carter", and uses them to guide reasoning. MindMap lang converts the structured knowledge paths into natural lan- guage narratives, which are then used to prompt the LLM. PEG exp_sum (Mou et al., 2024) retrieves relevant political triples and summarizes them us- ing the LLM to facilitate downstream reasoning. PEG exp_GT R (Mou et al., 2024) clusters and sum- marizes selected triples via LLMs for final answer generation. PAA (Li et al., 2025) utilizes political actor profiles to guide LLMs in simulating leg- islative behavior for roll-call vote prediction. For document-enhanced methods (i.e., LangChain and InstructRAG), we treat each record in profiles as an independent document. For KG-enhanced meth- ods (i.e., KAPING, MindMap route , MindMap lang , MindMap, PEG exp_sum , and PEG exp_GT R ), the po- litical KG MVPKG (Mou et al., 2024) is uniformly adopted as the external knowledge source. For the agent-based method PAA, we follow the original approach and extract20records per political actor from our constructed profiles. Note that the raw data used to construct MVPKG fully encompasses the profiles we construct. To report the comparative results with PEG, since its core implementation has not been publicly released, we present the perfor- mance metrics as reported in the original paper. The results are summarized in Table 2. From the results shown in Table 1, we can see that PSL outperforms all baselines on three datasets with different LLMs. Models without external knowledge (i.e., GKP and RECITE) usually fail to surpass Vanilla, as LLMs struggle to generate accu- rate knowledge about political facts or future events. Document-enhanced methods perform well only over RCVP, with limited effectiveness elsewhere, due to challenges in accurately retrieving relevant information and the interference caused by direct text injection in complex reasoning over ICEWS and StaId. In contrast, KG-enhanced methods show stronger and more consistent performance. KAP- ING remains stable across three datasets, while MindMap and its variants, relying on entity-path retrieval, are less effective in future-oriented sce- narios. PAA achieves notable performance over MethodRCVP ICEWS StaId Vanilla34.1119.4033.24 GKP (ACL’22)20.4315.4045.32 RECITE (ICLR’23)15.7921.4035.57 KAPING (ACL’23)37.8320.8036.99 MindMap route (ACL’24)32.6028.0035.03 MindMap lang (ACL’24)38.5728.4042.19 MindMap (ACL’24)38.7225.6023.38 PEG exp_sum (W’24)40.6226.4042.12 PEG exp_GT R (W’24)41.2128.6046.21 PSL50.2345.8949.90 Table 2: Experimental results of PSL with all baselines under GPT-3.5. The best results are highlighted in bold, and the second best results are underlined. Results are taken from (Mou et al., 2024), except for PSL. RCVP. Although both PEG and PAA are designed to enhance LLMs in political tasks using external knowledge similar in content to that employed by PSL, PSL consistently outperforms them in all ex- perimental setups, which may be attributed to the fact that PSL can mine political knowledge from semi-structured data to enhance the LLM. Further- more, PSL also demonstrates competitive time effi- ciency, as detailed in Appendix. 3.3 Ablation Study We validate PSL’s components by removing actor stance (w/o Stance) or high-order structure (w/o Structure) on Llama-8B. Note that w/o Structure eliminates collaborative embeddings, restricting in- puts to stance and question text. Results in Table 3 show: (1) w/o Stance causes significant drops across all datasets, validating that retrieved records indeed capture critical issue-specific positions; (2) w/o Structure degrades performance, notably on RCVP and ICEWS , confirming that high-order signals capture group-level behavioral dependen- cies essential for voting and diplomatic prediction. 3.4 Parameter Study We examine the impact of retrieved records and propagation layers using Llama-8B (Figure 3). (1) Retrieved Records: Performance improves initially, peaking at 5 records for RCVP/ICEWS and 15 for StaId, before declining due to noise from irrele- vant content. StaId shows a wider growth range, AblationsRCVPICEWSStaId PSL55.9257.8148.50 w/o Actor Stance Acquisition46.1539.0746.17 w/o High-Order Structure39.3549.0246.35 Signals Acquisition Table 3: The results of ablation study for PSL. suggesting a need for richer context. Notably, PSL surpasses baselines across all settings. (2) Propagation Layers: Performance peaks at layer 2 (RCVP/ICEWS) and layer 3 (StaId). This con- firms that limited propagation captures essential structure signals, whereas deeper layers lead to over-smoothing and reduced discriminative power. 4 Further Analysis Effect Analysis of Different Components of Ac- tor Stance Acquisition. We investigate the im- pact of retrieval and stance inference by evaluat- ing PSL variants (without stance inference) using TF-IDF (Aizawa, 2003), BM25 (Robertson et al., 2009), Embedding (Reimers and Gurevych, 2019), and our Ladder Retrieval (PSL LR ). As shown in Ta- ble 4, all variants surpass the baselines and the “w/o Stance” ablation, demonstrating that profile records provide critical context for prediction. Specifi- cally, lexical methods (BM25, TF-IDF) yield lower scores due to their reliance on lexical overlap, fail- ing to capture semantic or structural dependencies. Conversely, PSL LR achieves the best performance among retrieval variants. This validates LR’s ef- fectiveness in leveraging hierarchical structural in- formation and handling missing data through score inheritance. Ultimately, the full PSL framework outperforms all variants, confirming that transform- ing isolated records into targeted stance informa- tion reduces noise and boosts overall performance. Effect Analysis of The Presentation Form for High-Order Structure Signals. We investigate representing high-order structure as text by retriev- ing records from similar neighbors. For each actor, we rank its directly connected neighbors by this similarity and select the top ones. Similarity be- tween two actors is computed from their shared record links: for each record connected to both, we add 1 if their edge weights match (both +1 or both -1) and subtract 1 if they differ. Figure 4 shows the (a) With varied parameter of the retrieved record number. (b) With varied parameter of the propagation layer number. Figure 3: Parameter study on the RCVP, ICEWS, and StaId datasets. VariantRCVPICEWSStaId PSL55.9257.8148.50 PSL T F−IDF w/o SI52.0756.7046.45 PSL BM 25 w/o SI51.8757.2245.94 PSL Embedding w/o SI52.9657.1646.69 PSL LR w/o SI53.8157.3447.10 Table 4: Performance of different variants of PSL. SI denotes the procedure of stance inference. 1 record per political actor2 records per political actor5 records per political actor10 records per political actor 12510 Number of similar political actors 36.8 37.1 37.4 37.7 38.0 Macro F1 (a) RCVP 12510 Number of similar political actors 40 42 44 46 48 50 Accuracy (b) ICEWS 12510 Number of similar political actors 45 46 47 48 49 Macro F1 (c) StaId Figure 4: Performance of PSL using different numbers of political actors’ neighbors and their records in the form of text. impacts. RCVP benefits from distributing retrieval across more actors, as top-ranked neighbors pro- vide the most valuable signals. Conversely, ICEWS performance declines with increased context due to noise from indirect records, whereas StaId im- proves with retrieval volume to compensate for missing statement profiles. Crucially, all text-based settings consistently underperform PSL. This cor- roborates our assertion that articulating complex relations in natural language leads to information overload, validating the necessity of PSL’s collabo- rative vector modeling. 5 Related Work LLM Augmentation via External Knowledge. External knowledge augmentation grounds LLMs in resources beyond their parameters. Document- based methods, such as REALM (Guu et al., 2020), RAG (Lewis et al., 2020b), and RePlug (Shi et al., 2024), retrieve relevant passages, whereas KG- based methods inject compact factual triples. KAP- ING (Baek et al., 2023) and DiagLink (Zhou et al., 2026) uses KG triples for question answer- ing; GPT4Graph (Guo et al., 2023) and NLGraph (Wang et al., 2023) study graph reasoning with LLMs; and ToG (Sun et al., 2024) and MindMap (Wen et al., 2024) construct reasoning paths over graph structure. These methods are mainly de- signed for settings where external knowledge can provide answers or explicit reasoning paths. Pre- dictive political QA is different: external resources record past behavior rather than the target behav- ior itself. Recent work has adapted external aug- mentation to political reasoning. PEG (Mou et al., 2024) injects retrieved triples from a political KG, whereas PAA (Li et al., 2025) simulates political actors from textual profiles. Both improve politi- cal reasoning, but their evidence forms are limited for prediction: KG triples lose fine-grained con- text, and textual profiles weakly capture implicit group influence. We instead derive stance evidence and structure signals from semi-structured political records. Political Actor Modeling. Political actor model- ing is central to computational political science. Classical approaches estimate actors’ ideological positions from roll-call votes, most notably through ideal point models (Clinton et al., 2004), later ex- tended with legislative text (Gerrish and Blei, 2011; Kraft et al., 2016). Graph-based methods further model political relations through co-sponsorship networks (Yang et al., 2020), contribution networks (Davoodi et al., 2020), and donation networks (Davoodi et al., 2022). Recent work enriches actor representations with external knowledge, includ- ing media coverage (Feng et al., 2021), social me- dia statements (Mou et al., 2021), Wikipedia, and policy-research materials (Feng et al., 2022). De- spite their effectiveness, the heterogeneity of these data sources results in high collection costs. In this paper, we construct political behavior profiles for political actors using open-access and continuously updated sources and inject actors’ stances and their complex political relationships into LLMs. 6 Conclusion We propose PSL, a framework that transforms semi- structured political records into inference-oriented evidence for predictive political QA. PSL enables textual semantics and graph-structural features to jointly strengthen LLM reasoning. This dual-view design, grounded in semi-structured data, provides a more prediction-oriented evidence representation. Moreover, compared with KG triples, PSL better preserves contextual detail; compared with text- profile simulation, it more fully models structural relations among actors. Experiments on multiple real-world datasets and LLMs show that PSL con- sistently outperforms existing augmentation meth- ods. More broadly, our results provide initial ev- idence that inference-oriented evidence beyond knowledge-based evidence is effective for predic- tive political QA. We will release the code and model checkpoints to facilitate further research. Limitations Data scope. This paper validates PSL in U.S. politi- cal settings, using public records such as legislative votes, bill information, and diplomatic events to construct semi-structured profiles and an interac- tion graph. This setting provides a clear experimen- tal basis for testing PSL’s core design: extracting actor stance signals and high-order structure sig- nals from commonly available political records to enhance predictive political QA. However, there remains room to broaden the data scope. On the one hand, future work could apply PSL to more countries, political systems, and language contexts to assess its generalizability across political en- vironments. On the other hand, existing records could also be extended to richer sources, such as co-sponsorship, committee activities, public state- ments, campaign donations, and policy texts. These extensions do not require changes to PSL’s basic de- sign, but could provide more comprehensive behav- ioral evidence for stance extraction and structure modeling. Signal fusion. This paper designs two comple- mentary signals to enhance predictive political QA. Experiments and ablation studies show that these signals provide effective reasoning evidence for LLMs from different perspectives. However, dif- ferent questions may rely on the two signals to different degrees. Some questions may depend more on an actor’s historical stance on related is- sues, whereas others may rely more on group-level behavioral patterns among political actors. Future work could explore adaptive fusion mechanisms that dynamically adjust the weights of the two sig- nals according to the question, actor, or political set- ting, enabling finer-grained modeling of evidence needs across predictive tasks. Acknowledgments The work was partially supported by the National Key Research and Development Program of China (No. 2024YFF0617702); the National Natural Science Foundation of China (Nos. U22A2025, 62402097, 62232007, and U23A20309); the Joint Funds of the Natural Science Foundation of Liaon- ing Province (No. 2023-BSBA-132); the 111 Project (No. B16009); the Ant Group Research Program (No. 2025021900003); and the Funda- mental Research Funds for the Central Universities (No. N2417007) References Akiko Aizawa. 2003. An information-theoretic perspec- tive of tf–idf measures. IPM, 39(1):45–65. Jinheon Baek, Alham Fikri Aji, and Amir Saffari. 2023. Knowledge-augmented language model prompting for zero-shot knowledge graph question answering. In NLRSE, pages 78–106. Xiao Bi, Deli Chen, Guanting Chen, Shanhuang Chen, Damai Dai, Chengqi Deng, Hongyuan Ding, Kai Dong, Qiushi E, and 1 others. 2024. Deepseek llm: Scaling open-source language models with longter- mism. arXiv. Elizabeth Boschee, Jennifer Lautenschlager, Sean O’Brien, Steve Shellman, James Starz, and Michael Ward. 2015. ICEWS Coded Event Data. Michael Burnham. 2025. Stance detection: a practical guide to classifying political beliefs in text. Political Science Research and Methods, 13(3):611–628. Harrison Chase. 2022. LangChain. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, and 1 others. 2024. Scaling instruction-finetuned language models. JMLR, 25(70):1–53. Joshua Clinton, Simon Jackman, and Douglas Rivers. 2004. The statistical analysis of roll call data. Ameri- can Political Science Review, 98(2):355–370. Florin Cuconasu, Giovanni Trappolini, Federico Sicil- iano, Simone Filice, Cesare Campagnano, Yoelle Maarek, Nicola Tonellotto, and Fabrizio Silvestri. 2024. The power of noise: Redefining retrieval for RAG systems. In SIGIR, pages 719–729. Maryam Davoodi, Eric Waltenburg, and Dan Gold- wasser. 2020. Understanding the language of politi- cal agreement and disagreement in legislative texts. In ACL, pages 5358–5368. Maryam Davoodi, Eric Waltenburg, and Dan Gold- wasser. 2022. Modeling U.S. state-level policies by extracting winners and losers from legislative texts. In ACL, pages 270–284. Shangbin Feng, Zilong Chen, Qingyao Li, and Minnan Luo. 2021. Kgap: Knowledge graph augmented po- litical perspective detection in news media. CoRR, abs/2108.03861. Shangbin Feng, Zhaoxuan Tan, Zilong Chen, Ningnan Wang, Peisheng Yu, Qinghua Zheng, Xiaojun Chang, and Minnan Luo. 2022. PAR: Political actor rep- resentation learning with social context and expert knowledge. In EMNLP, pages 12022–12036. Divyanshi Galla and James Burke. 2018. Predicting social unrest using GDELT. In MLDM, pages 103– 116. Sean Gerrish and David M. Blei. 2011. Predicting leg- islative roll calls from text. In ICML, pages 489–496. Jianping Gou, Baosheng Yu, Stephen J Maybank, and Dacheng Tao. 2021. Knowledge distillation: A sur- vey. IJCV, 129(6):1789–1819. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al- Dahle, and et al. 2024. The llama 3 herd of models. CoRR, abs/2407.21783. Jiayan Guo, Lun Du, and Hengyu Liu. 2023. Gpt4graph: Can large language models understand graph struc- tured data ? an empirical evaluation and benchmark- ing. CoRR, abs/2305.15066. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. Retrieval augmented language model pre-training. In ICML, pages 3929– 3938. Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yong- dong Zhang, and Meng Wang. 2020. Lightgcn: Sim- plifying and powering graph convolution network for recommendation. In SIGIR, pages 639–648. Edward J Hu, yelong shen, Phillip Wallis, Zeyuan Allen- Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. LoRA: Low-rank adaptation of large language models. In ICLR, pages 12513–12525. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Men- sch, Chris Bamford, Chaplot Devendra, Guillaume Lample, Kevin Leach, Pierre Stock, Teven Le Scao, and 1 others. 2023. Mistral 7b. arXiv. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick SH Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. Dense passage re- trieval for open-domain question answering.In EMNLP, pages 6769–6781. Omar Khattab and Matei Zaharia. 2020. Colbert: Effi- cient and effective passage search via contextualized late interaction over BERT. In SIGIR, pages 39–48. Thomas N. Kipf and Max Welling. 2017.Semi- supervised classification with graph convolutional networks. In ICLR, pages 2713–2726. Peter Kraft, Hirsh Jain, and Alexander M. Rush. 2016. An embedding model for predicting roll-call votes. In EMNLP, pages 2066–2070. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020a. BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and com- prehension. In ACL, pages 7871–7880. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K ̈ "uttler, Mike Lewis, Wen-tau Yih, Tim Rockt ̈ "aschel, Sebastian Riedel, and Douwe Kiela. 2020b. Retrieval-augmented generation for knowledge-intensive NLP tasks. In NeurIPS, pages 9459–9474. Hao Li, Ruoyuan Gong, and Hao Jiang. 2025. Political actor agent: Simulating legislative system for roll call votes prediction with large language models. In AAAI, pages 388–396. Jiacheng Liu, Alisa Liu, Ximing Lu, Sean Welleck, Pe- ter West, Ronan Le Bras, Yejin Choi, and Hannaneh Hajishirzi. 2022. Generated knowledge prompting for commonsense reasoning. In ACL, pages 3154– 3169. Craig Macdonald and Nicola Tonellotto. 2021. On ap- proximate nearest neighbour selection for multi-stage dense retrieval. In CIKM, pages 3318–3322. Dan I. Moldovan, Sanda M. Harabagiu, Marius Pasca, Rada Mihalcea, Richard Goodrum, Roxana Girju, and Vasile Rus. 1999. LASSO: A tool for surfing the answer net. In TREC, pages 65–73. Xinyi Mou, Zejun Li, Hanjia Lyu, Jiebo Luo, and Zhongyu Wei. 2024. Unifying local and global knowledge: Empowering large language models as political experts with knowledge graphs. In W, pages 2603–2614. Xinyi Mou, Zhongyu Wei, Lei Chen, Shangyi Ning, Yancheng He, Changjian Jiang, and Xuanjing Huang. 2021.Align voting behavior with public state- ments for legislator representation learning.In ACL/IJCNLP, pages 1236–1246. Nils Reimers and Iryna Gurevych. 2019. Sentence-bert: Sentence embeddings using siamese bert-networks. In EMNLP-IJCNLP, pages 3980–3990. Stephen Robertson, Hugo Zaragoza, and 1 others. 2009. The probabilistic relevance framework: Bm25 and beyond. FTIR, 3(4):333–389. Pranab Sahoo, Prabhash Meharia, Akash Ghosh, Sri- parna Saha, Vinija Jain, and Aman Chadha. 2024. A comprehensive survey of hallucination in large lan- guage, image, video and audio foundation models. In EMNLP, pages 11709–11724. J. Ben Schafer, Dan Frankowski, Jon Herlocker, and Shi- lad Sen. 2007. Collaborative filtering recommender systems. The Adaptive Web, pages 291–324. Weijia Shi, Sewon Min, Michihiro Yasunaga, Min- joon Seo, Richard James, Mike Lewis, Luke Zettle- moyer, and Wen-tau Yih. 2024. REPLUG: retrieval- augmented black-box language models. In NAACL, pages 8371–8384. Behjat Siddiquie, Rogério Schmidt Feris, and Larry S. Davis. 2011. Image ranking and retrieval based on multi-attribute queries. In CVPR, pages 801–808. Sophie Sowden, Sofia Koletsi, Eva Lymberopoulos, Elisabeta Militaru, Caroline Catmur, and Geoffrey Bird. 2018. Quantifying compliance and acceptance through public and private social conformity. Con- sciousness and Cognition, 65:359–367. Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Saizhuo Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, Heung- Yeung Shum, and Jian Guo. 2024. Think-on-graph: Deep and responsible reasoning of large language model on knowledge graph. In ICLR, pages 14199– 14229. Zhiqing Sun, Xuezhi Wang, Yi Tay, Yiming Yang, and Denny Zhou. 2023. Recitation-augmented language models. In ICLR, pages 31171–31193. Heng Wang, Shangbin Feng, Tianxing He, Zhaoxuan Tan, Xiaochuang Han, and Yulia Tsvetkov. 2023. Can language models solve graph problems in natural language? In NeurIPS, pages 30840–30861. Jingjin Wang and Jiawei Han. 2025. PropRAG: Guiding retrieval with beam search over proposition paths. In EMNLP, pages 6223–6238. Zhepei Wei, Wei-Lin Chen, and Yu Meng. 2025. In- structRAG: Instructing retrieval-augmented genera- tion via self-synthesized rationales. In ICLR, pages 66510–66533. Yilin Wen, Zifeng Wang, and Jimeng Sun. 2024. Mindmap: Knowledge graph prompting sparks graph of thoughts in large language models. In ACL, pages 10370–10388. Keyulu Xu, Chengtao Li, Yonglong Tian, Tomo- hiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation learning on graphs with jumping knowledge networks. In ICML, pages 5449–5458. Yuqiao Yang, Xiaoqiang Lin, Geng Lin, Zengfeng Huang, Changjian Jiang, and Zhongyu Wei. 2020. Joint representation learning of legislator and legis- lation for roll call prediction. In IJCAI, pages 1424– 1430. Yang Zhang, Keqin Bao, Ming Yan, Wenjie Wang, Fuli Feng, and Xiangnan He. 2024. Text-like encoding of collaborative information in large language models for recommendation. In ACL, pages 9181–9191. Yaowei Zheng, Richong Zhang, Junhao Zhang, Yanhan Ye, Zheyan Luo, Zhangchi Feng, and Yongqiang Ma. 2024. Llamafactory: Unified efficient fine-tuning of 100+ language models. In ACL, pages 400–410. Zihan Zhou, Yinan Liu, Yuyang Xie, Bin Wang, Xi- aochun Yang, and Zezheng Feng. 2026. Diaglink: A dual-user diagnostic assistance system by synergiz- ing experts with llms and knowledge graphs. In CHI, pages 1–28. A EFFICIENCY STUDY We conduct experiments on RCVP to evaluate the running efficiency. To minimize the impact of plat- form differences, all experiments are performed using the GPT-3.5-Turbo API. As shown in Ta- ble 5, the intermediate generation process is the primary factor contributing to the efficiency degra- dation. However, this process is inevitable when interacting with LLMs. Benefiting from the effi- cient utilization of the SLM, the intermediate gen- eration time of PSL is shorter than that of existing generative approaches (e.g., RECITE, MindMap, and PEG). In future work, we plan to explore more efficient interaction strategies with LLMs. MethodRTProcess Vanilla1.00FI GKP2.10IG + FI RECITE3.11IG + FI LangChain1.67R + FI InstructRAG1.92R + IG + FI KAPING1.88R + FI MindMap route 1.95R + FI MindMap lang 4.99R + IG + FI MindMap13.9R + IG + FI PEG exp_sum 2.52R + IG + FI PEG exp_GT R 3.42R + IG + FI PAA1.78FI PSL2.48R + IG + FI Table 5: Running efficiency analysis. Relative Time (RT) denotes the ratio of the model’s running time us- ing the GPT-3.5-Turbo interface to that of the baseline Vanilla GPT-3.5-Turbo. Process abbreviations: R de- notes Retrieval, IG denotes Intermediate Generation, and FI denotes Final Inference. B EVALUATION For evaluation, we follow the setting of (Mou et al., 2024). Specifically, we provide multiple options in the prompt and instruct the model to output its choice. To handle cases where the options are not explicitly stated in the output, we employ regular expressions to match the answers effectively. C MLP TRAINING In this section, we detail the training procedure for the MLP. The training data is constructed from ac- tor profiles. For each actor, every positive record ParameterValue Learning Rate5e-5 Learning Rate SchedulerCosine Epochs3.0 Warmup Steps20 Maximum Samples800 Validation Split Ratio0.1 Training Batch Size4 Validation Batch Size1 Gradient Accumulation Steps8 Effective Batch Size32 (4×8) Maximum Sequence Length2048 Data Processing Threads16 Precision TypeBF16 Table 6: LoRA-Tuning parameters. ParameterValue Batch Size40,960 Max Epochs100 Learning Rate0.0005 OptimizerAdam Weight Decay0 L2 Regularization1e-4 Early Stopping Patience10 Minimum Delta0 Table 7: MLP training parameters. embedding is paired with a randomly selected neg- ative record embedding to form a training sam- ple, i.e., (actor embedding, positive embedding, negative embedding). Aggregating these samples across all actors yields over 900,000 samples in total. From these, 500,000 samples are randomly selected to construct the dataset, using a random seed of 42, which is then split into training (70%), validation (15%), and test (15%) subsets. The train- ing parameters are summarized in Table 7. The model performance is evaluated by using AUC as the evaluation metric, while both loss and AUC are reported for the test set. Figure 5 presents the training dynamics and final evaluation results. D LoRA TUNING This section details the Low-Rank Adaptation (LoRA) fine-tuning method applied to LLMs. LoRA is a parameter-efficient fine-tuning tech- nique that introduces trainable low-rank decom- position matrices alongside pre-trained weight ma- 5101520 Epoch 0.4 0.6 0.8 1.0 1.2 1.4 1.6 Loss Training Loss Validation Loss (a) Loss curves 5101520 Epoch 0.55 0.60 0.65 0.70 0.75 0.80 0.85 AUC Validation AUC Best AUC = 0.8808 (b) Validation AUC Test LossTest AUC 0.0 0.2 0.4 0.6 0.8 1.0 Value 0.3051 0.8816 (c) Test performance Figure 5: MLP training curves and model performance over epochs. trices while keeping the original model parameters frozen. This approach significantly reduces the number of trainable parameters, lowering computa- tional and storage costs while effectively adapting to downstream tasks. All experiments were con- ducted on 4×NVIDIA A6000 GPUs. To conserve resources, the total number of training samples was limited to 800. Table 6 summarizes the key param- eter settings for LoRA fine-tuning. E EXAMPLE OF STANCE Sample stance of Seth Moulton 1. **Previous Votes on Background Checks**: Seth Moul- ton has consistently voted ’yea’ on the Enhanced Back- ground Checks Act of 2019, indicating strong support for measures related to background checks for firearm sales. 2. **Legislative Focus**: Moulton’s voting record shows a tendency to support legislation aimed at amending ex- isting laws related to regulatory oversight, including labor relations and background checks. 3. **Consistency in Voting**: The repeated ’yea’ votes on the same bill (En- hanced Background Checks Act of 2019) suggest a firm stance on the issue, which could carry over to his vote on H.B. 8 regarding background checks for every firearm sale. 4. **Context of Gun Control Legislation**: Moul- ton’s history of supporting background check legislation may reflect a broader commitment to gun control mea- sures, potentially influencing his decision on related bills. 5. **Political Implications**: As a member of Congress, Moulton may consider the political landscape and public opinion regarding gun control when deciding on votes, es- pecially in light of his previous support for similar bills. F EXAMPLE OF POLITICAL BEHAVIOR PROFILE Sample Profile of Lindsey Graham "title": "Pechanga Band of Luiseno Mission Indians Water Rights Settlement Act", "description": "Pechanga Band of Luiseno Mission Indians Water Rights Settlement Act (Sec. 4) This bill authorizes, ratifies, and confirms the Pechanga Settlement Agreement, entered into by the Pechanga Band of Luiseno Mission Indians, the Rancho California Water District (RCWD), and the United States, except to the extent that the agreement is modified by or conflicts with this bill. (Sec. 5) The bill confirms water rights that must be held in trust by the United States on behalf of the tribe and its allottees. (Allottees are individuals who hold a beneficial real property interest in an Indian allotment that is lo- cated within the reservation and held in trust by the United States.) Allotted land is entitled to a just and equitable allocation of water from the water rights for irrigation and domestic purposes. Allottees may lease their land together with any water right. The tribe must enact a Pechanga Water Code that governs the storage, recovery, and use of the water rights, subject to the Department of the Interior’s approval. Interior must administer the water rights until the water code is enacted and approved. (Sec. 7) The tribe and the United States (acting as trustee for the tribe and allottees) must waive all claims to water rights within the Santa Margarita River Watershed, except water rights rec- ognized in the Pechanga Settlement Agreement and this bill. The tribe and the United States (acting as trustee for the tribe) waive specified claims against the RCWD. The tribe may waive claims against the United States regarding specified water rights and damages. The waivers in this bill are enforceable on the date Interior publishes speci- fied findings regarding deposits, waivers, and approved agreements. (Sec. 8) Interior must provide the amounts necessary to fulfill the tribe’s obligations under specified agreements regarding water infrastructure. (Sec. 9) The bill establishes the Pechanga Settlement Fund. The fund is to be used to carry out this bill. (Sec. 12) If Interior does not publish the findings required for enforcement of the waivers in this bill by April 30, 2021, or an alternative later date agreed to by the tribe and Interior, the provisions of this bill expire, related agreements are void, and funds are rescinded.", "summary": "The bill confirms that water rights shall be held in trust by the United States for the tribe and its allottees, who are individuals with beneficial interests in trust allotments within the reservation. The tribe must establish a Pechanga Water Code to regulate the storage, recovery, and use of these rights." , "event_text": "express intent to engage in diplomatic cooperation, including public policy support for Taiwan’s international participation, strengthening defense and secu- rity ties, and promoting economic exchanges", "target_name": "taiwan"