Paper deep dive
Context-Mediated Domain Adaptation in Multi-Agent Sensemaking Systems
Anton Wolter, Leon Haag, Vaishali Dhanoa, Niklas Elmqvist
Intelligence
Status: succeeded | Model: google/gemini-3.1-flash-lite-preview | Prompt: intel-v1 | Confidence: 97%
Last extracted: 3/27/2026, 1:12:53 AM
Summary
The paper introduces 'Context-Mediated Domain Adaptation' (CMDA), a paradigm for multi-agent systems where user modifications to AI-generated artifacts are treated as implicit domain specifications. By using the 'Seedentia' framework, the authors demonstrate how these edits can be reverse-engineered to extract domain knowledge, which then reshapes subsequent LLM-powered agent reasoning, enabling persistent, cross-participant knowledge accumulation.
Entities (4)
Relation Signals (2)
Anton Wolter â authored â Context-Mediated Domain Adaptation in Multi-Agent Sensemaking Systems
confidence 100% ¡ Context-Mediated Domain Adaptation in Multi-Agent Sensemaking Systems Anton Wolter
Seedentia â implements â Context-Mediated Domain Adaptation
confidence 100% ¡ We validate our approach through Seedentia, a web-based multi-agent framework... The contributions of this work are (1) the context-mediated domain adaptation (CMDA) paradigm
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:Domain experts possess tacit knowledge that they cannot easily articulate through explicit specifications. When experts modify AI-generated artifacts by correcting terminology, restructuring arguments, and adjusting emphasis, these edits reveal domain understanding that remains latent in traditional prompt-based interactions. Current systems treat such modifications as endpoint corrections rather than as implicit specifications that could reshape subsequent reasoning. We propose context-mediated domain adaptation, a paradigm where user modifications to system-generated artifacts serve as implicit domain specification that reshapes LLM-powered multi-agent reasoning behavior. Through our system Seedentia, a web-based multi-agent framework for sense-making, we demonstrate bidirectional semantic links between generated artifacts and system reasoning. Our approach enables specification bootstrapping where vague initial prompts evolve into precise domain specifications through iterative human-AI collaboration, implicit knowledge transfer through reverse-engineered user edits, and in-context learning where agent behavior adapts based on observed correction patterns. We present results from an evaluation with domain experts who generated and modified research questions from academic papers. Our system extracted 46 domain knowledge entries from user modifications, demonstrating the feasibility of capturing implicit expertise through edit patterns, though the limited sample size constrains conclusions about systematic quality improvements.
Tags
Links
- Source: https://arxiv.org/abs/2603.24858v1
- Canonical: https://arxiv.org/abs/2603.24858v1
Trouble viewing inline? Open PDF directly â
Full Text
123,150 characters extracted from source content.
Expand or collapse full text
Context-Mediated Domain Adaptation in Multi-Agent Sensemaking Systems Anton Wolter wol@cs.au.dk 0009-0004-6312-3355 Aarhus UniversityAarhusDenmark , Leon Haag l.haag@alumni.maastrichtuniversity.nl 0009-0005-4953-098X Maastricht UniversityMaastrichtNetherlands , Vaishali Dhanoa dhanoa@cs.au.dk 0000-0002-0493-8616 Aarhus UniversityAarhusDenmark TU WienViennaAustria and Niklas Elmqvist elm@cs.au.dk 0000-0001-5805-5301 Aarhus UniversityAarhusDenmark (5 June 2009) Abstract. Domain experts possess tacit knowledge that they cannot easily articulate through explicit specifications. When experts modify AI-generated artifacts by correcting terminology, restructuring arguments, and adjusting emphasis, these edits reveal domain understanding that remains latent in traditional prompt-based interactions. Current systems treat such modifications as endpoint corrections rather than as implicit specifications that could reshape subsequent reasoning. We propose context-mediated domain adaptation, a paradigm where user modifications to system-generated artifacts serve as implicit domain specification that reshapes Large Language Model-powered multi-agent reasoning behavior. Through our system Seedentia, a web-based multi-agent framework for sense-making, we demonstrate bidirectional semantic links between generated artifacts and system reasoning. Our approach enables specification bootstrapping where vague initial prompts evolve into precise domain specifications through iterative human-AI collaboration, implicit knowledge transfer through reverse-engineered user edits, and in-context learning where agent behavior adapts based on observed correction patterns. We present results from an evaluation with domain experts who generated and modified research questions from academic papers. Our system extracted 46 domain knowledge entries from user modifications, demonstrating the feasibility of capturing implicit expertise through edit patterns, though the limited sample size constrains conclusions about systematic quality improvements. Domain knowledge elicitation, multi-agent systems, LLM-powered agents, human-AI collaboration, LLM context management. â journalyear: 2026â copyright: rightsretainedâ conference: ACM Symposium on Engineering Interactive Computing Systems; April 13âApril 17, 2026; Patras, Greeceâ booktitle: ACM Symposium on Engineering Interactive Computing Systems (EICS â26), June 30âJuly 3, 2026, Patras, Greeceâ ccs: Information systems Computing platformsâ ccs: Information systems Information systems applicationsâ ccs: Information systems Enterprise applicationsâ ccs: Information systems Information retrievalâ ccs: Human-centered computingâ ccs: Human-centered computing Interactive systems and toolsâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paperâ ccs: Do Not Use This Code Generate the Correct Terms for Your Paper Figure 1. Context-Mediated Domain Adaptation transforms ephemeral user interactions into persistent domain knowledge. As user knowledge and LLM model knowledge deviate we analyze user interaction and edits in order to extract implicit domain knowledge. Through iterative refinement our approach expands the shared context substantially, capturing domain-specific terminology, conventions, and patterns. This accumulated knowledge persists in an LLM-agnostic format, enabling system improvements across sessions and participants while maintaining compatibility with different language models. 1. Introduction Large Language Model and Large Language Model-powered agents have transformed how analysts approach complex reasoning and information search tasks (Ferrag et al., 2025; Wu et al., 2025; Yousuf et al., 2024). Current systems operate through ephemeral prompts (Brown et al., 2020): users specify requirements upfront, receive outputs, then manually refine results by correcting errors, reorganizing content, or adjusting terminology. This workflow creates a one-way exchange: the system generates content, but user modifications never feed back to improve subsequent reasoning (Passerini et al., 2024; Shridhar et al., 2023). When a domain expert edits an AI-generated artifactâcorrecting technical details, restructuring arguments, or refining specialized vocabularyâthose modifications encode valuable domain expertise that remains latent and difficult to extract through explicit prompting alone (Patterson et al., 2010; Miller et al., 2024). Yet this knowledge does not propagate back into the system. Instead, each new request triggers a cold start, forcing users to repeatedly re-communicate domain understanding that they have already demonstrated through their edits. Consider a concrete scenario: a visualization researcher uses an Large Language Model-based system to generate research questions from a recent paper. The initial output contains three recurring error classes: (i) nonsensical visualization suggestions (âuse a 3D pie chart for temporal dataâ), (i) technical inaccuracies (misusing terms such as âsemantic zoomâ when meaning âgeometric zoomâ), and (i) wrong topical focus (emphasizing implementation details when the paperâs contribution is conceptual). The researcher corrects these errors, adjusting visualization types, fixing terminology, and redirecting focus to align with domain conventions. However, when generating questions for the next paper, the system repeats similar mistakes, having learned nothing from the previous corrections. This pattern forces experts to repeatedly correct the same fundamental misunderstandings about their domain. The need for better human-AI collaboration is evident across domains. In a preliminary survey with four pharmaceutical research professionals about their literature review workflows, we found that experts spend 5-60 hours on manual title/abstract screening, with teams processing 50-6,000 papers per review cycle. Critically, 25-50% of pre-processed datasets require manual corrections. When asked about AI assistance, all participants found AI pre-labeling acceptable âwith spot-checks,â but emphasized wanting to âsave time for crucial activities like categorization and extractionsâ and âdeeper scientific analysis.â Current AI systems require users to become prompting experts to effectively communicate domain requirements (Zamfirescu-Pereira et al., 2023; Mishra et al., 2025). These findings highlight that domain experts need AI systems that can learn their preferences and domain expertise through natural interactions rather than explicit specification (Desmond and Brachman, 2024; Arawjo et al., 2024). To address this challenge, we pose three research questions: ⢠RQ1: How can user modifications to Artificial Intelligence-generated artifacts be systematically captured and transformed into reusable domain knowledge for multi-agent systems? ⢠RQ2: What mechanisms enable bidirectional propagation of domain expertise between human edits and Large Language Model-powered agent reasoning? ⢠RQ3: How does accumulated implicit knowledge from multiple users improve subsequent artifact generation quality and reduce correction effort? We introduce context-mediated domain adaptation, a bidirectional human-Artificial Intelligence interaction (Amershi et al., 2019; Shneiderman, 2022) paradigm that treats user modifications as implicit domain specification capable of reshaping multi-agent reasoning behavior. Building upon foundational work on context-mediated behavior in intelligent agents (Turner, 1998), our approach extends these principles to modern Large Language Model-powered multi-agent systems with persistent knowledge accumulation capabilities. Our approach implements bidirectional semantic links through a structured artifact format enabling fine-grained editing and an adaptive context object representing accumulated domain knowledge. This adaptive context is both trackable through comprehensive logging and systematically utilizable across sessions and participants. When users modify artifacts through our three interaction modes, the system analyzes edit patterns to extract domain knowledge including terminology preferences, structural conventions, and conceptual relationships. This extracted knowledge propagates back as enriched context through a formal adaptation mechanism involving edit distance calculation, prompt specificity analysis, and behavioral metrics tracking, enabling multi-agent systems to learn from human expertise. We validate our approach through Seedentia, a web-based multi-agent framework enabling knowledge accumulation across participants. An exploratory evaluation with five domain experts in visualization literacy demonstrates the feasibility of capturing implicit expertise through edit patterns, with 46 domain knowledge entries extracted from user modifications across research question generation tasks. The contributions of this work are (1) the context-mediated domain adaptation (CMDA) paradigm enabling bidirectional human-Artificial Intelligence interaction where user modifications reshape multi-agent behavior through structured knowledge representations (Bidirectional Domain-Adaptive Representation format and Adaptive Context Object); (2) a prototype implementation through Seedentia with three interaction modes (direct manipulation, prompt-based regeneration, context-based generation) and comprehensive logging infrastructure supporting cross-participant knowledge accumulation; and (3) exploratory evaluation results with domain experts demonstrating the feasibility of capturing implicit expertise through edit patterns and cross-participant knowledge transfer. 2. Related Work Our work builds upon four complementary research streams: context management in agentic systems, interactive machine learning systems that adapt through user feedback, prompt engineering frameworks that enable iterative refinement, and multi-agent architectures for complex reasoning tasks. We position context-mediated domain adaptation as a synthesis that addresses limitations in each area while enabling bidirectional learning from user modifications. 2.1. Multi-Agent Systems and Context Management Context management in agentic systems has evolved from early foundational work on context-mediated behavior (Turner, 1998) to sophisticated frameworks for explicit context representation and multi-agent collaboration. Recent surveys highlight the importance of context acquisition, abstraction, and utilization pipelines in enabling agents to adapt and make robust decisions (Du et al., 2024). Explicit context representation approaches (Munguia-Galeano et al., 2023; Tutum et al., 2021) demonstrate how separating context from skills enables agents to generalize to unseen situations, improving learning efficiency and robustness. Multi-agent collaboration frameworks like Chain-of-Agents (Zhang et al., 2024) and self-taught agentic systems (Zhuang et al., 2025) show how agents can process long-context tasks through sequential communication and hierarchical reasoning. However, these approaches focus primarily on task-specific context rather than accumulated domain expertise from user interactions. 2.2. Human-AI Collaborative Knowledge Building The foundation for learning from user interactions was established by Endert et al.âs work on semantic interaction, which demonstrated how user manipulations of visualizations can implicitly adjust underlying models, enabling domain expertise injection through intuitive interactions (Endert et al., 2012). This principle of implicit knowledge transfer through user actions directly informs our approach to extracting domain knowledge from edit patterns. Mixed-initiative interaction (Hearst et al., 1999; Horvitz, 1999) systemsâas early examples of human-centered AI (Shneiderman, 2022) and human-AI interaction (Amershi et al., 2019)âhave long explored how systems can learn from user feedback, with early interactive machine learning work establishing principles that carry over to modern Large Language Model systems. However, these approaches typically focus on model training rather than real-time context adaptation within interactive sessions. Recent work on AGDebugger (Epperson et al., 2025) demonstrates the importance of interactive message resets and editing capabilities for debugging multi-agent AI systems, validating our approach of bidirectional interaction. Building trust in ML systems through visual explanations (Yang, 2021) remains a critical challenge that our transparent edit tracking addresses. While these systems enable user feedback integration, they lack mechanisms for persistent context evolution that spans multiple interaction cycles. This is a gap that our bidirectional semantic links address. 2.3. Prompt Engineering The emergence of sophisticated prompt engineering tools reveals the critical need for systematic approaches to Large Language Model optimization (Brown et al., 2020). Prompting in general is difficult (Zamfirescu-Pereira et al., 2023); non-experts lack good mental models, use opportunistic rather than systematic prompting techniques, and often overgeneralize their prompts. As a result, examples abound in the human-centered AI (Shneiderman, 2022) and human-computer interaction disciplines of sophisticated prompting techniques hidden by interactive graphical user interfaces. ChainForge (Arawjo et al., 2024) provides visual toolkits for prompt engineering and hypothesis testing, demonstrating user demand for systematic prompt refinement capabilities. PromptAid (Mishra et al., 2025) offers visual prompt exploration and iteration capabilities, showing the value of systematic prompt development environments. Enterprise applications have highlighted additional challenges in prompt engineering. Desmond and Brachman (Desmond and Brachman, 2024) identify key obstacles including the need for iterative refinement and domain-specific adaptation; precisely the problems our context-mediated approach addresses. The ART framework (Shridhar et al., 2023) introduces ask-refine-trust cycles for Large Language Model improvement, establishing foundations for iterative refinement. However, these approaches remain unidirectional: users refine prompts manually without systems learning from modification patterns to improve future interactions. Research on dynamic system prompting shows how Large Language Models can adapt to real-time context changes, supporting our theoretical framework for context-mediated domain adaptation. The PROMST framework (Chen et al., 2024b) demonstrates the value of incorporating human feedback for prompt optimization in multi-step tasks, recognizing that humans excel at providing feedback about Large Language Model outputs even when they struggle with direct prompt engineeringâa principle that directly informs our bidirectional learning approach. While prompt optimization work (Zhou et al., 2023) demonstrates that LLMs can generate effective prompts, and recent work shows LLMs can autonomously improve through implicit feedback (Chen et al., 2024a), these approaches require explicit specification of desired behaviors or operate at the model level rather than project-specific knowledge accumulation. CMDA differs by capturing implicit domain knowledge through edit analysis, enabling systems to learn preferences users cannot easily articulate. Yet existing prompt optimization frameworks lack the persistent memory and behavioral adaptation mechanisms that enable true domain specialization over time. 2.4. Implicit Knowledge Extraction Current Large Language Model-powered multi-agent frameworks excel at complex reasoning but lack mechanisms for incorporating user feedback into agent behavior modification. Traditional sensemaking tools focus on information organization and visualization but do not leverage user interactions to improve underlying reasoning processes. Work on human-AI collaboration (Amershi et al., 2019) emphasizes the importance of maintaining user agency while enabling system adaptation, principles central to our bidirectional interaction paradigm. Recent participatory AI approaches (Elmqvist et al., 2025) provide frameworks for meaningful human participation in AI system development and operation. Modern conversational interfaces have begun addressing interaction persistence through memory systems. ChatGPT and Claude now maintain âmemoriesââexplicit facts extracted from conversations through periodic introspection on dialogue history. These systems scan transcripts for factual nuggets (user preferences, biographical details, stated constraints) and store them as retrievable context for future sessions. While this represents progress beyond disposable prompts, memory extraction remains coarse-grained and declarative: systems capture what users explicitly state, not what they implicitly know. Unlike vector database approaches that retrieve similar past examples or conversational memory systems that store explicit statements (e.g., âUser prefers Oxford commaâ), CMDA extracts actionable operational patterns from user modifications (e.g., âResearch questions should specify target user expertise levelâ inferred from edits that consistently add expertise qualifiers). This enables behavioral adaptation rather than just contextual retrieval. Recent work by Gao et al. on inferring latent user preferences from edit histories through LLM-based analysis demonstrates the viability of extracting implicit knowledge from user modifications, providing methodological foundations for our approach of learning domain expertise from artifact edits (Gao et al., 2024). However, their work focuses on personalizing outputs to individual stylistic preferences, whereas our approach extracts generalizable domain knowledge that transfers across users within a discipline. While approaches like RLHF operate at token-level reward signals through gradient updates that optimize model weights, and transparency concerns (Zhao et al., 2024) motivate external knowledge mechanisms, CMDA operates at the semantic artifact level by enriching generation context without retraining. This enables interpretable knowledge extraction (human-readable patterns), domain-specific adaptation (knowledge scoped to projects/users), and cross-participant transfer (one userâs corrections improve othersâ generations). Collaborative knowledge management research provides additional foundations for our approach. DĂśrk et al. (DĂśrk et al., 2020) demonstrate how co-design processes that involve domain experts directly in visualization design ensure that resulting systems reflect specific practices, language, and needs of all usersâprinciples that directly inform our context-mediated adaptation approach. Peng et al. (Peng et al., 2017) show how graph-based models can effectively combine formal knowledge with tacit expertise, enabling flexible, context-rich representations that support capturing and reusing knowledge as it evolves through collaboration. Weck et al. (Weck et al., 2021) explore knowledge management visualization in collaborative decision-making, demonstrating how visual representations can facilitate integration of multiple perspectives and domain expertise. These collaborative knowledge approaches validate the importance of capturing tacit domain expertise through natural interactions, but they lack mechanisms for persistent context evolution that spans multiple interaction cycles. Existing collaborative AI systems treat user input as external guidance rather than as a source of domain knowledge that can fundamentally reshape system behavior. Multi-agent architectures typically employ fixed interaction patterns and lack the adaptive mechanisms necessary for context-mediated domain specialization. Our work addresses these limitations by introducing bidirectional semantic links that enable multi-agent systems to evolve their reasoning patterns based on accumulated user modifications, creating a feedback loop that bridges human domain expertise with automated reasoning capabilities. Recent work on agentic visualization (Dhanoa et al., 2025) provides a systematic framework for understanding autonomous and semi-autonomous components in visualization systems. This framework identifies recurring design patterns that effectively balance computational agency with human control. Building on established visualization techniques for interactive exploration (Elmqvist et al., 2008), several systems exemplify these patterns: InsightsFeed (Badam et al., 2017) implements progressive visual analytics with an insight timeline, DataSite (Cui et al., 2019) employs proactive background computations, and Snowy (Srinivasan and Setlur, 2021) generates contextual utterance recommendations. Recent Large Language Model-based systems extend these patterns further: AVA (Liu et al., 2024) uses multimodal Large Language Models for autonomous visualization decisions, Data Formulator (Wang et al., 2024) transforms raw data into visualizations based on user-defined concepts, and InsightLens (Weng et al., 2025) captures insights from conversational workflows. Multi-agent approaches to visualization are emerging, with systems for automated visual data reporting (Gyarmati et al., 2025b) and narrative generation (Wolter et al., 2025) demonstrating coordinated agent workflows. These systems demonstrate the value of agent role patterns (Forager, Analyst, Chart Creator, Storyteller), communication patterns (Insight Timeline, Progress Indicator, Provenance Log), and coordination patterns (Scouting, Swarming, Monitoring, Consolidating). However, they lack mechanisms for bidirectional learning where user modifications reshape agent behaviorâa gap our context-mediated adaptation addresses through persistent semantic links and behavioral adaptation mechanisms. Our genuine novelty lies not in individual components (LLMs, multi-agent systems, edit tracking) but in their systematic integration: bidirectional semantic links that maintain provenance from edits through extracted knowledge to subsequent generation, structured knowledge representations (Bidirectional Domain-Adaptive Representation + Adaptive Context Object) enabling persistent cross-user accumulation, and multi-agent orchestration where knowledge extraction and generation phases operate in coordinated cycles. This integration enables a new interaction paradigm where domain expertise flows bidirectionally between human modifications and AI reasoning, rather than remaining trapped in disposable prompt contexts. 3. Context-Mediated Domain Adaptation Through a process we call context-mediated domain adaptation (CMDA), Large Language Model-powered reasoning systems can develop domain-specific behaviors by observing and learning from bidirectional interactions modifying generated artifacts (whether text, visualizations, or structured narratives). This approach builds upon established context management principles in agentic systems (Du et al., 2024; Krishnan, 2025), recent advances in vision-language models for visualization understanding (Gyarmati et al., 2025a), agentic visualization design patterns (Dhanoa et al., 2025), and collaborative knowledge management techniques (Peng et al., 2017; Neogy et al., 2020). Our framework transforms the traditional unidirectional prompt-response paradigm into a bidirectional learning system where user modifications serve as implicit domain specification. When users edit system outputsâcorrecting terminology, restructuring content, or refining domain-specific conventionsâthese modifications encode valuable expertise that propagates back to improve subsequent reasoning. This creates an evolutionary process where generic prompts bootstrap into sophisticated domain specifications through iterative refinement cycles, enabling a fundamentally different interaction paradigm where systems learn from how users modify outputs rather than just from what users request. 3.1. Formal Definitions Definition 3.1 (Context-Mediated Domain Adaptation). Context-Mediated Domain Adaptation (CMDA) is a bidirectional learning process where: (1) user modifications M=m1,âŚ,mnM=\m_1,...,m_n\ to system-generated artifacts A=a1,âŚ,anA=\a_1,...,a_n\ are systematically captured, (2) domain knowledge D is extracted through the knowledge extraction pipeline f:MâDf:Mâ D, which analyzes edit patterns to identify domain-specific terminology, methodological preferences, and conceptual refinements, and (3) domain knowledge propagates back to reshape agent behavior through the context injection mechanism g:DâCg:Dâ C, where C represents the enriched context that is automatically incorporated into agent prompts for subsequent generations. Definition 3.2 (Bidirectional Domain-Adaptive Representation). A Bidirectional Domain-Adaptive Representation is a structured artifact format that maintains persistent links between AI-generated content and user modifications, enabling knowledge extraction through state comparison. Each artifact preserves generation context (prompts, parameters) and modification history (edit distances, change patterns), creating a delta-based representation capturing the difference between system knowledge and user expertise. Bidirectionality creates a learning cycle: user edits generate knowledge signals that are extracted, accumulated, and propagated back to enrich future generations, enabling subsequent users to benefit from previous corrections without explicit re-specification. This creates a continuous improvement loop where each user interaction simultaneously contributes to and benefits from collective domain expertise. Definition 3.3 (Adaptive Context Object). The Adaptive Context Object represents accumulated domain knowledge extracted from user modification patterns, organized into three primary categories: ⢠Domain Terminology Evolution: Systematic vocabulary preferences and specialized language usage patterns derived from user corrections; ⢠Methodological Refinements: Improvements to research approaches, analytical frameworks, and domain-specific practices; and ⢠Conceptual Depth Changes: Theoretical nuances, conceptual relationships, and domain-specific considerations not captured in initial generations. Knowledge entries maintain provenance links to their source interactions while supporting scoped application with user-specific knowledge taking precedence over project-shared and global contexts. Table 1. Knowledge categories extracted from user edits. The system identifies three distinct types of domain knowledge from user modifications to generated artifacts. Domain terminology evolution captures vocabulary preferences through direct text corrections. Methodological refinements encode expert knowledge about research practices and analytical frameworks. Conceptual depth changes add theoretical nuance and scholarly connections that distinguish expert from novice discourse. Knowledge Category Description & Characteristics Example Knowledge Patterns Domain Terminology Evolution Systematic vocabulary preferences and specialized language usage patterns derived from user corrections to technical terms and domain-specific expressions Replacing âchartâ with âvisualization,â preferring âparticipantsâ over âusers,â adopting field-specific acronyms and technical terminology Methodological Refinements Improvements to research approaches, analytical frameworks, and domain-specific practices reflecting expert knowledge of proper methodologies Specifying statistical analysis requirements, adding ethical considerations, refining experimental design elements, emphasizing reproducibility standards Conceptual Depth Changes Theoretical nuances, conceptual relationships, and domain-specific considerations that add scholarly depth beyond surface-level content Adding theoretical frameworks, clarifying causal relationships, introducing domain-specific constraints, connecting concepts to established literature Table 1 illustrates how different types of user interactions contribute to distinct knowledge accumulation patterns. Direct manipulation typically captures terminology preferences through immediate text corrections, while prompt-based regeneration reveals methodological knowledge through user guidance on content restructuring. Context-based generation leverages all accumulated knowledge categories to produce artifacts that reflect learned domain conventions without explicit user specification. 3.2. Bidirectional Semantic Links The core mechanism enabling domain adaptation is the maintenance of bidirectional semantic links between generated artifacts and their creation context. Each artifact maintains comprehensive metadata including original prompts, generation parameters, and contextual information. When users modify these artifacts, the system captures not just the changes but also their semantic relationship to the generation context. We define three interaction modes that contribute to domain learning, inspired by established HumanâAI Interaction paradigms (van Berkel et al., 2021; GammelgĂĽrd-Larsen et al., 2024). Rather than modeling general interaction timing or initiative, our modes formalize how user edits become machine-readable learning signals that drive persistent domain adaptation across sessions. Direct Manipulation captures explicit user interactions such as data modification and selection, revealing fine-grained terminology preferences, structural conventions, and localized corrections through immediate inline edits. This mode provides high-resolution signals about domain expertise and supports focused refinements. Prompt-based Regeneration enables LLM completions guided by a user prompt and contextual information, allowing users to express higher-level conceptual goals and methodological requirements in natural language. By analyzing both the prompt and resulting changes, the system extracts domain-specific preferences about research framing, rigor, and evaluation strategies. Context-based Generation produces LLM completions based purely on accumulated implicit knowledge without further user interaction, demonstrating learned domain understanding. This mode operationalizes previously extracted insights to generate new artifacts, creating a continuous learning loop in which each interaction type contributes distinct knowledge patterns that feed into subsequent generation contexts and support ongoing domain adaptation without explicit specification. 3.3. Knowledge Extraction and Propagation Our approach implements explicit context representation principles (Munguia-Galeano et al., 2023; Tutum et al., 2021) by separating accumulated domain knowledge from task-specific skills, enabling generalization across different content generation scenarios. The system extracts domain knowledge from user modifications through pattern analysis across three primary categories that represent different levels of domain expertise: ⢠Domain Terminology Evolution: Captures surface-level refinements in language and vocabulary preferences. By comparing original and modified text, the system identifies domain-specific terminologyâfor instance, changing âdata sourcesâ to âdata of diverse modalitiesâ or replacing broad task categories with specific patterns like âlookup, search, filtering.â These refinements teach the system precise language that distinguishes expert discourse from generic descriptions. ⢠Methodological Refinements: Encode procedural knowledge about research approaches and assessment techniques. These modifications reveal how experts conceptualize research methodologies, such as emphasizing âphysiological signals alongside visual attentionâ or incorporating âreal-time user state monitoringâ into assessment paradigms. The system learns preferred evaluation frameworks, experimental designs, and analytical approaches from these patterns. ⢠Conceptual Depth Changes: Represent the deepest level of expertise, fundamentally expanding the systemâs understanding of research scope and implications. These changes introduce new theoretical frameworks (e.g., âcognitive load theoryâ), expand to include accessibility considerations (e.g., âassist low-vision usersâ), or establish cross-domain connections. Such modifications teach the system to approach problems with greater sophistication and broader perspectives. Following established context management pipelines (Du et al., 2024), this extracted knowledge propagates through the system via enriched context that influences subsequent agent reasoning. The LangGraph workflow orchestrates this propagation through the three-stage process of context acquisition (edit tracking), abstraction (knowledge extraction), and utilization (context injection): (1) analyzing edit patterns to extract domain signals, (2) updating behavioral metrics to track adaptation progress, and (3) injecting learned knowledge into agent prompts for future generations. This extraction and propagation process enables three key theoretical properties of our framework: ⢠Specification Bootstrapping allows vague initial prompts to evolve into precise domain specifications through iterative human-AI collaboration, where users need not explicitly articulate all domain requirements upfront. ⢠Implicit Knowledge Transfer enables domain expertise embedded in user edits to transfer to the system without explicit programming, allowing experts to share knowledge through natural interactions rather than formal specification. ⢠In-Context Learning ensures agent behavior adapts dynamically within working memory based on observed correction patterns, unlike traditional fine-tuning approaches. These properties transform every user edit from a one-time correction into a persistent learning signal that improves future system behavior. 4. Implementation Seedentia is implemented as a working prototype demonstrating CMDA principles in a production-ready web-based multi-agent framework. The implementation fully realizes the domain adaptation mechanisms described in our theoretical framework. 4.1. System Architecture To enable effective context-mediated adaptation, we implement a modern web-based architecture that supports bidirectional learning and persistent knowledge accumulation. Our system separates concerns across three primary layers that work together to capture, process, and utilize domain knowledge from user interactions: ⢠Presentation Layer: Built using Next.js 15 with React components providing interactive interfaces for artifact editing with real-time feedback and multiple interaction modes. The interactive-report-viewer component enables inline content modification with entity-level granular control, allowing users to modify individual research questions, abstracts, and contextual narratives. User modifications trigger immediate UI updates while simultaneously capturing edit signals for knowledge extraction. ⢠Processing Layer: Orchestrated through Python FastAPI backend with LangGraph workflow engine managing multi-agent coordination. The system analyzes user modifications to extract domain knowledge, managing the bidirectional flow between user actions and system adaptation. Knowledge extraction nodes integrated into the LangGraph workflow analyze edit patterns in real-time, comparing initial and final values to identify implicit domain expertise. The unified state management system implements conditional routing between different task types while maintaining semantic links between user edits and generation context. ⢠Persistence Layer: Implemented through PostgreSQL database with specialized schemas for knowledge persistence and comprehensive edit tracking. This layer maintains the bidirectional semantic links essential for domain adaptation while enabling real-time adaptation based on user feedback across multiple participants and sessions. 4.2. User Interface Our implementation provides comprehensive infrastructure for the interaction modes defined in our framework (Section 3.2). The user interface implements the three interaction modes defined in our framework through a sophisticated component architecture that prioritizes usability while capturing meaningful interaction signals for domain knowledge extraction. Users begin by accessing the paper details interface (Figure 7(a) from Section 5), which displays metadata and provides a âGenerate Questionsâ button to trigger initial context-based generation. The system queries accumulated domain knowledge and generates three research questions asynchronously (10-30 seconds), each wrapped in an AIContentWrapper component exposing direct manipulation and prompt-based regeneration modes through color-coded interaction badges. 4.2.1. Interaction Mode Architecture The system implements three distinct interaction modes. Figure 2 demonstrates the implementation of these interaction modes through our user interface design. The interface prioritizes visual clarity and immediate feedback, with hover states that clearly indicate editable content areas and action boundaries. Design decisions focus on minimizing cognitive load while maximizing the capture of meaningful interaction signals for domain knowledge extraction. When users hover over editable content, the badges appear with a scale transform providing subtle visual feedback. The implementation is purely based on CSS based hover pseudo classes without JavaScript overhead. The system uses Tailwindâs peer and peer-hover classes, enabling interaction badges to respond to hover states of their container elements. Each interaction mode is color-coded according to the color coding within this paper itself: blue for Direct Manipulation: Enables inline content modifications through direct user input using the useInlineEditor hook. Hovering over generated content reveals the blue âEditâ badge; clicking transforms text into an editable field. For example, changing âHow can visualization systems assist usersâ to âHow can interactive visualization systems assist low-vision usersâ triggers three backend processes: (1) database persistence with original value preserved, (2) edit distance calculation, and (3) knowledge extraction analyzing the added methodological qualifier and accessibility consideration. purple for Prompt-based Regeneration: Facilitates AI-assisted content updates through natural language instructions via modal dialogs (Figure 3). Clicking the purple âRegenerateâ badge opens a dialog where users enter instructions (e.g., âMake this question more specific to eye-tracking methodologies and real-time adaptationâ). The targeted content displays a loading spinner during regeneration (5-15 seconds) while other interface elements remain fully interactive. Both the userâs prompt and resulting modifications are analyzed to extract domain preferences (e.g., âUser values specific methodological details and real-time system characteristicsâ). amber for Context-based Generation: Supports complete artifact creation based purely on accumulated context and previous user interactions. When triggered initially or for subsequent papers, the system queries the implicit_domain_knowledge table and automatically injects extracted terminology preferences, methodological refinements, and conceptual patterns into generation prompts. This creates a bidirectional learning cycle: user modifications extract knowledge that enriches future generation contexts without requiring explicit re-specification. Figure 2 shows the first two interaction modes, as context-based generation runs initially and ideally requires no user interaction. Based on hovering certain elements triggering the said interactions, the affected elements of the interactions are highlighted. (a) Direct manipulation mode. Interface showing direct content editing capabilities where users can modify research questions inline. The border is highlighted on hover and indicates the editable content area, enabling immediate text modifications that are captured for domain knowledge extraction through the bidirectional semantic links described in our framework. (b) Prompt-based regeneration mode. Interface demonstrating AI-assisted content regeneration where users provide natural language instructions to modify research questions. The border is highlighted on hover and indicates content that will be regenerated based on user prompts, implementing the context-mediated adaptation mechanism through explicit user guidance. Figure 2. Interaction modalities. Implementation of interaction modes defined in our Context-Mediated Domain Adaptation framework. These interfaces demonstrate how user modifications are captured and transformed into domain knowledge through bidirectional semantic links, enabling the system to learn from expert corrections and improve subsequent artifact generation. A side-by-side comparison of two interface screenshots. The left panel (a) shows âDirect Manipulation Modeâ with a research question interface displaying âResearch Question 1â at the top, followed by three sections: âResearch Questionâ with editable text about Chart-of-Thought prompting strategy, âContribution Summaryâ with a paragraph of text, and âEditâ buttons in the top right of each section. A red border highlights the editable content area. The right panel (b) shows âPrompt-based Regeneration Modeâ with an identical layout, but includes a highlighted yellow section indicating content that will be regenerated based on user prompts. Both interfaces show quality indicators and word counts (25 words) in the top right corner. The screenshots demonstrate different interaction approaches for modifying AI-generated research questions. The generic AIContentWrapper component manages its own edit states and interaction modes. It is used to wrap all kinds of interaction modes separately. The component follows a declarative pattern where interaction capabilities are enabled through props: ⏠<AIContentWrapper entityType="research_question" entityId=question.id directEdit= value: question.text, onSave: handleSave, validateValue: validateQuestionText onPromptEdit=() => setPromptDialogOpen(true) onContextEdit=() => triggerContextGeneration() onViewHistory=() => setHistoryDialogOpen(true) > /* Editable content */ <ResearchQuestionDisplay question=question /> </AIContentWrapper> Listing 1: AIContentWrapper component usage example This pattern enables any artifact type to become editable by wrapping it with appropriate handlers, maintaining separation of concerns between presentation and interaction logic. 4.2.2. Edit History and Provenance Tracking Beyond direct editing capabilities, the wrapper component provides comprehensive edit history visualization through the EditHistoryDialog component. The system uses react-diff-viewer to display character-level differences between edit states, enabling users to review their modification patterns and understand how their changes contribute to domain knowledge extraction. Figure 4 demonstrates this functionality, showing both the history access button integrated into the wrapper component and the detailed diff view. Each edit entry includes metadata such as edit type (direct edit, prompt modification, regeneration), timestamps, and provenance links to the generation context. This transparency enables users to understand how their interactions shape the systemâs learning process while maintaining full visibility into the adaptation mechanisms. When using prompt-based regeneration, the user can insert a prompt to regenerate the selected artifact. Figure 3 shows the complete interaction flow from input dialog to asynchronous generation. (a) Prompt-based input dialog. Interface showing a dialog with a text area field for a user to insert custom prompt (b) Prompt-based regeneration. Interface demonstrating a âloading stateâ showing that the respective artifact is being generated, while the rest of the application remains interactive Figure 3. Prompt-based generation. Complete workflow for prompt-based artifact regeneration showing the input dialog for natural language instructions and the asynchronous generation process. The interface maintains application responsiveness during AI processing, demonstrating the fire-and-forget architecture that decouples user interactions from computational workloads. A side-by-side comparison showing the prompt-based generation workflow. The left panel (a) displays a modal dialog box titled âPrompt based regenerationâ overlaying a darkened research questions interface. The dialog contains explanatory text about how the system will regenerate content, a text input field labeled âRegeneration Promptâ with example prompts, and two buttons at the bottom: âCancelâ (gray) and âRegenerateâ (blue). The right panel (b) shows the same interface during regeneration, with Research Question 1 displaying a spinner icon and grayed-out text indicating it is being regenerated, while Research Question 2 below remains fully visible and interactive with normal contrast. Both panels show the âResearch Questionsâ header with â1 of 2 modifiedâ status in the top right. (a) AIContentWrapper with history access. Interface demonstrating the AIContentWrapper component displaying multiple interaction mode badges alongside the edit history button (History badge on the right). The component implements the CSS-based hover system where hovering over the interaction badges triggers the highlighting of the associated content area with a subtle border, providing immediate visual feedback about which artifact will be affected by user actions. This interface exemplifies how the wrapper component integrates seamlessly into complex nested content structures while maintaining clear interaction affordances. (b) Edit history dialog. Interface showing the comprehensive edit history dialog powered by react-diff-viewer, displaying character-level differences between edit states. The dialog presents a chronological timeline of modifications with metadata including edit timestamps, edit types (direct manipulation, prompt-based regeneration), and user context. Green highlights indicate additions while red highlights show deletions, enabling users to understand precisely how their interactions have modified the content over time. This granular tracking provides transparency into the bidirectional learning process and demonstrates how user modifications contribute to domain knowledge extraction. Figure 4. Edit history visualization. The AIContentWrapper component provides integrated edit history functionality that powers context-mediated domain adaptation. A side-by-side comparison of edit history interfaces. The left panel (a) shows an AIContentWrapper component with a white background displaying the title âCollective Meaning-Making and Knowledge Building through AIâ at the top, followed by three light blue boxes containing action items: âGenerate Visualizationâ for Augmented Collective Meaning-Making Publication Network, âGenerate Visualizationâ for Impact of AI on Collaborative Knowledge Construction, and âCreate Visualizationâ to define a custom visualization. A âKey Insightsâ section appears below with explanatory text. In the top right corner is a âHistoryâ badge button with a clock icon. The right panel (b) shows a modal dialog titled âEdit History - Collective Meaning-Making and Knowledge Building through AIâ overlaying a darkened version of the same interface. The dialog displays a chronological timeline with two entries labeled âItem edit - Interviewâ from 1 minute ago, each showing a diff view with green highlighted additions and red highlighted deletions in the text. The dialog includes tabs for âInterviewâ and âTitleâ at the top. 4.2.3. Real-time State Management and Persistence The system implements optimistic UI updates through React state management, providing immediate feedback while asynchronous save operations complete in the background. The Next.js application functions as both a sophisticated frontend and a lightweight server that creates tasks for the Python backend to execute. Architecturally, the frontend operates as a standalone CRUD application optimized for high usability and user experience. All complex AI processing, knowledge extraction, and multi-agent coordination is offloaded to the more sophisticated Python/LangGraph backend system. This separation enables the frontend to remain responsive and maintain excellent user experience while computationally intensive operations execute asynchronously in the background. The frontend communicates with the backend exclusively through the agent_tasks infrastructure, using the createAndTriggerAgentTask pattern to initiate AI processing workflows. Toast notifications provide non-intrusive feedback on save status and task completion, while maintaining focus on the editing experience. 4.3. Core Infrastructure Implementation The user interface layer operates on a sophisticated infrastructure that manages data persistence, workflow coordination, and knowledge processing. The core infrastructure implements CMDA through three integrated subsystems: database schema architecture, agentic task processing, and evaluation integration. Our database schema implements Bidirectional Domain-Adaptive Representation (Definition 3.2) through two distinct model categories. Our architecture separates agentic task processing infrastructure from knowledge extraction mechanisms, enabling scalable multi-agent workflows while maintaining clean domain adaptation processing. The separation between business domain models and agentic process models provides several key advantages: (1) Frontend-Backend Decoupling: The Next.js frontend communicates with the Python/LangGraph backend exclusively through the agent_tasks infrastructure, eliminating the need for custom API endpoints. (2) Asynchronous Processing: Long-running AI operations execute without blocking the user interface, with real-time progress updates through Supabase subscriptions. (3) Scalability: The task queue system enables horizontal scaling of AI processing while maintaining clear separation between user-facing functionality and computational workloads. 4.4. Agentic Task Processing Infrastructure The agentic task processing infrastructure forms the computational backbone of our Context-Mediated Domain Adaptation system, enabling scalable multi-agent workflows that extract and apply domain knowledge through sophisticated coordination mechanisms. Agentic System Process Entities manage the asynchronous AI processing infrastructure that enables scalable multi-agent workflows: Table 2. Database tables supporting asynchronous multi-agent task processing. The system uses six interconnected tables to coordinate AI agent workflows, track execution status, and log processing details. The agent_tasks table serves as the central coordinator, while supporting tables define workflow types, decompose tasks into atomic actions, categorize processing steps, record external API calls, and maintain real-time execution logs for debugging and monitoring. Table Purpose agent_tasks Central coordination for asynchronous AI processing with status tracking via status, input_data, and output_data task_type Defines available AI workflows (research question generation, knowledge extraction, context injection) using code and label task_action Individual processing steps within multi-agent workflows for debugging using attempts and error_message action_type Categorizes processing actions (extraction, analysis, generation) for workflow orchestration api_logs External API interactions for literature retrieval tracking search_terms and papers_found project_agent_log Real-time logging of agent processing steps using log_type and message for monitoring and debugging 4.4.1. Multi-Agent Coordination Pipeline The LangGraph implementation provides sophisticated agent coordination through a unified planner/router that determines workflow paths based on task type and current state (Figure 5). Following established patterns in multi-agent collaboration (Zhang et al., 2024; Krishnan, 2025), the system supports multiple specialized task types including research question generation, knowledge extraction, and context injection, with dynamic routing enabling context-aware workflow adaptation. Key workflow capabilities include: ⢠State Consistency: Unified state management maintains context across all workflow nodes, similar to Chain-of-Agents approaches for long-context processing ⢠Interactive Control: Pause/resume capabilities with user interrupt handling for real-time feedback integration ⢠Node Modularity: Specialized business logic separated into domain-specific nodes for maintainability and scalability ⢠Context Propagation: Seamless transfer of accumulated domain knowledge between processing stages Figure 5. Agentic task processing graph. The backend workflow graph is centered on the planner router node, which conditionally dispatches tasks to specialized nodes for paper retrieval, context-based research question generation, and edit-driven knowledge extraction. Node outputs are merged back into a unified state and persisted via the agent tasks infrastructure, enabling asynchronous execution while maintaining traceable bidirectional links between user edits, extracted domain insights, and subsequent generations. Visualization of the backend workflow graph centered on the planner router node, which conditionally dispatches tasks to specialized nodes for paper retrieval (fetch_paper_content), context-based research question generation (generate_evaluation_questions), and edit-driven knowledge extraction (extract_implicit_knowledge). Node outputs are merged back into a unified state and persisted via the agent_tasks infrastructure, enabling asynchronous execution while maintaining traceable bidirectional links between user edits, extracted domain insights, and subsequent generations. The workflow engine orchestrates the bidirectional flow described in our framework, implementing the context injection g:DâCg:Dâ C mechanism (Definition 3.1) by routing user modifications through specialized knowledge extraction nodes that analyze edit patterns and update persistent context repositories, which then influence future agent reasoning through enriched context. 4.4.2. Asynchronous Processing Architecture The system implements a fire-and-forget processing pattern where the frontend creates tasks by inserting entries into the agent_tasks table and receives UUIDs for tracking, while the Python backend asynchronously executes these tasks through the LangGraph workflow engine. This architecture decouples user interface responsiveness from computational workloads, enabling complex knowledge processing without blocking user interactions. Task execution follows a hierarchical structure where high-level tasks represent LangGraph workflow nodes and lower-level actions track individual processing steps. The task_action table records detailed execution context including attempts and error messages, enabling comprehensive debugging and progress tracking of multi-step operations. External API interactions for literature retrieval are logged through api_logs, maintaining search terms, result counts, and response metadata for reproducibility and system optimization. 4.5. Domain Adaptation Engine The implemented system operationalizes the knowledge extraction and propagation mechanisms described in our framework through automated processing that forms the core of our context-mediated adaptation approach. 4.5.1. Evaluation Knowledge Retrieval Model Business and Functional Domain Models represent the core domain concepts for context-mediated domain adaptation: Table 3. Database tables for knowledge extraction and evaluation tracking. Eight tables implement the core knowledge representation infrastructure for context-mediated domain adaptation. The evaluation_research_questions table stores initial and final artifact states to enable knowledge extraction from user modifications. The implicit_domain_knowledge table materializes extracted domain expertise with category labels and provenance tracking. Supporting tables capture granular edit operations, preserve generation context for bidirectional semantic links, manage evaluation sessions with comprehensive metrics, profile participant expertise, store research papers for AI processing, and log detailed UI interactions for behavioral analysis. Table Purpose evaluation_research_questions Implements Bidirectional Domain-Adaptive Representation by storing initial/final states for knowledge extraction using initial_question, current_question, and edit distance metrics implicit_domain_knowledge Materializes Adaptive Context Object with categorized domain insights and provenance tracking through knowledge_category and source_question_ids ai_entity_edits Granular interaction tracking for behavioral analysis capturing edit_type, original_value, and user_prompt ai_entity_metadata Generation context preservation for bidirectional semantic links using generation_prompt and model_parameters evaluation_sessions Session management with comprehensive metrics including edit_distance_score and LLM monitoring via langfuse_trace_id evaluation_participants Participant management with domain_expertise profiling and evaluation_status tracking publication_raw Research paper storage with full_text content for AI processing and evaluation study materials user_interactions Granular UI interaction tracking with interaction_type and state transition analysis 4.5.2. Knowledge Extraction Pipeline The knowledge extraction pipeline implements the pattern analysis function f:MâDf:Mâ D (Definition 3.1) by processing all unprocessed user edits when research question generation tasks are initiated. The pipeline analyzes differences between initial AI-generated content and final user-approved versions, categorizing insights into the three knowledge categories defined in our Adaptive Context Object (Definition 3.3): ⢠Domain Terminology Evolution captures changes in specialized vocabulary, identifying when users consistently replace general terms with domain-specific language or prefer certain terminological conventions over others. ⢠Methodological Refinements identifies improvements to research approaches, study design considerations, or analytical frameworks that users introduce through their modifications. ⢠Conceptual Depth Changes encompasses modifications that add theoretical nuance, clarify conceptual relationships, or introduce domain-specific considerations not present in the initial generation. Intelligent de-duplication ensures that similar insights are consolidated rather than duplicated across multiple extraction cycles, with each knowledge entry maintaining provenance links to its source interactions. 4.5.3. Context Accumulation and Adaptive Generation Context Accumulation: Extracted knowledge accumulates across participants and sessions, creating a growing repository of domain expertise. Each new generation benefits from previously extracted insights, enabling progressive improvement in output quality. The system maintains provenance tracking, linking each piece of knowledge back to its source interactions while preventing redundant processing. Adaptive Generation: When generating new artifacts, the system incorporates accumulated domain knowledge into the generation context. This enables cross-participant learning where subsequent users benefit from the collective expertise of previous participants. The knowledge injection occurs transparently, improving output quality without requiring users to explicitly specify domain requirements. The research question generation process implements a sophisticated adaptive mechanism that evolves based on accumulated knowledge from participant interactions. The generate_evaluation_questions function orchestrates this process by retrieving evaluation paper content, gathering accumulated knowledge from previous participants, and incorporating both explicit edits and implicit domain knowledge into the generation context. This multi-layered knowledge integration ensures that each subsequent generation benefits from the collective expertise of all previous participants, creating a continuous improvement cycle. The following prompt template is used for generating research questions that build upon published papers: ⏠You are an expert researcher in Visualization Literacy who generates insightful research questions based on published papers. Your task is to generate exactly 3 research questions that extend or build upon the provided paper. PAPER DETAILS: Title: [paper_title] Abstract: [paper_abstract] Full Text: [paper_full_text] GUIDELINES FOR RESEARCH QUESTIONS: 1. Each question should identify a research gap in the field 2. Each question should be agnostic and not require knowledge of the paper itself to understand the question 3. Questions should be specific, measurable, and feasible for future research [If participant_order > 1:] ACCUMULATED KNOWLEDGE FROM PREVIOUS PARTICIPANTS: [knowledge_context including expansion, refinement, and condensation patterns extracted from previous participantsâ edits] Based on the patterns above, generate questions that reflect these improvements and refinements. Learn from how previous participants enhanced their initial responses. RESPONSE FORMAT: Generate exactly 3 research questions. For each question, provide: 1. A clear, specific research question 2. A brief summary (2-3 sentences) of the potential contribution if this research were conducted Focus on questions that: - Address limitations or gaps in the current paper - Extend the methodology to new contexts or populations - Explore long-term implications or applications - Investigate underlying mechanisms or theoretical foundations - Consider interdisciplinary connections - Address scalability, generalizability, or practical implementation Generate innovative, thought-provoking questions that a domain expert in Visualization Literacy would find valuable and feasible for future research. Listing 2: Research question generation prompt with knowledge accumulation. When accumulated domain knowledge is available from previous participants, the system automatically injects this knowledge into the generation context, enabling progressive refinement of research question quality across evaluation sessions. The multi-agent workflow orchestrates the complete adaptation cycle: extracting implicit knowledge from user modifications, categorizing and storing domain insights, and enriching future generations with accumulated expertise. This creates a continuous learning loop where each interaction strengthens the systemâs domain understanding. Crucially, every step of this process is comprehensively monitored and traced through integrated observability infrastructure, enabling both real-time operational monitoring and systematic research analysis of adaptation effectiveness. 4.6. Evaluation and Knowledge Extraction Integration The evaluation and knowledge extraction integration provides comprehensive infrastructure for systematic assessment of domain adaptation effectiveness while operationalizing the knowledge extraction mechanisms described in our theoretical framework. 4.6.1. Evaluation Framework Architecture Our implementation includes a sophisticated evaluation framework designed for controlled studies of domain adaptation effectiveness. The system supports participant management with domain expertise profiling through the evaluation_participants table, session-based tracking via evaluation_sessions, and comprehensive interaction logging through user_interactions. The framework automatically calculates edit distances between initial AI-generated content and final user-approved versions at both character and word levels. Edit distance computation occurs separately for research questions and contribution summaries, enabling fine-grained analysis of user modification patterns. Time-to-completion metrics are tracked per session, while edit type frequencies and prompt evolution patterns provide insights into user behavior and system adaptation effectiveness. 4.6.2. Knowledge Extraction Pipeline Integration The evaluation_research_questions table implements the core Bidirectional Domain-Adaptive Representation concept by storing original AI-generated content and final user-approved versions, enabling systematic knowledge extraction through comparison of initial and final states. Each entry contains initial and final text states with calculated edit distances, providing self-contained units for LLM-based knowledge generation essential to our CMDA framework. The knowledge extraction process employs a specialized prompt structure that analyzes the differences between original AI-generated content and final user-approved versions. The following listing shows the prompt template used for extracting implicit domain knowledge: ⏠You are an expert in Visualization Literacy research who analyzes how domain experts refine AI-generated research questions. Your task is to extract implicit domain knowledge from the changes a user made. ORIGINAL AI-GENERATED CONTENT: Question: [initial_question] Contribution: [initial_contribution] FINAL USER-EDITED CONTENT: Question: [final_question] Contribution: [final_contribution] [existing_knowledge if available] ANALYSIS TASK: Analyze the changes from original to final versions and extract implicit domain knowledge that reflects: 1. **Domain Terminology Evolution**: How the user refined technical terms, concepts, or field-specific language 2. **Methodological Refinements**: Changes to research methods, approaches, or evaluation criteria 3. **Conceptual Depth Changes**: Shifts in research focus, scope, specificity, or theoretical framing EXTRACTION RULES: - Only extract knowledge if there are meaningful changes (not just minor rewording) - Focus on domain expertise that could improve future AI-generated questions - Each insight should be actionable for improving AI generation - Avoid extracting knowledge that duplicates existing entries - Generate 0-3 knowledge entries based on the significance of changes RESPONSE FORMAT: Return a JSON array of knowledge objects. Each object must have: - "text": Clear, actionable insight (1-2 sentences) - "category": One of "domain_terminology_evolution", "methodological_refinements", "conceptual_depth_changes" Example format: [ "text": "Research questions should specify the target population (e.g., ânovice usersâ vs âdomain expertsâ) rather than using generic terms like âusersâ.", "category": "domain_terminology_evolution" , "text": "Evaluation studies in visualization literacy should include both immediate comprehension and retention measures over time.", "category": "methodological_refinements" ] If no meaningful domain insights can be extracted, return an empty array: [] Listing 3: Knowledge extraction prompt template. The implicit_domain_knowledge table materializes the Adaptive Context Object by storing extracted insights categorized into the three primary knowledge categories: domain terminology evolution, methodological refinements, and conceptual depth changes. Direct references to source research questions through source_question_ids arrays maintain traceable knowledge provenance, enabling detailed analysis of how specific user modifications contribute to accumulated domain expertise. 4.6.3. System Monitoring and Observability Our implementation integrates comprehensive monitoring infrastructure to provide visibility into the context-mediated adaptation process. The monitoring architecture combines Langfuse for Large Language Model interaction tracing with custom instrumentation for tracking domain adaptation effectiveness, creating a multi-layered observability system that supports both operational reliability and systematic research validation. ⢠Multi-Agent Workflow Tracing: Figure 6 demonstrates the comprehensive tracing capabilities integrated throughout the LangGraph workflow execution. The Langfuse interface provides hierarchical visibility into each workflow node, showing the complete execution flow from user interaction through knowledge extraction to subsequent generation enhancement. As illustrated in the figure, the extract_implicit_knowledge node processes multiple user interactions simultaneously, with each LLM call handling individual modifications to extract domain insights with precise context awareness. ⢠Knowledge Lifecycle Monitoring: The system tracks the complete knowledge lifecycle from extraction through application, providing visibility into knowledge reuse patterns, adaptation effectiveness over time, and the evolution of domain understanding across multiple user sessions. The implicit_domain_knowledge table enables visualization of clustered extracted knowledge with full provenance tracking through source_question_ids arrays, allowing researchers to trace each knowledge entry back to specific user modifications that generated it. The selected LLM call in Figure 6 displays the complete system prompt, demonstrating how accumulated domain knowledge is injected into generation contexts and how this process is made transparent through comprehensive tracing. ⢠Performance and Cost Analysis: Integrated monitoring captures evaluation metrics in real-time, correlating user interaction patterns with system performance indicators including processing time, model selection, token usage, and estimated costs. This enables dynamic analysis of how different participant expertise levels, session lengths, and domain contexts affect adaptation outcomes, providing rich data for both operational optimization and research validation. ⢠Provenance and Reproducibility: All Large Language Model interactions route through unified functions that preserve generation metadata and semantic relationships, ensuring consistency with our bidirectional semantic links architecture. The ai_entity_metadata table maintains comprehensive generation context including original prompts, model parameters, and generation code, enabling full reproducibility of generation processes and detailed analysis of how context modifications influence output quality. Figure 6. Context-mediated domain adaptation workflow tracing. Langfuse tracing demonstrates how the bidirectional learning cycle operates: user modifications flow through the extract_implicit_knowledge node (shown processing three user interactions), with extracted knowledge subsequently injected into the generate_evaluation_questions nodeâs system prompt. Notice how the interface makes the complete knowledge transfer visible, from hierarchical execution flow (center) to detailed prompts and performance metrics (right), enabling validation of our CMDA frameworkâs core claim that user edits systematically enhance AI reasoning. A screenshot of the Langfuse tracing interface showing multi-agent workflow execution. The interface has three main sections. The left panel displays a hierarchical trace list with timestamps, showing alternating entries for âuser_interactionâ and âLangGraphâ operations from 2025-10-23. Each LangGraph entry shows JSON input data. The center panel shows a tree structure with performance metrics: âLangGraphâ at 5.47s, nested âLangGraphâ at 5.47s, âplannerâ at 0.00s, âextract_implicit_knowledgeâ at 0.08s, and âChatGoogleGenerativeAIâ at 1.60s with token counts (932 prompt + 137 completion, 1,069 total). Below this is a workflow graph showing connected nodes: âstartâ at top, flowing to âplannerâ, which branches to âgenerate_evaluation_questionsâ, âextract_implicit_knowledgeâ, and âendâ. The right panel shows a detailed view with header information (trace ID, timestamp 2025-10-23 16:07:31.483), model configuration (gemini-2.0-flash-lite, temperature 0.7), and two content sections. The âPreviewâ tab displays the User prompt describing a visualization literacy research expert task, followed by âORIGINAL AI-GENERATED CONTENTâ and âFINAL USER-EDITED CONTENTâ sections showing research questions and contributions about visualization tasks and literacy levels. An âEXISTING KNOWLEDGEâ section lists conceptual depth changes about strategic focus shifts in visualization research. 4.7. Implementation Status Our current implementation provides comprehensive infrastructure for context-mediated domain adaptation, fully realizing the theoretical framework through a working prototype. The system successfully demonstrates bidirectional semantic links, sophisticated workflow orchestration, comprehensive edit tracking, and automated knowledge extraction with cross-participant learning. Critical to this success is the integrated monitoring and observability infrastructure that provides transparency into the adaptation process, enabling both operational reliability and systematic research validation of the theoretical framework. Current limitations include the focus on research question generation tasks, though the architecture supports extension to other content types. The knowledge extraction relies on LLM-based analysis, which may introduce variability in categorization consistency, though comprehensive monitoring enables detection and analysis of such variations. Additionally, the system requires domain experts as participants rather than general users, limiting broader applicability. While the monitoring infrastructure provides comprehensive visibility for researchers and system operators, the accumulated domain knowledge remains largely invisible to end users, limiting their ability to inspect or directly refine the systemâs learned understanding. The extensive observability data collected presents opportunities for developing user-facing transparency features in future iterations. Future development will address evaluation at scale, validation across multiple domains beyond visualization literacy, integration of advanced context management architectures (Du et al., 2024; Zhuang et al., 2025) for handling larger knowledge bases, and collaborative knowledge visualization approaches (DĂśrk et al., 2020; Weck et al., 2021) to make the accumulated domain expertise transparent and editable by users. 4.8. Adapting to New Domains The CMDA framework generalizes to other domains through modifications to three components while preserving core multi-agent infrastructure: The Bidirectional Domain-Adaptive Representation pattern, which stores both AI-generated initial states and user-modified final states, is universally applicable. E.g. for visualization generation, replace initial_question with initial_visualization_spec; for code generation, use initial_code and requirements_specification. The field names change, but the before-and-after comparison mechanism remains identical. Generation and extraction prompts require domain-specific customization while maintaining structural patterns. Replace role specifications (e.g., âvisualization researcherâ â âmedical researcherâ) and adjust knowledge category examples to domain conventions. The three knowledge categories (domain terminology evolution, methodological refinements, conceptual depth changes) apply across domains but require examples adjusted to domain conventions. The three interaction modes introduced in section 3.2 remain applicable, but the user interfaces require domain-specific adaptation. The Seedentia prototype is available to researchers upon request. We provide complete source code (Next.js frontend, Python/LangGraph backend), database schemas, Docker configuration, and documentation. The modular architecture enables straightforward customization of domain-specific components while preserving core CMDA infrastructure. 5. Evaluation We conducted an exploratory proof-of-concept study to assess the feasibility and potential of Context-Mediated Domain Adaptation through research question generation tasks with domain experts in visualization literacy. This preliminary investigation establishes whether the CMDA mechanisms can capture and apply implicit domain knowledge, providing initial evidence to motivate future controlled validation studies. (a) Evaluation session initialization. Interface showing the study setup where participants access paper details and interaction guidelines. This screen introduces domain experts to the research paper context and available interaction modalities before beginning the research question generation task that drives the context-mediated domain adaptation process. (b) Initial generation quality assessment. Participant interface for rating AI-generated research questions on a 1-5 scale before editing begins. This baseline quality measurement enables quantification of context-mediated adaptation effectiveness by tracking improvement in initial generation quality as domain knowledge accumulates across participants, implementing our cross-user knowledge transfer evaluation metric. Figure 7. Evaluation protocol interface. Key components of the controlled study we conducted for assessing context-mediated domain adaptation effectiveness. The system captures baseline quality assessments and provides standardized interaction protocols to ensure consistent evaluation of bidirectional learning mechanisms across participants and sessions. A side-by-side view of two evaluation protocol interfaces. The left panel (a) shows the evaluation session initialization screen with a header âResearch Paperâ displaying the title âChart-of-Thought: Enhancing LLM Visualization Literacy Through Structured Data Extractionâ with a green âFULLY ASSESSEDâ badge, author list, and affiliation. Below is an âAbstractâ section with paper summary text, followed by an âAccess Full Paperâ section with a âView PDFâ button. At the bottom is a âResearch Question Refinement Instructionsâ box with purple header, containing âYour Missionâ text explaining the participantâs task and two instruction boxes: a blue âDirect Tool Editâ box stating âFor questions that are not right track well (most major adjustments), freely clear out edit the text directlyâ and a pink âAI-Assisted Regenerationâ box stating âFor questions that arenât quite there (smaller approach or tone tweaks/range edits) guide the AI via prompt-specific questions.â The right panel (b) shows the âResearch Questionsâ interface with â1 of 3 Questionsâ header and a âGenerate Moreâ button. It displays âResearch Question 1â with a 5-star quality rating, followed by the research question text about Chart-of-Thought prompting strategy and a âContribution Summaryâ section. Below is âResearch Question 2â marked as âDELETEDâ with similar structure showing a question about cognitive mechanisms and structured prompting. 5.1. Method 5.1.1. Participants We recruited five visualization literacy experts (PhD students and postdoctoral researchers, 1â9 years of experience) with active research backgrounds in visualization, immersive analytics, and applied visualization. The participant pool represents a range of experience levels from early-career researchers to established postdoctoral researchers, ensuring diverse perspectives on research question quality and domain relevance. 5.1.2. Materials and Study Design Our evaluation employed a sequential knowledge accumulation design where participants processed three academic papers from the visualization literacy domain. We selected three recent papers focused on visualization literacy: âTell Me Without Telling Me: Two-Way Prediction of Visualization Literacy and Visual Attentionâ (Chang et al., 2025), âDRIVE-T: A Methodology for Discriminative and Representative Data Viz Item Selection for Literacy Construct and Assessmentâ (Locoro et al., 2025), and âCharts-of-Thought: Enhancing LLM Visualization Literacy Through Structured Data Extractionâ (Das et al., 2025). The complete evaluation data, including participant responses, extracted domain knowledge entries, and analysis scripts, are available at our anonymized OSF repository.111https://osf.io/84f3s/overview?view_only=6b4f191fa0d341c4803bf53d3229e3fd The critical aspect of our study was sequential learning: participants used the system one after another, with each benefiting from knowledge accumulated within the system through the interactions of previous participants. Specifically, Participant 1 receives baseline AI output generated without domain knowledge, Participant 2 benefits from knowledge extracted from Participant 1âs modifications across all three papers, Participant 3 leverages accumulated knowledge from both P1 and P2âs complete sessions, Participant 4 receives the full accumulated knowledge from all three prior participants, and Participant 5 benefits from the complete accumulated knowledge from all four previous participants. Importantly, the system learns not just between participants but also within each participantâs sessionâknowledge extracted from editing the first paper improves generation for the second and third papers within the same session. This design enables us to observe how accumulated domain expertise affects initial generation quality and user editing effort both within and across participant sequences. 5.1.3. Procedure For each paper, participants reviewed the abstract and full text, then received three AI-generated research questions with contribution summaries. They rated each question on a 1â5 Likert scale before editing and refined content using direct manipulation or prompt-based regeneration until satisfied. All edits were logged in real time, and extracted knowledge was used to improve subsequent generations. Each session lasted approximately 45-60 minutes, with participants encouraged to think aloud during the refinement process. 5.1.4. Metrics and Analysis We track five primary metrics to assess context-mediated adaptation. Edit distance measures character-level changes between initial and final versions, with decreasing distances across participants indicating improved initial generation quality. Initial generation quality uses participant ratings (1-5 scale) before any edits, with increasing ratings demonstrating successful knowledge transfer. Time-to-completion captures session duration from generation to participant satisfaction. Knowledge accumulation counts unique domain knowledge entries extracted per participant, revealing contribution patterns. Interaction mode usage tracks the frequency of direct edits versus prompt-based regeneration, indicating participant preferences and system behavior. The system automatically extracts domain knowledge from user modifications, categorizing insights into methodological refinements, conceptual depth changes, and domain terminology evolution. Knowledge saturation emerges when extraction rates decrease and existing knowledge reuse increases, indicating comprehensive domain coverage. 5.2. Analysis Framework and Threats to Validity Our analysis was guided by four hypotheses based on the theoretical framework. We examined whether edit distances decreased across participant positions as the system learned domain conventions. We measured if time-to-completion decreased for later participants who benefited from accumulated knowledge. We tracked whether initial generation quality ratings increased across the participant sequence, demonstrating successful knowledge transfer. Finally, we investigated whether knowledge saturation emerged, with fewer novel knowledge items extracted from later participants. Several threats to validity must be acknowledged. Internal validity concerns include participant fatigue across three papers and potential learning effects within sessions. External validity is limited by our focus on visualization literacy, with generalization to other domains remaining untested. Construct validity depends on subjective quality assessments that may vary across participants. We address these threats through standardized evaluation criteria, randomized paper presentation order where feasible, and detailed interaction logging for post-hoc analysis of confounding factors. 5.3. Results Our evaluation yielded rich data on the feasibility of context-mediated domain adaptation through 47 refined research questions and 46 extracted domain knowledge entries across five participants who used the system sequentially, with each participant benefiting from the accumulated knowledge of all previous users. 5.3.1. Quantitative Results We begin by examining how participants interacted with the system to understand engagement patterns and initial quality perception. Table 4 reveals distinct interaction strategies across participants in our sequential design. Table 4. Participation data showing temporal patterns in domain adaptation. Key insight: Quality ratings improve across sequential participants (P1: 2.67-3.0 â P5: 4.0-4.33), demonstrating progressive knowledge accumulation. Duration (minutes), quality ratings (1=poor to 5=excellent), and edit counts reveal how different participants engaged with the system. Part. Paper Duration minutes Quality Rating 1=poor, 5=excellent Direct Edits total sum Prompt Edits total sum P1 Tell Me Without Telling Me 9.0 2.67 4 0 DRIVE-T Methodology 5.1 3.0 1 0 Charts-of-Thought 4.8 3.0 1 0 P2 Tell Me Without Telling Me 32.5 2.33 5 1 DRIVE-T Methodology 18.8 3.67 3 1 Charts-of-Thought 14.2 2.67 3 1 P3 Tell Me Without Telling Me 16.6 3.0 4 0 DRIVE-T Methodology 10.2 2.67 2 0 Charts-of-Thought (session 1) 8.0 3.67 1 3 Charts-of-Thought (session 2) 4.1 3.33 0 2 P4 Tell Me Without Telling Me 6.9 4.33 0 0 DRIVE-T Methodology 4.8 3.67 1 0 Charts-of-Thought 5.0 4.33 0 1 P5 Tell Me Without Telling Me 4.0 3.67 1 0 DRIVE-T Methodology 4.0 3.0 1 0 Charts-of-Thought 2.6 4.0 0 0 The temporal patterns suggest potential efficiency gains from knowledge accumulation, although time was not a primary metric and individual differences likely contribute. P1 averaged 6.3 minutes per paper (18.9 total), whereas P5 completed all three papers in 10.6 minutes. Quality ratings show a similar pattern: later participants achieved higher baseline ratings with minimal intervention (e.g., P4: 4.11 average; P5: 3.56 with only two direct edits), compared to P1âs lower baseline (2.89) despite more edits. Without a control condition, these trends cannot be causally attributed to CMDA rather than participant characteristics or paper difficulty. Edit behavior did not decrease monotonically. Despite benefiting from 22 prior knowledge entries, P3 showed the highest editing activity (7 direct, 5 prompt), suggesting that improved baseline generations may enable deeper, more sophisticated refinement rather than simply reducing effort. Interaction logs reflect complementary roles of the two modalities: direct edits were used primarily for minor adjustments (28 instances), while prompt-based regeneration supported fundamental restructuring (7 instances). P3âs double evaluation of Charts-of-Thought further illustrates within-user adaptation dynamics: the second session was faster (4.1 vs. 8.0 minutes) with comparable quality (3.33 vs. 3.67), consistent with both system learning from earlier edits and participant familiarity. P2âs longer duration (65.5 minutes) included interruptions, making time less comparable across participants; overall, participants were not incentivized to optimize for speed, so timing should be interpreted as a secondary indicator. Across the sequence, baseline quality ratings increased from early participants (P1: 2.67â3.0) to later participants (P4âP5: 3.0â4.33), consistent with progressive knowledge accumulation. While the small sample (n=5; 47 rated questions) and lack of a control condition preclude causal claims, the pattern provides preliminary evidence that CMDA may contribute to improved initial generation quality and motivates future controlled validation. Apart from the engagement with the system, we now analyze what specific modifications were made. Table 5 quantifies these modifications through character-level edit distances and field counts. Table 5. Character-level edit distances and field modifications by participant. Edit distances quantify character-level changes between initial AI generation and final versions across research questions (Q) and contribution summaries (C). Notice how P3âs extensive modifications (2893 total characters) coupled with high quality ratings suggest substantive refinements rather than surface corrections, while P4âs minimal edits reflect satisfaction with generation quality. Part. Paper Edit Distance Q=Question, C=Contribution Edited fields amount per paper P1 Tell Me Without Telling Me Q: 71 - C: 22 6 DRIVE-T Methodology Q: 19 - C: 0 4 Charts-of-Thought Q: 50 - C: 0 4 P2 Tell Me Without Telling Me Q: 103 - C: 121 3 DRIVE-T Methodology Q: 82 - C: 63 1 Charts-of-Thought Q: 83 - C: 74 1 P3 Tell Me Without Telling Me Q: 43 - C: 41 4 DRIVE-T Methodology Q: 49 - C: 17 2 Charts-of-Thought Q: 197 - C: 201 6 Charts-of-Thought Q: 143 - C: 140 4 P4 Tell Me Without Telling Me Q: 0 - C: 0 0 DRIVE-T Methodology Q: 10 - C: 0 1 Charts-of-Thought Q: 22 - C: 61 1 P5 Tell Me Without Telling Me Q: 0 - C: 0 1 DRIVE-T Methodology Q: 0 - C: 0 1 Charts-of-Thought Q: 0 - C: 0 0 Edit distance did not decrease monotonically as knowledge accumulated, indicating that adaptation does not simply reduce editing effort. Instead, modification intensity varied widely, with P3 producing the most edits despite benefiting from 22 prior knowledge entries. This suggests that accumulated knowledge enables deeper expert refinement rather than discouraging engagement. P3âs second evaluation of the Charts-of-Thought paper still involved substantial edits, but these reflected new and complementary refinements because earlier insights had already been integrated. This pattern indicates that CMDA supports iterative quality improvement rather than redundant correction. Participants differed in editing focus, with some prioritizing research question framing and others refining contribution context and impact. Over time, research questions became longer and more conceptually rich, incorporating methodological detail, theoretical framing, and applied considerations such as accessibility. Edits encoded meaningful domain expertise rather than superficial corrections. From these refinements, we extracted 46 unique domain knowledge entries, showing a strong positive relationship between editing activity and knowledge extraction (slope = 0.78). This confirms that user edits act as a high-signal channel for implicit domain knowledge transfer, supporting ongoing system adaptation. Table 6 breaks down how this knowledge is distributed across participants and categories, revealing the depth of expertise captured. Table 6. Distribution of extracted knowledge entries by participant and category. Notice how P3 contributed the most knowledge entries (n=20) despite benefiting from accumulated knowledge, demonstrating that the system enables rather than replaces expert contribution. The uneven distribution (P1: 6, P2: 16, P3: 20, P4: 3, P5: 1) reflects varying engagement levels and expertise expression styles. Part. Edited fields total amount Conceptual Depth Changes Domain Terminology Evolution Methodological Refinements Total P1 14 2 3 1 6 P2 5 9 2 5 16 P3 15 12 5 3 20 P4 3 2 0 1 3 P5 2 1 0 0 1 39 26 10 10 46 The distribution challenges conventional assumptions about knowledge saturation. P3 contributed the most knowledge (20 entries) despite benefiting from 22 previously extracted entries, particularly emphasizing conceptual depth changes (12 entries). The double evaluation of Charts-of-Thought paper by P3 provides evidence for the systemâs learning capability: the second sessionâs knowledge entries were complementary rather than duplicative, as the system had already integrated learnings from the first session into its generation baseline. This pattern suggests bidirectional learningâthe system improves from edits while simultaneously enabling experts to explore different dimensions of quality in subsequent interactions. This counterintuitive pattern suggests that prior domain knowledge creates a foundation for increasingly sophisticated expert contributions rather than reaching a plateau. As shown in Table 6, the system categorized 46 unique knowledge entries into three primary types introduced in Section 3.3: Conceptual Depth Changes (56.5%, n=26) representing expansions in scope and theoretical frameworks, Domain Terminology Evolution (21.7%, n=10) reflecting refinements in technical language, and Methodological Refinements (21.7%, n=10) capturing improvements in assessment techniques. The predominance of conceptual depth changes reveals that experts primarily expand the systemâs understanding of research implications rather than correcting surface-level language. This distribution aligns with our frameworkâs goal of capturing tacit expert knowledge that extends beyond vocabulary corrections, showing that the system captures multiple dimensions of domain expertise with the majority of contributions advancing conceptual understanding rather than making cosmetic corrections. 5.3.2. Qualitative Findings Having quantified the patterns of interaction, modification, and knowledge extraction, we now examine specific examples to illustrate how domain expertise manifests through user modifications. We present these examples in order of increasing depth, from surface-level terminology refinements to fundamental conceptual expansions. Surface-Level Refinements: Precision in Language The most basic level of extracted knowledge involves terminology refinements that enhance precision without altering fundamental concepts. For example, based on user interaction the system generated this insight: âThe user removed the word âgranularityâ from the question, suggesting a preference for more concise and direct language when framing research questions about assessment methods.â While such edits might seem cosmetic, they teach the system domain-specific communication normsâwhat constitutes clear, professional discourse in visualization research. More substantively, participants consistently refined vague terms to precise constructs: âThe user replaced broader task categories (exploratory, explanatory, decision-making) with more specific ones (lookup, search, filtering), suggesting a preference for tasks more directly tied to interaction and information retrieval within visualizations, which is a common focus in usability and attention research.â This transformation from generic categorizations to specific interaction patterns represents essential domain vocabulary that distinguishes expert discourse from general descriptions. At a deeper level, participants introduced methodological refinements that expand how the system conceptualizes research approaches. A particularly impactful example involves multimodal assessment: âThe refined question emphasizes the use of âphysiological signalsâ alongside visual attention and cognitive factors, suggesting a shift towards a more holistic and potentially multimodal approach to assessing visualization literacy, perhaps incorporating biofeedback or real-time user state monitoring.â This modification doesnât merely correct terminology but introduces an entirely new methodological paradigmâteaching the system that modern visualization assessment extends beyond traditional cognitive metrics. The most profound knowledge contributions involve conceptual expansions that fundamentally reshape how the system approaches research questions. One notable example introduced accessibility considerations: âThe user expanded the potential impact of the research to include assisting âlow-vision users with visual analytics tasksâ, which highlights the importance of accessibility considerations when designing and evaluating interactive visualizations and LLM-based solutions.â This modification transcends correctionâit teaches the system that visualization research must consider diverse user populations and inclusive design principles. Participant feedback strongly validates the need for context-mediated domain adaptation. A critical theme emerged regarding the essential role of domain expertise in refining AI-generated content, with one participant emphasizing that â novelty stems from creating your own ideas. So after the first creation by LLMs, it is always important to think about it yourself as well. â This observation underscores that while AI systems can provide initial scaffolding, meaningful research contributions require domain experts to inject their specialized knowledge and critical thinking. Participants consistently reported that AI-generated research questions were âsuperficial or not that interesting on their ownâ but âcould be a good starting point,â highlighting the gap between generic AI output and domain-specific requirements. Furthermore, participants expressed desire for systems that could learn from their expertise, with one noting the tool would be more useful â if it would also give feedback on my direct edits, suggesting changes and formulations that capture things I did not think of. â The consistent preference for direct editing over promptingâwith participants noting that â improving the question myself was faster â âdemonstrates that current AI systems lack the domain-specific knowledge required for specialized tasks. To assess the quality and actionability of our knowledge extraction, we examined five representative entries that illustrate both the strengths and limitations of automated domain knowledge capture. The most impactful entry (conceptual_depth_changes) expanded research scope to include â The user expanded the potential impact of the research to include assisting âlow-vision users with visual analytics tasksâ, which highlights the importance of accessibility considerations when designing and evaluating interactive visualizations and LLM-based solutions. â This illustrates how expert modifications introduce critical accessibility considerations absent from initial AI generationâknowledge that reshapes how the system approaches visualization research questions. Similarly valuable is the shift (domain_terminology_evolution) from broad task categories to specific interaction patterns: â The user replaced broader task categories (exploratory, explanatory, decision-making) with more specific ones (lookup, search, filtering), suggesting a preference for tasks more directly tied to interaction and information retrieval within visualizations, which is a common focus in usability and attention research. â This teaches the system precise terminology that distinguishes expert discourse from generic descriptions. The emphasis on multimodal assessment (methodological_refinements) reveals how experts push beyond conventional metrics: â The refined question emphasizes the use of âphysiological signalsâ alongside visual attention and cognitive factors, suggesting a shift towards a more holistic and potentially multimodal approach to assessing visualization literacy, perhaps incorporating biofeedback or real-time user state monitoring. â 5.3.3. Synthesis of Findings Our evaluation reveals a coherent narrative of how context-mediated domain adaptation transforms user corrections into persistent system improvements. The progression from HOW participants interact, through WHAT they modify, to WHY they make changes illustrates the feasibility of bidirectional semantic links in capturing and propagating domain expertise. A notable pattern is that accumulated knowledge creates a virtuous cycle rather than reaching saturation. P3âs extensive contributions (20 knowledge entries) despite benefiting from 22 prior entries illustrates this pattern. The double evaluation of Charts-of-Thought paper particularly illustrates the systemâs learning dynamics: in the first session, P3 refined methodological aspects and terminology precision, while the second sessionâs improved baseline (from incorporating first session edits) enabled P3 to focus on different dimensions such as theoretical frameworks and cross-domain implications. This suggests that context-mediated adaptation enables iterative quality improvement rather than simple error correction. Later participants achieve higher quality ratings with less editing effortâP4âs 4.11 average rating with minimal intervention contrasts with P1âs 2.89 rating despite extensive editing (6 direct edits). While time was not a primary metric, P3âs double evaluation provides interesting context: the second session took 4.1 minutes versus 8.0 minutes initially, though this likely reflects both system learning and participant familiarity with the paper. Modifications become more sophisticated over timeâquestion length increases 35% as the system learns to generate more nuanced formulations, while edit patterns shift from surface corrections to deep conceptual refinements. The knowledge extracted evolves from basic terminology (early participants) to complex conceptual frameworks (later participants), with 56.5% of entries representing conceptual depth changes that fundamentally reshape the systemâs approach. Returning to our initial expectations, the results provide preliminary observations: H1 Decreasing edit distances: Pattern not observed uniformlyâP3âs extensive modifications suggest that knowledge accumulation may enable deeper engagement rather than simply reducing effort. H2 Decreasing time-to-completion: Pattern consistent with expectationsâaverage session time decreased from P1âs 6.3 minutes per paper to P4âs 5.6 minutes, though individual differences and paper familiarity effects cannot be ruled out. H3 Increasing quality ratings: Pattern observedâ42% improvement from P1 to P4 is consistent with knowledge transfer, though baseline condition needed to establish causality. H4 Knowledge saturation: Pattern not observedâthe system showed no signs of saturation within this limited study, with P3 contributing substantial knowledge despite prior accumulation. 6. Discussion Our evaluation provides preliminary evidence that context-mediated domain adaptation can bridge the gap between generic AI capabilities and domain-specific expertise requirements. The 46 extracted knowledge entries across five sequential participants demonstrate the feasibility of treating user modifications as implicit specifications for system behavior adaptation. 6.1. Engineering Contributions Our work provides concrete architectural patterns for building adaptive human-AI collaborative systems. The framework implements bidirectional semantic links between user interactions and system reasoning through persistent knowledge graph structures that maintain relationships between generated artifacts and extracted domain patterns. Multi-layered context assembly pipelines aggregate knowledge at user, project, and global scopes, while event-driven extraction mechanisms automatically categorize modifications into the three knowledge categories: domain terminology evolution, methodological refinements, and conceptual depth changes. This architecture provides reusable patterns for any domain requiring continuous adaptation to user expertise. The systemâs three interaction modes establish engineering best practices for accommodating varying levels of user intervention while maintaining semantic connections throughout. Our instrumentation framework captures edit distances at character and word levels, tracks knowledge saturation through generation-versus-reuse ratios, and enables longitudinal analysis of accumulation patterns. These metrics provide quantitative methods for evaluating knowledge transfer effectiveness in adaptive systems. The database architecture implements normalized knowledge representation that separates domain insights from specific instances, with versioning and provenance tracking maintaining complete evolution history. Scoped access patterns enable privacy-preserving knowledge sharing, while LLM-agnostic storage ensures portability across different AI backends. The complete knowledge lifecycleâfrom extraction through categorization to integrationâfollows systematic processes that analyze user modifications, classify insights into actionable types, and incorporate extracted knowledge into system prompts. These contributions directly address key engineering challenges in interactive AI systems. Automatic extraction and categorization eliminate manual prompt engineering, enabling scalability across domains without extensive configuration. Component separation ensures maintainability through independent subsystem evolution. Continuous knowledge accumulation allows systems to evolve with their user communities, reducing manual customization burden. The domain-agnostic patterns provide reusable components for diverse application contexts. 6.2. Limitations Our approach faces several important constraints that bound its applicability. The current implementation focuses on research question generation within visualization literacy, and while the architecture supports extension, the extraction patterns remain specialized for academic sensemaking tasks. With only five participants in our visualization literacy evaluation and 46 knowledge entries, we provide proof-of-concept validation but cannot demonstrate comprehensive domain coverage or scalability to larger communities. Transfer to significantly different domains would require adapting the categorization and extraction mechanisms. The system depends on domain experts capable of providing meaningful corrections. General users without sufficient expertise may not produce corrections that yield useful learning signals, limiting applicability beyond expert communities. Our approach works best for structured, text-based artifacts with clear editability boundaries; complex multimedia content or real-time collaborative tasks may strain the semantic linking mechanisms. We observed knowledge transfer across participants but not long-term retention or drift, and subjective quality ratings may not fully capture the nuanced improvements in generated content. Our knowledge extraction relies on carefully crafted prompts that may not be optimal across all scenarios. The quality and consistency of extracted knowledge varies significantly based on the LLM model usedâwe primarily tested with Gemini 2.0 Flash Liteâand different models may produce substantially different categorizations. This model-dependence introduces variability that could affect reproducibility and cross-system compatibility. Despite these limitations, the consistent patterns across multiple metricsâquality ratings, edit distances, knowledge extraction, question complexity, and temporal efficiencyâprovide converging evidence that context-mediated domain adaptation can bridge the gap between generic AI capabilities and domain-specific requirements. Participant feedback validates our approach: experts explicitly desired systems that learn from their corrections to improve future generations, which context-mediated domain adaptation delivers through systematic capture of edit patterns and domain conventions. 6.3. Future Work Our evaluation reveals that accumulated knowledge enables rather than replaces expert contribution, with the 0.78 correlation between editing activity and knowledge extraction demonstrating effective implicit knowledge transfer. This finding suggests new research directions for sustainable knowledge management in adaptive AI systems. Knowledge lifecycle management presents immediate challengesâas domains evolve, accumulated patterns may become outdated. Future systems need aging mechanisms that preserve foundational insights while deprioritizing obsolete patterns, validation methods to distinguish expert corrections from individual preferences, and consolidation strategies for conflicting knowledge entries. The current three-category taxonomy (conceptual depth, terminology, methodology) may not optimally capture all domain expertise forms. Research should explore automatic category discovery through unsupervised clustering and self-organizing taxonomies that adapt to different domains. Enterprise deployment requires governance mechanisms for knowledge sharing, privacy-preserving federated learning, and role-based access controls. Cross-domain transfer remains unexploredâcan knowledge from research questions generalize to related tasks? Knowledge graph visualization approaches (Li et al., 2023, 2021) could enable users to inspect and refine accumulated domain understanding, providing transparency into how their corrections shape system behavior. Acknowledgements.This work was supported partly by Villum Investigator grant VL-54492 by Villum Fonden. Any opinions, findings, and conclusions expressed in this material are those of the authors and do not necessarily reflect the views of the funding agency. References S. Amershi, D. Weld, M. Vorvoreanu, A. Fourney, B. Nushi, P. Collisson, J. Suh, S. Iqbal, P. N. Bennett, K. Inkpen, J. Teevan, R. Kikin-Gil, and E. Horvitz (2019) Guidelines for Human-AI interaction. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 3:1â3:13. External Links: Document Cited by: §1, §2.2, §2.4. I. Arawjo, C. Swoopes, P. Vaithilingam, M. Wattenberg, and E. L. Glassman (2024) ChainForge: A visual toolkit for prompt engineering and LLM hypothesis testing. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 304:1â304:18. External Links: Document Cited by: §1, §2.3. S. K. Badam, N. Elmqvist, and J. Fekete (2017) Steering the craft: UI elements and visualizations for supporting progressive visual analytics. Computer Graphics Forum 36 (3), p. 491â502. External Links: Document Cited by: §2.4. T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei (2020) Language models are few-shot learners. In Advances in Neural Information Processing Systems, Red Hook, NY, USA. Cited by: §1, §2.3. M. Chang, Y. Wang, H. W. Wang, Y. Zhou, A. Bulling, and C. X. Bearfield (2025) Tell me without telling me: two-way prediction of visualization literacy and visual attention. External Links: 2508.03713, Link Cited by: §5.1.2. X. Chen, M. Lin, N. Schärli, and D. Zhou (2024a) Teaching large language models to self-debug. In International Conference on Learning Representations (ICLR), External Links: Link Cited by: §2.3. Y. Chen, J. Arkin, Y. Hao, Y. Zhang, N. Roy, and C. Fan (2024b) PRompt optimization in multi-step tasks (PROMST): integrating human feedback and heuristic-based sampling. In Proceedings of the Conference on Empirical Methods in Natural Language Processing, Stroudsburg, PA, USA, p. 3859â3920. External Links: Document Cited by: §2.3. Z. Cui, S. K. Badam, M. A. Yalçin, and N. Elmqvist (2019) DataSite: proactive visual data exploration with computation of insight-based recommendations. Information Visualization 18 (2), p. 251â267. External Links: Document Cited by: §2.4. A. K. Das, M. Tarun, and K. Mueller (2025) Charts-of-thought: enhancing llm visualization literacy through structured data extraction. External Links: 2508.04842, Link Cited by: §5.1.2. M. Desmond and M. Brachman (2024) Exploring prompt engineering practices in the enterprise. CoRR abs/2403.08950. External Links: Document, 2403.08950 Cited by: §1, §2.3. V. Dhanoa, A. Wolter, G. Molina LeĂłn, H. Schulz, and N. Elmqvist (2025) Agentic visualization: extracting agent-based design patterns from visualization systems. IEEE Computer Graphics and Applications 45 (6), p. 89â100. External Links: Document Cited by: §2.4, §3. M. DĂśrk, B. MĂźller, J. Stange, J. Herseni, and K. Dittrich (2020) Co-designing visualizations for information seeking and knowledge management. Open Information Science 4 (1), p. 217â235. External Links: Document Cited by: §2.4, §4.7. H. Du, S. Thudumu, R. Vasa, and K. Mouzakis (2024) A survey on context-aware multi-agent systems: techniques, challenges and future directions. CoRR abs/2402.01968. External Links: Link, Document, 2402.01968 Cited by: §2.1, §3.3, §3, §4.7. N. Elmqvist, P. Dragicevic, and J. Fekete (2008) Rolling the dice: multidimensional visual exploration using scatterplot matrix navigation. IEEE transactions on visualization and computer graphics 14, p. 1141â8. External Links: Document Cited by: §2.4. N. Elmqvist, E. Hoggan, H. Schulz, M. G. Petersen, P. Dalsgaard, I. Assent, O. W. Bertelsen, A. Arora, K. GrønbĂŚk, S. Bødker, C. N. Klokmose, R. C. Smith, S. Hubenschmid, C. A. Johns, G. M. LeĂłn, A. Wolter, J. Ellemose, V. Dhanoa, S. A. Enni, M. S. Lunding, K. K. Bilstrup, J. S. Esquivel, L. Connelly, R. P. Sarabia, M. Birk, J. Nyborg, S. Zollmann, T. Langlotz, M. S. Chou, J. E. S. GrønbĂŚk, M. Wessely, Y. Jiang, C. Berger, D. Dai, M. M. Biskjaer, G. Leiva, J. Frich, E. Eriksson, K. Halskov, T. Mikkelsen, N. Potamitis, M. Yildirim, A. Srinivasan, J. Falk, N. Inie, O. S. Iversen, and H. Andersson (2025) Participatory ai: a scandinavian approach to human-centered ai. External Links: 2509.12752 Cited by: §2.4. A. Endert, P. Fiaux, and C. North (2012) Semantic interaction for visual text analytics. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 473â482. External Links: Document Cited by: §2.2. W. Epperson, G. Bansal, V. C. Dibia, A. Fourney, J. Gerrits, E. (. Zhu, and S. Amershi (2025) Interactive debugging and steering of multi-agent ai systems. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 156:1â156:15. External Links: Document Cited by: §2.2. M. A. Ferrag, N. Tihanyi, and M. Debbah (2025) From LLM reasoning to autonomous AI agents: A comprehensive review. CoRR abs/2504.19678. External Links: Document, 2504.19678 Cited by: §1. A. GammelgĂĽrd-Larsen, N. van Berkel, M. B. Skov, and J. Kjeldskov (2024) Designing for human-ai interaction: comparing intermittent, continuous, and proactive interactions for a music application. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, CHI EA â24, New York, NY, USA. Cited by: §3.2. G. Gao, A. Taymanov, E. Salinas, P. Mineiro, and D. Misra (2024) Aligning LLM agents by learning latent preference from user edits. In Advances in Neural Information Processing Systems, Red Hook, NY, USA. External Links: Link Cited by: §2.4. P. F. Gyarmati, M. KlaffenbĂśck, L. Koesten, and T. MĂśller (2025a) Do vision-language models see visualizations like humans? alignment in chart categorization. External Links: 2509.05718 Cited by: §3. P. F. Gyarmati, D. Moritz, T. MĂśller, and L. Koesten (2025b) A composable agentic system for automated visual data reporting. External Links: 2509.05721 Cited by: §2.4. M. A. Hearst, J. F. Allen, E. Horvitz, and C. I. Guinn (1999) Trends & controversies: mixed-initiative interaction. IEEE Intelligent Systems 14 (5), p. 14â24. External Links: Document Cited by: §2.2. E. Horvitz (1999) Principles of mixed-initiative user interfaces. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 159â166. External Links: Document Cited by: §2.2. N. Krishnan (2025) Advancing multi-agent systems through model context protocol: architecture, implementation, and applications. CoRR abs/2504.21030. External Links: Link, Document, 2504.21030 Cited by: §3, §4.4.1. H. Li, G. Appleby, C. Brumar, R. Chang, and A. Suh (2023) Knowledge graphs in practice: characterizing their users, challenges, and visualization opportunities. IEEE Transactions on Visualization and Computer Graphics 30 (1), p. 584â594. External Links: Document Cited by: §6.3. H. Li, Y. Wang, S. Zhang, Y. Song, and H. Qu (2021) KG4Vis: a knowledge graph-based approach for visualization recommendation. IEEE Transactions on Visualization and Computer Graphics 28 (1), p. 195â205. External Links: Document Cited by: §6.3. S. Liu, H. Miao, Z. Li, M. Olson, V. Pascucci, and P-T. Bremer (2024) AVA: towards autonomous visualization agents through visual perception-driven decision-making. Computer Graphics Forum 43 (3), p. e15093. External Links: Document Cited by: §2.4. A. Locoro, S. Golia, and D. Falessi (2025) DRIVE-t: a methodology for discriminative and representative data viz item selection for literacy construct and assessment. External Links: 2508.04160, Link Cited by: §5.1.2. T. Miller, I. Durlik, A. ĹobodziĹska, L. DorobczyĹski, and R. Jasionowski (2024) AI in context: harnessing domain knowledge for smarter machine learning. Applied Sciences 14 (24). External Links: Document Cited by: §1. A. Mishra, B. Danzy, U. Soni, A. Arunkumar, J. Huang, B. C. Kwon, and C. Bryan (2025) PromptAid: visual prompt exploration, perturbation, testing and iteration for large language models. IEEE Transactions on Visualization and Computer Graphics 31, p. 6946â6962. Cited by: §1, §2.3. F. Munguia-Galeano, A. Tan, and Z. Ji (2023) Deep reinforcement learning with explicit context representation. IEEE Transactions on Neural Networks and Learning Systems 36, p. 419â432. External Links: Document Cited by: §2.1, §3.3. R. Neogy, J. Zong, and A. Satyanarayan (2020) Representing real-time multi-user collaboration in visualizations. In Proceedings of the IEEE Visualization Conference, Los Alamitos, CA, USA, p. 146â150. External Links: Document Cited by: §3. A. Passerini, A. Gema, P. Minervini, B. Sayin, and K. Tentori (2024) Fostering effective hybrid human-LLM reasoning and decision making. Frontiers Artificial Intelligence 7. External Links: Document Cited by: §1. R. E. Patterson, B. J. Pierce, H. H. Bell, and G. Klein (2010) Implicit learning, tacit knowledge, expertise development, and naturalistic decision making. Journal of Cognitive Engineering and Decision Making 4 (4), p. 289â303. External Links: Document Cited by: §1. G. Peng, H. Wang, H. Zhang, Y. Zhao, and A. Johnson (2017) A collaborative system for capturing and reusing in-context design knowledge with an integrated representation model. Advanced Engineering Informatics 33, p. 314â329. External Links: Document Cited by: §2.4, §3. B. Shneiderman (2022) Human-centered ai. Oxford University Press, Oxford, UK. Cited by: §1, §2.2, §2.3. K. Shridhar, K. Sinha, A. Cohen, T. Wang, P. Yu, R. Pasunuru, M. Sachan, J. Weston, and A. Celikyilmaz (2023) The art of llm refinement: ask, refine, and trust. External Links: 2311.07961 Cited by: §1, §2.3. A. Srinivasan and V. Setlur (2021) Snowy: recommending utterances for conversational visual analysis. In Proceedings of the ACM Symposium on User Interface Software and Technology, New York, NY, USA, p. 864â880. External Links: Document Cited by: §2.4. R. Turner (1998) Context-mediated behavior for intelligent agents. International Journal of Human-Computer Studies 48 (3), p. 307â330. External Links: Document Cited by: §1, §2.1. C. C. Tutum, S. Abdulquddos, and R. Miikkulainen (2021) Generalization of agent behavior through explicit representation of context. In Proceedings of the IEEE Conference on Games, Los Alamitos, CA, USA, p. 1â7. External Links: Document Cited by: §2.1, §3.3. N. van Berkel, M. B. Skov, and J. Kjeldskov (2021) Human-ai interaction: intermittent, continuous, and proactive. Interactions 28 (6), p. 67â71. External Links: Document Cited by: §3.2. C. Wang, J. Thompson, and B. Lee (2024) Data formulator: ai-powered concept-driven visualization authoring. IEEE Transactions on Visualization and Computer Graphics 30 (1), p. 1128â1138. External Links: Document Cited by: §2.4. M. Weck, I. Humala, P. Tamminen, and F. Ferreira (2021) Knowledge management visualisation in regional innovation system collaborative decision-making. Management Decision 60 (4), p. 1017â1038. External Links: Document Cited by: §2.4, §4.7. L. Weng, X. Wang, J. Lu, Y. Feng, Y. Liu, H. Feng, D. Huang, and W. Chen (2025) InsightLens: augmenting llm-powered data analysis with interactive insight management and navigation. IEEE Transactions on Visualization and Computer Graphics 31 (6), p. 3719â3732. External Links: Document Cited by: §2.4. A. Wolter, G. Vidalakis, M. Yu, A. Grover, and V. Dhanoa (2025) Multi-agent data visualization and narrative generation. External Links: 2509.00481 Cited by: §2.4. J. Wu, J. Zhu, Y. Liu, M. Xu, and Y. Jin (2025) Agentic reasoning: A streamlined framework for enhancing LLM reasoning with agentic tools. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, Stroudsburg, PA, USA, p. 28489â28503. Cited by: §1. F. Yang (2021) How do visual explanations foster end usersâ appropriate trust in machine learning?. OSF Preprints. External Links: Document Cited by: §2.2. R. B. Yousuf, N. Defelice, M. Sharma, S. Xu, and N. Ramakrishnan (2024) LLM augmentations to support analytical reasoning over multiple documents. In Proceedings of the IEEE Conference on Big Data, Los Alamitos, CA, USA, p. 1892â1901. External Links: Document Cited by: §1. J. D. Zamfirescu-Pereira, R. Y. Wong, B. Hartmann, and Q. Yang (2023) Why Johnny canât prompt: how non-ai experts try (and fail) to design LLM prompts. In Proceedings of the ACM Conference on Human Factors in Computing Systems, New York, NY, USA, p. 437:1â437:21. External Links: Document Cited by: §1, §2.3. Y. Zhang, R. Sun, Y. Chen, T. Pfister, R. Zhang, and S. Ă. Arik (2024) Chain of agents: large language models collaborating on long-context tasks. CoRR abs/2406.02818. External Links: Link, Document, 2406.02818 Cited by: §2.1, §4.4.1. H. Zhao, H. Chen, F. Yang, N. Liu, H. Deng, H. Cai, S. Wang, D. Yin, and M. Du (2024) Explainability for large language models: a survey. ACM Transactions on Intelligent Systems and Technology 15 (2), p. 1â38. Cited by: §2.4. Y. Zhou, A. I. Muresanu, Z. Han, K. Paster, S. Pitis, H. Chan, and J. Ba (2023) Large language models are human-level prompt engineers. In International Conference on Learning Representations (ICLR), External Links: Link Cited by: §2.3. Y. Zhuang, X. Yu, J. Wu, X. Sun, Z. Wang, J. Liu, Y. Su, J. Shang, Z. Liu, and E. Barsoum (2025) Self-taught agentic long context understanding. In Proceedings of the Annual Meeting of the Association for Computational Linguistics, Stroudsburg, PA, USA, p. 5525â5537. External Links: Link Cited by: §2.1, §4.7.