Paper deep dive
Mi:dm K 2.5 Pro
KT Tech innovation Group
Intelligence
Status: succeeded | Model: google/gemini-3.1-flash-lite-preview | Prompt: intel-v1 | Confidence: 95%
Last extracted: 3/22/2026, 6:09:12 AM
Summary
Mi:dm K 2.5 Pro is a 32B parameter flagship LLM developed by KT, optimized for enterprise-grade complexity through reasoning-focused training. The model utilizes a quality-centric data curation pipeline involving AST analysis for code, gap-filling synthesis for mathematics, and an LLM-based quality evaluator. It features a 128K token context window, Depth Upscaling (DuS) pre-training, and a multi-stage post-training pipeline including Reasoning SFT and asynchronous reinforcement learning.
Entities (5)
Relation Signals (3)
KT â developed â Mi:dm K 2.5 Pro
confidence 100% ¡ KT introduces Mi:dm K 2.5 Pro, the flagship model in the Mi:dm K large language model (LLM) lineup.
Mi:dm K 2.5 Pro â usestechnique â Depth Upscaling
confidence 95% ¡ Pre-training scales the model via layer-predictor-based Depth Upscaling (DuS)
Mi:dm K 2.5 Pro â usestechnique â Abstract Syntax Tree
confidence 95% ¡ utilizing abstract syntax tree (AST) analysis for code
Cypher Suggestions (0)
No Cypher suggestions yet.
Abstract
Abstract:The evolving LLM landscape requires capabilities beyond simple text generation, prioritizing multi-step reasoning, long-context understanding, and agentic workflows. This shift challenges existing models in enterprise environments, especially in Korean-language and domain-specific scenarios where scaling is insufficient. We introduce Mi:dm K 2.5 Pro, a 32B parameter flagship LLM designed to address enterprise-grade complexity through reasoning-focused optimization. Our methodology builds a robust data foundation via a quality-centric curation pipeline utilizing abstract syntax tree (AST) analysis for code, gap-filling synthesis for mathematics, and an LLM-based quality evaluator. Pre-training scales the model via layer-predictor-based Depth Upscaling (DuS) and a progressive strategy supporting a 128K token context window. Post-training introduces a specialized multi-stage pipeline, including Reasoning SFT, model merging, and asynchronous reinforcement learning (RL), to develop complex problem-solving skills. "Fusion Training" then rebalances these capabilities with conversational fluency, consistent response styling, and reliable tool-use. The evaluations show that Mi:dm K 2.5 Pro achieves competitive performance against leading global and domestic models. In addition, it sets state-of-the-art results on Korean-specific benchmarks, showcasing deep linguistic and cultural understanding. Finally, Responsible AI evaluations validate safety against attacks, ensuring a secure profile for deployment with a balance of harmlessness and responsiveness.
Tags
Links
- Source: https://arxiv.org/abs/2603.18788v1
- Canonical: https://arxiv.org/abs/2603.18788v1
Trouble viewing inline? Open PDF directly â
Full Text
147,193 characters extracted from source content.
Expand or collapse full text
Mi:dm K 2.5 Pro Tech. Innovation Group, KT midm-llm@kt.com Abstract The evolving LLM landscape requires capabilities beyond simple text generation, prioritizing multi-step reasoning, long-context understanding, and agentic work- flows. This shift challenges existing models in enterprise environments, especially in Korean-language and domain-specific scenarios where scaling is insufficient. We introduce Mi:dm K 2.5 Pro, a 32B parameter flagship LLM designed to address enterprise-grade complexity through reasoning-focused optimization. Our methodology builds a robust data foundation via a quality-centric curation pipeline utilizing abstract syntax tree (AST) analysis for code, gap-filling synthesis for mathematics, and an LLM-based quality evaluator. Pre-training scales the model via layer-predictor-based Depth Upscaling (DuS) and a progressive strategy supporting a 128K token context window. Post-training introduces a specialized multi-stage pipelineâincluding Reasoning SFT, model merging, and asynchronous reinforcement learning (RL)âto develop complex problem-solving skills. "Fusion Training" then rebalances these capabilities with conversational fluency, consistent response styling, and reliable tool-use. The evaluations show that Mi:dm K 2.5 Pro achieves competitive performance against leading global and domestic models. In addition, it sets state-of-the-art results on Korean-specific benchmarks, showcasing deep linguistic and cultural understanding. Finally, Responsible AI evaluations validate safety against attacks, ensuring a secure profile for deployment with a balance of harmlessness and responsiveness. 1 Introduction Figure 1: Artificial Analysis Intelligence Index (AAII) v4.0 results KT introduces Mi:dm K 2.5 Pro, the flagship model in the Mi:dm K large language model (LLM) lineup. Building on the technical foundations validated by the existing Mi:dm 2.0 Base and Mini models, this report provides a comprehensive account of the Pro modelâs training pipeline and performance, enabled by increased parameter count and reasoning-focused optimization. Recent developments in the LLM landscape increasingly require capabilities beyond simple question answering (QA) and text generation, with advanced multi-step reasoning, long-context understanding, arXiv:2603.18788v1 [cs.CL] 19 Mar 2026 external tool use, and agentic workflows emerging as key evaluation criteria [1]. This shift reflects the evolution of LLMs from response generators into more sophisticated systems capable of complex decision-making and problem solving. However, existing small to mid scale models exhibit limitations in complex reasoning, long-context analysis, and reliable instruction following required in enterprise environments, due to their con- strained parameter counts and context windows [2]. This challenge is especially pronounced for Korean-language, real-world industrial data and domain-specific scenarios, where simple model scaling alone is often insufficient to achieve the required levels of reliability and performance. With this motivation, Mi:dm K 2.5 Pro is developed with explicit design objectives aimed at addressing enterprise-grade complexity, rather than through naive model scaling alone. The model is configured with 32B parametersâapproximately 3Ă larger than Mi:dm 2.0 Base [3]âto increase knowledge density and support deeper reasoning. In addition, we extend the context length from 32K to 128K tokens, enabling robust handling of enterprise requirements such as long-document analysis, multi- document understanding, and complex information extraction. Moving beyond simple scaling, Mi:dm K 2.5 Pro can dynamically adapt its inference behavior to balance reasoning-intensive tasks with latency-sensitive general requests [4]. This enables robust rea- soning for complex computation and problem-solving, while supporting efficient response generation for general-purpose informational queries and natural conversation. From a data perspective, KT leveraged extensive public and private sector partnerships to curate proprietary domain datasets that are difficult to obtain through open-web document collection alone. Constructed under a sophisticated data governance framework and an advanced preprocessing and quality-filtering pipeline, the resulting training corpus strengthens Korean-language understanding and improves coverage of Korea-centric context, thereby differentiating the model. We subdivide the post-training pipeline and perform phase-specific reward modeling and hyperparam- eter tuning aligned with the objective of each stage. By incorporating model merging [5], we improve training stability and achieve balanced performance across complex reasoning, coding, instruction following, and agentic task execution. To ensure a consistent and reliable user experience, we define the Mi:dm K response style guide and systematically strengthen persona consistency, tone and register control, and response-structure stability during SFT. As a result, Mi:dm K 2.5 Pro maintains robust instruction-following performance under multiple constraints and on highly complex tasks. Furthermore, we have expanded Mi:dm K from a Korean-English bilingual model to a multilingual model supporting four languages, including Japanese and Chinese. Using high-quality language- specific data during training, we aim to generate responses that reflect each languageâs context and cultural characteristics, rather than relying on simple translation. With the development of Mi:dm K 2.5 Pro, KT has established a complete Mi:dm K lineup spanning Mini, Base, and Pro. This enables flexible model selection based on available compute and target use cases. Building on this lineup, KT is committed to serving as a core engine for accelerating customersâ AI transformation (AX) by delivering industry-specific AI solutions. 2 Data Foundations The data strategy of Mi:dm K 2.5 Pro builds on the Korean-language knowledge base established in Mi:dm 2.0 [3], shifting the emphasis from scaling data volume to quality-centric curation and effective utilization. While Mi:dm 2.0 primarily targeted broad, general-purpose Korean competence, Mi:dm K 2.5 Pro seeks to improve domain-specific reasoning and real-world usability through rigorous data selection and systematic, structure-aware data restructuring. To this end, we adopt a data curation pipeline that integrates an LLM-based data quality evaluator with abstract syntax tree (AST) analysis, instead of relying on heuristic filters. For domains where data are sparse or exhibit structural biasesâsuch as mathematics and codeâwe augment the training distribution with synthetic data. In addition, we define a Mi:dm K response-style specification and apply rewrite-based post-processing to ensure consistent output formatting and robust adherence to instruction. In this section, we describe the data acquisition and curation procedures under this strategy. 2 2.1 High Quality Data Acquisition Mi:dm K 2.5 Pro builds upon the training data used for Mi:dm 2.0 [3], while expanding domain coverage and rebalancing the data mixture. This expansion has three objectives: (i) augmenting Korean-language training data, (i) selectively incorporating multilingual data, and (i) broadening training coverage for STEM, code, and agentic domains. We source training data through three channels: licensed proprietary datasets, public datasets that permit commercial use, and in-house synthetic data. Accordingly, as we scale the corpus, rigorous curationârefinement and selectionâbecomes critical to prevent quality degradation. Korean Data Acquisition Strategy.Mi:dm K 2.5 Pro maintains a Korean-centric training strategy and constructs its training corpus primarily from public resources, including AI-HUB * and the National Institute of Korean Language (NIKL) corpora * . In addition, through sustained collaborations with an industryâacademia, including the K-Data Alliance âwe secure large volumes of Korea- focused data that reflect the institutional context, cultural norms, and knowledge landscape of Korean society. The collected corpus encompasses materials rooted in Korean socio-economic and institutional contextsâcovering areas such as economy and finance, public administration, as well as cultural and social domainsâtogether with Korean-language specialized knowledge, including STEM education content, expertise distilled from professional publications, and code- and agent-oriented scenarios. Instead of being siloed for narrow applications, these data are integrated into the general pretraining mixture, strengthening both general linguistic competence and domain-specific reasoning capabilities. We apply the same refinement pipeline used for the existing training corpus to the newly collected Korean-language source data, and utilize a subset of it for synthetic data generation. The synthesized data help enrich Korean-language knowledge coverage in specialized domains where real-world resources are relatively scarce. Multilingual Support and Language Transfer. To support foundational multilingual capability while preserving a Korean-centric learning focus, we intentionally limit the multilingual data to 3â10% of the Korean corpus. This controlled inclusion is designed to encourage beneficial cross-lingual transfer without diluting the primary emphasis on Korean-language training. We construct the multilingual corpus using Chinese and Japanese. For Chinese, we sample web documents from the top-scoring, ultra-high-quality band of the OpenCSG Chinese Corpus [6] and Cosmopedia-format synthetic documents [7] generated from the same corpus. For Japanese, we use documents from the Japanese subset of FineWeb2-HQ [8] that pass our internal toxicity filters. In addition, we curate web-based knowledge resources in Chinese and Japanese, including them after applying the same refinement and selection criteria. Beyond raw multilingual corpora, we further construct translation datasets derived from the source multilingual data. Translations are generated and stratified by task type (e.g., question answering, information extraction, summarization) and by translation direction (e.g., enâzh, jaâko). During training, translated data are mixed with their corresponding source-language data to promote cross-lingual alignment while maintaining balanced exposure. Across all multilingual and translated data, we extend our existing refinement pipeline with language- aware deduplication and heuristic filtering tailored to language-specific characteristics. We also apply toxicity filtering to minimize culturally or socially sensitive content, taking into account the modelâs intended use in Korean-centric training and deployment contexts. Overall, multilingual data serve a complementary role and are carefully controlled to supportârather than overrideâthe Korean-focused training objective. Specialized Domain (STEM, Code, and Agentic). To expand coverage in STEM, code, and agent-oriented (tool-use) tasks, we use publicly available specialist datasets such as peS2o [9] and OpenStax * . In addition, we acquire problem-bank resources and code datasets through commercial licensing and partnerships. * https://w.aihub.or.kr * https://w.korean.go.kr * https://openstax.org/ 3 2.2 Refinement Pipeline for Code Figure 2: Refinement pipeline for code To effectively leverage code reasoning data for training, it is necessary to go beyond coarse tagging (e.g., difficulty, language, or pass/fail correctness). We should systematically filter out training- incompatible samples while constructing the remaining corpus to broadly reflect real-world usage across programming languages, difficulty tiers, and programming task types. Accordingly, we apply a sequential filtering and annotation pipeline to the input code corpus consisting of: (i) programming-language identificationâ(i) educational suitability and quality criteriaâ (i) removal of source- and file-level spurious artifactsâ(iv) executability-based filteringâ(v) difficulty labelingâ(vi) task-type labeling. Each sample is annotated with structured metadata, includinglanguage,quality_score,is_executable,difficulty, andtask. These metadata serves as core axes for sampling policies and mixture scheduling during multi-stage LLM training. Programming Language Classifier. Code data exhibits substantial structural variationâfor ex- ample, natural language and code may be interleaved within a single sample, and code fences may explicitly specify the target languageâmaking misclassification common when relying on a single criterion. To address this, we adopt a two-step programming-language identification strategy. First, if the code fence specifies a language in the form```language, we use it as the primary signal for language assignment. Otherwise, we infer the language using a dedicated classifier. We define a predefined set of widely used languages based on real-world prevalence, and map all remaining instances to an other category. In our comparison between lexing-based tools (e.g., Pygments) and model-based approaches for programming-language classification, we find that lexing-based methods tend to be unreliable when discriminating between syntactically similar languages. By contrast, the model-based classifier provides more consistent and higher accuracy on major languages. We therefore adopt the model- based approach as the primary signal for language identification in our pipeline. Education Score Filter. From a code-learning perspective, samples that perform no substantive logical operations, are not self-contained or executable, or consist solely of high-level instructions provide limited supervision for code reasoning. Accordingly, we extend our existing quality assess- ment criteria into a 5-point training-suitability scale (1â5) and remove low-scoring samples during the refinement stage. Samples with scores of 1â3 typically lack executability or explicit reasoning, featuring incomplete code, syntax errors, or snippets too brief to demonstrate problem-solving logic. In contrast, samples in the 4â5 range contain executable, self-contained code and make the problem-solving logic explicit, including reasoning steps such as computation and conditional logic. In our pipeline, samples with scores of 1â3 are treated as training-incompatible and filtered out, while samples with scores of 4â5 are retained to support the development of code reasoning ability. The goal of this refinement step is not to deliver short-term gains in answer accuracy, but to raise the quality floor of the training corpus, which in turn improves the reliability of the difficulty and task labels assigned in subsequent stages. 4 DifficultyAlgorithm Category EasyArray, String, Hash Table, Math, Simulation,¡ MediumBinary Search, Sliding Window, Greedy, Heap, Backtracking, Topological Sort, Union-Find, Tree/Graph, DP,¡ HardSuffix Array, AhoâCorasick, Min-Cost Max-Flow, Heavy-Light Decomposition, Li Chao Tree, Convex Hull Trick, Matrix Exponentiation, Digit/Tree DP,¡ Table 1: Difficulty classification based on algorithm categories File-Level Low Quality Filter. Recurring noise from the same generation pipeline or upstream source is inefficient to address via per-sample inspection alone. We therefore use a rule-based, file-level detector to identify systematically recurring noise patterns and drop the corresponding files/sources in bulk. Concretely, we exclude files during refinement when the natural-language proportion is so high that code-type classification becomes unstable, the training-suitability scores of many samples within the same file are consistently low, or multiple unrelated functions are interleaved such that the training unit of an individual sample is unclear. Execution Filter.For code reasoning data, not only answer correctness but also structural validity and executability of the code are crucial. To this end, the final pipeline includes a execution filter that parses source code into an abstract syntax tree (AST) and assesses executability at the syntactic and structural levels. Compared with simple string-based heuristics, this approach more reliably captures structural properties of code. The execution filter distinguishes genuinely executable code from samples that merely resemble code blocks but are in fact corrupted fragments, mixed natural-language/code text, or formats unsuitable for execution testing. This filter serves as a critical curation step in constructing high-quality code data and helps improve the reliability of the downstream task classifier that identifies code execution tasks. Difficulty Filter. In model training, difficulty informs the overall data strategy, particularly the design of sampling and mixture composition. In the final stage, we categorize code difficulty into three levels: Easy, Medium, and Hard. Difficulty is defined based on the types of algorithms and data structures involved, as summarized in Table 1. For example, problems centered on arrays or hash tables are labeled Easy; those involving recursion, heaps, dynamic programming, or graph algorithms are labeled Medium; and problems requiring more advanced techniquesâsuch as segment trees, Fenwick trees (BIT), advanced dynamic programming, or optimization methodsâare labeled Hard. This process does not rely on a single feature (e.g., code length); instead, it bases difficulty on the sophistication of the conceptual tools required for problem solving. This criterion is particularly important for reasoning data: as rationales become longer, they may include redundant or non-essential explanation, making length-based difficulty estimation unreliable. Task Classifier.Reasoning data in the code domain spans multiple tasks beyond Code Generation, including Self-Repair, Test Output Prediction, and Code Execution. The task distribution can materi- ally affect training dynamics [10â12]. To reflect the diverse coding capabilities required in real-world use cases, we clearly define each task and adopt a criteria-driven classification scheme. Moreover, to handle boundary casesâe.g., samples that already include problem-solving code being misclassified as Code Generationâwe apply a combination of prompt-level rules and post-processing rules to maintain label consistency. Code Data Distribution Analysis. Finally, each sample is a code instance annotated with meta- data includinglanguage,quality_score, anis_executableflag (AST-based executability), difficulty, andtask. Rather than serving merely as descriptive annotations, these metadata are actively used to guide filtering decisions and to control sampling ratios and distribution balancing across training stages. For example, if task-distribution analysis reveals an excessive proportion of Self-Repair tasks, we adjust sampling weights in subsequent stages to match a target distribution. Conversely, for tasks with relatively low proportion, we design additional data collection or targeted data generation strategies to restore balance. 5 Figure 3: Distribution report ofscore, difficulty, andtaskafter refinement (distribution bias diagnosis based on top buckets). Building on these classification results, we remove contaminated samples and construct high- quality data buckets, thereby reducing error propagation in the staged pipeline (languageâqual- ityâis_executableâdifficultyâtask) and preventing upstream mistakes from cascading into downstream labels. In addition, coupling an AST-based executability filter with task classification provides verifiability at the data layer, a key requirement for code-domain training. As a result, thelanguage/quality_score/executable/difficulty/taskmeta tags enable stage- and objective-aware data selection and mixture control. 2.3 Structural Refinement and Synthesis for Math Unlike general knowledge or code data, the difficulty of mathematical problems is determined not only by the concepts involved but also by the number of reasoning steps required to apply those concepts. In other words, even problems based on simple concepts can become highly challenging when they demand multi-step reasoning [13]. As a result, the quality of mathematical data cannot be adequately characterized through surface-level curation alone. To address this, we design a structured refinement pipeline that analyzes data distributions across domain, conceptual level, and reasoning depth, leveraging these signals to guide the direction of data synthesis. Specifically, we structure the mathematical data along these three primary axes to ensure a balanced and high-quality training corpus. The domain axis represents the mathematical subject area of each problem. Following the Mathematics Subject Classification (MSC) 2020 [14], we map 63 fine-grained categories into seven high-level domains: Algebra, Geometry & Topology, Analysis, Probability & Statistics, Applied Mathematics, Discrete Mathematics, and Others. Conceptual difficulty denotes the knowledge level required for problem solving and is defined with reference to the U.S. education curriculum, spanning six tiers: elementary, middle school, high school, undergraduate, graduate, and advanced research. Reasoning difficulty characterizes the structural complexity and depth of multi-step reasoning involved in a solution, and is categorized into four levels: shallow, moderate, deep, and extremely hard. Using the tagging standards defined above, we analyze distributions over the full mathematical corpus as well as each constituent dataset. The results reveal pronounced imbalances in both domain compo- sition and the joint distribution of domain and difficulty. At the corpus level, Algebra and Analysis account for the largest share of samples, whereas Geometry & Topology, Applied Mathematics, and Discrete Mathematics constitute a relatively smaller portion of the corpus. When analyzed jointly with difficulty, domain imbalance becomes more pronounced. In Algebra and Analysis, most problems cluster at the elementaryâhigh school conceptual levels and require shallowâmoderate reasoning. By contrast, in Geometry & Topology and Applied Mathematics, problems at the undergraduate level or above and those requiring deep (or higher) reasoning are markedly under-represented. This indicates structural gaps not only in overall domain coverage but also in the domainĂdifficulty space. This distribution can induce structural biases beyond mere data scarcity: models may be repeatedly exposed to certain modes of mathematical thinking while receiving insufficient coverage of others, including spatial reasoning, diagram-based reasoning, equation/formula modeling in applied contexts, and combinatorial reasoning over discrete structures. Notably, the commonly observed pattern of early 6 (a) DomainĂdifficulty distribution for general mathematical data. (b) DomainĂdifficulty distribution for mathematical reasoning data. (c) Conceptual difficultyĂreasoning difficulty distribution for general mathematical data. (d) Conceptual difficultyĂreasoning difficulty distribution for mathematical reasoning data. Figure 4: Mathematical data distribution according to domainĂconceptual difficultyĂreasoning difficulty combinations. gains followed by a plateau on benchmarks such as GSM8K [15] and MATH [16] could plausibly be linked to this domain and reasoning-type imbalance. To mitigate this, we perform targeted, gap-filling synthesis focused on under-covered regions of the domainĂdifficulty space. We prioritize domains with limited coverageâGeometry & Topology, Applied Mathematics, and Discrete Mathematicsâas well as problems at undergraduate-or-higher conceptual levels and/or requiring deep-or-higher reasoning. Conditioned on core concepts, we generate problemâsolution pairs with controlled reasoning depth, and we convert simple QA-style items into formats that include step-by-step solutions. The resulting synthetic corpus is annotated using the same domain, conceptual difficulty, and reasoning difficulty tagging criteria and is incorporated into our reasoning-data construction. 2.4 Mi:dm K Response Style Principles The quality of model responses depends not only on content accuracy but also on the stability and structural readability of the output format. In particular, for long-form answers, comparison and summarization queries, and procedural guidance requests, the absence of consistent visual conventions can fragment key information, degrading user experience and increasing post-processing overhead [17,18]. Accordingly, to ensure consistent formatting, we define the Mi:dm K Response Style Principles and rewrite SFT responses to conform to these principles. The principles comprise 15 elementsâcovering emphasis, numeric and year notation, indentation, and bullet usageâand are designed to enforce structure at the sentence, paragraph, and document levels. This form of response rewriting is most effective when stylistic consistency has a more direct impact on user experience than fine-grained task semantics. We therefore define such cases as general tasks and restrict style-based rewriting to this category. General tasks comprise open-ended tasks without a fixed answer format, including question answering, text generation, comprehension, and analysis. For these tasks, we prioritize consistency in response length, writing style, persona, and structural 7 organization over strict adherence to task-specific templates. As a result, Mi:dm K 2.5 Pro is trained to maintain a stable tone and structure even in the absence of explicit formatting instructions. By contrast, style-consistency rewriting can be inappropriate when output formats or constraints are strictâfor example, problem-solving data in the code and mathematics domains; simple QA or instruction-following (IF) data with fixed formats; and data involving agent workflows, multi-turn dialogue, safety, or reasoning-intensive tasks. In such cases, over-emphasizing stylistic uniformity can conflict with task-specific requirements. We also exclude data with mixed task types or low classification confidence from rewriting, as enforcing a uniform style may introduce unintended artifacts. Finally, when user instructions explicitly specify output formats or constraints, we prioritize instruction adherence over the style principles. In addition, to ensure safety against harmful requests, we separately incorporate a Responsible AI Response Style addressing content-level considerations. For adversarial prompts, the default policy is to refuse, deflect, or provide only a restricted response; however, the appropriate response formâin terms of both content and formatâis determined by taking into account the prompt type (i.e., intent) and topic category. CharacterLine Break( )Characters/LineParagraphHeadingBulletCode Block Before Rewriting742.927.87227.074.530.681.460.10 After Rewriting2649.9969.8543.4025.064.9040.470.14 â (Diff.) +1907.07 (256.7%) +61.98 (787.2%) â183.66 (â80.9%) +20.53 (453.1%) +4.22 (618.6%) +39.01 (2669.9%) +0.04 (42.6%) Table 2: Response structure statistics before and after rewriting. Figure 5: Response length distribution (before vs. after rewrit- ing) Figure 6: Bullet-count distribu- tion (before vs. after rewriting) Table 2 compares quantitative metrics and distributional statistics before and after response rewriting. After rewriting, we observe both longer responses and a higher degree of structural organization: the mean response length increases by 256.70%, reflecting a shift toward more detailed explanations Fig. 5. We also observe a substantial increase in bullet usage. As shown in Fig. 6, the share of responses with bullet_count = 0drops from 82.8% to 3.9%, indicating that most rewritten responses include bullet-list structure. These changes reflect not merely longer responses, but a shift toward a more structured presentation in which information is organized into discrete, itemized units. Qualitative analysis further suggests that rewritten responses move beyond short, answer-only statements toward explanation-driven structures that present conditions and context in a more logical, step-by-step manner. As a result, even for general queries with absent or weak instructions, variability in response length, tone, and persona is reduced, indicating improved service-level consistency and more reliable delivery of high-quality responses. 2.5 Difficulty-Aware Quality Assessment LLM performance is strongly influenced by the quality of supervised fine-tuning (SFT) data used during alignment, in addition to model architecture and pretraining scale. Lima [19] shows that strong alignment can be achieved with roughly 1,000 high-quality samples, underscoring the importance of data quality at the SFT stage. In contrast, incorporating low-quality data can lead models to internalize undesirable behaviorsâsuch as hallucinations, IF failures, and inappropriate safety 8 Assessment CriteriaDefinition High Quality Data Requirements Low Quality Data Examples (A) Quantitative Assessment Criteria for High Quality Data ResponseDiversity Based on Pre-Training Knowledge Reliable responses and expression di- versity based on pre-training knowl- edge Does not cause catastrophic forgetting and no excessive repetitive patterns are seen Repeated similar question answer structures and responses that termi- nate at a superficial level Capability to Handle High Difficulty Tasks Support performance on high diffi- culty benchmarks such as GPQA, MATH-500, MMLU-Pro Include accurate reasoning paths with- out hallucination Citation of non existent facts, statis- tics, logical leaps, incorrect causal re- lationships, fictitious API usage MultilingualPerfor- mance Balance Performance balance across sup- ported languages (e.g., Korean, En- glish, and etc.) Natural expressions in each language without awkward translated style Literally translated expressions, En- glish sentence structures for non- english, particle, ending errors Securing Specialized Capabilities Reasoning, RAG, agentic, and long- context capabilities Include high quality examples appro- priate for each scenario Lack of specialized scenario data or appropriate examples (B) Qualitative Assessment Criteria for High Quality Data System Prompt Accept- ability Ability to comprehend and consis- tently comply with system instruc- tions Compliance with system prompt, pri- oritization in case of conflict, posi- tional robustness Persona deviation, system constraint violation, role consistency collapse Instruction FollowingAccurate execution of diverse forms of instructions Output format compliance, constraint adherence, and persona consistency Format noncompliance, ignoring length limits, and missing requested items New Task Generaliza- tion Generalization capability for out of tasks (OOT) Inclusion of various task types and creative solution cases Exclusive generation of template re- sponses, excessive bias toward spe- cific tasks Cultural and Contex- tual Alignment Provide responses that align with cul- ture and context Reflect Korean sentiment, comply with the honorific system, recognizes local context Western centric examples, cultural misunderstandings,inappropriate honorific usage (C) Safety and Consistency Related Assessment Criteria Safety BalanceBalance between under-refusal and over-refusal Rejection of harmful requests while faithful response to legitimate re- quests Over: Rejection of harmless and edu- cational purpose requests Under: Partial compliance to harmful requests and vulnerability to jailbreak Honesty&Trans- parency Awareness of model limitations and transparent communication Explicit acknowledgment of uncer- tainty, hallucination avoidance, and no sycophancy Agreement with false premises, fail- ure to point out errors, excessive praise Role ConsistencyMaintaining consistency in persona, role Does not show role deviation during conversation Persona collapse mid conversation, contradict with system settings Response ConsistencyConsistent responses across identical or similar queries Stable factual answers and absence of self-contradiction Conflicting responses to identical queries, self-contradictions within the same conversation Table 3: SFT data quality assessment criteria judgmentsâthereby reducing alignment quality. In practice, SFT dataset construction typically draws on both public and synthetic data, which are subject to non-trivial quality variance due to their generation and distribution mechanisms. Public datasets are often released in bulk, making fine-grained, per-sample quality auditing difficult and thereby allowing substantial noise to persist. Synthetic data can likewise exhibit issuesâincluding hallucinations, logical inconsistencies, and cultural inappropriatenessâstemming from limitations of the generating model [20]. Moreover, prior work provides empirical evidence that heterogeneous data quality can negatively impact model performance [21]. To mitigate these issues, we introduce an automated quality assessment framework that identifies and filters low-quality samples from large-scale SFT corpora. We define multi-dimensional quality criteria and perform quality tagging and filtering using an LLM-based data evaluator. By removing samples that are clearly low-quality before training, this framework improves the overall effectiveness of alignment. Multi-Dimensional Criteria and Interdependencies. Systematic assessment of SFT data qual- ity requires a multidimensional perspective rather than a single criterion. Evaluations limited to grammatical correctness or formal completeness are insufficient to anticipate a modelâs real-world performance and behavior when trained on such data. We therefore define SFT quality criteria along three axes: quantitative performance, qualitative performance, and helpfulness/safety. The detailed criteria for each axis are summarized in Table 3. The three quality criteria defined above are not independent; rather, they are interdependent and interact with one another, as summarized in Table 4. For instance, strong quantitative performance (e.g., robust reasoning ability) underpins qualitative performance by enabling accurate execution of complex instructions. When qualitative performance is unstable, consistent compliance with safety 9 guidelines can also degrade. Moreover, safety and helpfulness exhibit an inherent trade-off: excessive emphasis on one can undermine the other. Moreover, low-quality signals often manifest across multiple criteria simultaneously rather than along a single dimension. We therefore assess data quality holistically, considering the balance and interactions among criteria instead of evaluating each criterion in isolation. InteractionRelationship Quantitative performanceâQualitative perfor- mance Strong reasoning capability is the foundation for complex instruction fol- lowing Qualitative performanceâ SafetyIn case of low acceptability of the system prompt, safety guideline compli- ance also becomes unstable Safetyâ HelpfulnessExcessive emphasis on safety impairs helpfulness, and vice versa Table 4: Interactions and trade-offs among performance, safety, and helpfulness Data Quality Assessment Framework. Building on the defined quality criteria and the analyzed problem types, we develop an LLM-based data assessment model to efficiently identify low-quality samples in large-scale SFT corpora. To ensure the reliability of the assessment model, we adopt a human-in-the-loop iterative refinement process. The overall workflow consists of three stages: data sampling, human assessment, and iterative prompt refinement. First, to improve the generality of the assessment model, we sample an evaluation set in a controlled manner across multiple dimensions. We balance response length by including samples ranging from short to long outputs, and ensure topical diversity by covering task types such as general conversation, coding, reasoning, and creative writing. To further mitigate source bias, we perform stratified sampling across purchased data, public datasets, and internally generated data. Next, data-quality experts directly evaluate the sampled data. Each evaluation comprises (i) a binary error judgment (True/False), (i) error-category annotation based on the criteria in Table 3, and (i) a written rationale supporting the judgment. This process yields a gold-standard dataset for validating the assessment model. Finally, we evaluate the LLM-based assessment model against the expert labels and iteratively refine the prompt by analyzing disagreement cases. After applying an initial prompt, we measure accuracy relative to expert judgments, examine false positives and false negatives, and update the prompt accordingly. Repeating this cycle progressively improves agreement with expert assessment. We design the prompt for the LLM-based data assessment model around three core principles. First, we simplify the decision structure by using a binary validity judgment (valid:true/false) instead of a complex scoring scheme. Second, we enforce a JSON output format to ensure structured, machine-readable results. Third, when issues are detected, we require the model to include both a high-level issue category and a textual explanation so that the rationale is ex- plicit. Accordingly, the final prompt outputs"valid": false, "issues": ["category": "<high-level category>", "explanation": "<issue description>"] when issues are present, and"valid": true, "issues": []otherwise. This binary, structured design clar- ifies filtering criteria, improves assessment consistency, and simplifies downstream post-processing and aggregation. After iterative refinement, the final assessment prompt attains 84.2% accuracy against human judg- ments, with 86.8% precision and 83.6% recall. To further validate the practical utility of the evaluator, we compare pass rates before and after rewriting samples flagged as low quality. Across 929 cases, the pass rate increases by approximately 6.8 percentage points after rewriting, suggesting that the evaluator can discriminate meaningful quality differences in practice. Finally, we filter the data using the validated assessment model. Samples withvalid: false that contain critical-category issues are labeled as Reject, whereas samples withvalid: false containing only minor-category issues are labeled as Review. Samples judged asvalid: trueare labeled as Pass, and we restrict exclusion from training to Reject only. Samples assigned to Review undergo additional inspection to determine whether they should be included. 10 3 Pre-Training In this section, we describe the key design elements for enhancing reasoning capability during the pre-training stage of Mi:dm K 2.5 Pro. Whereas Mi:dm 2.0 Base pre-training primarily targeted general language modeling performance, Mi:dm K 2.5 Pro expands pre-training data composition and training strategy to better meet the reasoning demands of subsequent post-training stages. Specifically, we introduce reasoning-centric continual pre-training (CPT) data expansion, depth upscaling (DuS) for efficient model scaling, and a gradual context-length extension strategy to maintain long-context capability. We focus on the design elements that most clearly distinguish Mi:dm K 2.5 Pro from Mi:dm 2.0. 3.1 Data Expansion To ensure the model with sufficient reasoning capability for subsequent post-training stages (e.g., SFT and RL), we design a CPT data expansion strategy that goes beyond collecting public reasoning datasets by explicitly incorporating reasoning processes. The goal is to introduce reasoning-centric supervision ahead of post-training, so that the model can learn coherent and consistent reasoning trajectories for problem solving in specialized knowledge domains. Curriculum-Guided Reasoning for STEM Domains. Unlike general commonsense queries, problems in expert domains often presuppose substantial prerequisite knowledge as well as specific theoretical, experimental, or measurement contexts. Moreover, they are frequently posed as compound queries rather than single questions, typically requiring at least 2â3 reasoning steps. Consequently, datasets dominated by simple questionâanswer pairs are insufficient for developing robust and stable reasoning capability in specialized domains. Accordingly, we first construct a reasoning knowledge framework grounded in course curriculum. We organize knowledge along subject- and major-level curricula and formalize it as a taxonomy that can be used as input to the data synthesis pipeline. We then expand this taxonomy into concrete training objectives that go beyond enumerating what should be known, explicitly capturing a reasoning perspective by specifying the conditions under which concepts should be applied and the conclusions that should be derived. Based on these training objectives, we construct data via a staged synthesis pipelineâknowledge documentâquestionâreasoning pathârather than directly augmenting individual items. For each objective, we first compile a knowledge document that captures key definitions, prerequisites, exceptions, and common confounders required for reasoning. We then generate multi-step QA instances with controlled reasoning depth. Each instance comprises an introduction that sets up the problem context and an application step that applies the relevant knowledge to derive a conclusion, and each QA is accompanied by an explicit reasoning path. Boilerplate or insufficient reasoning paths are detected using rule-based checks and strengthened via rewriting, ensuring that coherent reasoning flow is learned consistently during CPT. Enhancing Procedural Reasoning in Code.To effectively leverage reasoning-oriented code data for training, we go beyond coarse classification by difficulty, language, or correctness. We system- atically filter samples that are unsuitable for learning while maintaining a composition that reflects real-world distributions over programming languages, difficulty levels, and task types. Accordingly, during the CPT stage, we apply the code refinement and tagging pipeline described in Section 2.2. The pipeline sequentially performs programming-language identification, primary refinement based on educational suitability and quality criteria, source- and file-level noise removal, AST-based exe- cutability filtering, and difficulty and task labeling. The resulting metadata makes the problem-solving context and procedural complexity of each code sample explicit, providing a basis for broad coverage of procedural reasoning patterns and problem-solving types in the code domain during pre-training. Diverse Reasoning Coverage in Math.During CPT for mathematics, we prioritize broad exposure to diverse mathematical reasoning structures and concept combinations, rather than focusing solely on answer derivation for individual problems. The data composition follows the domain- and difficulty- based classification principles defined in Section 2.3. Since mathematical difficulty is determined not only by conceptual level but also by the number of reasoning steps required to apply those concepts, we curate a balanced mixture spanning different conceptual levels and reasoning depths. This design 11 encourages the model to learn a wide range of mathematical reasoning patterns without overfitting to specific computation types or problem formats during CPT, providing a foundation for more stable generalization to challenging mathematical reasoning tasks in subsequent post-training. 3.2 Depth Upscale Depth upscaling (DuS) is a model scaling technique that increases model depth by reusing the parameters of an existing model [22,23]. This approach provides an efficient way to expand model capacity and was previously adopted in the training of Mi:dm 2.0 [3]. In this work, we again employ DuS to enable rapid scaling toward a substantially larger model, Mi:dm K 2.5 Pro. For Mi:dm K 2.5 Pro, we systematically evaluate two representative model scaling strategies: cosine similarity based scaling [22], which was employed in Mi:dm 2.0, and layer predictor based scaling [23]. To analyze their effects under different architectural conditions, we conduct controlled experiments across a range of layer expansion positions. Layer predictor based scaling constructs newly added layers by predicting their parameters through a dedicated layer predictor. This predictor learns inter-layer parameter relationships from adjacent layers, which are extracted via singular value decomposition. By leveraging these learned relationships, the method enables coherent parameter initialization for deeper architectures while preserving structural continuity across layers. The existing cosine similarity based scaling requires extensive iterative experimentation to identify an optimal combination of layers that yields strong performance after scaling. In contrast, layer predictor based scaling initializes the expanded layers using pre-predicted parameters, leading to a more stable starting point for learning and substantially reducing the search cost. This advantage is particularly important because the performance of models using DuS strongly depends on the expressiveness of the layers selected for scaling. Accurately identifying layers with high expressiveness directly influences both the initial performance and the training stability of the scaled model. MMLUKMMLUGSM8KMBPP (5-shot)(5-shot)(5-shot)(3-shot) Baseline0.7720.5210.8040.646 + Random layer based DuS0.7580.5160.6670.574 + Cosine similarity based DuS0.7670.5140.7820.624 + Layer predictor based DuS0.8040.5720.8050.648 Table 5: Model performance before and after DuS across different methods. Table 5 compares the initial performance of each model before DuS and immediately after DuS is applied. The performance after DuS refers to a model that undergoes only structural expansion without any additional training. When random layer based DuS [24], which selects arbitrary layers for depth scaling, and cosine similarity based scaling are applied, model performance generally degrades compared to the baseline before DuS. In contrast, DuS with a layer predictor results in much smaller performance drops and, in some metrics, even leads to performance improvements. Furthermore, after additional training following DuS, we observe consistent improvements across benchmarks, demonstrating that stable performance gains are achievable even after depth expansion. Based on these findings, we adopt the layer predictor method as our DuS scaling strategy. ModelTraining Phase MMLUMMLU-ProKMMLUGSM8KMBPP (5-shot)(5-shot)(5-shot)(5-shot)(3-shot) CPT Stage 0After alignment80.2851.7052.9079.4559.20 CPT Stage 1After training replay data79.1153.2161.8887.5767.40 CPT Stage 1 MergedAfter model merge81.1160.0563.9586.6670.20 CPT Stage 2After focused STEM training83.1159.8467.8589.5471.20 Table 6: Comparison of model performance across CPT training stages After scaling the model with the layer predictor method, we conduct CPT in three stages, starting with a stabilization phase that consolidates the expanded layer structure introduced by DuS. Table 6 reports the changes in model performance across each CPT stage. To ensure stable training of the scaled model, we first conduct alignment training before full scale CPT. We refer to this as CPT stage 0. CPT stage 1 then focuses on stabilizing overall model performance after scaling, using a data 12 Model Training Length Training Step MMLU-Pro (5-shot, CoT) GPQA-D (5-shot, CoT) RULER 4K8K16K32KAvg. Midm 2.5 stage-24Kâ59.8435.3089.9079.260.100.0042.32 Midm 2.5 stage 3-132K1,00059.7636.9089.9488.0184.6865.1181.94 Midm 2.5 stage 3-264K2,00058.9841.9094.0293.0887.0273.4886.90 Midm 2.5 stage 3-3128K20059.1744.4491.9591.7188.0583.4388.79 Table 7: Performance comparison across long-context training stages. composition of 29% English, 17% Korean, 50% STEM, and 9% multilingual data. After stage 1, we apply a model merging technique using checkpoints saved at regular intervals [25]. Compared to the final checkpoint from stage 1, the merged model shows improved performance on most evaluation metrics, with the exception of GSM8K [15]. In CPT stage 2, we increase the proportion of STEM data relative to the previous stage in order to further enhance overall performance and strengthen reasoning capability. 3.3 Long Context Expansion Strategy To enhance the long context processing capability of Mi:dm K 2.5 Pro, we apply a progressive context length expansion strategy [26] during the final stage of pre-training. Across three expansion stages, we gradually increase the context length from 4,096 tokens to 32,768 tokens, 65,536 tokens, and finally 131,072 tokens, enabling stable support for inputs up to 128k tokens. Throughout this process, we aim to preserve performance on both general task benchmarks and long context benchmarks. In addition, to ensure stable compatibility with the vLLM [27] inference framework used during the reinforcement learning phase of post-training, we adopt the YaRN mechanism [28]. In the long context expansion stage, we compose 80% of the total training data with samples designed to elicit the reasoning capabilities required in the subsequent post-training stage. Specifically, we synthesize and use reasoning data such as mathematics and code, along with various types of long question answering data, including multi-document comprehension and information aggregation over long contexts. We determine the detailed data mixture ratio using RegMix [29], which recursively estimates the optimal proportions based on the performance of a proxy model. Compared to heuristic approaches, RegMix provides an automated strategy for data mixing in environments with diverse domains. We allocate a portion of the training mixture to replay data from previous stages to mitigate potential catastrophic forgetting during long-context expansion. [26, 25, 30]. To verify improvements in long context processing capability, we conduct evaluations at each context expansion stage using Ruler [31]. In addition, we use MMLU-Pro [32] and GPQA-Diamond [33] to monitor potential degradation in general performance that may arise from long context training. As shown in Table 7, long-context processing capability improves substantially as the context window used in training is extended. In particular, the model extended to 128k demonstrates improved performance on GPQA-Diamond relative to its performance prior to long-context training. These results suggest that potential degradation of existing capabilities during long-context training can be effectively mitigated through an appropriate data-mixing strategy. 4 Post-Training This section describes the post-training process of Mi:dm K 2.5 Pro. We describe the supervised fine-tuning (SFT), model merging, reinforcement learning (RL) pipeline that we design to enhance reasoning performance. Fusion SFT strengthens non-reasoning tasks and improves training stability via controlled mixing of reasoning vs. non-reasoning data and within-batch composition constraints. Fusion RL refines reward design to enhance steering, establish model identity, and reduce tool hallucinations, while improving efficiency through format/language/tool constraints and asynchronous LLM-as-a-Judgeâbased reward computation. Furthermore, we discuss the difficulty control and reward design components for improving training stability and efficiency during the reinforcement learning stage. 13 4.1 Data Expansion Mi:dm K 2.5 Pro expands its data composition to strengthen three key capabilities: Korean-specific vulnerability mitigation, long conversation context processing, and tool use in agentic environments. To achieve this, we incorporate error patterns and interaction requirements that have been repeat- edly observed in real-world settings. This section describes the design rationale and construction methodology of the Korean-centric SFT data, multi-turn conversation data, and multi-turn tool use datasets. Strengthening Korean Reliability.In Korean-language contexts, model limitations extend beyond translation quality and become most apparent when social and cultural context, institutional norms, Korean-specific linguistic processing, and user writing conventions interact. In practice, the model often misrepresents social contexts, such as appropriate use of honorifics, references to national symbols, and the tone required in official documents [34,35]. The model also frequently makes errors on queries that require alphabetic, syllable, and word-level analysis [36]. In addition, it produces inconsistent output structures for checklist, procedural, and summary queries. It also struggles to properly handle colloquial expressions, including memes and slang, as well as constraints specific to the Korean language [37]. Accordingly, during the data construction, we categorize these vulnerabilities into five types and design strategies corresponding to each type. Specifically, we focus on strengthening the coherence of Korean knowledge and social and institutional norms, systematically improving the Korean native unit processing capabilities, while simultaneously ensuring output format consistency, colloquial and creative domain adaptability, and stable constraint condition compliance. First, we focus on improving how the model reflects the Korean social and cultural context and institutional norms. Existing models tend to overgeneralize Korean honorifics, which vary according to relationship, generation, and familiarity, or fail to adequately capture Korean conventions in queries about national symbols and official documents. To mitigate this, we treat honorifics not merely as lexical knowledge but as expressions grounded in usage context and social nuance, enabling the model to generalize appropriate honorific choices in similar situations. Furthermore, for frequently asked Korean language queries such as administrative districts, public holidays, and currency units, we encourage the model to produce relational knowledge rather than simple lists. Responses include inclusion and boundary relationships, as well as relevant legal and institutional foundations. In addition, for queries related to major KT services, we explicitly define the scope of information under possible and impossible conditions, following conservative description principles to reduce exaggeration and hallucination. Next, we tackle recurring issues in segment recognition for queries that require analysis or calculation at the consonant, syllable, and word levels. Due to the compositional nature of Korean characters, models often make errors in tasks such as consonant separation, syllable-level counting, and string validation, even when the overall response appears fluent. To improve this, we design response formats that explicitly specify the units used for calculation and analysis, rather than presenting only the final result. This approach frames unit recognition as string-level operations and rule-based reasoning rather than as isolated factual recall, laying the groundwork for systematically reducing errors in spelling, search, counting, and text analysis queries. Additionally, we improve the naturalness of Korean expression and the robustness of creative and colloquial interaction. For creative tasks such as social media posts and slogan writing, we prioritize context-appropriate style and length for purposes like promotion, encouragement, and campaigns, while avoiding excessive ornamentation or abstraction. Our goal is to emphasize rhythm, emotional impact, and concise messaging rather than maximizing informational coverage. For colloquial interactions such as trending memes, balance games, and dad jokes, we focus on conversational pacing, shared context, and restrained responses instead of reproducing slang or memes verbatim. This design supports lightweight, natural interactions for Korean users and helps reduce quality degradation caused by unnecessarily verbose explanations. Lastly, we strengthen reliable adherence to compound constraints that frequently appear in Korean user requests. Under negative constraints such as âdo not include A but perform B,â existing models often violate prohibitions even when the response is semantically appropriate. To address this, we treat compliance with prohibitions as a core evaluation criterion and design the generation process 14 to avoid prohibited content naturally. This goes beyond safety policy compliance and improves adherence to real-world constraints, enabling more stable responses. This approach decomposes Korean language performance into four dimensions rather than relying on a single fluency metric: social context coherence, linguistic unit processing accuracy, naturalness of expression and interaction, and constraint compliance. Each dimension is grounded in recurring real-world failure patterns and aims to more systematically capture the linguistic, social, and formal requirements of Korean language use. Multi-Turn Dataset Construction.User utterances in real-world settings rarely encode all require- ments within a single-turn; instead, intents are often refined or changed as the conversation unfolds. Users may deepen a topic, pivot to a different one, or refer back to earlier turns, yielding nonlinear interaction patterns [38]. Handling such contexts requires capabilities beyond basic multi-turn di- alogue, including sustained tracking of conversational state and appropriate responses to evolving and compound situations [39,40]. Accordingly, we synthesize a high-quality Korean multi-turn conversation dataset with three key characteristics: dynamic context management, complex task exe- cution, and diversity and usability assurance. We define the components of high-quality conversation synthesis and employ a pipeline that decouples scenario design from utterance generation based on these components. We define high quality multi-turn conversations along three dimensions: interaction structure, topic and task, and persona. The interaction structure dimension covers not only context-preserving conver- sations but also real-world conversational phenomena such as topic shifts, recall of prior information, requests for error correction, and abrupt off-topic remarks. The topic and task dimension captures settings in which multiple topics and tasks are interleaved. To reflect real-world service environments, we establish a dual taxonomy that distinguishes task-oriented elements from conversational elements, incorporating both dimensions into scenario design. The persona dimension ensures diversity in synthetic data by sampling personas from a large profile pool [41]. Beyond simple role labels, each persona is specified as a combination of speaking style, domain expertise, and instruction/command style, promoting variation in utterance length, lexical choice, and reasoning progression even within the same topic or task [42]. This enables the model to learn a broad range of user characteristics and interaction styles without overfitting to specific user types or conversational patterns. Based on these component definitions, we adopt a two-stage generation method that first designs the scenario forming the skeleton of the conversation, then generates dialogue transcripts based on this scenario. This decoupling of conversation-level structural design from turn-level utterance generation ensures both contextual coherence and structural completeness in multi-turn dialogues. In stage 1 (Scenario Design), we take a user persona, topic and task lists, and multi-turn conversation patterns as input to design the overall conversational flowâincluding conversation introduction, topic transitions, and specific request sequences. To mitigate generation bias toward persona-aligned topics or specialized domains, we generate multiple diverse scenarios per persona and sample strategically. In stage 2 (Dialogue Transcript Generation), we synthesize multi-turn dialogues that preserve the scenarioâs intended topics and task objectives while allowing turn-level linguistic flexibility. We reflect persona-specific speaking styles in actual utterances and incorporate instruction following constraints (e.g., "summarize in 3 sentences") to create precise, high-quality user queries. To capture authentic multi-turn dynamics, we prompt the model to use pronominal and demonstrative references to prior turns, and include varied interaction patterns such as error correction, refinement requests, and follow-up questions. By targeting diverse conversation lengths, the dataset covers a broad range of real-world behaviors from brief exchanges to extended dialogues. Multi-Turn Tool-Use Dataset Construction.For LLMs to evolve into agents capable of complex decision-making, tool-use capabilityâthe ability to acquire information and perform actions via external toolsâis essential. However, single-turn tool call datasets have limitations in that they focus on the accuracy of generating arguments that conform to API specifications rather than flexible interactions based on conversational context. In real-world agentic environments, agents must handle richer interaction patterns, such as requesting missing information when user intent is underspecified, or recognizing when a request is not solvable with the available tools and declining appropriately [43â 45]. In Korean-language environments in particular, tool-use datasets that explicitly account for conversational context remain scarce. To address this gap, we construct multi-turn training datasets in 15 both Korean and English to enable comprehensive tool-use behaviors. We apply a stepwise pipeline consisting of tool and scenario design, multi-turn dialogue synthesis, and diversification of system prompts. To support general-purpose agent use, we select approximately 50 domains including telecommuni- cations, finance, healthcare, and public servicesâand design domain-specific virtual tools for each. For a subset of domains, we assume a dual-control environment in which both the agent and the user can invoke tools directly, and define user-facing tools accordingly [46]. All tool specifications strictly adhere to the Model Context Protocol (MCP) JSON Schema standard, enabling seamless integration with real APIs and open-source tools [47]. Beyond basic function names and parameter types, we provide detailed descriptions for each parameter, including sample values and expected output formats. This enables the model to deeply understand tool capabilities and limitations, ensuring consistent tool calls during multi-turn dialogue generation. We design tool-based conversation scenarios to mirror realistic tool usage patterns from real-world user interactions by combining three elements: conversational topics and contexts, user personas, and tool sets. Each scenario is structured around realistic contexts where tools can provide clear value to users. We vary conversational style and interaction complexity according to user personas (e.g., age, occupation) to ensure diverse dialogue patterns. Furthermore, by providing tool sets of 1â8 toolsâmixing relevant tools with intentional distractorsâthe model learns to accurately interpret user intent, select only necessary tools, and avoid erroneous calls. Based on the previously defined scenarios and tool specifications, we synthesize multi-turn conver- sations featuring organic user-system interactions. To reflect complex decision-making patterns in real agentic environments, we categorize system response patterns into four types: tool execution and result interpretation, proactive information requests, general responses, and rejection of out-of-scope requests [44,45,48]. We design prompts so these types naturally interweave within conversations, and adjust sampling ratios in training data to avoid bias toward any specific response type. Different open-source platforms and inference engines (e.g., LMStudio [49], OpenWebUI [49], Ollama [50]) impose distinct tool call specifications. To ensure immediate applicability across diverse ecosystems, we diversify system prompts during training to maximize instruction following capabilities. We establish a two-component pipeline: First, we conduct detailed analysis of platform- specific tool call prompts to define core and optional components, which we dynamically recombine to generate diverse prompt variants. Second, while we standardize the JSON format for tool calls, we vary the enclosing tag formats, strengthening the modelâs ability to immediately adapt to system- prompt rules in zero-shot settings. Figure 7: Overview of the post-training pipeline for Mi:dm K 2.5 Pro 4.2 Post-training Design for Reasoning Model To enhance the reasoning capability of Mi:dm K 2.5 Pro, we propose a reasoning-specialized post- training strategy that combines reasoning-focused SFT, model merging, and reinforcement learning 16 (RL). Fig. 7 provides an overview of the full training pipeline. In the SFT stage, we leverage the modelâs extended long-context capability to train step-by-step reasoning traces for complex tasks such as mathematics and coding. This enables the model to refine relevant knowledge, explore diverse reasoning traces, and derive correct answers. We then merge domain-specialized models to construct a general-purpose reasoning model that avoids domain bias. Finally, in the RL stage, we apply verifiable reward-based training to further enhance instruction following, general reasoning, and problem-solving accuracy. Tokenizer and Chat Template. Mi:dm K 2.5 Pro jointly designs the input representation and reasoning interaction structure to enhance reasoning stability and mathematical consistency for numerical data. First, in terms of tokenization, we adopt a 1-digit unit tokenization strategy instead of the 3-digit grouping method used in Mi:dm 2.0. Existing multi-digit number based tokenization can cause issues in which token boundaries distort numerical relationships in numbers with many digits or lead to misrecognition of digit information during computational processes [51]. By separating each digit into individual tokens, the model can more precisely learn the numerical context required in arithmetic operations, digit based comparisons, scientific notation, etc., thereby improving the overall consistency and interpretability of numerical reasoning. Additionally, during the SFT training process, we use a chat template based on harmony chat format [52], but apply some modifications considering training efficiency and reasoning control. We adapt this format with reasoning and agent training in mind, and explicitly separate internal reasoning traces from externally visible outputs using channel tokens (analysis,commentary,final) with distinct roles. In Mi:dm K 2.5 Pro, we control reasoning modes via an explicit system-prompt block to improve reasoning controllability and multi-turn training efficiency. During multi-turn reasoning training, we retain only the last reasoning trace associated with the final response or a single tool call, and discard earlier reasoning history to maximize effective context usage. This prevents context waste and reduces noise from accumulated, irrelevant reasoning. Fig. 8 illustrates an example application of the Harmony Chat Format under these settings. Figure 8: Harmony-based chat template design for efficient SFT training process. (a) Multi-turn reasoning with truncated reasoning trace. (b) Tool-augmented multi-turn interactions retaining only last reasoning trace. Domain Reasoning SFT (Stage-1)Task-Oriented TrainingReasoning RL Packing Comp.RatioContinual ModelSTEM ModelAgent ModelRatio STEM94%17%17%50%â21% Math85%48%48%27%â32% Code89%34%34%23%57%28% Agentâ43%â Instruction Followingâ12% Structured Outputâ12% Table 8: Domain mixture ratios across post-training stages and packing efficiency for Reasoning SFT Reasoning SFT Training Strategy.In the SFT stage, we focus on learning high-quality reasoning traces that leverage the modelâs existing knowledge and exploration capacity. To this end, we collect 17 diverse reasoning trace data using multiple models. However, errors in reasoning not only degrade downstream reasoning performance but also increase the likelihood of generating unnecessary tokens during the subsequent RL stage, reducing training efficiency [53,54]. To mitigate these issues, we apply strict post-collection filtering. Specifically, we remove samples exhibiting redundant repetition within reasoning steps, excessive line breaks, and language mixing in final responses. Through this process, we retain only verified, high-quality data as the final training set. We then apply a packing strategy to improve training efficiency for long-form reasoning data and perform task-oriented SFT to progressively incorporate task-specific characteristics while preserving general reasoning capability. (a) Overall length distribution(b) Zoomed-in view of theâĽ16k length distribution Figure 9: Response length distribution of collected SFT training data by domain The collected reasoning traces exhibit substantial length variability, with some reaching up to 64k tokens. Without packing, padding can dominate a batchâoften exceeding the number of effective training tokensâand severely reduce training efficiency. Fig. 9(a) shows the response-length distri- bution of the SFT data by domain; over 80% of the samples fall within the 0â4k range. We adopt Best bin fit Packing [55] with a 64k maximum sequence length, packing multiple samples into a single sequence. This yields an effective packing efficiency (compression) of 90% and substantially reduces wall-clock training time. In addition, because training can become unstable when a batch is dominated by a single task type, we apply a blending strategy that samples instances per batch in proportion to the global task mixture. Reasoning SFT is divided in two stages: the first stage establishes general reasoning capability, and the second stage improves task-specific performance on top of this foundation. Mi:dm K 2.5 Pro aims to preserve both generality and specialization by training a single base model and then deriving multiple task-oriented variants via model merging. To support stable training across stages and improve merging efficiency, we use the WarmupâStableâDecay (WSD) learning-rate schedule [56] for each stage. In the first stage, we heavily emphasize mathematics, code, and STEM data; Table 8 reports sample counts, packing statistics, and mixing ratios. In the subsequent task-oriented SFT stage, we run three additional SFT tracksâcontinual, STEM-oriented, and tool-orientedâand Table 8 summarizes the corresponding mixture ratios. Finally, we merge the resulting models sequentially, following the procedure in Fig. 6. Model Merging.Model merging offers an efficient post-training mechanism for improving perfor- mance without incurring additional optimization cost [57â59]. Rather than retraining a single model to simultaneously satisfy heterogeneous objectives, merging enables capability integration directly in parameter space, making it particularly suitable for large-scale LLM post-training pipelines [60,61]. In Mi:dm K 2.5 Pro, we first train multiple domain-specialized models during SFT, each emphasizing different capabilities such as mathematics, code, and general knowledge through distinct data mixtures and training ratios. We then merge these models to consolidate complementary strengths. As shown in Table 9(A), SFT merging reduces task-wise variance and produces a more uniformly balanced model across benchmarks. To further strengthen agentic capabilities, we additionally train the model specialized for agent behaviors and tool-use scenarios and merge them into the tool-use SFT model. As illustrated in Table 9(B), this approach substantially improves agent-task performance while constraining degrada- 18 Model / Merge RatioMathCodeGeneralInstr./Agent (src1:src2)AIME25LiveCode v5MMLU-Pro*GPQA-DIFBench /Ď 2 (A) SFTâSFT Model Merging (src1) SFT model 1â66.0043.9178.2963.6429.59 (src2) SFT model 2â62.6753.5875.0050.5142.52 Merged 8:266.6746.4279.2964.1439.46 5:572.6751.6180.4369.1950.00 2:866.0053.7678.7159.0953.40 (B) GeneralâAgent Model Merging (src1) General Modelâ70.6752.6978.0071.2152.38 / 21.90 (src2) Agentic Task Modelâ40.0010.2275.2957.0738.78 / 65.80 Merged 8:270.0050.5476.8675.2553.06 / 66.67 5:560.0045.3479.1470.7151.70 / 76.32 2:845.3324.5577.0065.1543.54 / 73.10 Table 9: Performance across different model merging ratios. (A) Merging two SFT models. (B) Merging a general-purpose model with an agentic model, with emphasis on agentic-task performance. An asterisk (*) indicates evaluation on a limited subset of the benchmark. tion in mathematics and code. The merging coefficients further provide an explicit and controllable trade-off between agentic gains and general-purpose retention. We adopt linear merging as a simple yet effective parameter-space aggregation strategy for models derived from a shared pre-trained backbone. This enables us to unify diverse domain capabilities into a single model without additional training overhead. The merged model then serves as a stable foundation for subsequent reinforcement learning, which further improves reasoning consistency and overall response reliability. Reasoning RL Training Strategy. Following SFT-based model merging, the RL stage aims to mitigate output instability that may occur during the merging process and to refine the consistency and coherence of reasoning traces. To achieve this, we construct the training data centered around the RLVR based training methodology [53,62] and further optimize the model using these signals. We conduct RL training under an on-policy reinforcement learning configuration [63]. At each update step, we sample 16 responses per prompt for 128 prompts and use the resulting trajectories as training signals. This configuration helps stabilize the output distribution of the model after merging while enabling relative quality comparisons across various response traces. This stage extends instruction following beyond mathematics, code, and STEM by incorporating data designed to strengthen the execution of complex instruction. It additionally includes tasks that require structurally correct outputs, such as agentic tool use and JSON schema generation. For tool-use optimization, we adopt a two-track strategy. In RLVR, we focus on preventing regression in structured tool-call generation to maintain execution correctness. In parallel, we apply Direct Preference Optimization (DPO) to improve tool selection accuracy from a predefined tool inventory. We then merge the two specialized variants to combine structural robustness with precise selection capability. Table 8 summarizes the domain-specific mixture ratios. As in the SFT stage Section 4.2, we apply batch-level blending to mix prompts from each domain within each training batch according to predefined ratios. In the reinforcement learning stage, we jointly optimize the training framework and system config- uration to stabilize post-merge generation while improving efficiency for long-horizon reasoning. We use verl [64] as the RL framework and adopt a GSPO-based fully asynchronous training strat- egy [65,66] that decouples training (trainer) from generation (rollouter). This architecture reduces system bottlenecks caused by large variance in response lengths, and Section 4.3 details the efficiency and stabilization techniques used. Additionally, we apply a shared penalty scheme to improve the efficiency and stability of reward computation. For every prompt, we assign a format penalty and a repetition penalty. When a reasoning trace fails to terminate properly, when special tokens repeat excessively and prevent the output from 19 Model MathCodingGeneral AIME25MATH500Math-HLCB Human Eval+ MMLU -Pro KMMLU -Redux GPQA-D Reasoning SFT (Stage 1) 65.3391.2090.5643.0189.0267.14â61.11 Reasoning SFT (+Merge) 65.3391.8093.3551.7989.6379.4365.6767.17 Reasoning RL70.6790.6092.3752.6990.8578.0065.5671.21 Table 10: Stage-wise performance changes during reasoning-focused post-training being parsed, or when specific words or phrases are repeated excessively, we skip accuracy-based reward computation and instead assign a negative reward. These penalties provide a strong constraint signal against failure modes that must be avoided, reducing reliance on computationally expensive accuracy-based rewards and improving both training stability and overall efficiency. We compute task specific rewards solely based on the accuracy of the final response, independent of the common penalty and reasoning budget. For code tasks, we prompt the code blocks to be wrapped with```through system prompts and assign continuous rewards between 0 and 1 based on the pass rate of predefined test cases for Python code extracted according to that pattern. For STEM tasks, we evaluate problems by considering their formal characteristics and calculate the rewards based on whether parsed results match the correct answer according to the specified output format for multiple choice responses. For IF tasks, we use the evaluation code from IFBench [67] to measure instruction compliance at each instruction unit as rewards. In structured output tasks, we compute rewards by validating the structural consistency of outputs against JSON schemas and by providing type definitions as input. We normalize all accuracy based rewards to the[â1, 1]range to prevent specific sequences from having excessive advantage. We employ GSPO [68] as the RL algorithm. Unlike GRPO, GSPO optimizes policies at the sequence level, which reduces token-level variance and mitigates log-probability instability during long- sequence generation. This improves overall training stability. Table 10 presents the performance change results in the early stages of reasoning post-training. Figure 10: Training data composition of Fusion SFT and Fusion RL across task, language, and reasoning dimensions. Fusion Training Strategy. Building upon the robust reasoning and task-solving foundations established in previous stages, we conduct Fusion Trainingâcomprising Fusion SFT and Fusion RLâto refine the modelâs practical usability. While prior iterations focus predominantly on reasoning modes, this stage ensures that the model yields appropriate responses in non-reasoning contexts as well. 20 ModelReasoning EnglishCode Instr. FollowingGen. Rsn.MathGen. Know. LCB V6 (pass@1) Human Eval+ (pass@1) MBPP+ (pass@1) IFEval (avg) IFBench (EM) GPQA-D (EM) MATH-H (EM) AIME25 (EM) MMLU-Pro (EM) (A) English & Code Reasoning Model Off85.04â74.24â70.57â83.5487.04 On88.4348.6467.6895.2461.3379.1446.2689.0289.42 Fusion SFT Off88.26â50.68â73.43â75.0081.75 On81.4453.0656.0690.4144.6774.7116.7485.9882.80 Fusion SFT Merge Off85.10â73.34â69.86â80.4990.21 On87.9449.6667.6895.2466.0078.8647.3690.8589.95 Fusion RL Off85.59â79.76â71.14â78.6687.83 On89.5656.4664.1495.1768.0078.4350.2291.4689.68 ModelReasoning Instr. FollowingGeneral KnowledgeMath Ko-IFEval (avg) KoBALT (EM) CLIcK-L (EM) CLIcK-C (EM) KMMLU (EM) AIME25-Ko (EM) HRM8K (EM) (B) Korean Reasoning Model Off80.5937.4373.8578.29â Onâ71.2464.6780.74 Fusion SFT Off86.1035.5770.9290.4866.0078.14â Onâ64.36 Fusion SFT Merge Off82.2438.5771.0879.11â Onâ71.7471.3381.35 Fusion RL Off82.8044.7173.5481.71â Onâ71.8671.3381.77 Table 11: Performance comparison across fusion training stages on English, Code, and Korean benchmarks. In the Fusion SFT phase, we partition the training data into reasoning and non-reasoning subsets. We deliberately emphasize non-reasoning tasks that are relatively underrepresented in earlier stages, including creative writing, translation, and general question answering. As shown in Fig. 10, we raise the ratio of non-reasoning subsets in the data mixture to favor instilling versatile conversational alignment. To ensure training stability, we also adopt a balanced batch design that preserves the predefined reasoning-toânon-reasoning ratio within each mini-batch, consistent with the strategy used in the reasoning stage. To mitigate the performance degradation observed on certain benchmarks during the initial SFT phase, we reintroduce the model merging strategy, which has demonstrated effectiveness in the reasoning SFT stage. This approach enables us to identify an appropriate trade-off between raw reasoning capability and conversational fluency prior to reinforcement learning. The Fusion RL stage aims to improve controllability, reinforce model identity, and mitigate tool- related hallucinations. We design a more fine-grained reward system that promotes high-fidelity and deployment-ready outputs. First, we introduce strict penalties for modeâchannel mismatches (e.g., invoking an analysis channel for a non-reasoning task) and bypass accuracy evaluation for incorrectly formatted responses, ensuring that structural violations are penalized before performance assessment and thereby enforcing structural consistency. Second, to enhance reliability in real-world settings, we incorporate penalties targeting unintended language switching (code-mixing) and tool-use hallucinations. These constraints reduce spurious tool invocation and unauthorized language shifts, improving robustness under real-world usage conditions. Finally, we replace the conventional reward model-based RLHF pipeline with an LLM-as-a-judge framework. Rewards are computed asynchronously and overlapped with response generation, mini- mizing additional latency while maintaining training efficiency described in Section 4.3. The results in Table 16 indicate that Fusion Training progressively rebalances reasoning and non- reasoning capabilities without compromising core reasoning strength. Fusion SFT improves con- versational alignment, model merging stabilizes performance regressions observed during initial 21 rebalancing, and Fusion RL further enhances controllability and robustness under practical usage conditions. 4.3 RL Training Efficiency and Operational Design In this section, we summarize the design choices that improve learning efficiency and stability during the reinforcement learning stage. Rather than modifying the underlying RL algorithm, we focus on operational components, including difficulty-aware data selection and curriculum learning, system- level efficiency enabled by an asynchronous training architecture, and LLM-assisted reward-signal generation. Difficulty-aware Prompt Selection. RL is a key technique for aligning language models with human preferences and values, and in particular, on-policy reinforcement learning uses only data gen- erated during the training process, so learning efficiency directly correlates to performance. However, not all prompts provide the same learning signal, and inefficient data usage can hinder performance improvement under limited resources and time. Therefore, we outline three key challenges to improve the efficiency of on-policy reinforcement learning. First, repeated learning on easy prompts that the model has already mastered, or the use of prompts that are excessively difficult at the current level, can reduce learning efficiency, therefore making data selection at a difficulty level appropriate for the model becomes necessary [69,70]. Second, multiple objectives such as safety, helpfulness, and format compliance can conflict with each other [71,72], and the method used to integrate these reward signals directly affects alignment quality. Third, while traditional reward models incur high training and maintenance costs and remain vulnerable to changes in evaluation criteria, the LLM-as-a-Judge approach offers flexibility but also introduces practical challenges related to cost and evaluation consistency [73, 74]. To mitigate these issues, we adopt a curriculum learning strategy. We define prompt difficulty relative to the current policyâi.e., how challenging it is for the policy to produce a high-quality responseâand treat it as a dynamic quantity that evolves over training. To address mismatched difficulty criteria across data sources, we re-define task and difficulty labels under a unified internal rubric and adjust the difficulty distribution to match the training-stage characteristics of the model. In STEM in particular, RLVR with verifiable rewards has been shown to be effective; accordingly, we apply difficulty-aware prompt selection more aggressively. In the mathematics domain, we define five difficulty levels (Levels 1â5) and categorize problems into seven content-based subdomains. After rebalancing the data mixture using difficulty and subdomain tags, we maintain or improve performance while using only 20.1% of the full dataset. Notably, MATH500 improves by more than 3Ă, and the high-difficulty benchmarks AIME 2024 and AIME 2025 show additional gains of +20.0% and +28.6%, respectively. In the code domain, we first obtain a coarse difficulty estimate using simple heuristics (number of test cases and problem-statement length), and then assign a 1.0â5.0 difficulty score via an LLM-based assessment that jointly considers problem comprehension difficulty, reasoning depth, implementation burden, and related factors. Table 12 lists the assessment criteria for code difficulty, and Table 13 summarizes the distribution across score bins. Overall, this difficulty-aware curriculum reduces unnecessary training while improving both the efficiency and stability of reinforcement learning under constrained resources. Assessment FactorDescriptionDifficulty Contribution Algorithmic ComplexityRequired algorithm types: Brute-force, Greedy, DP, Graph, advanced data structures, etc. when advanced algo- rithms is requiredâ Reasoning DepthNumber of logical and computational steps required for problem solving when multi-step reason- ing is neededâ Edge case RichnessExistence of ambiguous or non trivial corner caseswhencomplexedge cases are abundantâ Constraint PressureOptimization necessary according to input sizewhen input size is largeâ Implementation LoadDegree to which meticulous coding or mathematical approach is required when complex implemen- tation is neededâ Conceptual AbstractionWhether intuitive logic vs. advanced concepts (math- ematical theorems, specialized techniques, etc.) are required when advanced concepts are requiredâ Table 12: Code domain problem difficulty components and contributing factors 22 ScoreDifficultyCharacteristics 1.0 â 1.5Very EasySimple implementation, basic syntax level 1.5 â 2.5EasyBasic algorithms (sorting, search), simple condition handling 2.5 â 3.5MediumIntermediate algorithms (basic DP, BFS/DFS), multiple con- dition handling 3.5 â 4.5DifficultAdvanced algorithms (complex DP, graph optimization), com- plex reasoning 4.5 â 5.0Very DifficultHighly advanced algorithms, mathematical insight, combina- tion of optimization techniques required Table 13: Code domain difficulty definition by score range Asynchronous RL Execution and Stabilization. In reinforcement learning processes involving long form reasoning tasks, not only training stability but also efficient utilization of system resources directly impacts overall training performance. Particularly in environments with high variance in response length, the execution mode of the training framework can introduce significant inefficiencies. In conventional synchronous RL, the system advances to the next update only after rollouts have been generated for all prompts in the batch. For reasoning workloads with high variance in response length, this induces substantial straggler wait: the longest generation dominates step time, leaving many GPUs idle. By contrast, a fully asynchronous RL architecture decouples rollout generation from training and runs them in parallel. A rollouter continuously generates trajectories under a (slightly stale) policy and writes them to a buffer, while a trainer asynchronously consumes buffered trajectories and performs parameter updates. The rollouter is periodically refreshed to track the latest policy, enabling sustained parallelism between generation and learning. This design mitigates the long-tail straggler bottleneck common in synchronous RL and significantly reduces GPU idle time. To quantitatively analyze the system-efficiency impact of execution mode for GSPO training, we compare synchronous RL and fully asynchronous RL under the same model configuration on an 8-node setup. Table 14 presents the step time breakdown and token throughput for both training modes. In the fully asynchronous configuration, the system reduces the time required for the rollout generation stage to less than half compared to the synchronous method, which demonstrates that the system effectively alleviates the long tail bottleneck caused by varying response length. Although the actor update time increases, it has limited impact on the overall step time since the system performs it overlapping with the rollout generation. As a result, fully asynchronous GSPO training reduces step time by approximately 15% and improves token throughput by approximately 30% compared to the synchronous baseline. These improvement effects become more pronounced as the maximum response length increases and as the scale of resources used for training grows larger. Training ModeResource AllocationStep (sec)Generation (sec)Update Actor (sec)Throughput Synchronous64388.72286.8350.91211.31 Fully asynchronous32 / 32332.61124.08119.35275.37 Table 14: Comparison of Colocate sync and Fully async training speed However, in asynchronous training, trajectories generated by the rollouter may become off-policy relative to the trainerâs latest policy. In long-form reasoning tasks, such policy lag can lead to training instability or even collapse. To mitigate this, we apply rollout correction [75,76]. Specifically, for each sequence generated by the rollouter, we compare its log probability under the rollouter policy at generation time with its log probability under the current training policy; if the discrepancy exceeds a predefined threshold, we drop the sequence from training. This filtering limits off-policyâinduced distribution shift and improves training stability. LLM-based Reward Model Development. The approach of constructing reward models for individual attributes such as safety and helpfulness has the advantage that the trained model can internalize the preferences of human evaluators and provide relatively consistent reward signals. However, this approach entails several practical limitations. Training reward models requires large scale preference data collection and a separate training process, and the system inevitably requires retraining when new evaluation criteria are added or existing criteria are modified. Additionally, Moreover, reward models are largely opaque, limiting interpretability of their judgments. To address 23 these limitations, we adopt the LLM-as-a-Judge paradigm and use LLMs directly to generate reward signals. To use LLMs as reward models, it is essential to define evaluation criteria clearly and to design evaluation prompts that elicit consistent and calibrated judgments [77]. We begin by explicitly framing the LLM as an expert evaluator, encouraging assessments from a stable perspective and leveraging domain-specific judgment. We further improve consistency by moving beyond abstract notions and enumerating concrete sub-criteria. For example, helpfulness can be operationalized in terms of accuracy, completeness, relevance, and clarity. We also include a reasoning protocol that encourages the LLM to follow a stepwise deliberation process before issuing a final judgment. By explicitly generating evaluation rationales, this improves the stability and reproducibility of the judgments. To quantify outcomes, we provide a scoring rubric that defines the rating scale and the criteria for each score level. Depending on task characteristics, we choose either absolute or comparative scoring and adjust the score range and granularity accordingly. Finally, we incorporate a self-verification step in which the LLM revisits its initial assessment, mitigating evaluation errors and further improving judgment quality. Additionally, to enable reliable use of LLM evaluation outputs in downstream pipelines, we adopt structured output formats [78]. Each structured output includes a score field representing the final reward value and a reasoning field that records the evaluation rationale; for multi-dimensional assessments, we also include per-dimension sub-scores. Because safety evaluation has clear decision criteria, we use discrete judgments, whereas helpfulness is scored on a continuous scale to capture finer-grained quality differences. The reasoning field not only improves interpretability of reward signals but also supports debugging and quality auditing. Under these configurations, we compare human-tagged evaluations with LLM-based reward signals and find an agreement rate of 91%. This indicates that the proposed reward-signal generation method is sufficiently reliable for practical use. 5 Evaluation 5.1 Quantitative Evaluation We conduct a quantitative evaluation using a benchmark set that combines representative public benchmarks, translated versions of those public benchmarks in Korean, and in-house proprietary benchmarks constructed for Korean language and domain specific evaluation. We compare our model with both globally competitive models and industry leading Korean-specialized models; an overview is provided in Table 15. The evaluation is organized along two complementary axes: English benchmarks for general-purpose capabilities and Korean benchmarks for Korean-specific comprehension, culturally grounded reason- ing, and knowledge of Korean society and context. Together, these evaluations provide a broad view of the modelâs performance across both general and Korean-specific settings. In addition, we examine statistical significance for selected comparisons to support more reliable interpretation of performance differences. Mi:dm K Pro HyperCLOVAXQwen3-30B-A3BSolar-OpenK-EXAONE SEED-Think-32BThinking100B236B-A23B DeveloperKTNAVER CloudAlibaba QwenUpstageLG AI Research ArchitectureDenseDenseMoEMoEMoE # Total Params32B32B30.5B102B236B # Activated Params32B32B3.3B12B23B Table 15: Overview of open or externally reported baseline models used in our experiments. General English Benchmark. To evaluate the general capabilities of Mi:dm K 2.5 Pro, we use a representative set of public English benchmarks covering reasoning, knowledge, mathematics, instruction following, coding, and agentic capability. Selected results are additionally aligned with externally reported evaluations from Artificial Analysis [1], providing an externally comparable view of performance on widely used public benchmark settings. 24 ModelReasoning English Gen. Rsn.Gen. Know.MathInstr. Following GPQA-D* (EM) MMLU-Pro (EM) MATH-H (EM) AIME25 (EM) IFEval (avg) IFBench* (EM) (A) English K-EXAONE-236B-A23B Off7080.9691.004088.4040 On7883.4097.3686.6792.9065 Solar-Open-100B Offâ On6679.7795.9276.6789.4258 Qwen-3-30B-A3B Off6678.6792.7063.3089.0033 On7180.1097.0586.6791.5051 HyperCLOVAX-SEED-Think-32B Offâ67.3162.503.3086.83â On6278.5095.1756.6786.4038 Mi:dm K 2.5 Pro (March â26) Offâ73.9872.2033.3086.23â On7281.8096.6070.0089.5051 ModelReasoning CodeAgentic LCB V6 (pass@1) Human Eval+ (pass@1) MBPP+ (pass@1) Terminal* Bench (pass@1) Ď 2 -Bench* Telecom (pass@1) (B) Code & Agentic K-EXAONE-236B-A23B Off57.1083.5066.90759 On89.0090.8597.882374 Solar-Open-100B Offâ On72.8092.0775.13248 Qwen-3-30B-A3B Off58.3088.4077.70722 On78.9687.2090.48528 HyperCLOVAX-SEED-Think-32B Off28.1074.3089.90â On68.3488.41 83.071287 Mi:dm K 2.5 Pro (March â26) Off40.1082.9076.70â On74.7992.0789.68389 Table 16: Performance comparison across English, code, and agentic benchmarks. * denotes results reported from Artificial Analysis [1]. The English benchmark set is organized into six capability categories: ⢠Reasoning â GPQA-DIAMOND [33] ⢠General Knowledge â MMLU-PRO [32] ⢠Mathematics â MATH-HARD [16] and AIME25 [79] ⢠Instruction Following â IFEVAL [80] and IFBENCH [67] ⢠Coding â LIVECODEBENCH V6 [11], HUMANEVAL+ [81], and MBPP+ [81] ⢠Agentic Capability â TERMINAL-BENCH [82] and Ď 2 -BENCH TELECOM [83] As shown in Table 16, Mi:dm K 2.5 Pro shows a broadly comparable performance to similar sized models on the English benchmark set, with its clearest advantages appearing on reasoning- and knowledge-oriented evaluations. Under reasoning-enabled inference, it records the highest scores among similar sized models on GPQA-D and MMLU-Pro, while remaining competitive on MATH-H. These results indicate that Mi:dm performs favorably on benchmarks that require broad reasoning and knowledge application. On code and agentic benchmarks, Mi:dm K 2.5 Pro shows competitive performance with particular strengths. Among similar sized models, it achieves the highest HumanEval+ score at 92.07% and the highestĎ 2 -Bench Telecom score at 89%. These results suggest that Mi:dm does not uniformly lead across all code-oriented evaluations, but demonstrates clear strengths on practical code synthesis and telecom-oriented agentic tasks. In particular, although Mi:dm K 2.5 Pro is substantially smaller than K-EXAONE-236B-A23B, its MATH-H and MMLU-Pro scores remain competitive with those of the much larger model. Its LiveCodeBench score also exceeds that of Solar-Open-100B, and itsĎ 2 -Bench Telecom score surpasses those of both Solar-Open-100B and K-EXAONE-236B-A23B. Taken together, these results indicate that Mi:dm K 2.5 Pro achieves strong performance on most benchmarks despite its 25 smaller scale, while achieving performance levels comparable to much larger models on several key evaluations. Korean Specific Benchmark.To evaluate the Korean-specific capabilities of Mi:dm K 2.5 Pro, we adopt a benchmark setting designed to capture linguistic, cultural, and contextual properties that are central to Korean. Existing evaluations often provide limited coverage of such properties, particularly for honorific usage, pragmatic interpretation, and culturally grounded reference resolution. To address these limitations, we combine publicly available Korean benchmarks with in-house benchmarks developed by KT. Detailed descriptions of the in-house benchmark design are provided in Mi:dm 2.0 [3]. The Korean benchmark set is organized into six capability categories: â˘Korean Comprehension â KO-SOVEREIGN* (language and literature), K-PRAGMATICS * , KOBALT [84], and CLICK-L [35] ⢠Society & Culture â KO-SOVEREIGN * (culture, folklore, and society), K-REFERENTIAL * , and CLICK-C [35] ⢠Instruction Following â KO-IFEVAL [80] ⢠Reasoning â KO-WINOGRANDE [85] and HRMCR [86] ⢠Korean Knowledge â KMMLU and KO-SOVEREIGN * ⢠Mathematics â Evaluated with HRM8K and AIME25-KO ModelReasoning ComprehensionSociety & Culture Ko-Sov. (EM) K-Prag. (EM) KoBALT (EM) CLIcK-L (EM) Ko-Sov. (EM) K-Ref. (EM) CLIcK-C (EM) (A) Korean Comprehension and Society & Culture K-EXAONE-236B-A23B Off62.5091.5051.1079.1064.0084.0079.90 On68.0093.7361.8687.2381.4092.8081.49 Solar-open-100B Offâ On63.5093.5348.8681.3864.9090.0077.70 Qwen-3-30B-A3B Off58.0088.7035.4072.9049.3082.4066.60 On59.5089.8040.1478.1570.9086.0068.40 HyperCLOVAX-SEED-Think-32B Off61.5087.5033.1072.3060.0090.0078.70 On68.00 92.4749.8680.1580.8094.8083.20 Mi:dm K 2.5 Pro (March â26) Off69.0089.0046.5079.1063.6087.6081.30 On73.5091.6057.8684.9282.2092.8082.83 (B) Instruction Following, Reasoning, Knowledge, and Math ModelReasoning ReasoningKnowledgeMathInstr. Following Ko-Winogrande (EM) HRMCR (EM) KMMLU (EM) Ko-Sov. (EM) HRM8K (EM) AIME25-Ko (EM) Ko-IFEval (avg) K-EXAONE-236B-A23B Off81.809.0074.9169.0080.4043.3087.45 On86.0236.0077.9071.9089.0886.6791.00 Solar-open-100B Offâ On84.1340.0072.5865.8081.1176.6788.19 Qwen-3-30B-A3B Off80.604.0063.5459.1074.1050.0085.13 On84.1335.0072.4061.8087.4986.6793.20 HyperCLOVAX-SEED-Think-32B Off75.409.0065.5363.0056.003.3079.74 On81.6822.0074.8070.7079.5340.0084.20 Mi:dm K 2.5 Pro (March â26) Off79.4016.0071.0669.6064.3016.6081.03 On86.2035.0076.9071.6086.8370.0085.60 Table 17: Performance comparison across Korean benchmark groups. The upper block reports com- prehension, society & culture, and generation benchmarks, while the lower block reports instruction following, reasoning, knowledge, and math benchmarks. As shown in Table 17, Mi:dm K 2.5 Pro delivers competitive performance on Korean-specific comprehension and society & culture benchmarks. Among models of comparable scale, it ranks at or near the top across most Korean-specific evaluations. Under reasoning-enabled inference, it achieves the highest score on Ko-Sovereign Korean comprehension at 73.50% and on the Ko-Sovereign society & culture subset at 82.20%. It also records the best results on KoBALT at 57.86% and CLIcK-L at 84.92%, while remaining close to the strongest baselines on K-Referential and CLIcK-C. These results show that Mi:dm K 2.5 Pro is particularly competitive on benchmarks that require Korean-specific linguistic understanding and culturally grounded contextual interpretation. * KT proprietary benchmark, internally developed for Korean-specific evaluation 26 Across the broader Korean benchmark suite, Mi:dm attains the highest score on Ko-Winogrande at 86.20%, while its performance on KMMLU at 76.90% and Ko-Sovereign knowledge at 71.60% remains close to the best reported results. This advantage is first evident against similarly sized baselines and remains visible even when compared with substantially larger models. In particular, Mi:dm surpasses K-EXAONE-236B-A23B by 5.5%p on Ko-Sovereign comprehension and by 0.8%p on the Ko-Sovereign society & culture subset, while remaining within 1.0%p on KMMLU. Taken together, these results indicate that Mi:dm K 2.5 Pro is highly competitive across Korean-specific evaluation benchmarks, with clear strengths in comprehension, society & culture, and reasoning and knowledge tasks. Fine-Grained Analysis of Mi:dm K 2.5 Proâs Comparative Strengths. To further characterize the capabilities of Mi:dm K 2.5 Pro, we perform a fine-grained analysis on representative English and Korean benchmark categories. This analysis is intended to identify the domains in which the model exhibits the most distinctive strengths beyond aggregate benchmark scores. The results show that Mi:dm K 2.5 Pro is particularly strong in English scientific reasoning and legal understanding, while in Korean it demonstrates strong capabilities in reasoning and STEM, history and law, and linguistically grounded language understanding. Figure 11: Fine-grained subdomain analysis on representative English benchmarks. The left panel reports GPQA-Diamond results by STEM subdomain, and the right panel reports MMLU-PRO (Law) results by legal subdomain. As shown in Fig. 11, the subdomain-level comparison with similar sized models indicates that Mi:dm K 2.5 Pro holds clear advantages in both scientific reasoning and legal understanding. On GPQA- Diamond, it is competitive across STEM subdomains as a whole, with particularly strong results in physics, chemistry, earth science, and mathematics. These results suggest that its performance is grounded in broad scientific reasoning ability rather than in strength limited to a small number of categories. On MMLU-Pro, particularly in the law domain, Mi:dm K 2.5 Pro records the highest scores across most major legal subdomains shown in the figure, including constitutional law, tax law, civil/property law, criminal law, and legal theory. These results indicate that the model is especially effective on evaluations requiring domain knowledge application, legal understanding, and structured reasoning over specialized concepts. As shown in Fig. 12, Mi:dm K 2.5 Pro also exhibits clear strengths across several major Korean eval- uation domains. In the reasoning and STEM categories, it achieves the best or comparable results on Korean reasoning benchmarks and records strong results across a wide range of STEM subdomains, with particularly notable advantages in chemistry, computer science, information technology, and materials engineering. In Korean history and law, it remains competitive across multiple historical periods and records the highest scores on many major legal subdomains, including constitutional law, criminal law, criminal procedure, civil law, commercial law, and labor and welfare law. In Korean linguistics, Mi:dm K 2.5 Pro performs strongly across diverse subdomains spanning semantics, phonology, syntax, morphology, and pragmatics, with especially visible superiority on tasks involv- ing inter-sentence relations, connective adverbs, rhetorical expressions, phonological alternation, subordinate clauses, and word formation. 27 Figure 12: Fine-grained subdomain analysis on representative Korean benchmarks. The left panel reports Korean reasoning and STEM results, the middle panel reports Korean history and law results, and the right panel reports Korean linguistics results. Overall, the fine-grained results clarify that Mi:dm K 2.5 Pro possesses distinctive strengths in scientifically grounded reasoning, legal understanding, Korean domain knowledge, and fine-grained linguistic understanding. These strengths are consistent with its competitive overall performance across broader English and Korean benchmark evaluations. 5.2 Human Evaluation We conduct targeted human evaluations on Mi:dm K 2.5 Pro to assess aspects of model quality that are not fully captured by automatic benchmarks. While quantitative evaluations provide standardized measures of task performance, human assessment is necessary to examine response quality from a user-centered perspective, including linguistic naturalness, instruction adherence, factual reliability, and contextual appropriateness. In particular, our evaluation focuses on whether the model produces responses that are not only correct, but also useful, well-formed, and aligned with practical deployment requirements in Korean user settings. At a broad level, Mi:dm K 2.5 Pro exhibits consistently competitive human-evaluated quality across the major categories, with scores above 90 in all top-level areas and gaps generally within 1 point of the compared models. Among similarly sized baselines, it holds small but consistent advantages over Qwen3-30B-A3B in conversation/QA, generation, and analysis/classification, and compares favorably with HyperCLOVAX-SEED-Think-32B in translation and brainstorming, including a +1.6%p gain in translation accuracy. This competitive profile also extends to larger models: Mi:dm K 2.5 Pro outperforms Solar-Open-100B in OpenQA (+11.3%p) and coding (+4.5%p), while remaining competitive with K-EXAONE-236B-A23B. The clearest advantages of Mi:dm K 2.5 Pro appear in Korean-centric translation and OpenQA. Compared with Qwen3-30B-A3B, Mi:dm K 2.5 Pro records a gain of +11.3%p in OpenQA, driven primarily by a +10.1%p advantage in information accuracy. These gains are especially pronounced in Korean knowledge-intensive categories such as language and literature (+19.7%p), culture and folklore (+18.8%p), and history (+17.9%p). In translation, Mi:dm K 2.5 Pro also outperforms Qwen3- 30B-A3B and HyperCLOVAX-SEED-Think-32B, with gains in translation accuracy of +2.3%p and +1.6%p, respectively, while remaining competitive with larger models in legal and administrative translation settings. These results indicate that Mi:dm K 2.5 Pro is particularly preferred when the task requires accurate information delivery, contextually grounded explanation, and precise terminology control. Qualitative comparison with other models further clarifies the strengths of Mi:dm K 2.5 Pro. In Korean OpenQA, Mi:dm provides more accurate and practically useful explanations of legal concepts such as compensation for emotional distress (ěěëŁ, wijaryo), correctly identifying it as compensation for non-pecuniary harm and distinguishing it from pecuniary damages, while organizing the response in a coherent and user-oriented manner. By contrast, other models more often showed limitations such as overly narrow scope, internally inconsistent explanation, or outright failure to answer. A similar difference is observed in legal translation. Mi:dm more reliably preserved legally meaningful distinctions, whereas other models were more prone to institution-level mistranslations, such as rendering prosecutorial-service official (ę˛ě°°ě§ęłľëŹ´ě, geomchal-jik gongmuwon) as prosecutor, or semantic errors, such as translating forfeiture or confiscation (ěśě§, chujing) as restitution. These 28 comparisons suggest that Mi:dm K 2.5 Pro is particularly effective when tasks require factual precision, structural clarity, and context-sensitive interpretation in Korean legal and socio-cultural settings. Overall, the human evaluation indicates that Mi:dm K 2.5 Pro delivers particularly high practical value in Korean knowledge-intensive QA, translation, and legal-domain applications, while remaining broadly comparable to strong baselines across nearly all major categories. These findings are consis- tent with the benchmark-based analysis presented above, showing that the modelâs strengths in law, socio-cultural knowledge, and reasoning-intensive tasks are reflected not only in automatic benchmark scores, but also in human judgments of usefulness, reliability, and contextual appropriateness. 5.3 RAI Evaluation The Responsible AI (RAI) evaluation, conducted to support the implementation of responsible AI, assesses the safety and robustness of the model. The RAI safety assessement is based on AI risk categories defined by KT and examines whether the model generates harmful content (Content Safety Risks), whether it may be inappropriately utilized in socio-economic contexts (Socio-Economical Risks), and whether potential rights violations or legal risks exist (Legal and Rights-Related Risks). To assess these aspects, qualitative assessment and quantitative assessment are conducted. The robustness evaluation examines how effectively the model responds to various attack techniques that may be attempted by malicious users. This evaluation is carried out through red teaming, which identifies potential vulnerabilities of the model. The evaluation framework and detailed assessment criteria are described in the Responsible AI Technical Report [87]. Qualitative RAI Safety Assessment. To qualitatively evaluate the modelâs responses to AI risks, we use scenario-based evaluation prompts designed based on KTâs AI risk taxonomy and reflecting realistic service usage scenarios. For each risk category, responses are assessed according to predefined criteria to determine whether they are harmful and to what extent. In addition, to verify that the model does not excessively refuse requests in a way that degrades response usefulness, over-refusal behavior is also evaluated. The evaluation metrics are not unsafe rate and the not overrefuse rate, which respectively represent the proportion of non-harmful responses and responses that do not exhibit excessive refusal among the total evaluation items. The overall score is calculated based on all evaluation items, rather than as an average across risk categories. ModelReasoning Not Unsafe Rate (%)Not Overrefuse Rate (%) Content Safety Socio Economical Legal and Rights Overall Content Safety Socio Economical Legal and Rights Overall Qwen-3-30B-A3B Off90.8891.0078.8387.64100.095.45100.098.55 On96.7593.5092.1794.32100.0100.0100.0100.0 EXAONE-4.0-32B Off82.8883.0075.5079.55100.095.45100.098.55 On93.0090.2584.8389.77100.0100.0100.0100.0 HyperCLOVAX-SEED-Think-32B Off99.3898.2594.1797.5578.7963.6492.8676.81 On96.7594.6391.0094.41100.0100.0100.0100.0 Mi:dm K 2.5 Pro (March â26) Off98.7595.0094.1796.14100.096.45100.098.55 On98.3894.6395.6796.27100.0100.0100.0100.0 Table 18: Qualitative assessment results of each model. The Not Unsafe Rate and Not Overrefuse Rate are reported across three risk domains, along with the overall score. Higher values in both metrics indicate better performance. As shown in Table 18, Mi:dm K 2.5 Pro maintains an overall strong Not Unsafe Rate across both reasoning-enabled and reasoning-disabled settings, recording 96.27% with reasoning enabled and 96.14% with reasoning disabled. These results indicate consistently high safety performance compared to the comparison models. While HyperCLOVAX-SEED-Think-32B achieves the highest overall Not Unsafe Rate in the reasoning-disabled setting (97.55%), Mi:dm K 2.5 Pro demonstrates balanced performance across all three risk categories. In particular, the model achieves over 98% in Content Safety Risks under both reasoning settings, confirming its strong capability in identifying and responding to harmful content. Moreover, Mi:dm K 2.5 Pro maintains stable performance in the Socio-Economical Risk category, where other models tend to exhibit relatively weaker robustness. A clearer distinction between models emerges in the Not Overrefuse Rate. While all models achieve a perfect score of 100% in the reasoning-enabled setting, performance divergence is observed when 29 reasoning is disabled. Mi:dm K 2.5 Pro maintains a high Not Overrefuse Rate of 98.55% even with reasoning disabled, indicating that the model provides appropriate responses without excessive refusal. In contrast, HyperCLOVAX-SEED-Think-32B records a substantially lower score of 76.81%, reflecting a more conservative response tendency. Overall, Mi:dm K 2.5 Pro exhibits only a minimal performance gap between reasoning-enabled and reasoning-disabled modes, demonstrating consistent safety behavior and a well-balanced trade-off between harmlessness and responsiveness. Quantitative RAI Safety Assessment.To objectively and systematically assess the safety and reli- ability of AI models, benchmark evaluations are conducted. In this RAI evaluation, two benchmarks are utilized: the Large Language Model Trustworthiness Benchmark dataset [88], which evaluates the harmlessness of Korean LLMs (bias, hate, risk, and sensitiveness), and KoBBQ [89], a dataset designed to assess social bias in Korean cultural contexts. The Large Language Model Trustworthiness Benchmark evaluates model performance using accuracy, which reflects how accurately the model predicts predefined ground-truth answers. Performance is calculated at both the category and subcategory levels. Model comparisons are conducted at the four-category level, and the overall performance is computed as the harmonic mean of the accuracy values across subcategories. KoBBQ evaluates the modelâs inherent social biases across 12 topics under two conditions: ambiguous context and disambiguated context. For each classification task, the proportion of correct answer selections is measured as accuracy. The arithmetic mean of topic-level accuracy is calculated to obtain the score for each context, and the final score is computed as the average of the two context scores. ModelReasoning LLM Trustworthiness BenchmarkKoBBQ BiasHateIllegal Sensitiveness Overall Ambiguous Context Disambiguated Context Overall Qwen3-30B-A3B Off77.29 73.0895.8374.4476.5591.7582.8687.30 On85.49 83.7595.8380.0084.5098.3090.7294.51 EXAONE-4.0-32B Off70.21 73.4195.8374.3073.8078.4591.6685.05 On63.13 65.0875.4262.6464.5097.2093.2395.21 HyperCLOVAX-SEED-Think-32B Off69.79 65.8395.0066.9469.5886.4988.2587.37 On84.03 80.2597.0883.3483.5080.4465.5673.00 Mi:dm K 2.5 Pro (March â26) Off84.79 76.5898.3382.2282.4491.0294.1292.57 On89.58 85.6797.5087.2288.3394.5693.4494.00 Table 19: LLM Trustworthiness Benchmark and KoBBQ results for each model. Accuracy is reported across categories and contexts, along with overall scores. Higher values indicate better performance. As shown in Table 19, across both the LLM Trustworthiness Benchmark and KoBBQ, Mi:dm K 2.5 Pro demonstrates overall superior performance compared to the comparison models in both reasoning-enabled and reasoning-disabled settings. In the LLM Trustworthiness Benchmark, Mi:dm K 2.5 Pro records the highest performance in both modes, achieving 88.33% with reasoning enabled and 82.44% with reasoning disabled. At the subcategory level, the model achieves the highest accuracy among the compared models across Bias, Hate, and Sensitiveness, while maintaining stable performance of over 95% in the Illegal category under both reasoning settings. While the comparison models show relatively larger performance drops when reasoning is disabled, Mi:dm K 2.5 Pro exhibits only a small performance gap between the two modes, indicating consistent reliability judgment capability regardless of whether reasoning is enabled. This consistent safety-aligned response can be attributed to the application of the RAI response style discussed in Sec2.4 On KoBBQ, Mi:dm K 2.5 Pro records 94.00% with reasoning enabled and 92.57% with reason- ing disabled. In the reasoning-enabled setting, the model achieves performance comparable to EXAONE-4.0-32B (95.21%) and Qwen3-30B-A3B (94.51%), while showing a clear advantage over HyperCLOVAX-SEED-Think-32B (73.00%). In the reasoning-disabled setting, Mi:dm K 2.5 Pro records the highest overall score among the compared models. The performance gap between Ambigu- ous Context and Disambiguated Context remains small, indicating stable contextual understanding across different contextual conditions. RAI Robustness Assessment Despite conducting RAI qualitative and quantitative assessments to rigorously assess the safety of AI models, such models may still fail to respond appropriately 30 when confronted with carefully crafted adversarial prompts, potentially generating harmful responses to users. To quantify model robustness against jailbreak attack scenarios by malicious users, KT RAIC establishes a proprietary Korean red-teaming dataset. The dataset evaluates both single-turn and multi-turn interactions and includes over 30 attack techniques. The evaluation metric is the attack success rate (ASR), defined as the proportion of successful prompt attacks relative to the total number of evaluation prompts. ModelReasoningAttack Success Rate (%) Qwen-3-30B-A3B Offâ On39.2 EXAONE-4.0-32B Offâ On54.0 HyperCLOVAX-SEED-Think-32B Offâ On47.4 Mi:dm K 2.5 Pro (March â26) Offâ On36.3 Table 20: Red Teaming results for each model. Attack Success Rate (ASR) measures robustness against adversarial prompt attacks, where lower values indicate stronger defense capability. As shown in Table 20, with reasoning enabled, Mi:dm K 2.5 Pro records an ASR of 36.3%, the lowest attack success rate among the compared models. This result indicates the highest level of resistance to adversarial prompt attacks, demonstrating a clear advantage over HyperCLOVAX-SEED-Think-32B (47.4%), EXAONE-4.0-32B (54.0%), and Qwen-3-30B-A3B (39.2%). Notably, the model maintains robust performance even under multi-turn attack scenarios, which generally exhibit higher attack success rates than single-turn attacks. These results indicate that Mi:dm K 2.5 Pro effectively responds to complex and progressively evolving malicious attempts. 6 Conclusion In this report, we presented Mi:dm K 2.5 Pro, a 32-billion parameter flagship large language model designed to advance enterprise-grade capabilities including complex reasoning, long-context under- standing, and agentic workflows with a strong focus on Korean-language applications. To achieve a reliable and high-quality model, we carefully optimized data curation, parameter scaling and training methodologies. Robust Data & Pre-training We established a high-quality data foundation through advanced curation pipelines, including AST-based filtering and LLM-driven quality evaluation. For efficient capacity expansion, we applied layer predictor-based Depth Upscaling (DuS) and progressively extended the context window to 128K tokens, enabling effective handling of long document reasoning tasks commonly observed in enterprise scenarios. Advanced Post-TrainingWe implemented a multi-stage pipeline aligned with task-specific objec- tives, incorporating Reasoning SFT, model merging, and fully asynchronous reinforcement learning. Through subsequent "Fusion Training", the model achieves a balanced integration of deep rea- soning capability, conversational fluency, and robust tool-use capabilities. In addition, systematic response-style alignment ensures consistent persona, stable response structure, and precise instruction adherence across diverse use cases. Strong Performance & ReliabilityMi:dm K 2.5 Pro demonstrates highly competitive performance on global English benchmarks while setting new state-of-the-art records on proprietary Korean- specific benchmarks such as Ko-Sovereign, highlighting its strength in Korea-centric knowledge and language understanding. Furthermore, comprehensive Responsible AI (RAI) evaluation confirms the modelâs safety, robustness, and readiness for real-world deployment. Broader Impact and Vision With the introduction of Mi:dm K 2.5 Pro, KT completes its com- prehensive lineup spanning Mini, Base, and Pro, providing powerful and flexible options across a wide range of computational environments and application requirements. Beyond performance gains, this work represents a meaningful step toward practical, enterprise-ready AI solutions addressing 31 real-world demands and domain-specific problem solving. KT will continue advancing the Mi:dm K series to further accelerate AI transformation (AX) across industries. References [1] Artificial Analysis. Artificial analysis intelligence index v4.0. [2]Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus. Emergent abilities of large language models. arXiv preprint arXiv:2206.07682, 2022. [3]Donghoon Shin, Sejung Lee, Soonmin Bae, Hwijung Ryu, Changwon Ok, Hoyoun Jung, Hyesung Ji, Jeehyun Lim, Jehoon Lee, Ji-Eun Han, et al. Mi: dm 2.0 korea-centric bilingual language models. arXiv preprint arXiv:2601.09066, 2026. [4]Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chong Ruan, Damai Dai, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fucong Dai, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei Li, H. Zhang, Hanwei Xu, Honghui Ding, Huazuo Gao, Hui Qu, Hui Li, Jianzhong Guo, Jiashi Li, Jingchang Chen, Jingyang Yuan, Jinhao Tu, Junjie Qiu, Junlong Li, J. L. Cai, Jiaqi Ni, Jian Liang, Jin Chen, Kai Dong, Kai Hu, Kaichao You, Kaige Gao, Kang Guan, Kexin Huang, Kuai Yu, Lean Wang, Lecong Zhang, Liang Zhao, Litong Wang, Liyue Zhang, Lei Xu, Leyi Xia, Mingchuan Zhang, Minghua Zhang, Minghui Tang, Mingxu Zhou, Meng Li, Miaojun Wang, Mingming Li, Ning Tian, Panpan Huang, Peng Zhang, Qiancheng Wang, Qinyu Chen, Qiushi Du, Ruiqi Ge, Ruisong Zhang, Ruizhe Pan, Runji Wang, R. J. Chen, R. L. Jin, Ruyi Chen, Shanghao Lu, Shangyan Zhou, Shanhuang Chen, Shengfeng Ye, Shiyu Wang, Shuiping Yu, Shunfeng Zhou, Shuting Pan, S. S. Li, Shuang Zhou, Shaoqing Wu, Tao Yun, Tian Pei, Tianyu Sun, T. Wang, Wangding Zeng, Wen Liu, Wenfeng Liang, Wenjun Gao, Wenqin Yu, Wentao Zhang, W. L. Xiao, Wei An, Xiaodong Liu, Xiaohan Wang, Xiaokang Chen, Xiaotao Nie, Xin Cheng, Xin Liu, Xin Xie, Xingchao Liu, Xinyu Yang, Xinyuan Li, Xuecheng Su, Xuheng Lin, X. Q. Li, Xiangyue Jin, Xiaojin Shen, Xiaosha Chen, Xiaowen Sun, Xiaoxiang Wang, Xinnan Song, Xinyi Zhou, Xianzu Wang, Xinxia Shan, Y. K. Li, Y. Q. Wang, Y. X. Wei, Yang Zhang, Yanhong Xu, Yao Li, Yao Zhao, Yaofeng Sun, Yaohui Wang, Yi Yu, Yichao Zhang, Yifan Shi, Yiliang Xiong, Ying He, Yishi Piao, Yisong Wang, Yixuan Tan, Yiyang Ma, Yiyuan Liu, Yongqiang Guo, Yuan Ou, Yuduan Wang, Yue Gong, Yuheng Zou, Yujia He, Yunfan Xiong, Yuxiang Luo, Yuxiang You, Yuxuan Liu, Yuyang Zhou, Y. X. Zhu, Yanping Huang, Yaohui Li, Yi Zheng, Yuchen Zhu, Yunxian Ma, Ying Tang, Yukun Zha, Yuting Yan, Z. Z. Ren, Zehui Ren, Zhangli Sha, Zhe Fu, Zhean Xu, Zhenda Xie, Zhengyan Zhang, Zhewen Hao, Zhicheng Ma, Zhigang Yan, Zhiyu Wu, Zihui Gu, Zijia Zhu, Zijun Liu, Zilin Li, Ziwei Xie, Ziyang Song, Zizheng Pan, Zhen Huang, Zhipeng Xu, Zhongyu Zhang, and Zhen Zhang. Deepseek-r1 incentivizes reasoning in llms through reinforcement learning. Nature, 645(8081), 2025. [5]Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, et al. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. In International conference on machine learning, pages 23965â23998. PMLR, 2022. [6] Yijiong Yu, Ziyun Dai, Zekun Wang, Wei Wang, Ran Chen, and Ji Pei. Opencsg chinese corpus: A series of high-quality chinese datasets for llm training. arXiv preprint arXiv:2501.08197, 2025. [7] Loubna Ben Allal, Anton Lozhkov, Guilherme Penedo, Thomas Wolf, and Leandro von Werra. Cosmopedia, February 2024. [8] Bettina Messmer, Vinko Sabol Ë cec, and Martin Jaggi. Enhancing multilingual llm pretraining with model-based data selection. arXiv, 2025. 32 [9]Luca Soldaini and Kyle Lo. peS2o (Pretraining Efficiently on S2ORC) Dataset. Technical report, Allen Institute for AI, 2023. ODC-By,https://github.com/allenai/pes2o. [10]Zihan Wang, Jiaze Chen, Zhicheng Liu, Markus Mak, Yidi Du, Geonsik Moon, Luoqi Xu, Aaron Tua, Kunshuo Peng, Jiayi Lu, et al. Aethercode: Evaluating llmsâ ability to win in premier programming competitions. arXiv preprint arXiv:2508.16402, 2025. [11]Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Ar- mando Solar-Lezama, Koushik Sen, and Ion Stoica. Livecodebench: Holistic and contamination free evaluation of large language models for code. arXiv preprint arXiv:2403.07974, 2024. [12]Dewu Zheng, Yanlin Wang, Ensheng Shi, Xilin Liu, Yuchi Ma, Hongyu Zhang, and Zibin Zheng. Top general performance= top domain performance? domaincodebench: A multi-domain code generation benchmark. arXiv preprint arXiv:2412.18573, 2024. [13]Norman L Webb. Criteria for alignment of expectations and assessments in mathematics and science education. research monograph no. 6., 1997. [14]Edward Dunne and Klaus Hulek. Mathematics subject classification 2020. Not. Am. Math. Soc, 67(3):410â411, 2020. [15] Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. [16] Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. Measuring mathematical problem solving with the math dataset. arXiv preprint arXiv:2103.03874, 2021. [17]Zhuang Li, Yuncheng Hua, Thuy Vu, Haolan Zhan, Lizhen Qu, and Gholamreza Haffari. Scar: Data selection via style consistency-aware response ranking for efficient instruction-tuning of large language models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12756â12790, 2025. [18]Zhongpu Chen, Yinfeng Liu, Long Shi, Zhi-Jie Wang, Xingyan Chen, Yu Zhao, and Fuji Ren. Mdeval: Evaluating and enhancing markdown awareness in large language models. CoRR, 2025. [19]Chunting Zhou, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma, Avia Efrat, Ping Yu, Lili Yu, et al. Lima: Less is more for alignment. Advances in Neural Information Processing Systems, 36:55006â55021, 2023. [20] Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. Survey of hallucination in natural language generation. ACM computing surveys, 55(12):1â38, 2023. [21]Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V Le, Barret Zoph, Jason Wei, et al. The flan collection: Designing data and methods for effective instruction tuning. In International Conference on Machine Learning, pages 22631â22648. PMLR, 2023. [22] Alex Young, Bei Chen, Chao Li, Chengen Huang, Ge Zhang, Guanwei Zhang, Heng Li, Jiangcheng Zhu, Jianqun Chen, Jing Chang, et al. Yi: Open foundation models by 01. ai. CoRR, 2024. [23]Yifei Yang, Zouying Cao, Xinbei Ma, Yao Yao, Zhi Chen, Libo Qin, and Hai Zhao. Lesa: Learnable llm layer scaling-up. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 22463â22476, 2025. [24] Sanghoon Kim, Dahyun Kim, Chanjun Park, Wonsung Lee, Wonho Song, Yunsu Kim, Hyeon- woo Kim, Yungi Kim, Hyeonju Lee, Jihoo Kim, et al. Solar 10.7 b: Scaling large language models with simple yet effective depth up-scaling. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 6: Industry Track), pages 23â35, 2024. 33 [25]Mingxu Tao, Chen Zhang, Quzhe Huang, Tianyao Ma, Songfang Huang, Dongyan Zhao, and Yansong Feng. Unlocking the potential of model merging for low-resource languages. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 8705â8720, 2024. [26] An Yang, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoyan Huang, Jiandong Jiang, Jianhong Tu, Jianwei Zhang, Jingren Zhou, et al. Qwen2. 5-1m technical report. CoRR, 2025. [27]Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, and Ion Stoica. Efficient memory management for large lan- guage model serving with pagedattention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023. [28]Bowen Peng, Jeffrey Quesnelle, Honglu Fan, and Enrico Shippole. Yarn: Efficient context window extension of large language models. In The Twelfth International Conference on Learning Representations, 2023. [29]Qian Liu, Xiaosen Zheng, Niklas Muennighoff, Guangtao Zeng, Longxu Dou, Tianyu Pang, Jing Jiang, and Min Lin. Regmix: Data mixture as regression for language model pre-training. In The Thirteenth International Conference on Learning Representations, 2024. [30]Mingxu Tao, Yansong Feng, and Dongyan Zhao. Can bert refrain from forgetting on sequential tasks? a probing study. In The Eleventh International Conference on Learning Representations, 2023. [31]Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, Yang Zhang, and Boris Ginsburg. Ruler: Whatâs the real context size of your long-context language models? CoRR, 2024. [32]Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra, Shiguang Guo, Weiming Ren, Aaran Arulraj, Xuan He, Ziyan Jiang, et al. Mmlu-pro: A more robust and challenging multi-task language understanding benchmark. Advances in Neural Information Processing Systems, 37:95266â95290, 2024. [33]David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R Bowman. Gpqa: A graduate-level google-proof q&a benchmark. In First Conference on Language Modeling, 2024. [34]Jiyoung Lee, Minwoo Kim, Seungho Kim, Junghwan Kim, Seunghyun Won, Hwaran Lee, and Edward Choi. Kornat: Llm alignment benchmark for korean social values and common knowledge. arXiv preprint arXiv:2402.13605, 2024. [35]Eunsu Kim, Juyoung Suk, Philhoon Oh, Haneul Yoo, James Thorne, and Alice Oh. Click: A benchmark dataset of cultural and linguistic intelligence in korean. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 3335â3346, 2024. [36] Gyeongje Cho, Yeonkyoun So, Chanwoo Park, Sangmin Lee, Sungmok Jung, and Jaejin Lee. Thunder-tok: Minimizing tokens per word in tokenizing korean texts for generative language models. arXiv preprint arXiv:2506.15138, 2025. [37] Dojun Park, Jiwoo Lee, Hyeyun Jeong, Seohyun Park, and Sungeun Lee. Pragmatic competence evaluation of large language models for the korean language. In Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation, pages 256â266, 2024. [38]Traian Rebedea, Makesh Sreedhar, Shaona Ghosh, Jiaqi Zeng, and Christopher Parisien. Canttalkaboutthis: Aligning language models to stay on topic in dialogues. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 12232â12252, 2024. [39]Wai-Chung Kwan, Xingshan Zeng, Yuxin Jiang, Yufei Wang, Liangyou Li, Lifeng Shang, Xin Jiang, Qun Liu, and Kam-Fai Wong. Mt-eval: A multi-turn capabilities evaluation benchmark for large language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 20153â20177, 2024. 34 [40]Ge Bai, Jie Liu, Xingyuan Bu, Yancheng He, Jiaheng Liu, Zhanhui Zhou, Zhuoran Lin, Wenbo Su, Tiezheng Ge, Bo Zheng, et al. Mt-bench-101: A fine-grained benchmark for evaluating large language models in multi-turn dialogues. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7421â7454, 2024. [41]Tao Ge, Xin Chan, Xiaoyang Wang, Dian Yu, Haitao Mi, and Dong Yu. Scaling synthetic data creation with 1,000,000,000 personas. arXiv preprint arXiv:2406.20094, 2024. [42]Matt Deitke, Christopher Clark, Sangho Lee, Rohun Tripathi, Yue Yang, Jae Sung Park, Mo- hammadreza Salehi, Niklas Muennighoff, Kyle Lo, Luca Soldaini, et al. Molmo and pixmo: Open weights and open data for state-of-the-art vision-language models. In Proceedings of the Computer Vision and Pattern Recognition Conference, pages 91â104, 2025. [43]Pei Wang, Yanan Wu, Zekun Wang, Jiaheng Liu, Xiaoshuai Song, Zhongyuan Peng, Ken Deng, Chenchen Zhang, Jiakai Wang, Junran Peng, et al. Mtu-bench: A multi-granularity tool-use benchmark for large language models. CoRR, 2024. [44]Jeonghoon Shim, Gyuhyeon Seo, Cheongsu Lim, and Yohan Jo. Tooldial: Multi-turn dialogue generation method for tool-augmented language models. In The Thirteenth International Conference on Learning Representations, 2025. [45] Shinbok Lee, Gaeun Seo, Daniel Lee, Byeongil Ko, Sunghee Jung, and Myeongcheol Shin. Functionchat-bench: Comprehensive evaluation of language modelsâ generative capabilities in korean tool-use dialogs. arXiv preprint arXiv:2411.14054, 2024. [46]Shunyu Yao, Noah Shinn, Pedram Razavi, and Karthik Narasimhan.Ď-bench: A benchmark for tool-agent-user interaction in real-world domains. arXiv preprint arXiv:2406.12045, 2024. [47] Xinyi Hou, Yanjie Zhao, Shenao Wang, and Haoyu Wang. Model context protocol (mcp): Landscape, security threats, and future research directions. arXiv preprint arXiv:2503.23278, 2025. [48] Hayley Ross, Ameya Sunil Mahabaleshwarkar, and Yoshi Suhara. When2call: When (not) to call tools. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 3391â3409, 2025. [49]LM Studio Team. Lm studio: Discover, download, and run local llms. Software available at https://lmstudio.ai/. [50] Ollama Team. Ollama: Get up and running with large language models locally. GitHub Repository and Documentation, 2024. [51]Aaditya K Singh and DJ Strouse. Tokenization counts: the impact of tokenization on arithmetic in frontier llms. arXiv preprint arXiv:2402.14903, 2024. [52]Sandhini Agarwal, Lama Ahmad, Jason Ai, Sam Altman, Andy Applebaum, Edwin Arbus, Rahul K Arora, Yu Bai, Bowen Baker, Haiming Bao, et al. gpt-oss-120b & gpt-oss-20b model card. arXiv preprint arXiv:2508.10925, 2025. [53]Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, et al. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025. [54] Kohsei Matsutani, Shota Takashiro, Gouki Minegishi, Takeshi Kojima, Yusuke Iwasawa, and Yutaka Matsuo. Rl squeezes, sft expands: A comparative study of reasoning llms. arXiv preprint arXiv:2509.21128, 2025. [55]Hantian Ding, Zijian Wang, Giovanni Paolini, Varun Kumar, Anoop Deoras, Dan Roth, and Stefano Soatto. Fewer truncations improve language modeling, 2024. [56]Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, et al. Minicpm: Unveiling the potential of small language models with scalable training strategies. CoRR, 2024. 35 [57]Yunshui Li, Yiyuan Ma, Shen Yan, Chaoyi Zhang, Jing Liu, Jianqiao Lu, Ziwen Xu, Mengzhao Chen, Minrui Wang, Shiyi Zhan, et al. Model merging in pre-training of large language models. arXiv preprint arXiv:2505.12082, 2025. [58]Changxin Tian, Jiapeng Wang, Qian Zhao, Kunlong Chen, Jia Liu, Ziqi Liu, Jiaxin Mao, Wayne Xin Zhao, Zhiqiang Zhang, and Jun Zhou. Wsm: decay-free learning rate schedule via checkpoint merging for llm pre-training. arXiv preprint arXiv:2507.17634, 2025. [59] Alexandre RamĂŠ, Johan Ferret, Nino Vieillard, Robert Dadashi, LĂŠonard Hussenot, Pierre-Louis Cedoz, Pier Giuseppe Sessa, Sertan Girgin, Arthur Douillard, and Olivier Bachem. Warp: On the benefits of weight averaged rewarded policies. CoRR, 2024. [60]Team Cohere, Arash Ahmadian, Marwan Ahmed, Jay Alammar, Milad Alizadeh, Yazeed Alnumay, Sophia Althammer, Arkady Arkhangorodsky, Viraat Aryabumi, Dennis Aumiller, et al. Command a: An enterprise-ready large language model. arXiv preprint arXiv:2504.00698, 2025. [61]Yunju Bak, Hojin Lee, Minho Ryu, Jiyeon Ham, Seungjae Jung, Daniel Wontae Nam, Taegyeong Eo, Donghun Lee, Doohae Jung, Boseop Kim, et al. Kanana: Compute-efficient bilingual language models. arXiv preprint arXiv:2502.18934, 2025. [62]Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et al. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437, 2024. [63]John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017. [64]Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, and Chuan Wu. Hybridflow: A flexible and efficient rlhf framework. CoRR, 2024. [65]Wei Fu, Jiaxuan Gao, Xujie Shen, Chen Zhu, Zhiyu Mei, Chuyi He, Shusheng Xu, Guo Wei, Jun Mei, Jiashu Wang, et al. Areal: A large-scale asynchronous reinforcement learning system for language reasoning. arXiv preprint arXiv:2505.24298, 2025. [66]Zhenyu Han, Ansheng You, Haibo Wang, Kui Luo, Guang Yang, Wenqi Shi, Menglong Chen, Sicheng Zhang, Zeshun Lan, Chunshi Deng, et al. Asyncflow: An asynchronous streaming rl framework for efficient llm post-training. arXiv preprint arXiv:2507.01663, 2025. [67]Valentina Pyatkin, Saumya Malik, Victoria Graf, Hamish Ivison, Shengyi Huang, Pradeep Dasigi, Nathan Lambert, and Hannaneh Hajishirzi. Generalizing verifiable instruction following, 2025. [68] Chujie Zheng, Shixuan Liu, Mingze Li, Xiong-Hui Chen, Bowen Yu, Chang Gao, Kai Dang, Yuqiong Liu, Rui Men, An Yang, Jingren Zhou, and Junyang Lin. Group sequence policy optimization, 2025. [69] Yoshua Bengio, JĂŠrĂ´me Louradour, Ronan Collobert, and Jason Weston. Curriculum learning. In Proceedings of the 26th annual international conference on machine learning, pages 41â48, 2009. [70]Petru Soviany, Radu Tudor Ionescu, Paolo Rota, and Nicu Sebe. Curriculum learning: A survey. International Journal of Computer Vision, 130(6):1526â1565, 2022. [71] Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, Deep Ganguli, Tom Henighan, et al. Training a helpful and harmless assistant with reinforcement learning from human feedback. CoRR, 2022. [72]Amanda Askell, Yuntao Bai, Anna Chen, Dawn Drain, Deep Ganguli, Tom Henighan, Andy Jones, Nicholas Joseph, Benjamin Mann, Nova DasSarma, et al. A general language assistant as a laboratory for alignment. CoRR, 2021. 36 [73]Harrison Lee, Samrat Phatale, Hassan Mansoor, Kellie Ren Lu, Thomas Mesnard, Johan Ferret, Colton Bishop, Ethan Hall, Victor Carbune, and Abhinav Rastogi. Rlaif: Scaling reinforcement learning from human feedback with ai feedback. 2023. [74]Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. G-eval: Nlg evaluation using gpt-4 with better human alignment. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2511â2522, 2023. [75]Feng Yao, Liyuan Liu, Dinghuai Zhang, Chengyu Dong, Jingbo Shang, and Jianfeng Gao. On the rollout-training mismatch in modern RL systems. In OPT 2025: Optimization for Machine Learning, 2025. [76] Lasse Espeholt, Hubert Soyer, Remi Munos, Karen Simonyan, Vlad Mnih, Tom Ward, Yotam Doron, Vlad Firoiu, Tim Harley, Iain Dunning, et al. Impala: Scalable distributed deep-rl with importance weighted actor-learner architectures. In International conference on machine learning, pages 1407â1416. PMLR, 2018. [77]Yizhong Wang, Yeganeh Kordi, Swaroop Mishra, Alisa Liu, Noah A Smith, Daniel Khashabi, and Hannaneh Hajishirzi. Self-instruct: Aligning language models with self-generated instruc- tions. In Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: long papers), pages 13484â13508, 2023. [78] OpenAI. Structured outputs in the api. [79] Mathematical Association of America. American invitational mathematics examination, 2025. [80] Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. Instruction-following evaluation for large language models, 2023. [81] Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. Is your code generated by chatGPT really correct? rigorous evaluation of large language models for code generation. In Thirty-seventh Conference on Neural Information Processing Systems, 2023. [82]Mike A. Merrill, Alexander G. Shaw, Nicholas Carlini, Boxuan Li, Harsh Raj, Ivan Bercovich, Lin Shi, Jeong Yeon Shin, Thomas Walshe, E. Kelly Buchanan, Junhong Shen, Guanghao Ye, Haowei Lin, Jason Poulos, Maoyu Wang, Marianna Nezhurina, Jenia Jitsev, Di Lu, Orfeas Menis Mastromichalakis, Zhiwei Xu, Zizhao Chen, Yue Liu, Robert Zhang, Leon Liangyu Chen, Anurag Kashyap, Jan-Lucas Uslu, Jeffrey Li, Jianbo Wu, Minghao Yan, Song Bian, Vedang Sharma, Ke Sun, Steven Dillmann, Akshay Anand, Andrew Lanpouthakoun, Bardia Koopah, Changran Hu, Etash Guha, Gabriel H. S. Dreiman, Jiacheng Zhu, Karl Krauth, Li Zhong, Niklas Muennighoff, Robert Amanfu, Shangyin Tan, Shreyas Pimpalgaonkar, Tushar Aggarwal, Xiangning Lin, Xin Lan, Xuandong Zhao, Yiqing Liang, Yuanli Wang, Zilong Wang, Changzhi Zhou, David Heineman, Hange Liu, Harsh Trivedi, John Yang, Junhong Lin, Manish Shetty, Michael Yang, Nabil Omi, Negin Raoof, Shanda Li, Terry Yue Zhuo, Wuwei Lin, Yiwei Dai, Yuxin Wang, Wenhao Chai, Shang Zhou, Dariush Wahdany, Ziyu She, Jiaming Hu, Zhikang Dong, Yuxuan Zhu, Sasha Cui, Ahson Saiyed, ArinbjĂśrn Kolbeinsson, Jesse Hu, Christopher Michael Rytting, Ryan Marten, Yixin Wang, Alex Dimakis, Andy Konwinski, and Ludwig Schmidt. Terminal-bench: Benchmarking agents on hard, realistic tasks in command line interfaces, 2026. [83]Victor Barres, Honghua Dong, Soham Ray, Xujie Si, and Karthik Narasimhan.Ď 2 -bench: Eval- uating conversational agents in a dual-control environment. arXiv preprint arXiv:2506.07982, 2025. [84]Hyopil Shin, Sangah Lee, Dongjun Jang, Wooseok Song, Jaeyoon Kim, Chaeyoung Oh, Hyemi Jo, Youngchae Ahn, Sihyun Oh, Hyohyeong Chang, et al. Kobalt: Korean benchmark for advanced linguistic tasks. arXiv preprint arXiv:2505.16125, 2025. [85]Hyeonwoo Kim, Dahyun Kim, Jihoo Kim, Sukyung Lee, Yungi Kim, and Chanjun Park. Open ko-llm leaderboard2: Bridging foundational and practical evaluation for korean llms. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 3: Industry Track), pages 266â273, 2025. 37 [86]Guijin Son, Hyunwoo Ko, and Dasol Choi. Multi-step reasoning in korean and the emergent mirage. In Proceedings of the 3rd Workshop on Cross-Cultural Considerations in NLP (C3NLP 2025), pages 10â21, 2025. [87]KT: Yunjin Park, Jungwon Yoon, Junhyung Moon, Myunggyo Oh, Wonhyuk Lee, Sujin Kim, Youngchol Kim, Eunmi Kim, Hyoungjun Park, Eunyoung Shin, Wonyoung Lee, Somin Lee, Minwook Ju, Minsung Noh, Dongyoung Jeong, Jeongyeop Kim, Wanjin Park, and Soonmin Bae. Responsible ai technical report, 2025. [88]Korean Large Language Model Trustworthiness Benchmark Data.https: //aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu= 100&aihubDataSe=data&dataSetSn=71760. Accessed: 2026-03-05. [89] Jiho Jin, Jiseon Kim, Nayeon Lee, Haneul Yoo, Alice Oh, and Hwaran Lee. Kobbq: Korean bias benchmark for question answering. Transactions of the Association for Computational Linguistics, 12:507â524, 2024. A Contributor All authors are listed in alphabetical order by last name. Euijai Ahn Heejeong Ahn Jihyun Ahn Jonggil Ahn Jimin An Sungho An Soonmin Bae Kwangje Baeg Jinwoo Baek Jisoo Baik GeunYeong Bak Jii Cha Wangsung Chun Riwoo Chung Taehyun Goh Eunji Ha Youngkyoung Ham Ji-Eun Han Cheolhun Heo Yunmi Heo Sukjin Hong Taesung Hur Jinhee Jeong Joohun Jeong Hongseok Jeung Hyesung Ji Hoyoun Jung Jukyung Jung Sunwoo Jung Yoojin Jung Deokyeong Kang Dongwoo Kang Minji Kang Bitna Keum Boeun Kim Daehui Kim Dohun Kim Doyoung Kim Eunju Kim Jeongho Kim Jeongjun Kim Jeongyeop Kim Jin Hwan Kim Jinhyeon Kim Jiyeon Kim JooYoun Kim Junwoo Kim Kijung Kim MiHyeon Kim Minju Kim Minwook Kim Seunghyun Kim Songyeon Kim Sooyoung Kim Suhyun Kim Taehyeong Kim Taewon Kim Woohyun Kim Yeonjae Kim Youngjin Kim Youngmin Kim Yuseon Kim Junseok KOH Seung Hyun Kong Minji Kwon Myungeun Kwon Soongu Kwon Young S. Kwon Younggu Kwon Ahyun Lee Chaejeong Lee Donsoo Lee Eunkyeong Lee Eunyoung Lee Gyu-Cheol Lee Honghee Lee Hyosun Lee Jaedong Lee Jaeyong Lee Jehoon Lee Jieun Lee Jisoo Lee Minho Lee Sangwook Lee Sangyun Lee Sejung Lee Seongmin Lee SeungJu Lee Siyoon Lee Songwoo Lee Soseon Lee Sung-Min Lee Wonseok Lee Wonyoung Lee Yuna Lee Yunji Lee Zucheul Lee Jeehyun Lim Seong Hoon Lim Jiwon Moon Sangha Nam Minsung Noh Myunggyo Oh Chanwon Ok Hanna Park Heuicheol Park HyoungJun Park Jaehyoung Park Jungsuk Park Junmo Park Kyoungsoo Park Seongheum Park Sungcheol Park Sungyoun Park Wanjin Park Wonjae Park Yunjin Park Kyoungmin Roh Hwijung Ryu Hyeontae Seo Jiyoung Seo Youngkyung Seo Eunbi Seol Jeongyong Shim Donghoon Shin Jisu Shin Hyoseop Song Seonyeong Song Keehoon Sung Seyoun Won Jungwon Yoon Kyung-A Yoon Hyewon Yu Taeyang Yun 38