Research library

Search papers on equipment connectivity, quality inspection, production analysis, and manufacturing work.

Search and filter

New paper summaries

Summaries are editorial notes, not statements by the original authors. Check the original paper. Updated 2026-11-20.

  1. 99Architecture

    Stronger Normalization-Free Transformers

    • Traditional normalization layers such as Batch Norm and Layer Norm stabilize deep neural network training but incur overhead from memory access and synchronization and remain sensitive to batch size.
    • Existing normalization-free methods like Dynamic Tanh (DyT) achieve performance comparable to normalization, but they do not systematically surpass it, leaving room for further improvement.
    • There has been a lack of systematic understanding of how the intrinsic properties of pointwise functions affect training dynamics and model performance in normalization-free Transformers.
    • The paper systematically analyzes four intrinsic properties of pointwise functions, zero-centeredness, boundedness, central sensitivity, and monotonicity, to derive design principles for effective normalization-free Transformer components.
    • Based on these principles, the authors extensively explore pointwise functions empirically and identify the error function (erf) as the best-performing design.
    • They develop Dynamic erf (Derf), a pointwise function parameterized as "γ × erf(αx+s)+β" by applying scale, shift, and bias parameters to the error function, which serves as a statistically independent alternative that directly replaces all normalization layers in Transformer architectures.
  2. 98Cybersecurity / Agents

    Comparing AI Agents to Cybersecurity Professionals in Real-World Penetration Testing

    • Existing AI cybersecurity benchmarks are often run in abstract environments, so they lack the operational realism and complexity of live production systems.
    • There has been a substantial gap in empirically comparing AI agents with human cybersecurity experts on penetration testing against real operational systems.
    • Current AI agent architectures for offensive security often struggle with context management and long-horizon tasks in dynamic operational environments.
    • We compared human cybersecurity experts with diverse AI agents on a large, heterogeneous real-world university enterprise network with 8,000 hosts and 12 subnets.
    • We introduced ARTEMIS, a new multi-agent AI scaffold designed for complex cybersecurity tasks, featuring a supervisor agent, subagents, dynamic prompt generation, and a triage module.
    • We developed a unified scoring system that quantifies vulnerability discovery based on business impact, reflecting technical complexity and weighting, enabling direct comparison across participants.
  3. 97Benchmarks / Factuality

    The FACTS Leaderboard: A Comprehensive Benchmark for Large Language Model Factuality

    • Large language models frequently generate factually incorrect information, which undermines reliable deployment in real-world applications.
    • Existing benchmarks for LLM factuality often focus on narrow abilities, such as context-grounded or general knowledge recall, and therefore fail to provide a holistic evaluation.
    • Real LLM applications require combinations of factual capabilities across different modalities and knowledge sources, which current evaluation frameworks do not adequately cover.
    • The FACTS Leaderboard consists of four separate sub-leaderboards, FACTS Multimodal, FACTS Parametric, FACTS Search, and FACTS Grounding v2, each of which evaluates a specific dimension of LLM factuality.
    • The benchmark evaluates model responses across thousands of diverse questions using sophisticated automatic judges that have been rigorously validated against human annotations.
    • Kaggle conducts all evaluations fairly, with public and private data splits that preserve benchmark integrity and reduce overfitting.
  4. 96RAG

    CLaRa: Bridging Retrieval and Generation with Continuous Latent Reasoning

    • Traditional retrieval-augmented generation systems suffer from separate optimization, where the retriever and generator are optimized independently, which creates a mismatch between retrieved information and the generator's actual needs.
    • RAG systems often process long, uncompressed text contexts, which leads to high inference cost, redundant text handling, context overflow in LLMs, and a structural mismatch between embedding-based retrieval and raw-text-based generation.
    • The discrete nature of document selection in retrieval blocks direct gradient flow from the generator back to the retriever, which hinders true end-to-end joint learning and alignment of the retriever with downstream tasks.
    • The Salient Compressor Pretraining (SCP) stage uses synthetic QA pairs and paraphrases to train the compressor to distill documents into concise, semantically rich continuous "memory tokens" that preserve key information.
    • CLaRa integrates retrieval and generation within a single end-to-end differentiable framework by jointly training the query reasoner and generator with a language modeling loss and precomputed compressed document representations.
    • It uses a Straight-Through (ST) estimator to enable gradient flow through discrete top-k document selection, allowing the query reasoner to receive weak supervision from the generator's downstream task objective.
  5. 95Code Generation / Agents

    DeepCode: Open Agentic Coding

    • Existing LLM-based coding agents struggle with information overload and context bottlenecks when converting long, multimodal scientific papers into functional code repositories.
    • Common failure modes include preserving fragmented specifications, maintaining global consistency across modules, completing underspecified designs, and ensuring end-to-end execution fidelity.
    • Existing general-purpose and specialized scientific code agents have had limited success because their reproduction scores on autonomous software engineering tasks fall far short of human experts.
    • DeepCode adopts a multi-stage framework. Blueprint Generation reduces information overload by refining raw documents into structured specifications.
    • Code Generation uses CodeMem for stateful structural indexing of the evolving codebase to ensure global consistency, and CodeRAG for conditional knowledge injection from high-quality code corpora.
    • Automated Verification and Refinement integrates static analysis with sandbox execution feedback to perform closed-loop error correction, ensuring the functional fidelity of the synthesized repository.
  6. 94Search Agents / Efficiency

    Budget-Aware Tool-Use Enables Effective Agent Scaling

    • Standard tool-augmented LLM agents lack intrinsic budget awareness, so they use resources inefficiently and quickly hit performance limits even when the tool-use budget increases.
    • There was no systematic study or formal cost metric for jointly evaluating LLM token consumption and the economic cost of external tool interactions during agent test-time scaling.
    • Agents often explore too shallowly or stop early without strategically using the extra resources they have available, which leads to suboptimal results and wasted compute.
    • The authors developed Budget Tracker, a lightweight plug-and-play module that provides agents with real-time, continuous budget awareness through prompt-level policy guidance and state updates.
    • They introduced BATS, or Budget Aware Test-time Scaling, a training-free framework that dynamically adjusts planning, including constraint decomposition and structured dynamic planning, and self-verification strategies using continuous budget awareness.
    • They formalized a unified cost metric that comprehensively covers both internal LLM token consumption and the economic cost of external tool interactions, making scaling efficiency easier to evaluate transparently.
  7. 93Agents / Theory

    Detailed balance in large language model-driven agents

    • There is no unified theoretical framework for understanding the emergent behavior of large language model (LLM)-based agents at the macroscopic level.
    • The complex internal engineering of LLM agents often produces black-box behavior, making their dynamics hard to predict or analyze.
    • Current theoretical understanding of LLMs focuses mainly on microscopic token-level properties and does not explain emergent goal-directed agent behavior.
    • We formalize the generation process of LLMs inside agents as a Markov transition process over a defined state space.
    • We hypothesize an implicit potential function (VT) for LLMs and estimate it quantitatively using a minimum-action principle.
    • Experimental validation includes measuring transition probabilities between states generated by LLMs and statistically confirming detailed balance conditions across tasks and models.
  8. 92Math Reasoning / Benchmarks

    Towards Robust Mathematical Reasoning

    • Existing mathematical reasoning benchmarks, such as GSM8K, MATH, and AIME, are approaching saturation, which limits their usefulness for distinguishing advanced model capability.
    • Many current benchmarks rely mainly on final-answer matching, which can let models guess or memorize answers without demonstrating robust multi-step reasoning.
    • There is a lack of a comprehensive evaluation framework for assessing deeper mathematical understanding, such as the ability to generate and rigorously evaluate proofs.
    • The paper introduces IMO-Bench, a comprehensive collection of three benchmarks: IMO-AnswerBench for robust problem solving, IMO-Proof Bench for rigorous proof writing, and IMO-GradingBench for proof evaluation.
    • IMO-AnswerBench uses 400 olympiad problems across four categories and applies explicit hardening techniques, such as paraphrasing and numerical changes, to prevent data memorization.
    • IMO-Proof Bench provides 60 IMO-level proof problems split into foundational and advanced sets, and it is evaluated mainly by human experts on a 0 to 7 scale that mimics traditional IMO grading.
  9. 91Research Agents

    Enterprise Deep Research: Steerable Multi-Agent Deep Research for Enterprise Analytics

    • Current autonomous agents lack domain specialization and seamless integration, making it difficult for enterprises to turn exponentially growing unstructured data into actionable insights.
    • Existing deep research systems are often opaque black boxes, lacking transparency, auditability, and real-time controllability, which makes them a poor fit for dynamic enterprise environments.
    • Most current systems are designed for open-domain web data and do not adequately handle heterogeneous, proprietary internal enterprise sources such as databases and files.
    • A modular multi-agent architecture coordinates a master research agent, specialized retrieval agents for the web, academic sources, GitHub, and LinkedIn, a visualization agent, and a Reflection mechanism for adaptive query decomposition and execution.
    • Through a Research Todo Manager that maintains a human-readable todo.md file, it introduces steerable context engineering, allowing real-time natural-language human intervention to dynamically adjust agent plans and priorities.
    • It uses an extensible Model Context Protocol (MCP)-based tool ecosystem to integrate domain-specific tools such as file analysis and NL2SQL agents, enabling reasoning over diverse proprietary enterprise data sources.
  10. 90LLMs / Reasoning

    Every Step Evolves: Scaling Reinforcement Learning for Trillion-Scale Thinking Model

    • The lack of an open-source one-trillion-parameter thinking model has made advanced reasoning capabilities less accessible to the broader AI research community.
    • Scaling reinforcement learning (RL) to a one-trillion-parameter Mixture-of-Experts (MoE) model led to substantial instability caused by training-inference mismatch.
    • Inefficiencies in handling long reasoning trajectories and system bottlenecks in RL infrastructure created major challenges at an unprecedented scale.
    • They developed Ring-1T, a one-trillion-parameter MoE model trained through a multi-stage pipeline that includes Long Chain-of-Thought supervised fine-tuning and large-scale reinforcement learning.
    • They introduced IcePop, an RL algorithm variant that stabilizes training by suppressing noisy gradient updates through bilateral masking correction for probability drift.
    • They designed C3PO++ for efficient trajectory processing with dynamic, budget-controlled partitioning, and they built ASystem, a high-performance distributed RL infrastructure tuned for the trillion-parameter scale.
  11. 89Reasoning / Inference

    Reasoning with Sampling: Your Base Model is Smarter Than You Think

    • It is unclear whether RL fundamentally teaches new reasoning capabilities to LLMs or simply sharpens already latent capabilities.
    • Current RL-based LLM post-training methods inherently require high compute cost, curated datasets, and external verifiers.
    • RL-post-trained models often suffer from diversity collapse, sacrificing multi-sample reasoning performance, pass@k, in favor of single-sample gains.
    • The base LLM's power distribution is defined by sampling from the original distribution raised to exponent α (α >= 1), which mathematically reweights the original distribution to favor higher-likelihood sequences.
    • The Metropolis-Hastings (MH) algorithm, a Markov chain Monte Carlo (MCMC) method, is used to enable approximate sampling from the unnormalized power distribution.
    • An iterative, blockwise autoregressive MCMC approach is introduced that progressively refines sequence segments, managing complexity and improving mixing time for long-sequence generation.
  12. 88Continual Learning

    Continual Learning via Sparse Memory Finetuning

    • Large language models suffer from catastrophic forgetting, meaning they lose previously learned knowledge when updated with new information.
    • Current continual-learning methods for LLMs, such as replay-based and regularization-based approaches, are often compute-heavy, data-inefficient, or require trade-offs between new learning and retaining old knowledge.
    • LLMs are usually deployed as static models after training, which limits their ability to adapt to real-time information, user feedback, and changing world knowledge.
    • This paper proposes sparse memory fine-tuning, which uses a memory hierarchy where each token accesses only a small portion of a large memory pool.
    • It applies TF-IDF-like ranking scores to identify the most knowledge-specific memory indices in a new training batch, reducing interference with general knowledge.
    • During fine-tuning, only the top t memory indices identified by TF-IDF scores are updated, while all other memory parameters and the base LLM parameters remain fixed through gradient masking.
  13. 87Vision / Compression

    DeepSeek-OCR: Contexts Optical Compression

    • As input sequence length increases, LLMs face major compute and memory challenges because computation grows quadratically, limiting their ability to handle long text contexts.
    • Existing vision encoders in vision-language models (VLMs) suffer from limitations such as complex deployment, excessive image splitting, and high activation memory consumption for high-resolution documents.
    • Traditional OCR models did not explicitly address the optimal vision-text compression ratio or the minimum number of vision tokens needed for accurate text decoding when integrated with LLMs for long-context understanding.
    • DeepSeek-OCR is an end-to-end vision-language model composed of a new 380M-parameter DeepEncoder and a DeepSeek3B-MoE decoder.
    • DeepEncoder combines SAM-base and CLIP-large with a core 16x token compressor, a two-layer convolutional neural network, to efficiently process high-resolution images, reduce activation memory, and produce only a small number of vision tokens.
    • The model supports multiple resolution modes, including a dynamic "Gundam" mode that handles ultra-high-resolution inputs through tiling, and is trained on diverse datasets spanning traditional OCR, complex synthetic images such as charts, equations, and diagrams, and general vision data.
  14. 86Benchmarks / Agents

    LiveMCP-101: Stress Testing and Diagnosing MCP-enabled Agents on Challenging Queries

    • AI agents show promising prototype performance, but they lack reliability and robustness when deployed in real, dynamic operating environments.
    • Existing benchmarks for tool-augmented LLMs are limited because they evaluate only single-step tool calls, operate in synthetic environments, or focus on low task complexity, so they miss the complexity of real tool interaction.
    • There has been no clear framework for diagnosing the concrete failure modes of agents that handle diverse, time-varying external tools.
    • We constructed LiveMCP-101, a benchmark of 101 carefully selected real-world queries that require multi-step coordination across diverse MCP-enabled tools.
    • We propose a new evaluation methodology that uses gold execution plans and parallel live execution to reflect the dynamic and evolving nature of live MCP tool responses.
    • We use a human-expert-validated LLM-as-a-judge approach to provide fine-grained scoring for both final outputs and the agent's execution trajectory.
  15. 85Reasoning / RL / Survey

    A Survey of Reinforcement Learning for Large Reasoning Models

    • The rapid success of RL in transforming LLMs into LRMs faces substantial challenges related to compute, optimal algorithm design, and scalable high-quality training data.
    • Existing RL applications for LLMs have focused mainly on human alignment, overlooking RL's potential to fundamentally improve complex reasoning abilities.
    • The lack of a unified framework for understanding and navigating the complex, fast-moving landscape of RL for reasoning models hinders systematic research and development.
    • The authors conduct a comprehensive literature review and organize the field into its foundational components: reward design, policy optimization, and sampling strategies.
    • The survey introduces and highlights reinforcement learning with verifiable rewards, or RLVR, as a key paradigm for strengthening reasoning on tasks with objective feedback.
    • It clarifies and discusses foundational questions and ongoing debates, such as RL's role in sharpening versus discovering reasoning and the interaction between RL and supervised fine-tuning, or SFT.
  16. 84Multi-Agent / Debate

    Talk Isn't Always Cheap: Understanding Failure Modes in Multi-Agent Debate

    • There is a common belief that multi-agent debate universally improves large language model performance on complex reasoning tasks.
    • There is still a limited understanding of the specific failure modes that arise when multiple LLMs interact, especially in heterogeneous groups with varied capabilities.
    • It is necessary to clarify when and why multi-agent debate can be harmful rather than beneficial.
    • The authors used a standard multi-agent debate framework in which LLMs iteratively revise their responses over multiple rounds based on peer input.
    • They conducted an empirical study with heterogeneous groups of three LLMs, GPT-4o-mini, LLaMA-3.1-8B-Instruct, and Mistral-7B-Instruct-v0.2, across three datasets, CommonSenseQA, MMLU, and GSM8K.
    • They analyzed failure patterns through sequential revision traces, social influence evaluation using the probability of answer flipping after peer agreement, and interventions designed to reduce sycophancy.
  17. 83Agents / RL

    AgentGym-RL: Training LLM Agents for Long-Horizon Decision Making through Multi-Turn Reinforcement Learning

    • There is no integrated, interactive reinforcement learning (RL) framework that can train LLM agents from scratch for complex, multi-turn, long-horizon tasks.
    • Existing methods for developing LLM agents, such as prompting and supervised fine-tuning (SFT), often rely on proprietary models or human-curated data, limiting scalability, adaptability, and intrinsic self-improvement.
    • Traditional RL applications to LLMs are mostly limited to single-turn tasks or face instability and inefficiency when extended to multi-turn agentic decision making.
    • AgentGym-RL is a modular open-source framework that separates the environment, agent, and training modules to support diverse multi-turn long-horizon tasks.
    • ScalingInter-RL is a new progressive interactive scaling strategy that adaptively increases the maximum number of turns during RL training to balance exploration and exploitation while improving optimization stability and efficiency.
    • The framework integrates a full RL pipeline that supports mainstream online RL algorithms such as PPO and GRPO, with engineering optimizations for scalability and reliability across a variety of realistic environments.
  18. 82Reasoning / Parallelism

    ParaThinker: Native Parallel Thinking as a New Paradigm to Scale LLM Test-time Compute

    • Sequential LLM reasoning shows tunnel vision, where early mistakes cause diminishing returns and stagnation even as compute increases.
    • Current depth-scaling approaches become inefficient beyond a certain point and fail to unlock further gains on complex reasoning tasks.
    • Existing parallel or search-based methods often depend on external verifiers or domain-specific components, or they add substantial extra compute.
    • ParaThinker uses a two-stage process: parallel reasoning that generates multiple independent thought paths, followed by summarization that integrates those paths into a single final answer.
    • It uses special control tokens, `think i` and `summary`, to guide the model in generating diverse reasoning paths and then merging them.
    • Thought-specific positional embeddings augment standard RoPE to resolve positional ambiguity across parallel paths, ensuring distinct processing and effective summarization.
  19. 81RL / Writing

    ACE-RL: Adaptive Constraint-Enhanced Reward for Long-form Generation Reinforcement Learning

    • Existing supervised fine-tuning approaches for long-form generation rely heavily on high-quality datasets that are scarce and expensive.
    • Current reinforcement learning, or RL, methods use coarse and subjective evaluation metrics, which fail to capture the subtle and instruction-specific requirements that matter for high-quality long-form writing.
    • LLMs struggle to consistently satisfy fine-grained, multi-faceted, and instruction-specific requirements in complex long-form generation tasks.
    • An automated pipeline using a strong LLM decomposes high-level user instructions into a verifiable checklist of constraints covering content completeness, structural logic, and stylistic formality.
    • The new reward mechanism combines length rewards with fine-grained constraint rewards, and a smaller verifier LLM evaluates whether each constraint is satisfied with a three-level judgment.
    • Training uses the Group Relative Policy Optimization, or GRPO, algorithm, which encourages the LLM to produce long-form responses that satisfy both length and instruction-specific requirements through this comprehensive reward.
  20. 80RAG / Efficiency

    REFRAG: Rethinking RAG based Decoding

    • Retrieval-augmented generation (RAG) systems that use large language models (LLMs) suffer from substantial system latency and high memory consumption when processing long retrieved contexts.
    • This creates a tradeoff in which enriching knowledge with longer contexts often reduces system efficiency and throughput.
    • General-purpose optimization for long-context reasoning in LLMs does not properly handle the RAG-specific block-diagonal attention pattern and redundant computation inherent in RAG contexts.
    • A framework using a lightweight encoder compresses RAG contexts into chunk embeddings, greatly reducing the effective input sequence length for a decoder-only LLM.
    • The encoder and decoder are aligned through a continual pretraining (CPT) scheme that includes next-paragraph prediction and reconstruction tasks, with curriculum learning used to manage complexity.
    • A reinforcement-learning policy dynamically expands important context chunks into full token sequences and compresses less important chunks, enabling flexible compression at arbitrary positions.
  21. 79Reasoning / RL

    Emergent Hierarchical Reasoning in LLMs through Reinforcement Learning

    • Despite empirical success, the mechanistic understanding of how reinforcement learning (RL) improves complex reasoning in LLMs remained unclear.
    • Puzzling phenomena during RL training, such as the aha moment and length-scaling effects, lacked a unified explanation.
    • Existing RL algorithms often apply optimization pressure indiscriminately to every generated token, which leads to inefficient learning.
    • We functionally decomposed LLM-generated tokens into high-level planning tokens, such as logical maneuvers, and low-level execution tokens, such as calculations.
    • We introduced Strategic Grams (SGs), a data-driven method that empirically identifies planning tokens without subjective manual annotation.
    • We developed Hierarchy-Aware Credit Assignment (HICRA), an RL algorithm that concentrates optimization by amplifying advantage signals on identified planning tokens.
  22. 78Research Agents / RL

    SFR-DeepResearch: Towards Effective Reinforcement Learning for Autonomously Reasoning Single Agents

    • It equips large language models, or LLMs, with advanced reasoning and tool-use capabilities so they can carry out complex, long-horizon tasks while mitigating issues such as hallucination.
    • It develops an effective autonomous single-agent system for deep research that works without rigid multi-agent orchestration and generalizes better.
    • It stabilizes reinforcement learning, or RL, for multi-turn agentic tasks, where existing methods struggle with stability and can degrade the base model's reasoning ability.
    • It develops an agentic reasoning scaffold for a specific LLM family with the minimal set of three tools, Internet search, page viewing, and a code interpreter, and an iterative single-turn workflow.
    • It builds a new synthetic data generation pipeline that produces difficult multi-hop QA and long-form report-writing tasks for agentic training.
    • It implements an end-to-end RL recipe with a length-normalized REINFORCE objective, trajectory filtering, and partial rollouts to ensure stable policy optimization over multi-turn interactions.
  23. 77Medical AI / RAG

    Retrieval-augmented reasoning with lean language models

    • State-of-the-art retrieval-augmented generation (RAG) and reasoning systems depend on large external language models, which introduce privacy and security risks in applications that handle sensitive data.
    • Deploying and running large frontier language models locally is computationally burdensome for many organizations because of their high resource demands.
    • General-purpose language models often lack deep, verifiable expertise in specialized domains, leading to inaccuracy or hallucination in critical applications.
    • The researchers used Qwen2.5-Instruct models ranging from 1.5B to 32B parameters as an efficient language-model backbone for reasoning and generation.
    • They developed a retrieval system using semantic embeddings, a vector database, and a new strategy that retrieves whole documents and summarizes them in advance to manage context length while preserving relevant information.
    • To supervise supervised fine-tuning of the lightweight language models, they generated synthetic domain-specific data with diverse user queries and detailed reasoning trajectories using high-performance models (GPT-4o and DeepSeek-R1).
  24. 76Computer Use Agents

    OpenCUA: Open Foundations for Computer-Use Agents

    • Most state-of-the-art computer-use agent, or CUA, systems are proprietary and closed-source, which makes it harder to study their capabilities, limitations, and risks.
    • There is no scalable open-source infrastructure for collecting diverse, large-scale computer-use data, including real-time user interaction and accessibility trees.
    • Existing open-source CUA datasets have limited scope, scale, and diversity, and they focus on narrow domains rather than general computer-use applications.
    • The authors developed AGENTNET TOOL, a cross-platform application that captures human computer-use demonstrations, including screen video, mouse and keyboard signals, and accessibility trees, across Windows, macOS, and Ubuntu.
    • They built AGENTNET, the first large-scale and diverse computer-use task dataset with 22,625 trajectories spanning multiple operating systems and more than 200 applications and websites.
    • To improve agent planning and error recovery, they propose a scalable training pipeline that integrates a new reflective long-chain-of-thought synthesis and multi-image history context encoding.
  25. 75Computer Use Agents

    ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents

    • The human-computer interface is inherently designed for people, which makes robust LLM-based GUI agents difficult to build because machine interaction is more complex.
    • Existing approaches such as behavior cloning suffer from scalability limits, weak generalization, and poor error recovery on diverse and complex desktop tasks.
    • Applying reinforcement learning to desktop automation has been constrained by heavy compute demands, slow convergence, instability, and entropy collapse, where policies lose exploration ability during long training.
    • The API-GUI interaction paradigm integrates direct GUI interaction with programmatic API calls, and it is complemented by an LLM-driven automation workflow for API development to improve efficiency and versatility.
    • To collect data efficiently, the team developed a scalable and reliable Ubuntu environment with distributed multi-node clustering infrastructure that can orchestrate thousands of concurrent virtual desktop environments.
    • They implemented a fully asynchronous RL framework with multi-LLM behavior cloning, step-level Group Relative Policy Optimization (GRPO) with verifiable rewards, and an Entropulse strategy for continued exploration through periodic RL-SFT alternation.
  26. 74Agents / Distillation

    Chain-of-Agents: End-to-End Agent Foundation Models via Multi-Agent Distillation and Agentic RL

    • Existing multi-agent systems, or MAS, suffer from high computational overhead, generalization issues, and a lack of end-to-end data-driven training because LLM backbones are not inherently trained for multi-turn multi-agent workflows.
    • Existing tool-integrated reasoning, or TIR, models are constrained by rigid think-act-observe workflows and do not natively support flexible multi-agent collaboration patterns.
    • Both MAS and TIR paradigms fail to make effective use of end-to-end training to learn complex, dynamic multi-agent, multi-tool orchestration within a single unified LLM.
    • The Chain-of-Agents, or CoA, paradigm integrates multi-agent collaboration inside the decoding process of a single LLM, dynamically activating role agents such as thinking, planning, and reflection as well as tool agents such as search, crawling, and code generation.
    • An agentic supervised fine-tuning, or SFT, framework distills expert-level multi-agent trajectories into CoA-compatible training data and uses progressive quality filtering to ensure high-quality, complex problem-solving patterns.
    • Agentic reinforcement learning, or RL, further refines the LLM's multi-tool orchestration policy through outcome-based rewards, strengthening strategic tool use and adaptive reasoning on demanding task-specific queries.
  27. 73Routing / Efficiency

    Beyond GPT-5: Making LLMs Cheaper and Better via Performance-Efficiency Optimized Routing

    • Balancing high performance, including accuracy and reasoning, with computational efficiency, including cost and latency, is a core challenge in advancing large language models.
    • State-of-the-art proprietary LLMs often come with substantial operating costs and resource demands, which limit broad and cost-effective deployment.
    • Existing test-time routing methods for LLMs often focus mainly on aggregate performance or add overhead by requiring complex training of additional neural networks.
    • The paper develops Avengers-Pro, a test-time routing framework that coordinates diverse LLM ensembles to dynamically select the best model for each query.
    • The framework relies on three lightweight unsupervised operations: query embedding, k-means clustering of queries, and per-cluster model-level performance-efficiency scoring.
    • During online inference, it embeds incoming queries, assigns them to the nearest cluster, and routes them to the model with the highest aggregate performance-efficiency score, adjustable by the tradeoff parameter α.
  28. 72Vision / Reasoning

    Visual Structures Helps Visual Reasoning: Addressing the Binding Problem in VLMs

    • Large vision-language models, or LVLMs, struggle with precise visual understanding such as exact counting, spatial reasoning, and detailed scene description.
    • LVLMs suffer from the binding problem, which prevents them from reliably connecting perceptual features to the correct visual objects and spatial properties in complex scenes.
    • Existing LVLMs often process visual features in parallel, which causes interference and misattribution errors, especially in cluttered environments.
    • The VISER method adds evenly spaced horizontal lines to the input image so that the image is divided into separate visual compartments or rows.
    • It prepends a short text instruction such as 'Scan the image sequentially along the horizontal lines present in the image' to the original prompt so that the LVLM processes the content region by region.
    • This lightweight, model-agnostic approach introduces only negligible compute overhead and requires no architectural changes, fine-tuning, or multi-query inference.
  29. 71Reasoning / Data

    NaturalThoughts: Selecting and Distilling Reasoning Traces for General Reasoning Tasks

    • There was no systematic understanding of which characteristics of reasoning demonstrations are most effective for distilling reasoning ability into smaller language models.
    • The prevailing Less is More hypothesis, which claims that a few handpicked examples are enough for reasoning distillation, mostly came from domain-specific settings and needs reevaluation for general reasoning.
    • Large language models often overthink and produce excessively long reasoning traces, which increases inference cost and reduces deployment efficiency in practice.
    • The authors built NaturalThoughts, a dataset that annotates reasoning traces generated by DeepSeek-R1, the teacher, for diverse NaturalReasoning questions by domain, meta-reasoning strategy, and verbosity.
    • They systematically explored data selection strategies based on diversity, such as question topic, semantic embedding, and reasoning strategy, as well as difficulty, such as answer length, verbosity, and model agreement.
    • They proposed and evaluated a mixed System 1/System 2 distillation approach, including random and difficulty-based mixtures, so student models can adjust reasoning depth at inference time.
  30. 70Research Agents / Survey

    Deep Research Agents: A Systematic Examination And Roadmap

    • Beyond existing LLMs and RAG, there is no clear definition or taxonomy for a new class of AI systems that integrate dynamic reasoning, adaptive planning, and iterative tool use.
    • There is a need to unify scattered research efforts into a single framework in order to understand common architectural patterns and foundational technologies.
    • Existing evaluation benchmarks do not adequately assess the full end-to-end capabilities of advanced AI research agents.
    • This paper formally defines deep research, or DR, agents and proposes a unified taxonomy that distinguishes static from dynamic workflows and single-agent from multi-agent systems.
    • It systematically analyzes foundational technologies, including information acquisition strategies such as API-based versus browser-based approaches, diverse tool-use capabilities such as code interpreters and multimodal processing, and memory mechanisms for optimizing long context.
    • It evaluates current tuning paradigms such as SFT, RL, and nonparametric continual learning, reviews key industry implementations, and critically assesses existing benchmarks for DR agents.

From research to product use

Operating capabilities, pilots, and technologies in development are identified separately.

View technology