Research library

Search papers on equipment connectivity, quality inspection, production analysis, and manufacturing work.

Search and filter

Paper list

T02. Recursive language models and long-context handling

Research on reading documents that do not fit in one context window.

  1. T02-1Structural parallelSince 2025

    Recursive Language Models

    Authors
    Alex L. Zhang, Tim Kraska, Omar Khattab
    Year
    2026
    Venue
    arXiv (MIT CSAIL)

    Korean review of T02-1

  2. T02-2Structural parallel

    RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval

    Authors
    Parth Sarthi, Salman Abdullah, Aditi Tuli, Shubh Khanna, Anna Goldie, Christopher D. Manning
    Year
    2024
    Venue
    ICLR 2024

    Korean review of T02-2

  3. T02-3Similar problem

    Walking Down the Memory Maze: Beyond Context Limit through Interactive Reading (MemWalker)

    Authors
    Howard Chen, Ramakanth Pasunuru, Jason Weston, Asli Celikyilmaz
    Year
    2023
    Venue
    arXiv

    Korean review of T02-3

  4. T02-4Candidate approach

    MemGPT: Towards LLMs as Operating Systems

    Authors
    Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Ion Stoica, Joseph E. Gonzalez
    Year
    2023
    Venue
    arXiv (UC Berkeley)

    Korean review of T02-4

  5. T02-5Structural parallel

    Chain of Agents: Large Language Models Collaborating on Long-Context Tasks

    Authors
    Yusen Zhang, Ruoxi Sun, Yanfei Chen, Tomas Pfister, Rui Zhang, Sercan O. Arik
    Year
    2024
    Venue
    NeurIPS 2024

    Korean review of T02-5

  6. T02-6Similar problem

    Lost in the Middle: How Language Models Use Long Contexts

    Authors
    Nelson F. Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, Percy Liang
    Year
    2023
    Venue
    Transactions of the ACL (TACL)

    Korean review of T02-6

  7. T02-7Similar problem

    RULER: What's the Real Context Size of Your Long-Context Language Models?

    Authors
    Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, Yang Zhang, Boris Ginsburg
    Year
    2024
    Venue
    COLM 2024

    Korean review of T02-7

  8. T02-8Candidate approach

    LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

    Authors
    Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu
    Year
    2024
    Venue
    ACL 2024

    Korean review of T02-8

  9. T02-9Structural parallel

    Recursively Summarizing Books with Human Feedback

    Authors
    Jeff Wu, Long Ouyang, Daniel M. Ziegler, Nisan Stiennon, Ryan Lowe, Jan Leike, Paul Christiano
    Year
    2021
    Venue
    arXiv (OpenAI)

    Korean review of T02-9

  10. T02-10Candidate approach

    Efficient Streaming Language Models with Attention Sinks (StreamingLLM)

    Authors
    Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
    Year
    2024
    Venue
    ICLR 2024

    Korean review of T02-10

  11. T02-11Similar problem

    LongBench: A Bilingual, Multitask Benchmark for Long Context Understanding

    Authors
    Yushi Bai, Xin Lv, Jiajie Zhang, Hongchang Lyu, Jiankai Tang, Zhidian Huang, Zhengxiao Du, Xiao Liu, Aohan Zeng, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
    Year
    2024
    Venue
    ACL 2024

    Korean review of T02-11

  12. T02-12Candidate approach

    Ring Attention with Blockwise Transformers for Near-Infinite Context

    Authors
    Hao Liu, Matei Zaharia, Pieter Abbeel
    Year
    2023
    Venue
    arXiv (UC Berkeley)

    Korean review of T02-12

  13. T02-13Candidate approach

    Extending Context Window of Large Language Models via Positional Interpolation

    Authors
    Shouyuan Chen, Sherman Wong, Liangjian Chen, Yuandong Tian
    Year
    2023
    Venue
    arXiv (Meta)

    Korean review of T02-13

  14. T02-14Candidate approach

    Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

    Authors
    Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal
    Year
    2024
    Venue
    arXiv (Google)

    Korean review of T02-14

  15. T02-15Candidate approach

    H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

    Authors
    Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Re, Clark Barrett, Zhangyang Wang, Beidi Chen
    Year
    2023
    Venue
    NeurIPS 2023

    Korean review of T02-15

From research to product use

Operating capabilities, pilots, and technologies in development are identified separately.

View technology