Research library

Search papers on equipment connectivity, quality inspection, production analysis, and manufacturing work.

Search and filter

Paper list

T02. Recursive language models and long-context handling

Research on reading documents that do not fit in one context window.

  1. T02-4Candidate approach

    MemGPT: Towards LLMs as Operating Systems

    Authors
    Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Ion Stoica, Joseph E. Gonzalez
    Year
    2023
    Venue
    arXiv (UC Berkeley)

    Korean review of T02-4

  2. T02-8Candidate approach

    LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compression

    Authors
    Huiqiang Jiang, Qianhui Wu, Xufang Luo, Dongsheng Li, Chin-Yew Lin, Yuqing Yang, Lili Qiu
    Year
    2024
    Venue
    ACL 2024

    Korean review of T02-8

  3. T02-10Candidate approach

    Efficient Streaming Language Models with Attention Sinks (StreamingLLM)

    Authors
    Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, Mike Lewis
    Year
    2024
    Venue
    ICLR 2024

    Korean review of T02-10

  4. T02-12Candidate approach

    Ring Attention with Blockwise Transformers for Near-Infinite Context

    Authors
    Hao Liu, Matei Zaharia, Pieter Abbeel
    Year
    2023
    Venue
    arXiv (UC Berkeley)

    Korean review of T02-12

  5. T02-13Candidate approach

    Extending Context Window of Large Language Models via Positional Interpolation

    Authors
    Shouyuan Chen, Sherman Wong, Liangjian Chen, Yuandong Tian
    Year
    2023
    Venue
    arXiv (Meta)

    Korean review of T02-13

  6. T02-14Candidate approach

    Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

    Authors
    Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal
    Year
    2024
    Venue
    arXiv (Google)

    Korean review of T02-14

  7. T02-15Candidate approach

    H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models

    Authors
    Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Re, Clark Barrett, Zhangyang Wang, Beidi Chen
    Year
    2023
    Venue
    NeurIPS 2023

    Korean review of T02-15

From research to product use

Operating capabilities, pilots, and technologies in development are identified separately.

View technology