Bizarim
Menu

Research library

Search papers on equipment connectivity, quality inspection, production analysis, and manufacturing work.

Search and filter

Paper list

T13. Edge AI, streaming inference, and resource scheduling

Running models near the machine under limited compute and latency budgets.

  1. T13-1Structural parallel

    Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge

    Authors
    Yiping Kang, Johann Hauswald, Cao Gao, Austin Rovinski, Trevor Mudge, Jason Mars, Lingjia Tang
    Year
    2017
    Venue
    ASPLOS 2017, pp. 615-629

    Korean review of T13-1

  2. T13-2Similar problem

    Live Video Analytics at Scale with Approximation and Delay-Tolerance

    Authors
    Haoyu Zhang, Ganesh Ananthanarayanan, Peter Bodik, Matthai Philipose, Paramvir Bahl, Michael J. Freedman
    Year
    2017
    Venue
    USENIX NSDI 2017, pp. 377-392

    Korean review of T13-2

  3. T13-3Similar problem

    AWStream: Adaptive Wide-Area Streaming Analytics

    Authors
    Ben Zhang, Xin Jin, Sylvia Ratnasamy, John Wawrzynek, Edward A. Lee
    Year
    2018
    Venue
    ACM SIGCOMM 2018, pp. 236-252

    Korean review of T13-3

  4. T13-4Similar problem

    Chameleon: Scalable Adaptation of Video Analytics

    Authors
    Junchen Jiang, Ganesh Ananthanarayanan, Peter Bodik, Siddhartha Sen, Ion Stoica
    Year
    2018
    Venue
    ACM SIGCOMM 2018, pp. 253-266

    Korean review of T13-4

  5. T13-5Similar problem

    Reducto: On-Camera Filtering for Resource-Efficient Real-Time Video Analytics

    Authors
    Yuanqi Li, Arthi Padmanabhan, Pengzhan Zhao, Yufei Wang, Guoqing Harry Xu, Ravi Netravali
    Year
    2020
    Venue
    ACM SIGCOMM 2020, pp. 359-376

    Korean review of T13-5

  6. T13-6Structural parallel

    Ekya: Continuous Learning of Video Analytics Models on Edge Compute Servers

    Authors
    Romil Bhardwaj, Zhengxu Xia, Ganesh Ananthanarayanan, Junchen Jiang, Yuanchao Shu, Nikolaos Karianakis, Kevin Hsieh, Paramvir Bahl, Ion Stoica
    Year
    2022
    Venue
    USENIX NSDI 2022, pp. 119-135

    Korean review of T13-6

  7. T13-7Structural parallel

    Clipper: A Low-Latency Online Prediction Serving System

    Authors
    Daniel Crankshaw, Xin Wang, Giulio Zhou, Michael J. Franklin, Joseph E. Gonzalez, Ion Stoica
    Year
    2017
    Venue
    USENIX NSDI 2017, pp. 613-627

    Korean review of T13-7

  8. T13-8Structural parallel

    Serving DNNs like Clockwork: Performance Predictability from the Bottom Up

    Authors
    Arpan Gujarati, Reza Karimi, Safya Alzayat, Wei Hao, Antoine Kaufmann, Ymir Vigfusson, Jonathan Mace
    Year
    2020
    Venue
    USENIX OSDI 2020, pp. 443-462

    Korean review of T13-8

  9. T13-9Candidate approach

    INFaaS

    Authors
    Francisco Romero, Qian Li, Neeraja J. Yadwadkar, Christos Kozyrakis
    Year
    2021
    Venue
    USENIX ATC 2021, pp. 397-411

    Korean review of T13-9

  10. T13-10Candidate approach

    Orca: A Distributed Serving System for Transformer-Based Generative Models

    Authors
    Gyeong-In Yu, Joo Seong Jeong, Geon-Woo Kim, Soojeong Kim, Byung-Gon Chun
    Year
    2022
    Venue
    USENIX OSDI 2022, pp. 521-538

    Korean review of T13-10

  11. T13-11Candidate approach

    Efficient Memory Management for Large Language Model Serving with PagedAttention

    Authors
    Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, Ion Stoica
    Year
    2023
    Venue
    ACM SOSP 2023, pp. 611-626

    Korean review of T13-11

  12. T13-12Candidate approach

    Gandiva: Introspective Cluster Scheduling for Deep Learning

    Authors
    Wencong Xiao, Romil Bhardwaj, Ramachandran Ramjee, Muthian Sivathanu, Nipun Kwatra, Zhenhua Han, Pratyush Patel, Xuan Peng, Hanyu Zhao, Quanlu Zhang, Fan Yang, Lidong Zhou
    Year
    2018
    Venue
    USENIX OSDI 2018, pp. 595-610

    Korean review of T13-12

  13. T13-13Candidate approach

    Tiresias: A GPU Cluster Manager for Distributed Deep Learning

    Authors
    Juncheng Gu, Mosharaf Chowdhury, Kang G. Shin, Yibo Zhu, Myeongjae Jeon, Junjie Qian, Hongqiang Liu, Chuanxiong Guo
    Year
    2019
    Venue
    USENIX NSDI 2019, pp. 485-500

    Korean review of T13-13

  14. T13-14Candidate approach

    AntMan: Dynamic Scaling on GPU Clusters for Deep Learning

    Authors
    Wencong Xiao, Shiru Ren, Yong Li, Yang Zhang, Pengyang Hou, Zhi Li, Yihui Feng, Wei Lin, Yangqing Jia
    Year
    2020
    Venue
    USENIX OSDI 2020, pp. 533-548

    Korean review of T13-14

  15. T13-15Candidate approach

    Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

    Authors
    Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, Amar Phanishayee, Matei Zaharia
    Year
    2020
    Venue
    USENIX OSDI 2020, pp. 481-498

    Korean review of T13-15

  16. T13-16Candidate approach

    Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning

    Authors
    Aurick Qiao, Sang Keun Choe, Suhas Jayaram Subramanya, Willie Neiswanger, Qirong Ho, Hao Zhang, Gregory R. Ganger, Eric P. Xing
    Year
    2021
    Venue
    USENIX OSDI 2021, pp. 1-18

    Korean review of T13-16

  17. T13-17Structural parallel

    MLPerf Inference Benchmark

    Authors
    Vijay Janapa Reddi, Christine Cheng, David Kanter, Peter Mattson, Guenther Schmuelling, Carole-Jean Wu (47 authors in total)
    Year
    2020
    Venue
    ACM/IEEE ISCA 2020, pp. 446-459

    Korean review of T13-17

  18. T13-18Similar problem

    MillWheel: Fault-Tolerant Stream Processing at Internet Scale

    Authors
    Tyler Akidau, Alex Balikov, Kaya Bekiroğlu, Slava Chernyak, Josh Haberman, Reuven Lax, Sam McVeety, Daniel Mills, Paul Nordstrom, Sam Whittle
    Year
    2013
    Venue
    Proceedings of the VLDB Endowment, Vol. 6, No. 11, 2013, pp. 1033-1044

    Korean review of T13-18

  19. T13-19Similar problem

    The Dataflow Model: A Practical Approach to Balancing Correctness, Latency, and Cost in Massive-Scale, Unbounded, Out-of-Order Data Processing

    Authors
    Tyler Akidau, Robert Bradshaw, Craig Chambers, Slava Chernyak, Rafael J. Fernandez-Moctezuma, Reuven Lax, Sam McVeety, Daniel Mills, Frances Perry, Eric Schmidt, Sam Whittle
    Year
    2015
    Venue
    Proceedings of the VLDB Endowment, Vol. 8, No. 12, 2015, pp. 1792-1803

    Korean review of T13-19

From research to product use

Operating capabilities, pilots, and technologies in development are identified separately.

View technology