Daily | Yixun Hong

Filtered by: Inference × Clear all

Automated Tensor Scheduling for Hybrid CPU-GPU LLM Inference on Consumer Devices

Yangyijian Liu, Hongyi Ye, Mingyang Li, Wu-jun Li 2026-07-14

Scheduling GPU LLM Inference × Hardware Data

Running large language models on consumer devices such as laptops and desktops is challenging because model weights often exceed GPU memory capacity, making offloading inference necessary to extend effective model capacity with CPU memory. Existing offloading systems, however, typically rely on.

PDF

GPU-Tile-Sim: A Tile-Centric GPU Simulation Framework for LLM Hardware-Software Co-Design

Yitong Ding, Jiawei Huang, Renyang Guan, Yangjie Zhou 2026-07-14

GPU Simulation LLM Hardware Design Workload Scheduling Architecture

Modern LLM (large language model) workloads increasingly rely on optimized GPU kernels through hardware-software co-design. These kernels achieve high-performance through fine-grained dependency scheduling and computation-memory overlap.

PDF