PipeSwitch introduces fast pipelined context switching for deep learning applications, aiming to enable GPU-efficient multiplexing of multiple DL tasks with fine-grained time-sharing. The goal is to achieve millisecond-scale context switching overhead and high throughput, addressing the challenges o

1 views • 38 slides

PipeSwitch is a solution that enables fast and efficient context switching for deep learning applications, aiming to multiplex multiple DL apps on GPUs with minimal latency. It addresses the challenges of low GPU cluster utilization, high context switching overhead, and drawbacks of existing solutio

0 views • 46 slides