Lesson 24: Scheduling Computations on NVIDIA GPUs (cont'd)

Outline:

  1. Experiments to answer GPU-scheduling questions
    • Experiment #1: single stream
    • Experiment #2: multiple streams
    • Experiment #3: cutting ahead
    • Experiment #4: low-priority starvation
    • Experiment #5: NULL stream
  2. Future work on GPU scheduling
  3. A look ahead: SRT optimality results

Reading assignment (to be completed by the next class):

  • Amert, Tanya, Nathan Otterness, Ming Yang, James H. Anderson, and F. Donelson Smith. “GPU scheduling on the NVIDIA TX2: Hidden details revealed.” In 2017 IEEE Real-Time Systems Symposium (RTSS), pp. 104-115. IEEE, 2017. [paper] [presentation]
    • Read: Sec. 3-5