slide 20 of 32

Communication Latency

• Minimum time to transmit one object, including all overhead
• Minimum useful grain size
  • Suppose latency = L
  • If sequential code executes in < 2*L, parallel execution will yield slowdown!