Why Not?

• Execution mode
  • Only MIMD (most often SPMD)
• Communication/synchronization model
  • Only message passing/signals or active messages
• Networks have bandwidth, but latency...?
  • Latency determines minimum grain size
  • Coarser grain means fewer applications
  • 1,000 us latency ~= 100,000 FLOP granularity