Sources of Latency

• Actual network transmission time
• Network interface and routing overhead
• Message formatting and tag handling
• Unreliable transport mechanisms
• Interrupt and context switch overhead
• Memory-based buffering
• OS-level protocols (e.g., BSD sockets)
• Constructed collective operations
• User-level messaging libraries (e.g., PVM)