AI Inference & Serving
End-to-End Latency
Elapsed time across the complete boundary being measured, from a declared request start to a declared completion event. A client-visible completion and a server-internal completion are not automatically the same event.
Also called: E2EL
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.