As inference workloads move into physical environments, latency becomes a liability, a variable that can’t be abstracted away ...