● Adaptive inference runtime · v2

Takes any shape.

One API that reshapes itself around your workload — batching, routing and scaling models the moment traffic changes.

38msp50 latency
−61%GPU cost