SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints

SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints. It centres on Inference, and also names Amazon and NVIDIA. Reported by AWS. Bharat Hunt files it under AI Hardware and AI Models — the section covering chips, accelerators, data centres, on-device inference and supply.

Written by Bharat Hunt from the headline and the coverage below. The original reporting is the source of truth.