Amazon Web Services announced the SageMaker HyperPod Global Inference Gateway, a single managed endpoint that routes inference requests across multiple clusters, in one Region or across Regions. The gateway selects the best-suited cluster, carries traffic over the AWS backbone via PrivateLink, and fails over automatically when a cluster fails. Requests are authenticated with SigV4 and IAM, and customers no longer need to build their own load balancers, DNS, or cross-Region networking.
No score is assigned. Sources and their independence are shown in the citation chain below.