← Back to the wire

Introducing Amazon SageMaker HyperPod Global Inference Gateway: One endpoint across Regions and clusters

AnnouncementProductNov 20, 2026

Amazon Web Services announced the SageMaker HyperPod Global Inference Gateway, a single managed endpoint that routes inference requests across multiple clusters, in one Region or across Regions. The gateway selects the best-suited cluster, carries traffic over the AWS backbone via PrivateLink, and fails over automatically when a cluster fails. Requests are authenticated with SigV4 and IAM, and customers no longer need to build their own load balancers, DNS, or cross-Region networking.

Receipt № 30041 source · awaiting confirmation ◐

Evidence

1source· awaiting independent confirmation

No score is assigned. Sources and their independence are shown in the citation chain below.

Citation chain · 1 source

01high
aws.amazon.comOfficialhttps://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/This Amazon Web Services announcement explains the Global Inference Gateway's mechanics, including cluster publishing, the request flow, and beta customer feedback on cross-Region failover.
PRIMARY
Amazon Web ServicesCompany
Canonical: https://aws.amazon.com/blogs/machine-learning/introducing-amazon-sagemaker-hyperpod-global-inference-gateway-one-endpoint-across-regions-and-clusters/