AWS

Amazon SageMaker AI inference now supports G7e instances in Asia Pacific (Seoul and Tokyo) and Europe (London). These instances utilize up to eight NVIDIA RTX PRO 6000 Blackwell GPUs, delivering 2.3x performance gains over G6e. The expansion allows for lower-latency deployment of large language models up to 70B parameters closer to end users in these regions.

• G7e instances are now live in Seoul, London, and Tokyo for lower-latency AI inference.
• Performance increases by up to 2.3x compared to previous-generation G6e instances.
• Supports models up to 70B parameters with up to 768 GB total GPU memory per instance.
• Features 5th Gen Intel Xeon CPUs and 1,600 Gbps EFA networking for high throughput.

AWS Network Load Balancer now supports listener rules that route connections to different target groups based on the source IP address type. A single dual-stack NLB can direct IPv6 client traffic to IPv6 targets and IPv4 traffic to IPv4 targets, preserving the original client IP end-to-end. This eliminates the previous trade-off of maintaining separate load balancers or losing client IP information through protocol translation.

• Route IPv6 and IPv4 traffic to same-family target groups on a single dual-stack NLB
• Preserve original client IP address end-to-end without protocol translation
• Remove need for DNS-based client splitting across separate load balancers
• Simplify architecture by handling conditional routing at Layer 3

Amazon ECS Service Connect now prioritizes service-to-service traffic within the same Availability Zone, reducing both data transfer fees and latency. The feature dynamically adjusts traffic weights as endpoints scale, maintaining balanced loads while keeping local requests local. This eliminates the previous trade-off between application resilience and cross-zone networking costs.

• Reduces cross-AZ data transfer costs by keeping intra-service traffic local to the originating AZ.
• Lowers latency for service-to-service calls through same-AZ routing prioritization.
• Dynamically adjusts traffic weights during scaling events to maintain load balance.
• Removes the need to choose between high availability and network cost efficiency.

Amazon EC2 I8ge instances are now generally available in Europe (London) and Canada (Central). Powered by AWS Graviton4 processors, these storage-optimized instances deliver up to 60% better compute performance than Graviton2-based Im4gn instances. They also provide up to 55% better real-time storage performance per TB and significantly lower I/O latency.

• I8ge instances launch in EU (London) and Canada (Central) regions today.
• Graviton4 processors offer 60% compute performance gains over Graviton2.
• Third-gen Nitro SSDs improve storage performance by 55% per TB vs Im4gn.
• Local NVMe storage scales up to 120TB with reduced I/O latency variability.
• Ideal for latency-sensitive workloads requiring rapid local storage access.

Amazon EC2 C7a instances are now available in the US West (N. California) region, offering compute-optimized performance powered by 4th Gen AMD EPYC processors. These instances deliver up to 50% higher performance than C6a, featuring AVX-512, VNNI, and bfloat16 capabilities alongside DDR5 memory for increased bandwidth. With support for up to 128 EBS volumes per instance, C7a is designed for latency-sensitive workloads requiring high-speed data access.

• C7a instances launch in US West (N. California), expanding regional availability.
• Performance up 50% over C6a using 4th Gen AMD EPYC Genoa processors.
• DDR5 memory provides 2.25x bandwidth for latency-sensitive workloads.
• Supports AVX-512, VNNI, and bfloat16 for advanced compute tasks.
• Capacity to attach up to 128 EBS volumes per instance increases flexibility.

Amazon EC2 M8a instances, powered by 5th Gen AMD EPYC processors, are now available in the Asia Pacific (Hyderabad) region. These instances offer up to 30% higher performance and 19% better price-performance than M7a, with 45% more memory bandwidth for latency-sensitive workloads. Specific benchmarks show up to 60% faster GroovyJVM and 39% faster Cassandra performance compared to previous generations.

• M8a instances use 5th Gen AMD EPYC (Turin) CPUs with 4.5 GHz max frequency.
• Up to 30% higher performance and 19% better price-performance vs M7a.
• 45% more memory bandwidth improves latency-sensitive workload handling.
• SAP-certified with 12 sizes, including 2 bare metal options.