Amazon SageMaker AI now allows ml.g6e instances in Batch Transform jobs, enabling offline prediction on large S3 datasets. These instances feature up to eight NVIDIA L40S GPUs and third-gen AMD EPYC processors, delivering higher performance for GPU-intensive tasks. This update targets workloads like large language models and generative AI models for images, video, and audio.
- Use ml.g6e types for Batch Transform jobs via SDK, CLI, or API.
- Ideal for offline inference on large datasets without persistent endpoints.
- Leverages NVIDIA L40S GPUs for improved LLM and diffusion model performance.
- Supports high-throughput generation of images, video, and audio content.