2 days ago - Compared to comparable instances they offer up to 45% better price performance for graphics-intensive applications. ... G4dn instances, powered by NVIDIA T4 GPUs, are the lowest cost GPU-based instances in the cloud for machine learning inference and small scale training.

April 10, 2025 - Although the pricing models are straightforward, there are several factors that can influence the prices widely. Understanding these factors is key before committing to AWS GPU services: These factors include: Instance and GPU Types. The type of instance-based GPUs you choose will significantly impact your costs. For example, NVIDIA A100 GPUs are more expensive than P2 instances equipped with NVIDIA K80 GPUs.

Discover more about what's new at AWS with Pricing and usage model updates for Amazon EC2 instances accelerated by NVIDIA GPUs

June 7, 2025 - Today, we’re announcing up to 45 percent price reduction for Amazon Elastic Compute Cloud (Amazon EC2) NVIDIA GPU-accelerated instances: P4 (P4d and P4de) and P5 (P5 and P5en) instance types.

It supports NVIDIA GPUs, making it ideal for machine learning, data analytics, and rendering tasks. Users can leverage advanced security features and automatic updates, ensuring reliable performance and compliance. This AMI is perfect for developers and data scientists looking to accelerate their workflows while benefiting from the flexibility and scalability of the AWS cloud.

This table is generated by transform_gpus.py in GitHub, with data from the Instances codebase. For more detailed information about matching CUDA compute capability, CUDA gencode, and ML framework version for various NVIDIA architectures, please see this up-to-date resource.

2 days ago - G5 instances feature up to 8 NVIDIA and second generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.6 TB of local NVMe SSD storage. ... G5 instances deliver up to 3x higher graphics performance and up to 40% better price performance than G4dn instances. They have more ray tracing cores than any other GPU-based EC2 instance, feature 24 GB of memory per GPU, and support NVIDIA RTX technology.

June 24, 2025 - For example, if P6-B200 instances ... accessible for continuous workloads. ... AWS Spot Instances often cost 60–70% less than On-Demand rates, but prices usually track the baseline....

1 week ago - Amazon EC2 instances, powered by NVIDIA GPUs, accelerate training and inference for increasingly complex LLMs and compute-intensive generative AI applications. NVIDIA NIM and NeMo microservices, part of NVIDIA AI Enterprise in the AWS Marketplace, enables organizations to unlock the potential of generative AI and LLMs at scale.

NVIDIA accelerates innovation by eliminating the complex do-it-yourself task of building and optimizing a complete deep learning software stack tuned specifically for GPUs. ... You can now purchase comprehensive solutions tailored to use cases and industries. ... AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program.

The g4dn.xlarge instance is in the GPU instance family with 4 vCPUs, 16 GiB of memory and up to 25 Gibps of bandwidth starting at $0.526 per hour.

Critics have pointed out that EC2 has very few GPU options available given the market dominance that AWS enjoys in cloud computing generally. But what AWS lacks in options and configuration speed, they make up for in pricing power and volume discount.

List of Amazon Elastic Compute Cloud (EC2) instance types with Accelerators (GPU). Sorted by GPU count.

September 9, 2025 - For three-year periods, costs on P4d on the Instance Savings Plan will decrease by 25%. The Compute Savings plan is not available for the same period. P4de instances get the same reduction as P4d instances across all plans. For P5 and P5en instances, AWS has reduced prices by 44% and 25%, respectively, under the On-demand plan.

NVIDIA DGX Cloud on AWS is a high-performance, turnkey, full-stack AI platform that provides co-engineered NVIDIA accelerated computing clusters optimized for AWS with flexible term lengths and access to NVIDIA experts.

This is a calculator to give you a rough estimate for what your team's GPU costs on AWS for Deep Learning based on their usage patterns.

If you're looking for the cheapest GPU, based on our data that'd be the Nvidia K620 offered by Database Mart at $0.03/hour (or $21.60/month). Here's a selection of the most affordable cloud providers by GPU (1324 price points, on-demand preferred):