2 days ago - Compared to comparable instances they offer up to 45% better price performance for graphics-intensive applications. ... G4dn instances, powered by NVIDIA T4 GPUs, are the lowest cost GPU-based instances in the cloud for machine learning inference and small scale training.

Discover more about what's new at AWS with Pricing and usage model updates for Amazon EC2 instances accelerated by NVIDIA GPUs

June 7, 2025 - Today, we’re announcing up to 45 percent price reduction for Amazon Elastic Compute Cloud (Amazon EC2) NVIDIA GPU-accelerated instances: P4 (P4d and P4de) and P5 (P5 and P5en) instance types.

April 10, 2025 - Although the pricing models are straightforward, there are several factors that can influence the prices widely. Understanding these factors is key before committing to AWS GPU services: These factors include: Instance and GPU Types. The type of instance-based GPUs you choose will significantly impact your costs. For example, NVIDIA A100 GPUs are more expensive than P2 instances equipped with NVIDIA K80 GPUs.

2 days ago - G5 instances feature up to 8 NVIDIA and second generation AMD EPYC processors. They also support up to 192 vCPUs, up to 100 Gbps of network bandwidth, and up to 7.6 TB of local NVMe SSD storage. ... G5 instances deliver up to 3x higher graphics performance and up to 40% better price performance than G4dn instances. They have more ray tracing cores than any other GPU-based EC2 instance, feature 24 GB of memory per GPU, and support NVIDIA RTX technology.

June 24, 2025 - For example, if P6-B200 instances ... accessible for continuous workloads. ... AWS Spot Instances often cost 60–70% less than On-Demand rates, but prices usually track the baseline....

It supports NVIDIA GPUs, making it ideal for machine learning, data analytics, and rendering tasks. Users can leverage advanced security features and automatic updates, ensuring reliable performance and compliance. This AMI is perfect for developers and data scientists looking to accelerate their workflows while benefiting from the flexibility and scalability of the AWS cloud.

This table is generated by transform_gpus.py in GitHub, with data from the Instances codebase. For more detailed information about matching CUDA compute capability, CUDA gencode, and ML framework version for various NVIDIA architectures, please see this up-to-date resource.

List of Amazon Elastic Compute Cloud (EC2) instance types with Accelerators (GPU). Sorted by GPU count.

NVIDIA accelerates innovation by eliminating the complex do-it-yourself task of building and optimizing a complete deep learning software stack tuned specifically for GPUs. ... You can now purchase comprehensive solutions tailored to use cases and industries. ... AWS Marketplace now accepts line of credit payments through the PNC Vendor Finance program.

Critics have pointed out that EC2 has very few GPU options available given the market dominance that AWS enjoys in cloud computing generally. But what AWS lacks in options and configuration speed, they make up for in pricing power and volume discount.

1 week ago - Amazon EC2 instances, powered by NVIDIA GPUs, accelerate training and inference for increasingly complex LLMs and compute-intensive generative AI applications. NVIDIA NIM and NeMo microservices, part of NVIDIA AI Enterprise in the AWS Marketplace, enables organizations to unlock the potential of generative AI and LLMs at scale.

The g4dn.xlarge instance is in the GPU instance family with 4 vCPUs, 16 GiB of memory and up to 25 Gibps of bandwidth starting at $0.526 per hour.

September 9, 2025 - For three-year periods, costs on P4d on the Instance Savings Plan will decrease by 25%. The Compute Savings plan is not available for the same period. P4de instances get the same reduction as P4d instances across all plans. For P5 and P5en instances, AWS has reduced prices by 44% and 25%, respectively, under the On-demand plan.

This is a calculator to give you a rough estimate for what your team's GPU costs on AWS for Deep Learning based on their usage patterns.

If you're looking for the cheapest GPU, based on our data that'd be the Nvidia K620 offered by Database Mart at $0.03/hour (or $21.60/month). Here's a selection of the most affordable cloud providers by GPU (1324 price points, on-demand preferred):

March 20, 2024 - g4ad.xlarge with GPU RAM of 8 GiB has an on demand cost of $3315.9228 annually which appears to be the cheapest GPU VM option provided by AWS from my review. Is this correct or is there a cheaper option?