Would it be possible for you to use spot instances? This brings down our costs substantially when paired with AWS batch. Answer from adamavfc on reddit.com
🌐
Bash Prompt
bash-prompt.net › guides › aws-gpu-spot
How To Get A Cheap AWS GPU Spot Instance
November 23, 2020 - The cheapest option is the g4dn.4xlarge. This is the page that allows you to select a spot instance and get a GPU at a discount.
Discussions

Suggest instance type NVIDIA GPU has the best cost
AWS Interconnect - multicloud is ... Gateway, AWS Cloud WAN, and Amazon VPC to other cloud service providers with ease. ... My system is using the EC2 g4dn.xlarge instance type to run stable diffusion or train lora. Currently I want to find an NVIDIA GPU type version that ... More on repost.aws
🌐 repost.aws
3
0
August 9, 2024
python - How to activate the use of a GPU on AWS EC2 instance? - Stack Overflow
I have tested it on a g5.xlarge, documented at: https://aws.amazon.com/ec2/instance-types/g5/ which I believe is currently the most powerful single Nvidia GPU machine available (Nvidia A10G) as of December 2023. Make sure to use a US region as they are cheaper there, us-east-1 (North Virginia) was one of the cheapest ... More on stackoverflow.com
🌐 stackoverflow.com
Cheapest NVIDIA GPU Instance?
Would it be possible for you to use spot instances? This brings down our costs substantially when paired with AWS batch. More on reddit.com
🌐 r/aws
8
6
September 1, 2022
A tool for finding + launching the cheapest AWS GPU spot instances for ML.
Beginners -> /r/mlquestions or /r/learnmachinelearning , AGI -> /r/singularity, career advices -> /r/cscareerquestions, datasets -> r/datasets · Create your account and connect with a world of communities More on reddit.com
🌐 r/MachineLearning
24
36
December 10, 2015
🌐
Network World
networkworld.com › home › cloud computing › iaas › amazon web services
AWS cuts prices of some EC2 Nvidia GPU-accelerated instances | Network World
September 9, 2025 - For three-year periods, costs on P4d on the Instance Savings Plan will decrease by 25%. The Compute Savings plan is not available for the same period. P4de instances get the same reduction as P4d instances across all plans. For P5 and P5en ...
🌐
AWS
aws.amazon.com › blogs › aws › announcing-up-to-45-price-reduction-for-amazon-ec2-nvidia-gpu-accelerated-instances
Announcing up to 45% price reduction for Amazon EC2 NVIDIA GPU-accelerated instances | AWS News Blog
June 7, 2025 - Today, we’re announcing up to 45 percent price reduction for Amazon Elastic Compute Cloud (Amazon EC2) NVIDIA GPU-accelerated instances: P4 (P4d and P4de) and P5 (P5 and P5en) instance types.
🌐
CloudOptimo
cloudoptimo.com › home › blog › aws announces significant price reductions for nvidia gpu ec2 instances
AWS Announces Significant Price Reductions for NVIDIA GPU EC2 Instances
June 24, 2025 - For example, if P6-B200 instances cost roughly $80/hr On-Demand, Savings Plans might lower that to about $56/hr, making these very large GPU clusters more financially accessible for continuous workloads.
🌐
Doit
compute.doit.com › gpu
AWS GPU Instance Pricing | P5, G6, G5 Spot Price Comparison
Compare AWS GPU instance spot prices across P5, P4, P3, G6, G5, G4, G3 families. Find the most affordable GPU instances for ML, AI, rendering and HPC workloads.
🌐
Thundercompute
thundercompute.com › blog › cheapest-cloud-gpu-providers-in-2025
Cheapest GPU Clouds (December 2025)
Modal is built on top of GPUs provided by Oracle Cloud, with support for AWS, GCP, and Azure. The major drawback is cost, Modal is often the most expensive cloud provider on a per-hour basis. Vast.ai is another low-cost marketplace for renting GPUs. Vast.ai is primarily container-based, although they have begun rolling out support for traditional Virtual Machines. Similarly to TensorDock, users frequently complain about reliability and setup issues, where instances may randomly disappear.
Find elsewhere
🌐
Hacker News
news.ycombinator.com › item
AWS has V100's available so most Universities with a decent budget should be abl... | Hacker News
September 4, 2020 - Meanwhile the GPUs cost $56,000 total. So the numbers aren't really very far off · I think you are confusing this with AWS Elastic Inference
🌐
Quora
quora.com › How-many-GPUs-can-you-have-per-one-AWS-EC2-instances
How many GPUs can you have per one AWS EC2 instances? - Quora
Answer (1 of 2): There are so many combinations - see: Instance Type Explorer - Amazon Web Services If the question is “what is the biggest or most powerful GPU”, as of this writing, I believe it’s the [code ]p4d.24xlarge [/code] instance. But, I can’t just get one.
🌐
Google Cloud
cloud.google.com › compute › gpus-pricing
GPU pricing | Google Cloud
See the estimated costs of your instances and Compute Engine resources when you create them in the Google Cloud console. Estimate your total project costs with the Google Cloud Pricing Calculator. View and download prices from the Pricing Table in the Google Cloud console. View more information about costs and usage in Cloud Billing reports. Use the Cloud Billing Catalog API for programmatic access to SKU information. You can attach one or more GPUs ...
🌐
AWS
docs.aws.amazon.com › deep learning ami › developer guide › getting started with dlami › choosing a dlami instance type › recommended gpu instances
Recommended GPU Instances - AWS Deep Learning AMIs
1 week ago - We recommend a GPU instance for most deep learning purposes. Training new models is faster on a GPU instance than a CPU instance.
🌐
AWS
aws.amazon.com › amazon ec2 › instance types › g4 instances
Amazon EC2 G4 Instances — Amazon Web Services (AWS)
2 days ago - For Nearmap, the impact of upgrading to Amazon EC2 G4 instances was immediate and profound: the company was able to run three times as much data for the same cost as on Amazon EC2 G2 instances, in a process that felt effortless and whose integration felt seamless with the AWS tools it was already ...
🌐
Vantage
vantage.sh › blog › aws-ec2-gpu-instances-g-family-vs-p-family-g4dn
EC2 GPU Instances | Vantage
Fortunately, for companies looking to harness GPU compute power, they can rent GPU from cloud providers like Amazon, instead of investing in expensive hardware upfront. Amazon has several EC2 instance options with GPU, categorized into the G and P families, which we will compare, mainly focusing on use case and price.
🌐
Vantage
handbook.vantage.sh › aws › reference › aws-gpu-instances
AWS GPU Instances | Cloud Cost Handbook - Cloud Cost Handbook
This table is generated by transform_gpus.py in GitHub, with data from the Instances codebase.
🌐
AWS
aws.amazon.com › amazon ec2 › instance types › g5 instances
Amazon EC2 G5 Instances | Amazon Web Services
2 days ago - G5 instances are built on the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor which delivers practically all of the compute and memory resources of the host hardware to your instances for better overall performance and security.
🌐
TRG Datacenters
trgdatacenters.com › resource › aws-gpu-pricing
AWS GPU Pricing Explained: Costs & Optimization Guide | TRG Datacenters
April 10, 2025 - Whether you’re training machine learning models, running simulations, or rendering high-quality graphics, choosing the right GPU instance at the right price can significantly impact your business operations or performance. This comprehensive guide breaks down AWS GPU pricing, we’ll explore different pricing models and all the factors that could influence costs, and practical strategies to optimize your expenses.
🌐
AWS
aws.amazon.com › amazon ec2 › pricing › on-demand pricing
EC2 On-Demand Instance Pricing
2 days ago - Amazon also provides you with additional instances for Amazon EC2 running Microsoft Windows with SQL Server, Amazon EC2 running SUSE Linux Enterprise Server, and Amazon EC2 running Red Hat Enterprise Linux. Notice: Red Hat has made an update to their cloud pricing model for Red Hat Enterprise Linux (RHEL). On July 1, 2024 pricing for EC2 RHEL changed to a per-vCPU-hour based pricing model. Learn about the new prices in the RHEL on AWS ...
🌐
Lambda
lambda.ai › instances
Instances | Lambda
November 17, 2025 - Automate with the Lambda Cloud API to create, stop, and restart instances from your CLI, CI/CD, or orchestration scripts. Transparent pricing with no egress fees. ... Turnkey performance: Full GPU access, zero throttling, and an optimized ML stack with essential tools like PyTorch and CUDA pre-installed via Lambda Stack.