Would it be possible for you to use spot instances? This brings down our costs substantially when paired with AWS batch. Answer from adamavfc on reddit.com
Reddit
reddit.com › r/aws › cheapest nvidia gpu instance?
r/aws on Reddit: Cheapest NVIDIA GPU Instance?
September 1, 2022 -
Which AWS instance would be the cheapest that has an available NVIDIA GPU? Is it the p2.xlarge ? Cost explorer sais this one is $800/month :O
Top answer 1 of 3
5
Would it be possible for you to use spot instances? This brings down our costs substantially when paired with AWS batch.
2 of 3
4
g4dn.xlarge has a T4 and is cheaper than p2.xlarge. g4g.xlarge g5g.xlarge is cheaper still, but you'll need software that will run on ARM. GPUs are generally expensive though - the hardware is very costly, and they are very power hungry (and thus expensive to cool too)
Bash Prompt
bash-prompt.net › guides › aws-gpu-spot
How To Get A Cheap AWS GPU Spot Instance
November 23, 2020 - The cheapest option is the g4dn.4xlarge. This is the page that allows you to select a spot instance and get a GPU at a discount.
Suggest instance type NVIDIA GPU has the best cost
AWS Interconnect - multicloud is ... Gateway, AWS Cloud WAN, and Amazon VPC to other cloud service providers with ease. ... My system is using the EC2 g4dn.xlarge instance type to run stable diffusion or train lora. Currently I want to find an NVIDIA GPU type version that ... More on repost.aws
python - How to activate the use of a GPU on AWS EC2 instance? - Stack Overflow
I have tested it on a g5.xlarge, documented at: https://aws.amazon.com/ec2/instance-types/g5/ which I believe is currently the most powerful single Nvidia GPU machine available (Nvidia A10G) as of December 2023. Make sure to use a US region as they are cheaper there, us-east-1 (North Virginia) was one of the cheapest ... More on stackoverflow.com
Cheapest NVIDIA GPU Instance?
Would it be possible for you to use spot instances? This brings down our costs substantially when paired with AWS batch. More on reddit.com
A tool for finding + launching the cheapest AWS GPU spot instances for ML.
Beginners -> /r/mlquestions or /r/learnmachinelearning , AGI -> /r/singularity, career advices -> /r/cscareerquestions, datasets -> r/datasets · Create your account and connect with a world of communities More on reddit.com
Videos
09:34
AWS Releases New Cheaper GPU Instances - G6 - YouTube
12:47
How to Select GPU Powered EC2 Instance in AWS with Cost - YouTube
07:45
Guide to Select GPU Instance on AWS for AI and ML - YouTube
49:35
AWS re:Invent 2021 - How to select Amazon EC2 GPU instances for ...
02:00
New Amazon EC2 G4ad Instances - YouTube
23:12
L3/1 Setting up a GPU instance on AWS - YouTube
Doit
compute.doit.com › gpu
AWS GPU Instance Pricing | P5, G6, G5 Spot Price Comparison
Compare AWS GPU instance spot prices across P5, P4, P3, G6, G5, G4, G3 families. Find the most affordable GPU instances for ML, AI, rendering and HPC workloads.
Thundercompute
thundercompute.com › blog › cheapest-cloud-gpu-providers-in-2025
Cheapest GPU Clouds (December 2025)
Modal is built on top of GPUs provided by Oracle Cloud, with support for AWS, GCP, and Azure. The major drawback is cost, Modal is often the most expensive cloud provider on a per-hour basis. Vast.ai is another low-cost marketplace for renting GPUs. Vast.ai is primarily container-based, although they have begun rolling out support for traditional Virtual Machines. Similarly to TensorDock, users frequently complain about reliability and setup issues, where instances may randomly disappear.
Top answer 1 of 3
2
Hello.
The following document describes the GPU-equipped instance types that can be used with EC2.
https://docs.aws.amazon.com/dlami/latest/devguide/gpu.html
I checked the prices in the price list below, and I thought that "g4dn.xlarge" was the cheapest if you were running it on demand.
https://aws.amazon.com/ec2/pricing/on-demand/?nc1=h_ls
2 of 3
0
The g4dn is among the lowest cost GPU-based instances.
If your software supports Graviton arm64, you can explore g5g instance. It is available in Regions such as Oregon us-west-2.
Hacker News
news.ycombinator.com › item
AWS has V100's available so most Universities with a decent budget should be abl... | Hacker News
September 4, 2020 - Meanwhile the GPUs cost $56,000 total. So the numbers aren't really very far off · I think you are confusing this with AWS Elastic Inference
Top answer 1 of 3
3
Checkout this answer for listing available GPUs.
from tensorflow.python.client import device_lib
def get_available_gpus():
local_device_protos = device_lib.list_local_devices()
return [x.name for x in local_device_protos if x.device_type == 'GPU']
You can also use CUDA to list the current device and, if necessary, set the device.
import torch
print(torch.cuda.is_available())
print(torch.cuda.current_device())
2 of 3
2
In the end it had to do with my tensorflow package! I had to uninstall tensorflow and install tensorflow-gpu. After that the GPU was automatically activated.
For documentation see: https://www.tensorflow.org/install/gpu
Google Cloud
cloud.google.com › compute › gpus-pricing
GPU pricing | Google Cloud
See the estimated costs of your instances and Compute Engine resources when you create them in the Google Cloud console. Estimate your total project costs with the Google Cloud Pricing Calculator. View and download prices from the Pricing Table in the Google Cloud console. View more information about costs and usage in Cloud Billing reports. Use the Cloud Billing Catalog API for programmatic access to SKU information. You can attach one or more GPUs ...
AWS
docs.aws.amazon.com › deep learning ami › developer guide › getting started with dlami › choosing a dlami instance type › recommended gpu instances
Recommended GPU Instances - AWS Deep Learning AMIs
1 week ago - We recommend a GPU instance for most deep learning purposes. Training new models is faster on a GPU instance than a CPU instance.
AWS
aws.amazon.com › amazon ec2 › instance types › g4 instances
Amazon EC2 G4 Instances — Amazon Web Services (AWS)
2 days ago - For Nearmap, the impact of upgrading to Amazon EC2 G4 instances was immediate and profound: the company was able to run three times as much data for the same cost as on Amazon EC2 G2 instances, in a process that felt effortless and whose integration felt seamless with the AWS tools it was already ...
Vantage
vantage.sh › blog › aws-ec2-gpu-instances-g-family-vs-p-family-g4dn
EC2 GPU Instances | Vantage
Fortunately, for companies looking to harness GPU compute power, they can rent GPU from cloud providers like Amazon, instead of investing in expensive hardware upfront. Amazon has several EC2 instance options with GPU, categorized into the G and P families, which we will compare, mainly focusing on use case and price.
Vantage
handbook.vantage.sh › aws › reference › aws-gpu-instances
AWS GPU Instances | Cloud Cost Handbook - Cloud Cost Handbook
This table is generated by transform_gpus.py in GitHub, with data from the Instances codebase.
AWS
aws.amazon.com › amazon ec2 › instance types › g5 instances
Amazon EC2 G5 Instances | Amazon Web Services
2 days ago - G5 instances are built on the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor which delivers practically all of the compute and memory resources of the host hardware to your instances for better overall performance and security.
TRG Datacenters
trgdatacenters.com › resource › aws-gpu-pricing
AWS GPU Pricing Explained: Costs & Optimization Guide | TRG Datacenters
April 10, 2025 - Whether you’re training machine learning models, running simulations, or rendering high-quality graphics, choosing the right GPU instance at the right price can significantly impact your business operations or performance. This comprehensive guide breaks down AWS GPU pricing, we’ll explore different pricing models and all the factors that could influence costs, and practical strategies to optimize your expenses.
AWS
aws.amazon.com › amazon ec2 › pricing › on-demand pricing
EC2 On-Demand Instance Pricing
2 days ago - Amazon also provides you with additional instances for Amazon EC2 running Microsoft Windows with SQL Server, Amazon EC2 running SUSE Linux Enterprise Server, and Amazon EC2 running Red Hat Enterprise Linux. Notice: Red Hat has made an update to their cloud pricing model for Red Hat Enterprise Linux (RHEL). On July 1, 2024 pricing for EC2 RHEL changed to a per-vCPU-hour based pricing model. Learn about the new prices in the RHEL on AWS ...
Lambda
lambda.ai › instances
Instances | Lambda
November 17, 2025 - Automate with the Lambda Cloud API to create, stop, and restart instances from your CLI, CI/CD, or orchestration scripts. Transparent pricing with no egress fees. ... Turnkey performance: Full GPU access, zero throttling, and an optimized ML stack with essential tools like PyTorch and CUDA pre-installed via Lambda Stack.