🌐
Amazon Web Services
aws.amazon.com › machine learning › amazon sagemaker ai › pricing
SageMaker Pricing
1 week ago - Let's say you wanted to provision a cluster of 4 ml.g5.24xlarge for 1 month (30 days) with an additional 100 GB of storage per instance to support model development.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g5.2xlarge
g5.2xlarge pricing and specs - Vantage
The g5.2xlarge instance is in the GPU instance family with 8 vCPUs, 32 GiB of memory and up to 10 Gibps of bandwidth starting at $1.212 per hour.
🌐
AWS
aws.amazon.com › amazon ec2 › instance types › g5 instances
Amazon EC2 G5 Instances | Amazon Web Services
1 week ago - G5 instances deliver up to 3x higher performance and up to 40% better price performance for machine learning inference compared to G4dn instances. They are a highly performant and cost-efficient solution for customers who want to use NVIDIA libraries such as TensorRT, CUDA, and cuDNN to run their ML applications.
🌐
Cloudzero
advisor.cloudzero.com › aws › sagemaker › ml.g5.2xlarge
ml.g5.2xlarge SageMaker ML Instance Specs And Pricing
1 month ago - CloudZero's intelligent platform helps you optimize cloud costs and improve infrastructure efficiency.
🌐
Saturn Cloud
saturncloud.io › sagemaker-pricing
Amazon SageMaker Pricing | Saturn Cloud
A Comparison of Saturn Cloud's pricing VS Amazon SageMaker's Pricing
🌐
Amazon Web Services
aws.amazon.com › machine learning › amazon sagemaker › pricing
SageMaker pricing - AWS
1 week ago - The key pricing dimensions for SageMaker AI include instance usage (compute resources used in training, hosting, and notebook instances), storage (Amazon SageMaker notebooks, Amazon Elastic Block Store (Amazon EBS) volumes, and Amazon S3), data processing jobs, model deployment, and MLOps (Amazon SageMaker Pipelines and Model Monitor).
🌐
Economize
economize.cloud › resources › aws › pricing › ec2 › g5.2xlarge
g5.2xlarge pricing: $884.76 monthly - AWS EC2
1 week ago - The g5.2xlarge instance is in the g5 family with 8 vCPUs and 32 GiB of memory, priced from $1.21/hr or $884.76/mo.
🌐
Cloudforecast
cloudforecast.io › home › aws pricing & cost optimization › aws sagemaker pricing guide – cost breakdown & optimization tips
AWS SageMaker Pricing Guide - Cost Breakdown & Optimization Tips | CloudForecast
October 29, 2025 - For example, if you initially pick a ml.p3.2xlarge ($3.825/hour) for training, but see that GPU utilization is consistently below 30%, you might decide to switch to the ml.g5.2xlarge ($1.515/hour) instead.
🌐
CloudPrice
cloudprice.net › amazon web services › ec2 › g5.2xlarge
g5.2xlarge specs and pricing | AWS | CloudPrice
1 month ago - Amazon EC2 instance g5.2xlarge with 8 vCPUs, 32 GiB RAM and 1 x NVIDIA A10G 22.35 GiB. Available in 16 regions starting from $884.76 per month.
Find elsewhere
🌐
Vantage
instances.vantage.sh › aws › ec2 › g5.xlarge
g5.xlarge pricing and specs - Vantage
The g5.xlarge instance is in the GPU instance family with 4 vCPUs, 16 GiB of memory and up to 10 Gibps of bandwidth starting at $1.006 per hour.
🌐
AWS
aws.amazon.com › amazon ec2 › pricing › on-demand pricing
EC2 On-Demand Instance Pricing
1 week ago - On-Demand Instances let you pay for compute capacity by the hour or second (minimum of 60 seconds) with no long-term commitments. This frees you from the costs and complexities of planning, purchasing, and maintaining hardware and transforms what are commonly large fixed costs into much smaller ...
🌐
Cloudzero
advisor.cloudzero.com › aws › sagemaker › ml.g5.xlarge
ml.g5.xlarge SageMaker ML Instance Specs And Pricing
October 11, 2025 - CloudZero's intelligent platform helps you optimize cloud costs and improve infrastructure efficiency.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g5.12xlarge
g5.12xlarge pricing and specs - Vantage
The g5.12xlarge instance is in the GPU instance family with 48 vCPUs, 192 GiB of memory and 40 Gibps of bandwidth starting at $5.672 per hour.
🌐
Amazon Web Services
amazonaws.cn › en › sagemaker › pricing
SageMaker Pricing
1 week ago - For built-in rules, there is no charge and Amazon SageMaker Debugger will automatically select an instance type. For custom rules, you will need to choose an instance (e.g. ml.m5.xlarge) and you will be charged for the duration for which the instance is in use for the Amazon SageMaker Processing ...
🌐
CloudPrice
cloudprice.net › amazon web services › ec2 › g5.12xlarge
g5.12xlarge specs and pricing | AWS | CloudPrice
October 13, 2025 - Amazon EC2 instance g5.12xlarge with 48 vCPUs, 192 GiB RAM and 4 x NVIDIA A10G 22.35 GiB. Available in 16 regions starting from $4140.56 per month.
🌐
Reddit
reddit.com › r/aws › how to do cost estimation for amazon sagemaker
r/aws on Reddit: How to do cost estimation for Amazon Sagemaker
March 15, 2024 -

Hey guys, I am trying to do some cost estimation in Sagemaker for an AI chatbot I am building. The AI chatbot will be using the Mixtral-8x7b-Instruct quantized model downloaded from Hugging Face. And I will be using Sagemaker endpoints for inference.

When I went into the AWS Pricing Calculator website (https://calculator.aws/#/) and selected Sagemaker, I was presented with different options to choose from like Sagemaker Studio Notebooks, RStudio on Sagemaker, SageMaker On-Demand Notebook Instances etc (see the link below).

https://imgur.com/a/KVSHINe

For my chatbot that I had described above, how would I know which of these options to select to do my pricing estimate?

Would really appreciate any help with this. Many thanks!

Top answer
1 of 5
41

I've listed some pros and cons from experience...

..., as opposed to marketing materials. If I were to guess, I'd say you have a much higher chance to experience all the drawbacks of SageMaker, than any one of the benefits.

Drawbacks

  • Cloud vendor lock in: free improvements in the open source projects in the future and better prices in competitor vendors are difficult to get. Why don't AWS invest developers in JupyterLab, they have done limited work in open source. Find some great points here, where people have experienced companies using as few AWS services as possible with good effect.
  • SageMaker instances are currently 40% more expensive than their EC2 equivalent.
  • Slow startup, it will break your workflow if every time you start the machine, it takes ~5 minutes. SageMaker Studio apparently speeds this up, but not without other issues. This is completely unacceptable when you are trying to code or run applications.
  • SageMaker Studio is the first thing they show you when you enter SageMaker console. It should really be the last thing you consider.
    • SageMaker Studio is more limited than SageMaker notebook instances. For example, you cannot mount an EFS drive.I spoke to a AWS solutions architect, and he confirmed this was impossible (after looking for the answer all over the internet). It is also very new, so there is almost no support on it, even by AWS developers.
  • Worsens the disorganised Notebooks problem. Notebooks in a file system can be much easier to organise than using JupyterLab. With SageMaker Studio, a new volume gets created and your notebooks lives in there. What happens when you have more than 1...
  • Awful/ limited terminal experience, coupled with tedious configuration (via Lifecycle configuration scripts, which require the Notebook to be turned off just to edit these scripts). Additionally, you cannot set any lifecycle configurations for Studio Notebooks.
  • SageMaker endpoints are limited compared to running your own server in an EC2 instance.
  • It may seem like it allows you to skip certain challenges, but in fact it provides you with more obscure challenges that no one has solved. Good luck solving them. The rigidity of SageMaker and lack of documentation means lots of workarounds and pain. This is very expensive.

Benefits

These revolve around the SageMaker SDK (the Sagemaker console and SageMaker SDK) (please comment or edit if you found any more benefits)

  • Built in algorithms (which you can easily just import in your machine learning framework of choice): I would say this is worse than using open source alternatives.
  • Training many models easily during hyperparameter search YouTube video by AWS (a fast way to spend money)
  • Easily create machine learning related AWS mechanical turk tasks. However, mturk is very limited within SageMaker, so youre better off going to mturk yourself.

My suggestion

If you're thinking about ML on the cloud, don't use SageMaker. Spin up a VM with a prebuilt image that has PyTorch/ TensorFlow and JupyterLab and get the work done.

2 of 5
17

You are correct about EC2 being cheaper than Sagemaker. However you have to understand their differences.

  • EC2 provides you computing power
  • Sagemaker (try to) provides a fully configured environment and computing power with a seamless deployment model for you to start training your model on day one

If you look at Sagemaker's overview page, it comes with Jupyter notebooks, pre-installed machine learning algorithms, optimized performance, seamless rollout to production etc.

Note that this is the same as self-hosting a EC2 MYSQL server and utilizing AWS managed RDS MYSQL. Managed services always appears to be more expensive, but if you factor in the time you have to spent maintaing server, updating packages etc., the extra 30% cost may be worth it.

So in conclusion if you rather save some money and have the time to set up your own server or environment, go for EC2. If you do not want to be bothered with these work and want to start training as soon as possible, use Sagemaker.

🌐
Concurrencylabs
concurrencylabs.com › blog › sagemaker-ai-cost-savings
How To Keep SageMaker AI Cost Under Control and Avoid Bad Billing Surprises when doing Machine Learning in AWS - Concurrency Labs
December 4, 2024 - Depending on the number of instances and allocated storage, this price dimension can result in significant cost; especially considering that ML processes typically access large amounts of data that often need to be available in local storage for performance reasons.
🌐
Cloudchipr
cloudchipr.com › blog › amazon-sagemaker-pricing
Amazon SageMaker AI Pricing: Detailed Breakdown and Ultimate Guide
SageMaker Feature Store is a central repository for ingesting, storing, and serving ML features. Pricing includes charges for data storage, writes, and reads, with different rates for the standard online store and in-memory online store.
🌐
AWS re:Post
repost.aws › questions › QUkJ5_ET6aRPm8A3ij7TBtOg › sagemaker-stop-hosting-ml-g5-2xlarge-hour
SageMaker> STOP Hosting ml.g5.2xlarge hour | AWS re:Post
February 7, 2024 - SageMaker> STOP Hosting ml.g5.2xlarge hour · rePost-User-1690947 · asked 2 years ago · How do I delete/shut down ml.m5.2xlarge-Hosting instance from SageMaker AI? Kusum Miraj · asked 3 months ago · Being charged for unused SageMaker: What beyond Instances and Domain can I shut down in SageMaker?