If you're bringing your own model, you don't need to use SageMaker. I've got mixtral-8x7b.Q5_K_M running on a g5.2xlarge (24GB of VRAM, 32 GB RAM), and it's $1.212 per hour in us-east-1. Just be sure to pick the Ubuntu deep learning AMI, as it has the required GPU drivers. Be aware that you're paying for the server whenever it's running - not just when you're interacting with the model. If you forget to shut it off and leave it for a month, that's $860... Answer from kingtheseus on reddit.com
🌐
Amazon Web Services
aws.amazon.com › machine learning › amazon sagemaker › pricing
SageMaker pricing - AWS
6 days ago - For example, you can generate an entire data transformation pipeline in 4 to 8 credits (15 to 30 cents total), depending on the notebook context and datasets available in the catalog. Tasks that would traditionally require hours of manual coding, debugging incorrect table references, and iterating ...
🌐
AWS re:Post
repost.aws › articles › AR864QSGIIRlCmxnaNRzeouw › being-mindful-of-your-spend-while-experimenting-with-ml
Being mindful of your spend while experimenting with ML. | AWS re:Post
February 7, 2024 - Cost and Usage Dashboards Operations Solution (CUDOS) is an Amazon QuickSight dashboard with many insightful visuals covering financial aspects of your AWS usage. In the AI/ML section you can find this graph that shows the cost of instances associated with SageMaker Studio and Notebook instances:
🌐
AWS re:Post
repost.aws › questions › QUp_yTquDhTgiweq85PA1oWg › aws-sagemaker-studio-pricing-how-does-the-billing-work
AWS SageMaker Studio pricing. How does the billing work? | AWS re:Post
July 6, 2020 - You pay for both compute and storage when you use SageMaker Studio notebooks. See Amazon SageMaker Pricing (https://aws.amazon.com/sagemaker/pricing/) for charges by compute instance type. Your notebooks and associated artifacts such as data files and scripts are persisted on Amazon EFS.
🌐
Reddit
reddit.com › r/aws › how to do cost estimation for amazon sagemaker
r/aws on Reddit: How to do cost estimation for Amazon Sagemaker
March 15, 2024 -

Hey guys, I am trying to do some cost estimation in Sagemaker for an AI chatbot I am building. The AI chatbot will be using the Mixtral-8x7b-Instruct quantized model downloaded from Hugging Face. And I will be using Sagemaker endpoints for inference.

When I went into the AWS Pricing Calculator website (https://calculator.aws/#/) and selected Sagemaker, I was presented with different options to choose from like Sagemaker Studio Notebooks, RStudio on Sagemaker, SageMaker On-Demand Notebook Instances etc (see the link below).

https://imgur.com/a/KVSHINe

For my chatbot that I had described above, how would I know which of these options to select to do my pricing estimate?

Would really appreciate any help with this. Many thanks!

🌐
AWS
docs.aws.amazon.com › amazon sagemaker › developer guide › machine learning environments offered by amazon sagemaker ai › amazon sagemaker notebook instances
Amazon SageMaker notebook instances - Amazon SageMaker AI
An Amazon SageMaker notebook instance is a machine learning (ML) compute instance running the Jupyter Notebook application. One of the best ways for machine learning (ML) practitioners to use Amazon SageMaker AI is to train and deploy ML models using SageMaker notebook instances.
🌐
Amazon Web Services
amazonaws.cn › en › sagemaker › pricing
SageMaker Pricing
6 days ago - If you have never used Amazon SageMaker before, for the first two months, you are offered a monthly free tier in Amazon Web Services China (Ningxia) Region of 250 hours of t2.medium or t3.medium notebook usage for building your models, plus 50 hours of m4.xlarge or m5.xlarge for training, plus ...
🌐
CloudZero
cloudzero.com › home › blog › amazon sagemaker pricing guide: 2025 costs (and savings)
Amazon SageMaker Pricing Guide: 2025 Costs (And Savings)
August 15, 2025 - You can test the service for free in either case. The Amazon SageMaker Free Tier includes the following benefits for each SageMaker component: Amazon SageMaker Studio Notebooks – 250 hours ...
Find elsewhere
🌐
e2m.live
spotsaas.com › product › amazon-sagemaker › pricing
Amazon SageMaker Pricing: Detailed Cost & Plans & Alternatives
Get a detailed breakdown of Amazon SageMaker pricing. Compare costs with other alternatives and choose the best Data Science and Machine Learning Platforms
🌐
JFrog ML
qwak.com › post › the-hidden-cost-of-sagemaker
Uncovering The Hidden Costs Behind Sagemaker's Pricing | JFrog ML
On top of breaking down the different products offered and the cost structure entailed, we'll take a look at the complexity that comes with this offering and how SageMaker's pricing can easily skyrocket accordingly.
🌐
Medium
medium.com › @mahammadkhadir2 › lets-understand-how-amazon-pricing-works-sagemaker-best-practices-for-right-sizing-compute-a3aaef150531
Let’s Understand how Amazon SageMakerpricing works, SageMaker best practices for right-sizing compute resources for different stages of an ML project. | by Khadir Mahammad | Medium
January 25, 2024 - Amazon SageMaker Studio is a fully integrated ML development environment with a managed Jupyter Notebook app experience, now accessible for free, with payment only for used AWS services. Notebook Instances are fully managed compute instances running Jupyter Notebook, handling ML workflows. Prices for compute instances are the same for both Studio and on-demand instances.
🌐
Finout
finout.io › blog › amazon-sagemaker-basics-pricing-and-cost-optimization-tips
Amazon SageMaker Pricing: Options, Examples, and 7 Ways to Cut Costs
September 11, 2025 - SageMaker features: Specific features like SageMaker Studio notebooks, Ground Truth data labeling, and SageMaker JumpStart have their own pricing models. For example, Ground Truth is priced per labeling task, and JumpStart costs vary based on the resources used and the model's complexity.
Top answer
1 of 5
41

I've listed some pros and cons from experience...

..., as opposed to marketing materials. If I were to guess, I'd say you have a much higher chance to experience all the drawbacks of SageMaker, than any one of the benefits.

Drawbacks

  • Cloud vendor lock in: free improvements in the open source projects in the future and better prices in competitor vendors are difficult to get. Why don't AWS invest developers in JupyterLab, they have done limited work in open source. Find some great points here, where people have experienced companies using as few AWS services as possible with good effect.
  • SageMaker instances are currently 40% more expensive than their EC2 equivalent.
  • Slow startup, it will break your workflow if every time you start the machine, it takes ~5 minutes. SageMaker Studio apparently speeds this up, but not without other issues. This is completely unacceptable when you are trying to code or run applications.
  • SageMaker Studio is the first thing they show you when you enter SageMaker console. It should really be the last thing you consider.
    • SageMaker Studio is more limited than SageMaker notebook instances. For example, you cannot mount an EFS drive.I spoke to a AWS solutions architect, and he confirmed this was impossible (after looking for the answer all over the internet). It is also very new, so there is almost no support on it, even by AWS developers.
  • Worsens the disorganised Notebooks problem. Notebooks in a file system can be much easier to organise than using JupyterLab. With SageMaker Studio, a new volume gets created and your notebooks lives in there. What happens when you have more than 1...
  • Awful/ limited terminal experience, coupled with tedious configuration (via Lifecycle configuration scripts, which require the Notebook to be turned off just to edit these scripts). Additionally, you cannot set any lifecycle configurations for Studio Notebooks.
  • SageMaker endpoints are limited compared to running your own server in an EC2 instance.
  • It may seem like it allows you to skip certain challenges, but in fact it provides you with more obscure challenges that no one has solved. Good luck solving them. The rigidity of SageMaker and lack of documentation means lots of workarounds and pain. This is very expensive.

Benefits

These revolve around the SageMaker SDK (the Sagemaker console and SageMaker SDK) (please comment or edit if you found any more benefits)

  • Built in algorithms (which you can easily just import in your machine learning framework of choice): I would say this is worse than using open source alternatives.
  • Training many models easily during hyperparameter search YouTube video by AWS (a fast way to spend money)
  • Easily create machine learning related AWS mechanical turk tasks. However, mturk is very limited within SageMaker, so youre better off going to mturk yourself.

My suggestion

If you're thinking about ML on the cloud, don't use SageMaker. Spin up a VM with a prebuilt image that has PyTorch/ TensorFlow and JupyterLab and get the work done.

2 of 5
17

You are correct about EC2 being cheaper than Sagemaker. However you have to understand their differences.

  • EC2 provides you computing power
  • Sagemaker (try to) provides a fully configured environment and computing power with a seamless deployment model for you to start training your model on day one

If you look at Sagemaker's overview page, it comes with Jupyter notebooks, pre-installed machine learning algorithms, optimized performance, seamless rollout to production etc.

Note that this is the same as self-hosting a EC2 MYSQL server and utilizing AWS managed RDS MYSQL. Managed services always appears to be more expensive, but if you factor in the time you have to spent maintaing server, updating packages etc., the extra 30% cost may be worth it.

So in conclusion if you rather save some money and have the time to set up your own server or environment, go for EC2. If you do not want to be bothered with these work and want to start training as soon as possible, use Sagemaker.

🌐
UnoGeeks
unogeeks.com › home › blog › aws sagemaker pricing
AWS SageMaker Pricing
November 24, 2023 - The cost of using AWS SageMaker can vary depending on the following factors: 1. **Notebook Instances**: The cost depends on the instance type and the duration of usage.
🌐
Cloudforecast
cloudforecast.io › home › aws pricing & cost optimization › aws sagemaker pricing guide – cost breakdown & optimization tips
AWS SageMaker Pricing Guide - Cost Breakdown & Optimization Tips | CloudForecast
October 29, 2025 - Confused by AWS SageMaker pricing? This guide breaks down costs, real-world examples, and expert tips to forecast and optimize your SageMaker bill.
🌐
TrustRadius
trustradius.com › home › ai development platforms › amazon sagemaker › pricing
Amazon SageMaker Pricing 2025
Below is an image example of the pricing list for Sagemaker Studio Notebooks. You can go to the pricing page with this link here. You should know that the costs will change for the AWS region you chose so it’s best to make sure it’s the right setting. Only Feature Store and Serverless Inference are priced ...
🌐
Holori
holori.com › accueil › blog › ultimate aws sagemaker pricing guide
Holori - Ultimate AWS Sagemaker pricing guide
October 23, 2024 - Here’s what the free tier includes: Studio Notebooks and Notebook Instances: 250 hours of ml.t3.medium instance on Studio notebooks OR 250 hours of ml.t2.medium or ml.t3.medium instance on notebook instances per month for the first two months.
🌐
TutorialsPoint
tutorialspoint.com › sagemaker › sagemaker-pricing.htm
Amazon SageMaker - Pricing
When you use Amazon SageMaker's integrated Jupyter notebooks to develop machine learning models, you are charged based on the instance type and usage time.
🌐
Medium
medium.com › @darya_petrashka › aws-sagemaker-how-not-spend-all-your-money-16ea1e3e7255
AWS SageMaker: How not Spend all Your Money | by Darya Petrashka | Medium
July 13, 2022 - As an example, several months ago I spent $0.89 for SageMaker (by running several example notebooks). As you can see on the screenshot above, different instances have different prices, and the more advantageous instance the higher price.
🌐
Paperspace
blog.paperspace.com › sagemaker-studio-notebooks-alternative-comparison
Comparison: SageMaker Studio Notebooks and Paperspace Gradient Notebooks
May 6, 2021 - That said, Gradient Notebooks from Paperspace provide much of the same production-grade (as far as notebooks can be said to be production-grade) reliability but with far greater ease of use for things like collaboration, instance selection, metered pricing simplicity, and so on. SageMaker Studio notebooks are best-suited to those who are already invested in SageMaker and have corporate requirements around notebook provisioning and access.