Guide for Sagemaker AI.
SageMaker is Terrible - Is Using EC2 a Better Alternative?
SageMaker costs for AI model
Why not Sagemaker?
Videos
I am thinking of training LLMs on Sagemaker but want to do it for free with minimal to no expense. I did some digging around and found that i need to create something called as Domain and then create a profile choosing the instance types. I need your help to understand this. Please layout ur thoughts and experiences.
I’ve been trying to use SageMaker, and honestly, it feels awful. The training and inference workflows force you to use the unnecessary SageMaker Python SDK, and the code editor is terrible, no support for Pylance or other Microsoft tools, making development incredibly difficult. I don’t see any real advantages.
The only thing that seems relatively easy is managing but overall, it feels extremely frustrating.
Would it make more sense to just spin up an EC2 instance, develop models there using VSCode + SSH, and handle deployment directly? Also, would setting up MLflow on EC2 work just as well?