I've been implementing some AI tools at my company with GPT 4.0 until now. No pretrainining or fine-tuning, just instructions with the Responses API endpoint. They've work well, but we'd like to move away from OpenAI because, unfortunately, no one at my company trusts it confidentiality wise, and it's a pain to increase adoption across teams. We'd also like the pre-training and fine-tuning flexibility that other tools give.

Since our business suite is Google based and Gemini was already getting heavy use due to being integrated on our workspace, I decided to move towards Vertex AI. But before my Tech team could set up a Cloud Billing Account for me to start testing on that platform, it got a sales call from AWS where they brought up Bedrock.

As far as I have seen, it seems like Vertex AI remains the stronger choice. It provides the same open source models as Bedrock or even more (Qwen is for instance only available in Vertex AI, and many of the best performing Bedrock models only seem available for US region computing (my company is EU)). And it provides high performing proprietary Gemini models. And in terms of other features, seems to be kind of a tie where both offer many similar functionalities.

My main use case is for the agent to complete a long Due Diligence questionnaire utilising file and web search where appropriate. Sometimes it needs to be a better writer, sometimes it's enough with justifying its answer. It needs to retrieve citations correctly, and needs, ideally, some pre-training to ground it with field knowledge, and task specific fine-tuning. It may do some 300 API calls per day, nothing excessive.

What would be your recommendation, Vertex AI or Bedrock? Which factors should I take into account in the decision? Thank you!

Hello everyone. I’m currently exploring AI infrastructure and platform for a new project and I’m trying to decide between Amazon Bedrock and Azure (AI Infrastructure & AI Studio). I’ve been considering both but would love to hear about your real-world experiences with them.

Has anyone used Amazon Bedrock or Azure AI Infrastructure and Azure AI Studio? How would you compare the two in terms of ease of use, performance, and overall flexibility? Are there specific features from either platform that stood out to you, or particular use cases where one was clearly better than the other?

Any advice or insights would be greatly appreciated. Thanks in advance!