Hey guys, I’m currently using AWS bedrock to host my AI for my business (UK) but I’m getting rate limits and they’re being extremely slow to respond. I need a GDPR compliant alternative, what’s the best solution where I wouldn’t be rate limited ? Need to parse long text documents with it on a scale of around every 10 seconds for a day or two, then on a request basis after that.ideally looking for a solution that’s not crazy expensive, if possible. I’ve seen azure seems like a decent alternative, I’m curious how well it would handle such volume of requests? Would I be waiting on red tape like with AWS ? I’ve considered sageMaker but it seems expensive. Thank you for your time

Hey guys, I’m currently using AWS bedrock to host my AI for my business (UK) but I’m getting rate limits and they’re being extremely slow to respond. I need a GDPR compliant alternative, what’s the best solution where I wouldn’t be rate limited ? Need to parse long text documents with it on a scale of around every 10 seconds for a day or two, then on a request basis after that.ideally looking for a solution that’s not crazy expensive, if possible, Thank you !

Hello everyone. I’m currently exploring AI infrastructure and platform for a new project and I’m trying to decide between Amazon Bedrock and Azure (AI Infrastructure & AI Studio). I’ve been considering both but would love to hear about your real-world experiences with them.

Has anyone used Amazon Bedrock or Azure AI Infrastructure and Azure AI Studio? How would you compare the two in terms of ease of use, performance, and overall flexibility? Are there specific features from either platform that stood out to you, or particular use cases where one was clearly better than the other?

Any advice or insights would be greatly appreciated. Thanks in advance!

What is Azure’s version for quickly setting up a RAG chat system? With AWS it seems pretty straight forward being able to drop your documents in S3.

Hi all, lately I have several projects where I need to extracr text from images or pdf.

I usually use Amazon Textract because it's the desicated OCR service. But now I'm experimenting with Amazon Bedrock and also using cheap FM like Claude 3 Haiku I can extract the text very easily. Thank to the prompt I can also query only the text that I need without too manu elaborations.

What do you think of this? Do you see pros or cons? Have you ever faced a similar situation?

Thanks

I was looking into AWS Bedrock for a client requirement and I can't really understand how is it different from Groq? Both provide open source models..?

I understand that AWS Bedrock has some additional feature like image generation... but is it same from the perspective of text generation?

If yes, then why the exorbitant price?

What are your pros to using Sagemaker? Seems to me that it’s a little dead whereas bedrock is the future due to it’s ease of use and flexibility specially for getting to use something that’s already “built”

https://aws.amazon.com/bedrock/

Today I was struggling with some documentation on a hosted public cloud application. Ironically this is an AWS hosted proprietary service with poor google visibility or local search but it could be anything. I 'built and trained' a Custom GPT in about ten minutes. Looks good but I am not allowed to share it by default because 'it references trademarks'. OK, well, appeal, and maybe I can use Bedrock instead. Do I really have this right?

I sign in to AWS and go to Bedrock.

1. I have to enable permission for my (admin) user to use Bedrock

2. I have to make a request for the specific model(s) I want access to, i.e. this request may be denied, and wait. Apparently the UI is terrible in this respect so not sure how long that might take.

I'm then expected to do some Heath Robinson immersion-day special with Lambdas and dynamo and S3 and whatever else to ingest my data and then whatever else to support an API that I can call and hook up to a web frontend that of course I have the time and inclination to create myself, maybe like this

Oh yeah, and much of this is console only apparently...

Is this seriously what AWS are doing for a service that they want uptake on? Alternatively I could deploy a Kubernetes cluster with Llama3 and openwebui completely in code. For a 'complete' example on an odd-bod cloud see this. Might need to do some tweaks to read websites but not write original code. I suppose it might be even simpler to simply hook a front end on my website up to an OpenAI/Anthropic etc backend API.

In other words I can have a complete implementation in code for an LLM 'self hosted' that I would expect (after assembly!) to deploy in less than 30 minutes with high availability etc, a web front end and its own site crawler. I can do this in AWS, test out, tear down, not worry about leaving anything potentially expensive running and transfer verbatim to a client site without having to grant myself or request special permission or wait or be potentially refused.

What am I supposed to be considering paying Amazon for here again?

As per title. What are some aws services you think are under rated and not used that often by businesses?

I work in the enterprise space so it’s very much typical like vpc, ec2, iam, cloudwatch, rds, s3, ecs, eks etc

i used to use the langsmith with openai before but rn im changing to use models from bedrock to trace what are the better alternatives?? I’m finding that setting up LangSmith for non-openai providers feels a bit overwhelming...type of giving complex things...so yeah any better recommendations for easier setup with bedrock??