Deciding between RDS and Redshift for "data warehouse"
Redshift RA3 vs RDS PostgreSQL
DynamoDB or Aurora or RDS?
What are the pros and cons of using DMS to power a redshift datawarehouse?
What is the difference between AWS RDS and Redshift?
Redshift is a cloud data warehouse designed for analytical workloads, handling large-scale data queries and complex aggregations.
What is the difference between Redshift and RD?
Relational databases (like those in RDS) are optimized for Online Transaction Processing (OLTP), suited for applications requiring frequent read/write operations.
Is Redshift a relational database?
Hi all,
I have a business request to ETL data from several sources into a data warehouse to run BI tools on (Tableau or PowerBI for example).
The dataset isn't that big, 400GB growing 4GB per week. I can't find any good explanation on if I should use RDS or Redshift to store the data.
Can anyone with experience on this topic guide me please?
Thank you!
** No other DB suggestions, please. Now Read on**
We offer a data lake ( lakehouse) platform purely based on AWS services along with our solution. There are reporting and analytical applications that connect to the lake for various needs. For the data layer, we have chosen Redshift RA3 as the primary data storage ( reporting and analytics) , and Postgres for maintaining the application data ( because we need relational ) and S3 as a cold data archive, which can be accessed through Redshift Spectrum.
We were thinking that when implementing for smaller use-cases and smaller data set ( 0 -5 TB), we could remove Redshift from the platform and maintain Postgres RDS for storing data lake and S3 for the data archival, thus saving cost. This was based of the assumption that Redshift computing costs are higher than RDS costs and hence may be an overkill for smaller use- cases. But when I am pricing out the hardware with similar specs in AWS calculator for RDS and RA3, RA3 is turning out to be cheaper! RDS storage costs are very high !!
For example, I priced a PostgresSQL RDS with r5.xlarge 7 TB storage , 1 node, Single AZ with a comparable Redshift RA3 xlplus 1 node 7TB RMS storage, and found that Redshift ended up being cheaper monthly cost compared to Postgres RDS.
Is there a catch in the long run for Redshift RA3?
Does it make sense to replace Redshift with RDS for smaller use cases?
Am I comparing them right? or does xlplus match with a lower tier instance type for RDS?