Currently, in my organization, we have BI products built on top of a data warehouse implemented using PostgreSQL, following a snowflake schema architecture (fact and dimension tables). This structure has become extremely complex and hard to maintain. Updates are very costly, and I’m heavily dependent on a single person to keep it running. I’m considering moving to a cloud-based environment, such as AWS Redshift or Google BigQuery. Based on your experience, would migrating to one of these platforms help me move away from this complex snowflake architecture? Also, between the two solutions (AWS Redshift and Google BigQuery), which one would you recommend and why?

1.8k viewscircle icon3 Comments
Sort by:
Principal Software Engineer, Data Engineering in Energy and Utilities3 months ago

It is better to analyze from the problem perspective. Whether you need a Snowflake schema, star schema, or one big table, it needs to be analyzed based on the user requirements, data volume, query patterns, business asks, latency requirements, etc. Changing the database/platforms might not solve the issue if you need a sustainable solution.

Lightbulb on1
IT Manager in Banking4 months ago

Warehouse performance can be linked to multiple factors, like actual design vs blueprint design, how it has been built, underlying infrastructure and then comes technology choices. Before looking at a cloud data platform and thinking of moving to solve your problem, try to assess if your implemented design is scalable or not. 

Lightbulb on1
Data Manager4 months ago

Based on what you have described, it sounds like your problem is more the architecture or design of your database.  I don't think changing the underlying database technology is going to address your problem.  

Is your problem more related to the process you use to update your DW rather than the database itself?

What tools are you using to update your star / snowflake schema?

Content you might like

Yes, it's integrated together56%

No, VMO is separated41%

Other (comment below)2%

View Results

Severe impact: Major disruptions in critical services and operations12%

Significant impact: Noticeable disruptions but manageable26%

Moderate impact: Some disruptions but business largely continues as usual21%

Minor impact: Minimal disruptions with quick resolution13%

No impact: Not affected28%

View Results