Out of following technologies, which are the ones do you use at your organization for data engineering pipelines?

Azure Data Factory26%

Azure Data Bricks34%

Azure Data Lake42%

Azure Cosmos DB19%

Azure Blob Storage22%

Azure Synapse Analytics16%

Azure HDInsight8%

Azure SQL / SQL Server23%

Azure Service Bus10%

Amazon Redshift17%

Amazon S326%

Amazon EMR6%

Amazon RDS19%

Amazon Lake formation10%

Amazon Glue DataBrew6%

Amazon SNS9%

GCP BigQuery8%

GCP BigTable5%

GCP Cloud Data prep4%

GCP Cloud Data flow7%

GCP Cloud Storage8%

GCP Cloud SQL6%

GCP Cloud Pub/Sub2%


2k views3 Upvotes1 Comment

Associate VP - Digital Technologies in Software, 501 - 1,000 employees
At 28 votes, it seems like Azure Data Lake is being widely used. It is the leading tech (43%) followed by Azure Data Bricks. Let's see how the picture changes when there is more participation.

Content you might like




Non-production DBs (Dev, Training, QA, etc.)30%


1.5k views1 Upvote

CTO in Software, 201 - 500 employees
Without a doubt - Technical Debt! It's a ball and chain that creates an ever increasing drag on any organization, stifles innovation, and prevents transformation.
Read More Comments
46.6k views133 Upvotes324 Comments

Yes - Maine did the right thing. There are too many security risks with free versions of these tools. Not enough copyright or privacy protections of data.31%

No, but.... - You must have good security and privacy policies in place for ChatGPT (and other GenAI apps). My organization has policies and meaningful ways to enforce those policies and procedures for staff.52%

No - Bans simply don't work. Even without policies, this action hurts innovation and sends the wrong message to staff and the world about our organization.13%

I'm not sure. This action by Maine makes me think. Let me get back to you in a few weeks (or months).3%


9.5k views9 Upvotes1 Comment