How does your data team unit test data transformation code, especially when that code is written in SQL?

2.4k views1 Upvote4 Comments

Director of Engineering in Healthcare and Biotech, 501 - 1,000 employees
Use fake input into the code under test and check to ensure the output matches what's expected. 
Director of Engineering in Software, 10,001+ employees
Enter dummy data and validate various use cases
Director of Customer Engineering - APAC in Software, 201 - 500 employees
Validate with dummy data
Sr. Director of Engineering in Software, 51 - 200 employees
Use simulated data streams to create artificial datasets using data tranformation code and validate it against expected output.

Content you might like




Non-production DBs (Dev, Training, QA, etc.)30%


1.5k views1 Upvote

CTO in Software, 201 - 500 employees
Without a doubt - Technical Debt! It's a ball and chain that creates an ever increasing drag on any organization, stifles innovation, and prevents transformation.
Read More Comments
46.9k views133 Upvotes324 Comments

Decreasing spend on premise, increasing spend on cloud23%

Increasing spend on premise, decreasing spend on cloud53%

Increased spending on both on premise and cloud16%

Decreased spending on both premise and cloud8%