How do you create KPI and collect metrics for a data warehouse/ data center when looking to identify the value objectively/quantifiable?

1.6k views1 Upvote3 Comments

Co-founder/Practicum Director in Travel and Hospitality, 2 - 10 employees
This one is pretty context-driven imo but we can start with looking at the individual columns captured inside the data warehouse and set up quality metrics accordingly building it up to the dataset level and then to the database level. 
Director in IT Services, 10,001+ employees
There are multiple KPIs/metrics that you can define and collect data for correspondingly, to be able to look at the functioning and/or the success of a datawarehouse. Some of them might be easy to quantify, while the others are bit more difficult.

Some metrics that can be easy to quantify can be

Data Availability metrics : Such as system uptime, % of system availability
Performance metrics : Such as data latency, Query response time and concurrency
Cost metrics : such as storage costs, processing costs trending over time

Some metrics may be harder to quantify, such as Data quality (completeness, integrity) or Data governance (lineage, ownership)
The Data Governance Coach in Miscellaneous, 2 - 10 employees
In my experience this has to be defined by the consumers of the data in the data warehouse/data center.  They need to articulate what outcomes they want to achieve from having the data warehouse and then you can create metrics to measure whether this is being achieved.  You can also ask the same people to define what makes that data good enough for them to use for those purposes and you can then measure and report on data quality in the data warehouse

Content you might like

Open AI (Game Changer: adoption w/ChatGPT)40%

Google (Game Changer: inventor of Transformers, Bard)20%

Microsoft (Game Changer: real time BingGPT+Search plus enterprise enablement)18%

Meta (Game Changer: LLM that can run on single GPU)7%

Amazon (Game Changer: TBD)4%

X.AI / Elon Musk (Game Changer: TBD)3%

Baidu (Chinese tech giant, with GPT version released in March)3%

Someone completely new5%


27k views89 Upvotes14 Comments

Microsoft Power Bi0%


Qlik Sense0%


194 views1 Upvote

Oracle ERP System Analyst / Accounting Manger in Retail, 10,001+ employees
Commuting to work in the morning.
Read More Comments
9.6k views2 Upvotes4 Comments