More than 25 Percent of Critical Data in the World's Top Companies is Flawed
Over the next two years, more than 25 percent of critical data in Fortune 1000 companies will continue to be flawed, that is, the information will be inaccurate, incomplete or duplicated, according to research and advisory firm Gartner, Inc. Gartner expects that three-quarters of large enterprises will make little to no progress towards improving data quality until 2010. To gain competitive advantage from information, organisations need to identify ‘data stewards’ in the business and manage information as a corporate asset.
Speaking at the company’s inaugural Business Intelligence and Information Management Summit in Sydney this week, Gartner Research vice president Andreas Bitterer said that “dirty data” or poor data quality is an often-overlooked business issue and it can have a large negative impact on a business.
"There is not a company on the planet that does not have a data quality problem," said Mr Bitterer. “And where a company does recognise they have a problem, they often underestimate the size of it. It’s also important to realise that data quality is not static, as various forces cause it to change over time. So addressing this issue is not a one-time project, but an ongoing program that requires commitment and often a cultural shift as well.”
The cost of poor data quality
Gartner research shows that poor-quality customer data leads to significant costs, such as higher customer turnover, excessive expenses from customer contact processes like mail-outs and missed sales opportunities. But companies are now discovering that data quality has a significant impact on their most strategic business initiatives, not only sales and marketing. Other back-office functions like budgeting, manufacturing and distribution are also affected.
Compliance and transparency are now at the top of the list of most companies’ data concerns, according to Gartner. Legislation such as the US Sarbanes-Oxley Act, the European Basel Accords and the Privacy Act in Australia now demands that information is accurate and managed appropriately.
“By introducing data quality initiatives, some companies have added millions of dollars to their bottom line as they gain benefits such as increased sales, lower distribution costs and better compliance,” said Mr Bitterer.
Fixing the problem of ‘dirty data’
“Data quality is not an IT problem. IT can help fix it, but the business must own the problem,” said Mr Bitterer. “For example, company culture can have a significant influence. Organisations need ‘data stewards’, people within the business who are responsible for the quality of the information. However, technology will play a role in fixing many data quality issues, and organisations need to invest in a portfolio of data quality solutions such as profiling, cleansing, matching and enrichment.”
According to Gartner, data quality has many facets, including:
The first two of these aspects of quality represent a good staring point for improvement, as they can be measured fairly easily and will help identify major gaps in the data. From there, organisations should look at including other attributes in their definition of data quality.
“Many companies are trying to improve data quality ‘by hand’, writing their own correction or cleansing routines, when instead they should look at tools already available which can help them,” said Mr Bitterer.
According to Gartner, the market for data quality tools is currently small (approximately US$300 million in annual license revenue) but growing. Large vendors, such as Business Objects, IBM and Pitney Bowes, have entered via acquisitions, while numerous small vendors have developed their own data quality technology.
In Gartner’s annual survey of 1400 CIOs worldwide released this month, business intelligence was again ranked the number one technology priority, as organisations increasingly rely on data todrive growth and innovation.
For more information about Gartner’s Business Intelligence and Information Management Summit, please visit www.gartner.com/ap/bi
Gartner, Inc. (NYSE: IT), is the world's leading research and advisory company and a member of the S&P 500. We equip business leaders with indispensable insights, advice and tools to achieve their mission-critical priorities and build the successful organizations of tomorrow.
Our unmatched combination of expert-led, practitioner-sourced and data-driven research steers clients toward the right decisions on the issues that matter most. We're trusted as an objective resource and critical partner by more than 15,000 organizations in more than 100 countries—across all major functions, in every industry and enterprise size.
To learn more about how we help decision makers fuel the future of business, visit www.gartner.com.
Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.