Gartner Research

采用五种方法,改善数据工程实践

Published: 18 May 2023

Summary

客户对可用数据的需求,推动了数据工程技术的发展。数据和分析领导者可以通过促进协作、提早论证业务价值、实现发布流程自动化、将数据作为产品来管理以及消除运营负担等方式,增强数据工程实践。

Included in Full Research

概述

主要发现
  • 成功的数据工程团队是跨职能团队,采用DataOps实践。

  • 相比于注重技术增强,企业机构如果注重数据工程所产生的业务价值,能更高效地确定数据交付需求的优先级。

  • 对于新的/新兴数据工程团队而言,测试和发布流程需要消耗大量人力。成熟的团队已开始对这些流程进行自动化改造。

  • 许多企业机构在运营单体数据系统和流程,大幅延长了数据交付时间。

  • 虽然许多企业机构已经采用了自助式数据准备,以便业务用户探索数据,但很少能看到将工作负载交付到生产阶段所需的网络控制管理流程。

建议

希望提升数据工程实践的数据和分析(D&A)领导者,应:

  • 建立包含数据、业务和技术角色的跨职能团队,并且根据需要设置产品负责人/经理,以鼓励协作。

  • 在重大数据工程项目启动前展示业务价值,实现价值驱动,避免出现多余的数据工程工作。

  • 提高流程效率,首先实现单个测试和发布流程的自动化,然后通过发布管道协调各个步骤。

  • 将单一数据交付流程分解为模块化数据产品交付,倡导数据复用。

  • 使用必要的网守协议将重复性的数据准备工作推送至生产环境,减轻公民角色的运营负担。

Clients can log in to view the entire document.

Access Research

Already a Gartner client?

To view this research and much more, become a client.

Speak with a Gartner specialist to learn how you can access peer and practitioner research backed by proprietary data, insights, advice and tools to help you achieve stronger performance.

By clicking the "Continue" button, you are agreeing to the Gartner Terms of Use and Privacy Policy.

Gartner research: Trusted insight for executives and their teams

What is Gartner research?

Gartner research, which includes in-depth proprietary studies, peer and industry best practices, trend analysis and quantitative modeling, enables us to offer innovative approaches that can help you drive stronger, more sustainable business performance.

Gartner research is unique, thanks to:

Independence and objectivity

Our independence as a research firm enables our experts to provide unbiased advice you can trust.

Actionable insights

Not only is Gartner research unbiased, it also contains key take-aways and recommendations for impactful next steps.

Proprietary methodologies

Our research practices and procedures distill large volumes of data into clear, precise recommendations.

Gartner research is just one of our many offerings.

We provide actionable, objective insight to help organizations make smarter, faster decisions to stay ahead of disruption and accelerate growth.

Tap into our experts

We offer one-on-one guidance tailored to your mission-critical priorities.

Pick the right tools and providers

We work with you to select the best-fit providers and tools, so you avoid the costly repercussions of a poor decision.

Create a network

Connect directly with peers to discuss common issues and initiatives and accelerate, validate and solidify your strategy.

Experience Information Technology conferences

Join your peers for the unveiling of the latest insights at Gartner conferences.

©2022 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.