Gartner Research

A Guidance Framework for Operationalizing Machine Learning for AI

Published: 24 October 2018

ID: G00366587

Analyst(s): Soyeb Barot

Summary

As AI and ML initiatives mature, the biggest challenge faced by technical professionals is operationalizing ML for effective management and delivery of models. This guidance document provides a framework to build and deploy ML models in production for successful delivery of AI-based systems.

Table Of Contents

Problem Statement

The Gartner Approach

The Guidance Framework

  • Prework: Ideation and Team
    • Ideation to Set Platform Objectives
    • Technical Team
  • Step 1: Design the Target Architecture
    • Acquire
    • Organize and Analyze
    • Deliver Models for Inference
  • Step 2: Establish the Data Pipeline
    • Data Integration
    • Logical Data Warehouse (LDW)
    • Data Cleansing and Metadata
  • Step 3: Build the Machine Learning Architecture
    • Data Processing
    • Model Engineering
    • Model Execution
    • Model Deployment
  • Step 4: Implement a Model Management System
    • Model Registry
    • Model Manifestation
    • Model Servicing
    • Model Monitoring
    • Products and Tools
  • Step 5: Operationalize the Model-Building Process
    • Development Cycle
    • Test/Release Cycle
    • Activation Cycle
  • Follow-Up

Risks and Pitfalls

  • Spaghetti Bowl of ETL Scripts
  • Incoherent Technical Team
  • DIY Data Science
  • Inconsistent Provisioning of Models
  • Failing to Track and Monitor Models
    • Conclusion

Gartner Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Log In

Become a client

Learn how to access this content as a Gartner client.

Learn More