Gartner Research

5 Useful Ways to Use Artificial Intelligence and Machine Learning With Your Logical Data Warehouse

Published: 08 January 2019

ID: G00346635

Analyst(s): Henry Cook

Summary

Artificial intelligence/machine learning and the domain of the multiengine architecture of the logical data warehouse are complementary. Technical professionals working in data and analytics can increase business benefit by architecting their systems to take advantage of this natural synergy.

Table Of Contents

Analysis

  • Method 1 — Interface the AI/ML Service or Product to the LDW
  • Method 2 — Invoking Machine Learning Within the DBMS or DMSA
    • Invocation Example: Forecasting Using Linear Regression
    • Integrating AI/ML Algorithms at the Operating System Level
  • Method 3 — Using AI/ML to Help Manage the LDW Workload
    • Using AI/ML to Boost Concurrency for Short Queries
    • Using AI/ML to Automatically Tune an LDW Subsystem
  • Method 4 — Profiling and Cleansing the LDW Input Data
    • Automated Data Detection
    • Data Cleansing Within the DBMS
  • Method 5 — Deployment of Models and Results
    • Deployment Through a Model Description Language
    • Simple Deployment Using an ODS
    • Robust Deployment Is Essential to Retraining and Recalibration of Models
    • Deployment Using Multiple Languages, Tools and Analytic Engines
  • Strengths
  • Weaknesses

Guidance

The Details

  • Classification Using Support Vector Machines
  • Finding Relationships Using Association Analysis
  • Combining Free-Form Text Input and Structured Data
  • Invoking Algorithms in the Data Lake With Spark ML and MLlib
  • Expanded Detail on the Flight Data Cleanup Example

Gartner Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.