Published: 06 March 2024
鉴于监管要求以及数据隐私和安全方面的担忧，中国企业倾向于在本地而非通过公有云部署生成式人工智能（GenAI）。由于目前的基础设施环境无法支持GenAI项目，中国的基础设施和运营（I&O）领导者须为应对这一技术对数据中心的影响做好准备。
由于中国市场上的高端图形处理器（GPU）供应有限，I&O领导者要在本地部署GenAI就需要改变托管环境的设计方式。
在本地部署大型GPU集群将对现有数据中心带来颠覆，因为GenAI模型的训练需要高吞吐量、低延迟和无损的基础设施，还需要对相关设施进行改造，以便为升级后的基础设施提供支持。
为GenAI的部署准备基础设施资源的中国首席信息官（CIO）及I&O领导者，应：
在讨论GenAI部署计划时，主动与业务及相关团队合作，并预测不同工作负载对数据中心的成本和时间表的影响，从而为GenAI的部署制定数据中心宏观战略。
如果训练模型需要高端GPU集群，则通过平衡成本、风险和机遇（如购买替代硬件或租赁GPU资源），充分了解各类托管方案。
与数据科学家和工程师合作，明确GPU集群规模和GenAI性能要求，从而确定网络和存储等方面的基础设施要求。
分析电力需求、冷却效率、机架、空间等，确定现有数据中心环境在部署大型GPU集群方面存在的差距。平衡时间和成本，选择最适合的数据中心改造方案。
Clients can log in to view the entire document.
Analysts:
Gartner research, which includes in-depth proprietary studies, peer and industry best practices, trend analysis and quantitative modeling, enables us to offer innovative approaches that can help you drive stronger, more sustainable business performance.
Our independence as a research firm enables our experts to provide unbiased advice you can trust.
Not only is Gartner research unbiased, it also contains key take-aways and recommendations for impactful next steps.
Our research practices and procedures distill large volumes of data into clear, precise recommendations.
We provide actionable, objective insight to help organizations make smarter, faster decisions to stay ahead of disruption and accelerate growth.
We offer one-on-one guidance tailored to your mission-critical priorities.
We work with you to select the best-fit providers and tools, so you avoid the costly repercussions of a poor decision.
Connect directly with peers to discuss common issues and initiatives and accelerate, validate and solidify your strategy.
Gartner clients can log in to access the full library.
Attend a Conference
Experience Information Technology conferences
With exclusive insights from Gartner experts on the latest trends, sessions curated for your role and unmatched peer networking, Gartner conferences help you accelerate your priorities.
Gartner CIO & IT Executive Conference
São Paulo, Brasil
© 2026 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner's prior written permission. It consists of the opinions of Gartner's business and technology insights organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner business and technology insights may address legal and financial issues, Gartner does not provide legal or investment advice and its insights should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its insights are produced independently by its business and technology insights organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity. Gartner publications and other content may not be used as input into or for the training or development of generative artificial intelligence, machine learning, algorithms, software or related technologies.
