Explainable AI (XAI) is quickly becoming a prerequisite of automated supply chain planning, offering transparency into complex algorithmic decisions. This presentation explores how XAI improves trust, transparency and adoption of AI for supply chain planning. The session will highlight benefits, risks and actionable steps for leveraging XAI to bridge the gap between advanced technology and practical decision making, ultimately driving ROI of the AI technology.