What ethical and practical considerations should guide the use of AI in decision-making processes?

A leader advised using AI as a co-pilot, not as an autopilot. I want to understand the balance between human judgment and AI assistance in important decision-making scenarios.