The Demo Decoder - AI Marketing Transparency Scorecard

What Responsible AI Marketing Should Include

Check all that apply to your vendor's marketing materials:

✓

Accuracy Limitations

Clearly discloses that AI outputs require human verification and may contain errors or hallucinations

✓

Appropriate Use Cases

Specifies what tasks the AI is and isn't suitable for, with concrete examples

✓

Implementation Timeline

Provides realistic timeframes for deployment, including pilot phases and scaling considerations

✓

Security Prerequisites

Outlines data privacy requirements, security reviews, and compliance considerations

✓

Governance Requirements

Discusses change management, stakeholder alignment, and organizational readiness

✓

Realistic Time-to-Productivity

Sets honest expectations for training, adoption curves, and when ROI becomes measurable

✓

Common Failure Modes

Acknowledges known issues, edge cases, and scenarios where the system may underperform

How Do They Score?

Microsoft

365 Copilot

✗ Accuracy Limitations
✗ Appropriate Use Cases
✗ Implementation Timeline
✗ Security Prerequisites
✗ Governance Requirements
✗ Realistic Time-to-Productivity
✗ Common Failure Modes

Score: 0/7

Marketing focuses exclusively on capabilities with zero disclosure of limitations, implementation complexity, or realistic deployment timelines. The 47-second demo omits all friction points.

Anthropic

Claude

✓ Accuracy Limitations
✓ Appropriate Use Cases
✓ Implementation Timeline
✓ Security Prerequisites
✓ Governance Requirements
✓ Realistic Time-to-Productivity
✗ Common Failure Modes

Score: 6/7

Documentation explicitly covers model limitations, use case guidance, security considerations, and implementation best practices. Could improve on failure mode transparency.