Skip to content
PYMNTS· PYMNTS·· 17 days agoAI score43

Visa found AI models failed in 43% of shopping tests

Visa Finds AI Models Fail 43% of Shopping Test Runs

AI brief

AI-assisted source summary · not independently verified. Content standards

Visa tested 22 AI models from 12 labs in real-world shopping scenarios, with results showing that 57.2% of test runs passed and 42.8% failed. The Visa Agentic Commerce Benchmark assesses whether models can identify consumer needs from conversations, find sufficient information to inform purchase decisions, and abandon the purchase when no suitable product is available; 54% of failed tests still resulted in purchases that did not meet the requirements.

Source:PYMNTS · pymnts.com