How Amazon weaned Alexa off Anthropic's pricey models to slash AI costs

Internal documents show Amazon worked to lower Alexa+ AI costs by reducing the use of Anthropic models and getting more work from every GPU.
How Amazon weaned Alexa off Anthropic's pricey models to slash AI costs

Amazon is redesigning Alexa to rely less on Anthropic’s models and more on its own in-house AI to significantly reduce operational costs. This effort includes optimizing GPU usage and routing requests more efficiently to lower the projected $1.7 billion AWS cloud costs for Alexa+ in 2026. The strategy mirrors a broader industry trend of using cheaper models for simpler tasks while reserving advanced models for complex reasoning.

  • Amazon is overhauling Alexa to reduce reliance on Anthropic’s AI models and cut costs.
  • The company aims to quadruple the number of customer transactions per unit of computing capacity.
  • Projected AWS cloud costs for Alexa+ were estimated at $1.7 billion in 2026, nearly triple the previous year.
  • Initiatives include reducing calls to Claude models, using caching, and expanding deterministic handling for predictable requests.
  • Amazon is also focusing on increasing the work each GPU can perform through software upgrades and evaluating its own Trainium chips.
  • The strategy aligns with a wider industry trend of optimizing AI inference costs.
    Continue reading https://www.businessinsider.com/amazon-push-lower-alexa-ai-costs-use-anthropic-models-less-2026-7
Write a comment