Tools Nov 20, 2026 · Originally published Nov 19

AWS AppConfig adds AI model invocation and prompt configurations: change models and prompts without redeploying, roll out by traffic share and roll back automatically on alarms

Swapping models and editing prompts are the most frequent and riskiest changes in an AI app. How AppConfig brings them under gradual rollout, for teams with AI features in production.

Primary source AWS What's New · aws.amazon.com Read the original ↗

// Key points

  • AI model invocation configurations hold the model ID, inference parameters such as temperature and max tokens, and messages such as system prompts and example turns; provider-specific options go in custom parameters so one schema works across providers.
  • AI prompt configurations store prompts as separately versioned artifacts that can be changed on their own and reused across applications.
  • Changes can roll out gradually, say 10%, then 20%, then 30% of traffic, and roll back automatically when an alarm fires in CloudWatch, Datadog, New Relic or similar; it is available in all AppConfig Regions at no extra cost.

Builder's takeTreating prompts as config and rolling them out by traffic share is something many teams do with homemade flags; now it comes ready-made. Even off AWS, copy the structure: version model parameters and prompts separately, and tie every change to an alarm on token usage and success rate, so a bad change rolls back by version instead of by redeploy.

Every Monday, the week in AI in one email

Every Monday morning: the 6 AI stories that mattered most in the past seven days, with my take, in your inbox.

Your email is only used to send the weekly and is never shared. Every email has a one-click unsubscribe link. See the latest issue →