Cost Control

Apply cost control using configuration.

Cost control helps manage API spending by setting daily, monthly, or total cost limits. Configure cost limits using:

# Set daily and monthly limits
ai-gateway serve \
  --cost-daily 100.0 \
  --cost-monthly 1000.0 \
  --cost-total 5000.0

Or in config.yaml:

cost_control:
  daily: 100.0   # $100 per day
  monthly: 1000.0  # $1000 per month
  total: 5000.0    # $5000 total

When a cost limit is reached, the API will return a 429 response indicating the limit has been exceeded.

Benefits of Cost Control

• Prevents overspending: Ensures budgets are adhered to.

• Optimizes usage: Encourages efficient API consumption.