To enable auto-scaling you need to go to the checkbox autoscaling:

The way that auto-scaling works is in conjunction with Max Concurrent requests that is set:

**Max Concurrent Requests**: This is the number of requests per replica that after the number set will begin rejecting requests. The trade off with setting a higher number can be higher latency but a lower number rejecting the requests.

**Target Concurrent Requests:** This is the number of concurrent requests that trigger autoscaling of another replica. This should be set below the Max Concurrent requests.

**Smoothing Factor:** This is the moving average of concurrent requests and how long you the amount of target requests coming in before a new replica is brought up or scaled down.

- Conservative: Responds to changes slowly
- Moderate: Balanced responsiveness
- Aggressive: Quickly react to change

**Auto Scaling Range for Replicas:** This is the minimum to maximum amount of replicas the system will put as the base line and the max it will go up to.

**Note:** Whatever options you have set for hardware selection will be used for autoscaling.

## Next steps

- [Dedicated Instances overview](https://docs.parasail.io/parasail-docs/products/overview-1)
- [Management API](https://docs.parasail.io/parasail-docs/products/overview-1/management-api)
- [Speculative Decoding](https://docs.parasail.io/parasail-docs/products/overview-1/speculative-decoding)
- [FP8 Quantization](https://docs.parasail.io/parasail-docs/products/overview-1/fp8-quantization)
- [Pricing](https://docs.parasail.io/parasail-docs/billing/pricing)