Optimize Concurrency

When dealing with multiple user requests, you might want to handle user requests concurrently.

Under the hood, ComfyDeploy uses Modal, and we leverage Modal’s serverless scaling.

https://modal.com/docs/guide/concurrent-inputs#concurrent-inputs-on-a-single-container-beta

Here’s how we suggest you set the machine settings here to serve multiple users at the same time.