Back
UPDATE
2 months ago
BennyKokBennyKok

Optimize Concurrency

How to properly configure machine settings for concurrent request

Machine

When dealing with multiple user requests, you might want to handle user requests concurrently.

Under the hood, ComfyDeploy uses Modal, and we leverage Modal’s serverless scaling.

https://modal.com/docs/guide/concurrent-inputs#concurrent-inputs-on-a-single-container-beta

Here’s how we suggest you set the machine settings here to serve multiple users at the same time.