Scaling Your Dyno Formation
Last updated 09 September 2015
Table of Contents
All apps on Heroku use a process model (via Procfile) that lets them scale up or down instantly from the command line or Dashboard. Each app has a set of running dynos, managed by the dyno manager, which are known as its dyno formation.
Dynos are prorated to the second, so if you want to experiment with different configurations, you can do so and only be billed for actual seconds used. Remember, it’s your responsibility to set the correct number of dynos and workers for your app.
Use the app’s resources page on Dashboard to scale your dynos. Select your app and then, on the Resources tab, in the dyno section, click “Edit”. Drag the slider to set the number of dynos and then, click “Save”.
A web app typically has at least web and worker process types. You can set the concurrency level for either one by adjusting the number of dynos running each process type with the
$ heroku ps:scale web=2 Scaling dynos... done, now running web at 2:standard-1x
Or both at once:
$ heroku ps:scale web=2 worker=1 Scaling dynos... done, now running web at 2:standard-1x, worker at 1:standard-1x
Scaling dynos quantities can be specified as an absolute number or an increment from the current number of dynos.
$ heroku ps:scale web+2 Scaling dynos... done, now running web at 4:standard-1x.
If you want to stop running a particular process type entirely, simply scale it to
$ heroku ps:scale worker=0 Scaling dynos... done, now running web at 0:standard-1x.
Scaling the dyno size
Dynos can also be scaled vertically, providing them with more memory and CPU share. For example, to scale to two dynos of the
$ heroku ps:scale web=2:standard-2x Scaling dynos... done, now running web at 2:standard-2x.
Whenever you change the dyno size for a process type, using a simple count when scaling will retain the previously set size, so to scale down to one dyno of size
$ heroku ps:scale web=1 Scaling dynos... done, now running web at 1:standard-2x.
In order to scale back to two
standard-1x dynos for the “web” process type, you can again explicitly specify the size of dyno you want to scale to:
$ heroku ps:scale web=2:standard-1x
See the documentation on dyno types for more information on dynos and their characteristics.
Different dyno types have different limits to which they can be scaled. See Dyno Types to learn about the scaling limits.
The term dyno formation refers to the layout of your app’s dynos at a given time. The default formation for simple apps will be a single web dyno, whereas more demanding applications may consist of web, worker, clock, etc… process types. In the examples above, the formation was first changed to two web dynos, then two web dynos and a worker.
The scale command affects only process types named in the command. For example, if the app already has a dyno formation of two web dynos, and you run
heroku ps:scale worker=2, you will now have a total of four dynos (two web, two worker).
The current dyno formation can been seen by using the
heroku ps command:
$ heroku ps === web (Free): `bundle exec unicorn -p $PORT -c ./config/unicorn.rb` web.1: up for 8h web.2: up for 3m === worker (Free): `bundle exec stalk worker.rb` worker.1: up for 1m
The Unix watch utility can be very handy in combination with the
ps command. Run
watch heroku ps in one terminal while you add or remove dynos, deploy, or restart your app.
Any changes to the dyno formation are logged:
$ heroku logs | grep Scale 2011-05-30T22:19:43+00:00 heroku[api]: Scale to web=2, worker=1 by email@example.com
Note that the logged message includes the full dyno formation, not just dynos mentioned in the scale command.
Singleton process types, such as clock/scheduler process type or a process type to consume the Twitter streaming API, should never be scaled beyond a single dyno. They can’t benefit from additional concurrency and in fact they will create duplicate records or events in your system as each tries to do the same work at the same time.
Scaling up a given process type gives you more concurrency for the type of work handled by that process type. For example, adding more web dynos allows you to handle more concurrent HTTP requests, and therefore higher volumes of traffic. Adding more worker dynos will let you process more jobs in parallel, and therefore higher volumes of jobs.
There are circumstances where creating more dynos to run your web, worker, or other process types won’t help. One of these is bottlenecks on backing services, most commonly the database. If your database is a bottleneck, adding more dynos may actually make the problem worse. Instead, optimize your database queries, upgrade to a larger database, use caching to reduce load on the database, or switch to a sharded configuration or scale reads using followers.
Another circumstance where increased concurrency won’t help is long requests or jobs. For example, a slow HTTP request such as a report with a database query that takes 30 seconds, or a job to email out your newsletter to 20,000 subscribers. Concurrency gives you horizontal scale, which means it applies to work that can be subdivided - not large, monolithic work blocks.
The solution to the slow report might be to move the report calculation into the background and cache the results in memcache for later display. For the long job, the answer is to subdivide the work - create a single job which fans out by putting 20,000 jobs (one for each newsletter to be sent) onto the queue. A single worker can consume all these jobs in sequence, or you can scale up to multiple workers to consume these jobs more quickly. The more workers you add, the more quickly the entire batch will finish.