Creating and Managing Heroku Postgres Follower Databases

Last updated 03 July 2017

Database replication serves many purposes including increasing read throughput with a leader-follower configuration, additional availability with a hot standby, serving as a reporting database, and seamless migrations and upgrades. Though these strategies all serve different purposes they are all based on the ability to create and manage copies of a lead database. On Heroku Postgres, this functionality is exposed as the follow feature.

A database follower is a read-only copy of the leader database that stays up-to-date with the leader database data. As writes and other data modifications are committed in the leader database, the changes are streamed, in real-time, to the follower databases.

Create a follower

A follower can be created for any Standard, Premium, or Enterprise tier database that is itself not a follower (that is, followers cannot be chained). Followers cannot be created for a period on newly forked databases (this applies to both explicit forks and forks created through unfollow). The exact timeframe varies depending on the size of the database to be followed, and is typically between a few minutes and a few hours.

When a database is ready to support followers, that information will be shown in heroku pg:info:

$ heroku pg:info
=== DATABASE_URL, HEROKU_POSTGRESQL_PURPLE_URL
...
Fork/Follow: Available
...

To create a follower database you must first know the add-on name of the leader database. Use heroku pg:info to find its HEROKU_POSTGRESQL_*COLOR*_URL name.

$ heroku pg:info
=== DATABASE_URL, HEROKU_POSTGRESQL_CHARCOAL_URL
Plan:        Standard 0
Status:      available
...

Create a follower database by provisioning a new heroku-postgresql Standard, Production or Enterprise tier add-on database and specify the leader database to follow with the --follow flag. The flag can take either the config var name of the database on the same app, an argument of the form appname::HEROKU_POSTGRES_COLOR_URL, or the full URL of any Heroku Postgres database.

$ heroku addons:create heroku-postgresql:standard-2 --follow HEROKU_POSTGRESQL_CHARCOAL_URL
Adding heroku-postgresql:standard-2 to sushi... done, v71 ($200/mo)
Attached as HEROKU_POSTGRESQL_WHITE
Follower will become available for read-only queries when up-to-date
Use `heroku pg:wait` to track status

Preparing a follower can take anywhere from several minutes to several hours, depending on the size of your dataset. The heroku pg:wait command outputs the provisioning status of any new databases.

$ heroku pg:wait
Waiting for database HEROKU_POSTGRESQL_WHITE_URL... available

Create a follower on a different app

Followers do not need to be tied to the same application. With sharable add-ons, the databases can be on two separate applications. The steps are the same as those outlined for creating a follower on the same application with a few slight differences.

First, use heroku pg:info to find the resource name of the database that you want to follow:

$ heroku pg:info -a sushi
=== DATABASE_URL, HEROKU_POSTGRESQL_CHARCOAL_URL
Plan:        Standard 0
Status:      available
Add-on:      looking-simply-2449
...

Once the resource name has been found, type the add-ons command to create the follower on the app that you want it attached to. For example, if a second application is called other-app and I want to have a follower attached to it using the main database from sushi:

$ heroku addons:create heroku-postgresql:standard-0 --follow looking-simply-2449 -a other-app

Unfollow

The heroku pg:unfollow command stops the follower from receiving updates from its leader database and transforms it into a full read/write database containing all of the data received up to that point. This creates a database fork.

$ heroku pg:unfollow HEROKU_POSTGRESQL_WHITE_URL
!    HEROKU_POSTGRESQL_WHITE_URL will become writable and no longer
!    follow HEROKU_POSTGRESQL_CHARCOAL. This cannot be undone.

!    WARNING: Potentially Destructive Action
!    This command will affect the app: sushi
!    To proceed, type "sushi" or re-run this command with --confirm sushi

> sushi
Unfollowing... done

Database upgrades and migrations with changeovers

In addition to providing data redundancy, followers can also be used to change database plans with minimal downtime. To upgrade or migrate your database with a follower, see this guide on upgrading Heroku Postgres.

Monitoring followers

Because followers are asynchronously updated, they may be behind their leader by some number of commits. You can view the number of commits your follower is behind by running heroku pg:info. If your follower is increasing in the number of commits it is behind it may be due to long running transactions on your database. Using the pg-extras plugin you can run heroku pg:ps to get currently running transactions, then if any have been running for longer than expected you may cancel those with:

$ heroku pg:kill PROCESSID

If you are not able to cancel them, you can try terminating them with the -f parameter.

High availability with followers

Having a follower provisioned, even if not being actively used as a read slave, ensures that you always have a hot standby available for immediate promotion in situations where the primary database becomes corrupted or unavailable. As a general practice, applications desiring high-availability should provision a hot standby follower.

Manual failover

Heroku does not automatically promote a follower database when the primary database is corrupt or inaccessible. If this functionality is required, use a premium or enterprise tier plan that does offer HA. Performing a database failover is the same manual process as a database migration starting with the prevent data updates step.

Distributing app reads to followers

Heroku allows you to easily horizontally scale your app by adding additional dynos to meet capacity. Similarly, as detailed above, Heroku Postgres allows you to horizontally scale your database by adding read-only followers to the lead database. While these followers are great for analytical purposes, you can also use them via your application for handling read-only queries to your data. This type of architecture can be used to improve app performance as well as work around Heroku Postgres connection limits.

Redirecting your app’s read operations to one or more followers will require changes at the code level of your app. Since each app on Heroku is different, it’s not possible to make a detailed recommendation as to how to proceed. If your app is built using a framework, it’s likely the framework will have support for using multiple databases. In other cases, there will be third party libraries available to help with the handling of multiple databases. In some cases, especially as your app gets more complex, writing custom code will be necessary.