Knapsack Pro

This add-on is operated by Knapsack Sp. z o.o.

Run 1-hour tests in 2 min on your current CI server with optimal parallelisation

Knapsack Pro

Last updated March 15, 2023

Knapsack Pro is a tool that helps split Ruby and JavaScript tests automatically across parallel CI nodes, also known as parallel jobs. Knapsack Pro has “Queue Mode”, which split tests in a dynamic way across parallel CI nodes to ensure that each CI node completes the tests simultaneously. As a result, you will not experience a bottleneck with your CI build, and you can execute tests in an optimal time or as fast as possible.

Ruby supported test runners:

  • RSpec
  • Minitest
  • Cucumber
  • Test::Unit
  • Spinach
  • Turnip

JavaScript supported test runners:

  • Cypress.io
  • Jest

Custom integration with Knapsack Pro API:

Supported CI servers:

  • GitHub Actions
  • CircleCI.com
  • Buildkite.com
  • Gitlab CI
  • Heroku CI
  • SemaphoreCI.com
  • Jenkins
  • Travis-CI.org
  • Codeship.com
  • Codefresh.io
  • AWS CodeBuild
  • Google Cloud Build
  • Azure Pipelines
  • Bitbucket Pipelines
  • TeamCity
  • Drone.io
  • Buddy.works
  • AppVeyor
  • Solano CI
  • GoCD
  • Concourse
  • Cirrus-CI.org
  • Jenkins X for Kubernetes
  • Argo CI/CD for Kubernetes
  • Flux CD for Kubernetes
  • Harness.io CI/CD
  • Tekton Kubernetes-native CI/CD
  • Prow Kubernetes-based CI/CD
  • Any other CI server using an ENV variables custom setup

How Knapsack Pro Queue Mode works

Please see an article showing the difference between Regular Mode and Queue Mode.

Provisioning the add-on

Knapsack Pro can be attached to a Heroku application using the Heroku CLI:

$ heroku addons:create knapsack-pro --app YOUR_HEROKU_APP_NAME

Once Knapsack Pro has been added you may want to attach it to another Heroku app and then sign into Knapsack Pro user dashboard to get your API token for your first test suite. In the user dashboard, you will also find the installation guide for your test runner and CI provider.

Test plan

All users of the Beta version of the Knapsack Pro add-on can use an unlimited version of Knapsack Pro for free during Beta testing.

Trial plan

When you use a trial plan, you can test Knapsack Pro for 14 days with active API usage. For instance, when you don’t use Knapsack Pro API over the weekend or when you are busy with other work, your trial days are waiting for you. CI configuration can take time especially when you are migrating from one CI provider to another. If you need more time for testing just let us know. We would be happy to extend your trial period and help you with CI and project configuration.

Attaching the add-on to another app

The Knapsack Pro add-on is shareable across Heroku apps. You can attach it to multiple Heroku apps so your developers can use it with many projects. Remember you need to generate a new API token for each project’s test suite in the Knapsack Pro user dashboard. You can create many projects in Knapsack Pro user dashboard.

Attaching the add-on can be useful for instance when you have staging and production Heroku app. You can provision the Knapsack Pro add-on for the production applications and later attach it to the staging applications so all developers could easily access the add-on from the Heroku dashboard.

# First we need to check what's the name generated for the Knapsack Pro add-on
# which was provisioned for your first Heroku app.
# Show list of add-ons and copy add-on name for Knapsack Pro
$ heroku addons --app YOUR_HEROKU_APP_NAME

# replace knapsack-pro-staging-infinite-32142 with your Knapsack Pro add-on name
$ heroku addons:attach knapsack-pro-staging-infinite-32142 --app YOUR_HEROKU_APP_NAME

User dashboard

The Knapsack Pro user dashboard can be accessed via the CLI:

$ heroku addons:open knapsack-pro --app YOUR_HEROKU_APP_NAME

or by visiting the Heroku Dashboard, selecting the application, and then selecting Knapsack Pro from the Add-ons menu.

In the user dashboard, you can find a list of your projects and all associated API tokens for each project. Each test suite should have a separate API token. For instance, you have a Ruby on Rails project and you have RSpec tests for backend API. You also have Cucumber tests for end-to-end testing. In such a case, you need to generate 2 API tokens. One for RSpec and the second API token for Cucumber tests.

If you run the single test suite in multiple steps on your CI server, for instance, you have RSpec tests but you run unit tests first and as a second step on your CI you run RSpec features tests then you should generate 2 API tokens. The first API token is needed for unit tests and second API token is for features tests.

Installation

Installation depends on the test runner and CI provider you use. You can follow the installation guide that fits your project.

Troubleshooting

The most common problems can be found in FAQ but here are listed the top questions developers ask for.

For Ruby projects:

FAQ

Answers to common questions specific to your test runner or your CI provider can be found in the documentation for particular Knapsack Pro client.

Migrating between plans

Plans migration is easy and instant. It requires no code change and does not affect your existing collected tests timing data for CI builds. You can use the below command to migrate to a new plan:

An example of how to upgrade to a parallel-10 plan.

$ heroku addons:upgrade knapsack-pro:parallel-10 --app YOUR_HEROKU_APP_NAME

List of all plans can be found here.

Support

All Knapsack Pro Heroku add-on support and runtime issues should be submitted via the Heroku Support channels. You can send us your suggestions and feedback at knapsackpro.com.

Case studies

Knapsack Pro supports many CI providers and various test runners. You can see parallel testing examples with videos for a few CI providers here. If you use Heroku CI you should take a look at this article explaining how to run tests faster on Heroku CI with parallel dynos.

Removing the add-on

Knapsack Pro can be removed using the Heroku CLI.

This will not destroy associated data immediately. Can be undone only after support contact. Removing the add-on will mark your organization account in Knapsack Pro as de-provisioned (you won’t be able to use API tokens to split tests). Within 30 days your collected test timing data will be destroyed.

$ heroku addons:destroy knapsack-pro --app YOUR_HEROKU_APP_NAME

Feedback

Log in to submit feedback.