Introducing Parallel Test Execution in JOSF

We are excited to announce a powerful new feature in JOSF, our low-code test automation solution for low-code platforms: parallel test execution. This enhancement allows you to run multiple tests concurrently, significantly speeding up your testing process and improving efficiency.

What is Parallel Test Execution?

Parallel test execution refers to the ability to run multiple tests simultaneously rather than sequentially. In JOSF, this is implemented at the playlist level, meaning that the collection of tests grouped within a playlist can be executed in parallel. This approach can drastically reduce the total time required to complete your test suite.

To visualize this, imagine executing your tests not by yourself and one-by-one, but in a team of testers, executing the tests all at the same time! To compare this, look at the following situation for 5 tests.

In the sequential execution, 5 tests are executed over a period of around six and a half minutes, while with the parallel execution, these tests are completed in a time, equal to the duration of the longest test.

Sequential execution

Parallel execution

How to enable parallel test execution for your tests in JOSF?

To enable parallel testing, open your playbook and select the playlist you’d like your tests to be run parallel. From there, enable parallelization options and set the maximum parallel tests and the ramp-up to what you’d like it to be.

Benefits of Parallel Test Execution

  1. Reduced Test Time: By running tests concurrently, you can achieve faster test completion times. This is especially beneficial for large test suites where running tests sequentially would be time-consuming.
  2. Increased Productivity: With quicker test cycles, your team can receive feedback sooner and address issues more promptly. This leads to a more efficient development process and quicker iterations.
  3. Optimized Resource Utilization: Parallel execution allows you to make better use of your available hardware resources, distributing the test load and avoiding bottlenecks.

Limitations and Considerations

While parallel test execution offers many advantages, there are some important considerations and potential limitations to keep in mind. Ensure that your machine has the necessary resources (CPU, memory, etc.) to handle multiple tests running at the same time. Running too many tests in parallel on a limited machine can lead to performance degradation and unreliable test results. Next to that, your System under test must be able to handle concurrent users.

Lastly, if you are running your tests within a continuous integration/continuous deployment (CI/CD) pipeline, be aware of the limitations of the pipeline environment. The machines used in the pipeline may have restrictions on the number of parallel processes they can efficiently support.

Investigate the possibilities

We invite you to explore the capabilities of parallel test execution in JOSF. Download the latest version of JOSF and push the limits of your test automation. Experiment with the number of parallel tests and discover the optimal configuration for your setup. Your feedback will be invaluable as we continue to enhance JOSF.

Download the latest version of JOSF and start speeding up your test cycles today!