Continuous Testing Server with Functional UI test execution in parallel

Version 1.2.5

All Platforms

Set up Parallel Testing

Distribute tests to multiple build agents to run them in parallel.

Build agent machine

In the context of testing web apps, a build agent is considered as a computer with browser, which is driven by test scripts to verify the app.

Build agent machines are be physical or virtual machines, as long as they can communicate to the BuildWise server and the target web sites.

  • Virtual Machines in computers on LAN

    Use virtualization software such as VMware, Oracle VM VirtualBox or Parallel Desktop for Mac. Virtual Box is free.
    You can download free 90-day VM images from Microsoft.

  • Cloud instances

    AWS, AZure and Vultr all offer hosting Windows Server 2016 instances. The prices are all quite reasonable, staring about $50 per month.

  • Physical machines on LAN

    Reuse existing physical machines.

Once the machine is set up, install Git and Chrome (and other browsers if necessary).

Verify connection

Verify that you can visit

  • BuildWise server
  • Your test server (the application under testing)

in your browser.

Install BuildWise agent

A BuildWise agent is installable software that runs test jobs, perform the following steps repeatedly:

  1. Check the server whether there is an active build? If yes,
  2. Get the test script from the server
  3. Run the test script
  4. Return test results to the server.

BuildWise agnet currently only available on Windows. As BuildWise Server is 100% open-source (in Ruby), software companies can develop own agents that can work with BuildWise server.

Install BuildWise agent is simple, just download and run the installer, accepting all default options.

Starting with 3 agents

More agents will speed up test executions, but also require more infrastructure maintenance effort.

If you are not sure, we recommend starting with 1 BuildWise Server + 3 Virtual Box VMs in one computer. A typical laptop nowadays with 16GB memory can comfortably run them, and you probably can get it all set up within hours, no need seeking permissions.

General BuildWise agent configuration

  • Connection between agent and the server

Configure BuildWise agent for project

To make an agent to run tests for one project, two things

  • The test project checked out (from Git) on the Build agent machine

    This only needs to be done once.

    It is important that the parent repository of checked out project source on BuildWise Server are the same as the ones on build agents.

  • Environment variables