This patch set runs tests in parallel (on travis/appveyor/vagrant), it
includes cmake/autotools(automake).
It should significantly decrease time that tests tooks on travis-ci (3-4
times lower, right now it is about 14-17 hours - too long!), but not
without downsides, now because travis-ci workers has limited resources
we will have more timing-related failures, but this is another storry,
anyway ~16 hours is not acceptable. Anyway if machine has enough
resources it is great to have ability to run tests in parallel (which
automake couldn't do before).
Changes for common test env:
- autotools: before 17m / after 3m
- cmake: before 15m / after 87 sec
* automake-tests-parallel-v4:
Run tests in parallel (they are lightweight), on CI and vagrant boxes
travis-ci: install cmake from xenial (CTEST_PARALLEL_LEVEL support)
test: register different tests in automake
test: run different tests under different options (in a wrapper)
automake: do not use serial-tests if parallel-test-harness available
Fixes: #439
By default 20 parllel jobs, but one caveat for travis-ci, osx boxes
there slower and have less resources then linux (discovered during
testing), so limit number of parallel jobs to 4 there, and also install
travis_wait, so that travis-ci will not fail the build when there is no
output for 10 minutes, since for osx boxes it is very likely.
Refs: travis-ci/travis-ci@7202
$ make --version
GNU Make 3.81
Copyright (C) 2006 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.
There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.
This program built for i386-apple-darwin11.3.0
OS:
- linux
- freebsd
- osx
- netbsd
- solaris
- win
And mostly they all are more or less fine, except for timing issues
Also it supports next environment variables:
- NO_PKG
- NO_CMAKE
- NO_AUTOTOOLS
For instance if you run ubuntu box seocnd time, then you can run with:
$ NO_PKG=true vagrant provision ubuntu
