First, note that today the use of this harness is strongly discouraged in favour of the parallel test harness (see Parallel Test Harness). Still, there are few situations when the advantages offered by the parallel harness are irrelevant, and when test concurrency can even cause tricky problems. In those cases, it might make sense to still use the serial harness, for simplicity and reliability (we still suggest trying to give the parallel harness a shot though).
The serial test harness is enabled by the Automake option serial-tests. It operates by simply running the tests serially, one at the time, without any I/O redirection. It’s up to the user to implement logging of tests’ output, if that’s required or desired.
For historical and implementation reasons, the
variable is not supported by this harness (it will be silently
ignored if defined); only
TESTS_ENVIRONMENT is, and it is to be
considered a developer-reserved variable. This is done so that, when
using the serial harness,
TESTS_ENVIRONMENT can be defined to an
invocation of an interpreter through which the tests are to be run.
For instance, the following setup may be used to run tests with Perl:
TESTS_ENVIRONMENT = $(PERL) -Mstrict -w TESTS = foo.pl bar.pl baz.pl
It’s important to note that the use of
here would be invalid with the parallel harness. That harness
provides a more elegant way to achieve the same effect, with the further
benefit of freeing the
TESTS_ENVIRONMENT variable for the user
(see Parallel Test Harness).
Another, less serious limit of the serial harness is that it doesn’t really distinguish between simple failures and hard errors; this is due to historical reasons only, and might be fixed in future Automake versions.