GCC 2.95 regression test strategy

Regression Testing

One of the critical steps in making releases is regression testing. For GCC 2.95 regression tests have been performed against EGCS 1.1.2.

Since it is impossible to test every platform, several popular platforms were selected for regression testing. The goal is for GCC 2.95 to have zero regressions relative to EGCS 1.1.2 for gcc, g++, g77, objc, libstdc++, libio, and libg++.

Regression Testing Status

Platform build regressions libg++ tests fast-fixinc
alpha-dec-osf4.0 OK OK OK OK
alphaev5-unknown-linux-gnu OK OK OK N/A
hppa1.1-hp-hpux10.20 OK OK OK OK
i386-pc-freebsd2.2.6 OK OK OK OK
i386-pc-freebsd3.0 OK OK OK OK
i586-pc-linux-gnu OK OK OK N/A
i686-pc-linux-gnulibc1 OK OK UNTESTED N/A
i686-pc-linux-gnu OK OK OK N/A
i686-pc-sco3.2v5.0.5 OK libstdc++
m68k-hp-bsd4.4 OK OK OK OK
mips-sgi-irix6.5 OK OK OK OK
{rs6000,powerpc}-ibm-aix4.2 OK OK OK OK
powerpc-ibm-linux-gnu OK OK OK N/A
sparc-sun-solaris2.5 OK OK OK OK
sparc-sun-solaris2.7 OK OK OK OK
sparc-sun-sunos4.1 OK OK OK OK
sparc-sun-linux-gnu OK OK OK N/A

Package/Feature Testing

Platform linux-2.2.10 glibc-2.1.1 redhat-6.0 lapack
alphaev6-unknown-linux-gnu OK FAILS
hppa1.1-hp-hpux10.20 N/A N/A N/A -O2 OK
-O3 -funroll-loops fails
i586-unknown-linux-gnu OK OK
i686-unknown-linux-gnu OK OK compat-binutils compat-egcs kdelibs korganizer python sgml-tools OK
powerpc-unknown-linux-gnu 2.2.6 OK OK OK
sparc-sun-solaris2.5 N/A N/A N/A -O2 OK
sparc-unknown-linux-gnu OK

Package testing notes

Note the linux kernel, modules and related code must be compiled with -fno-strict-aliasing as the linux kernel violates ANSI/ISO C standards used to perform type based alias analysis


In addition to performing regression testing we want to test major software packages with GCC 2.95. This list is not complete (I would like to add at least one major C++ and Fortran package).