GCC 2.95 regression test strategy

Regression Testing

One of the critical steps in making releases is regression testing. For GCC 2.95 regression tests have been performed against EGCS 1.1.2.

Since it is impossible to test every platform, several popular platforms were selected for regression testing. The goal is for GCC 2.95 to have zero regressions relative to EGCS 1.1.2 for gcc, g++, g77, objc, libstdc++, libio, and libg++.

Regression Testing Status

Platform build regressions libg++ tests fast-fixinc
alpha-dec-osf4.0 OK OK OK OK
alphaev5-unknown-linux-gnu OK OK OK N/A
hppa1.1-hp-hpux10.20 OK OK OK OK
i386-pc-freebsd2.2.6 OK OK OK OK
i386-pc-freebsd3.0 OK OK OK OK
i586-pc-linux-gnu OK OK OK N/A
i686-pc-linux-gnulibc1 OK OK UNTESTED N/A
i686-pc-linux-gnu OK OK OK N/A
i686-pc-sco3.2v5.0.5 OK libstdc++
typename8.C
sig13.C
new3.C
 OK N/A
m68k-hp-bsd4.4 OK OK OK OK
mips-sgi-irix6.5 OK OK OK OK
{rs6000,powerpc}-ibm-aix4.2 OK OK OK OK
powerpc-ibm-linux-gnu OK OK OK N/A
sparc-sun-solaris2.5 OK OK OK OK
sparc-sun-solaris2.7 OK OK OK OK
sparc-sun-sunos4.1 OK OK OK OK
sparc-sun-linux-gnu OK OK OK N/A

Package/Feature Testing

Platform linux-2.2.10 glibc-2.1.1 redhat-6.0 lapack
alphaev6-unknown-linux-gnu OK FAILS
hppa1.1-hp-hpux10.20 N/A N/A N/A -O2 OK
-O3 -funroll-loops fails
i586-unknown-linux-gnu OK OK
i686-unknown-linux-gnu OK OK compat-binutils compat-egcs kdelibs korganizer python sgml-tools OK
powerpc-unknown-linux-gnu 2.2.6 OK OK OK
sparc-sun-solaris2.5 N/A N/A N/A -O2 OK
sparc-unknown-linux-gnu OK

Package testing notes

Note the linux kernel, modules and related code must be compiled with -fno-strict-aliasing as the linux kernel violates ANSI/ISO C standards used to perform type based alias analysis

.

In addition to performing regression testing we want to test major software packages with GCC 2.95. This list is not complete (I would like to add at least one major C++ and Fortran package).

For questions related to the use of GCC, please consult these web pages and the GCC manuals. If that fails, the gcc-help@gcc.gnu.org mailing list might help. Comments on these web pages and the development of GCC are welcome on our developer list at gcc@gcc.gnu.org. All of our lists have public archives.

Copyright (C) Free Software Foundation, Inc. Verbatim copying and distribution of this entire article is permitted in any medium, provided this notice is preserved.

These pages are maintained by the GCC team. Last modified 2022-11-01.