glibc/conform
Joseph Myers 95edd05c75 Combine more conformtest tests into single execution of the compiler.
In <https://sourceware.org/ml/libc-alpha/2018-11/msg00225.html>,
Florian reported that the change from conformtest.pl to conformtest.py
had increased conform/ test time, possibly because of increased
startup overhead for Python scripts.

This patch improves conformtest.py performance by arranging for as
many tests of a (header, standard) pair as possible to use a single
execution of the compiler, so it does not need to initialize and parse
the whole header under test separately for every test assertion.
Specifically, compilation tests that are not marked as "optional" or
"xfail" are combined into a single source file, and are only then run
separately if compilation of that combined file fails.  For me, this
reduces the wall clock time for the conformtest.py tests (not the
whole of the conform/ directory) from two minutes to 15 seconds.

Tested for x86_64, and with build-many-glibcs.py.

	* conform/conformtest.py (CompileSubTest.__init__): Set
	self.run_early to False.
	(ExecuteSubTest.__init__): Likewise.
	(HeaderTests.run): Try running all non-optional, non-XFAILed
	compilation tests in a single execution of the compiler.
2018-11-22 21:21:36 +00:00
..
data Replace conformtest.pl with conformtest.py. 2018-11-09 13:54:06 +00:00
check-header-lists.sh Update copyright dates with scripts/update-copyrights. 2018-01-01 00:32:25 +00:00
conformtest.py Combine more conformtest tests into single execution of the compiler. 2018-11-22 21:21:36 +00:00
glibcconform.py Replace conformtest.pl with conformtest.py. 2018-11-09 13:54:06 +00:00
linknamespace.py Convert linknamespace tests from Perl to Python. 2018-10-30 22:18:34 +00:00
list-header-symbols.py Replace conform/list-header-symbols.pl with a Python script. 2018-08-31 21:19:51 +00:00
Makefile Update conform/Makefile mkdir commands. 2018-11-09 17:40:58 +00:00