Ninjatrappeur's systemd working tree
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
 
Félix Baylac-Jacqué 15d1e0badf
wip
1 year ago
..
TEST-01-BASIC test: update test_create_image 2 years ago
TEST-02-UNITTESTS test: switch TEST-02-CRYPTSETUP and TEST-24-UNITTESTS 2 years ago
TEST-03-JOBS
TEST-04-JOURNAL
TEST-05-RLIMITS
TEST-06-SELINUX
TEST-07-ISSUE-1981
TEST-08-ISSUE-2730
TEST-09-ISSUE-2691
TEST-10-ISSUE-2467
TEST-11-ISSUE-3166
TEST-12-ISSUE-3171
TEST-13-NSPAWN-SMOKE nspawn: implement container host os-release interface 2 years ago
TEST-14-MACHINE-ID
TEST-15-DROPIN
TEST-16-EXTEND-TIMEOUT
TEST-17-UDEV-WANTS
TEST-18-FAILUREACTION
TEST-19-DELEGATE
TEST-20-MAINPIDGAMES test: de-duplicate test_setup() functions 2 years ago
TEST-22-TMPFILES
TEST-23-TYPE-EXEC
TEST-24-CRYPTSETUP test: switch TEST-02-CRYPTSETUP and TEST-24-UNITTESTS 2 years ago
TEST-25-IMPORT test: convert ubuntu-ci to use deny-list 2 years ago
TEST-26-SETENV
TEST-27-STDOUTFILE
TEST-28-PERCENTJ-WANTEDBY
TEST-29-UDEV-ID_RENAMING test: add test for device renaming issue #16967 2 years ago
TEST-30-ONCLOCKCHANGE test: convert ubuntu-ci to use deny-list 2 years ago
TEST-31-DEVICE-ENUMERATION
TEST-32-OOMPOLICY
TEST-33-CLEAN-UNIT
TEST-34-DYNAMICUSERMIGRATE test: de-duplicate test_setup() functions 2 years ago
TEST-36-NUMAPOLICY test: s/MUMA/NUMA/ 2 years ago
TEST-37-RUNTIMEDIRECTORYPRESERVE
TEST-38-FREEZER
TEST-39-EXECRELOAD
TEST-40-EXEC-COMMAND-EX test: convert ubuntu-ci to use deny-list 2 years ago
TEST-41-ONESHOT-RESTART
TEST-42-EXECSTOPPOST
TEST-43-PRIVATEUSER-UNPRIV
TEST-44-LOG-NAMESPACE
TEST-46-HOMED
TEST-47-ISSUE-14566
TEST-48-START-STOP-NO-RELOAD core: store timestamps of unit load attempts 2 years ago
TEST-49-UDEV-EVENT-TIMEOUT test: add integration test for udev event timeout 2 years ago
TEST-50-DISSECT test: fix TEST-50-DISSECT build on Ubuntu CI 2 years ago
TEST-51-ISSUE-16115 core: don't consider SERVICE_SKIP_CONDITION for abnormal or failure restarts 2 years ago
TEST-52-HONORFIRSTSHUTDOWN test: Add "finish" rule to .PHONY 2 years ago
TEST-53-ISSUE-16347 timer: Adjust calendar timers based on monotonic timer instead of realtime 2 years ago
TEST-54-CREDS test: add test suite for new credentials logic 2 years ago
TEST-55-UDEV-TAGS test: add test for new "sticky" tags logic 2 years ago
TEST-56-OOMD test: add basic memory pressure extended test for oomd 2 years ago
dmidecode-dumps test: add one more dmidecode dump 2 years ago
fuzz meson: fix git ls-files invocations during rebase 1 year ago
hwdb.d
journal-data
mocks
test-execute test-execute: make sure shell execs the child 2 years ago
test-network test-network: add tests for route advmss 2 years ago
test-network-generator-conversion
test-path license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
test-path-util core/execute: fall back to execve() for scripts 2 years ago
test-resolve
test-sysusers sysusers: look at login.defs when setting the default range to allocate users 2 years ago
test-umount
testsuite-04.units tests: replace the few remaining Type=simple with Type=exec 2 years ago
testsuite-06.units
testsuite-08.units
testsuite-10.units
testsuite-11.units tests: replace the few remaining Type=simple with Type=exec 2 years ago
testsuite-16.units
testsuite-28.units
testsuite-30.units/systemd-timedated.service.d
testsuite-52.units test: remove executable bit from testsuite-52.service 2 years ago
units wip 1 year ago
.gitignore
README.testsuite tests: add TEST_PREFER_NSPAWN variable to run as many as possible under nspawn 2 years ago
create-busybox-container tests/TEST-50: support the case when /etc/os-release is present 2 years ago
create-sys-script.py license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
hwdb-test.sh license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
meson.build meson: fix git ls-files invocations during rebase 1 year ago
mkosi.build.networkd-test
mkosi.default.networkd-test mkosi: make sure our mkosi files work with f33 2 years ago
mkosi.nspawn.networkd-test
networkd-test.py networkd-test: add final newlines in generated files, use .format() 2 years ago
rule-syntax-check.py license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
run-integration-tests.sh Do not run ninja in run-integration-tests.sh 2 years ago
run-unit-tests.py
sd-script.py tree-wide: fix typo 2 years ago
splash.bmp
sys-script.py Merge pull request #17431 from msekletar/udev-link-update-race 2 years ago
sysv-generator-test.py license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
test-efi-create-disk.sh
test-exec-deserialization.py license: LGPL-2.1+ -> LGPL-2.1-or-later 2 years ago
test-functions tests: add TEST_PREFER_NSPAWN variable to run as many as possible under nspawn 2 years ago
test-network-generator-conversion.sh tests: when creating temp dirs, include test name in path 2 years ago
test-sysusers.sh.in sysusers: look at login.defs when setting the default range to allocate users 2 years ago
testdata
udev-dmi-memory-id-test.sh meson: make each dmidecode a separate test 2 years ago
udev-test.pl test/udev-test: gracefully exit when imports fail 2 years ago

README.testsuite

The extended testsuite only works with UID=0. It contains of several
subdirectories named "test/TEST-??-*", which are run one by one.

To run the extended testsuite do the following:

$ ninja -C build # Avoid building anything as root later
$ sudo test/run-integration-tests.sh
ninja: Entering directory `/home/zbyszek/src/systemd/build'
ninja: no work to do.
--x-- Running TEST-01-BASIC --x--
+ make -C TEST-01-BASIC BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run
make: Entering directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
TEST-01-BASIC CLEANUP: Basic systemd setup
TEST-01-BASIC SETUP: Basic systemd setup
...
TEST-01-BASIC RUN: Basic systemd setup [OK]
make: Leaving directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
--x-- Result of TEST-01-BASIC: 0 --x--
--x-- Running TEST-02-CRYPTSETUP --x--
+ make -C TEST-02-CRYPTSETUP BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run

If one of the tests fails, then $subdir/test.log contains the log file of
the test.

To run just one of the cases:

$ sudo make -C test/TEST-01-BASIC clean setup run

Specifying the build directory
==============================

If the build directory is not detected automatically, it can be specified
with BUILD_DIR=:

$ sudo BUILD_DIR=some-other-build/ test/run-integration-tests

or

$ sudo make -C test/TEST-01-BASIC BUILD_DIR=../../some-other-build/ ...

Note that in the second case, the path is relative to the test case directory.
An absolute path may also be used in both cases.

Configuration variables
=======================

TEST_NO_QEMU=1
Don't run tests under QEMU

TEST_QEMU_ONLY=1
Run only tests that require QEMU

TEST_NO_NSPAWN=1
Don't run tests under systemd-nspawn

TEST_PREFER_NSPAWN=1
Run all tests that do not require qemu under systemd-nspawn

TEST_NO_KVM=1
Disable QEMU KVM auto-detection (may be necessary when you're trying to run the
*vanilla* QEMU and have both qemu and qemu-kvm installed)

TEST_NESTED_KVM=1
Allow tests to run with nested KVM. By default, the testsuite disables
nested KVM if the host machine already runs under KVM. Setting this
variable disables such checks

QEMU_MEM=512M
Configure amount of memory for QEMU VMs (defaults to 512M)

QEMU_SMP=1
Configure number of CPUs for QEMU VMs (defaults to 1)

KERNEL_APPEND='...'
Append additional parameters to the kernel command line

NSPAWN_ARGUMENTS='...'
Specify additional arguments for systemd-nspawn

QEMU_TIMEOUT=infinity
Set a timeout for tests under QEMU (defaults to infinity)

NSPAWN_TIMEOUT=infinity
Set a timeout for tests under systemd-nspawn (defaults to infinity)

INTERACTIVE_DEBUG=1
Configure the machine to be more *user-friendly* for interactive debuggung
(e.g. by setting a usable default terminal, suppressing the shutdown after
the test, etc.)

The kernel and initramfs can be specified with $KERNEL_BIN and $INITRD.
(Fedora's or Debian's default kernel path and initramfs are used by default)

A script will try to find your QEMU binary. If you want to specify a different
one with $QEMU_BIN.

Debugging the qemu image
========================

If you want to log in the testsuite virtual machine, you can specify additional
kernel command line parameter with $KERNEL_APPEND and then log in as root.

$ sudo make -C test/TEST-01-BASIC KERNEL_APPEND="systemd.unit=multi-user.target" run

Root password is empty.

Ubuntu CI
=========

New PR submitted to the project are run through regression tests, and one set
of those is the 'autopkgtest' runs for several different architectures, called
'Ubuntu CI'. Part of that testing is to run all these tests. Sometimes these
tests are temporarily deny-listed from running in the 'autopkgtest' tests while
debugging a flaky test; that is done by creating a file in the test directory
named 'deny-list-ubuntu-ci', for example to prevent the TEST-01-BASIC test from
running in the 'autopkgtest' runs, create the file
'TEST-01-BASIC/deny-list-ubuntu-ci'.

The tests may be disabled only for specific archs, by creating a deny-list file
with the arch name at the end, e.g.
'TEST-01-BASIC/deny-list-ubuntu-ci-arm64' to disable the TEST-01-BASIC test
only on test runs for the 'arm64' architecture.

Note the arch naming is not from 'uname -m', it is Debian arch names:
https://wiki.debian.org/ArchitectureSpecificsMemo

For PRs that fix a currently deny-listed test, the PR should include removal
of the deny-list file.

In case a test fails, the full set of artifacts, including the journal of the
failed run, can be downloaded from the artifacts.tar.gz archive which will be
reachable in the same URL parent directory as the logs.gz that gets linked on
the Github CI status.

To add new dependencies or new binaries to the packages used during the tests,
a merge request can be sent to: https://salsa.debian.org/systemd-team/systemd
targeting the 'upstream-ci' branch.