Systemd/test
Chris Down c52db42b78 cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow
In cgroup v2 we have protection tunables -- currently MemoryLow and
MemoryMin (there will be more in future for other resources, too). The
design of these protection tunables requires not only intermediate
cgroups to propagate protections, but also the units at the leaf of that
resource's operation to accept it (by setting MemoryLow or MemoryMin).

This makes sense from an low-level API design perspective, but it's a
good idea to also have a higher-level abstraction that can, by default,
propagate these resources to children recursively. In this patch, this
happens by having descendants set memory.low to N if their ancestor has
DefaultMemoryLow=N -- assuming they don't set a separate MemoryLow
value.

Any affected unit can opt out of this propagation by manually setting
`MemoryLow` to some value in its unit configuration. A unit can also
stop further propagation by setting `DefaultMemoryLow=` with no
argument. This removes further propagation in the subtree, but has no
effect on the unit itself (for that, use `MemoryLow=0`).

Our use case in production is simplifying the configuration of machines
which heavily rely on memory protection tunables, but currently require
tweaking a huge number of unit files to make that a reality. This
directive makes that significantly less fragile, and decreases the risk
of misconfiguration.

After this patch is merged, I will implement DefaultMemoryMin= using the
same principles.
2019-04-12 17:23:58 +02:00
..
fuzz network: add MACsecTransmitAssociation.UseForEncoding= setting 2019-04-12 10:12:42 +09:00
hwdb hwdb: improve and test syntax error messages 2016-12-01 11:56:50 -05:00
journal-data test-journal-importer: add a test case with broken input 2017-02-15 00:31:55 -05:00
loopy.service.d core: do not add dependencies to self 2014-08-07 20:42:58 -04:00
mocks Add mock fsck process 2015-02-18 16:33:46 +01:00
TEST-01-BASIC scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-02-CRYPTSETUP scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-03-JOBS scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-04-JOURNAL scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-05-RLIMITS scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-06-SELINUX scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-07-ISSUE-1981 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-08-ISSUE-2730 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-09-ISSUE-2691 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-10-ISSUE-2467 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-11-ISSUE-3166 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-12-ISSUE-3171 scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-13-NSPAWN-SMOKE scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-14-MACHINE-ID scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-15-DROPIN scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-16-EXTEND-TIMEOUT scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-17-UDEV-WANTS scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-18-FAILUREACTION scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-19-DELEGATE scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-20-MAINPIDGAMES scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-21-SYSUSERS scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-22-TMPFILES scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-23-TYPE-EXEC scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-24-UNIT-TESTS scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-25-IMPORT scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-26-SETENV scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-27-STDOUTFILE scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-28-PERCENTJ-WANTEDBY scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-29-UDEV-ID_RENAMING scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-30-ONCLOCKCHANGE scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-31-DEVICE-ENUMERATION scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
TEST-31-OOMPOLICY test: add test case for new OOM logic 2019-04-09 11:17:58 +02:00
test-execute test-execute: block /sys not /proc 2019-03-15 15:46:41 +01:00
test-network test-network: add tests for MACsec 2019-04-12 10:12:42 +09:00
test-path test-path: move all related test files to a specific directory 2015-10-31 15:07:19 +01:00
test-resolve test: move resolved test data into test/ 2017-02-13 22:23:48 +01:00
test-umount test-umount: add a simple test for swap_list_get() 2018-03-16 10:12:50 +01:00
unit-.service.d test: add test for prefix unit loading 2018-04-13 11:34:48 +02:00
unit-with-.service.d test: add test for prefix unit loading 2018-04-13 11:34:48 +02:00
unit-with-multiple-.service.d test: add test for prefix unit loading 2018-04-13 11:34:48 +02:00
unit-with-multiple-dashes.service.d test: add test for prefix unit loading 2018-04-13 11:34:48 +02:00
.gitignore
a.service
b.service
basic.target
c.service
create-sys-script.py tree-wide: use proper unicode © instead of (C) where we can 2018-06-14 10:20:20 +02:00
d.service
daughter.service cgroup v2: Don't require CPU controller for CPU accounting in 4.15+ 2018-11-18 12:21:41 +00:00
dml-discard-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-discard-set-ml.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-discard.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-override-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-override.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-empty.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-set-dml.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough-set-ml.service cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml-passthrough.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
dml.slice cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
e.service
end.service tests: various fixes 2015-11-10 18:01:15 +00:00
f.service
g.service
grandchild.service
h.service
hello-after-sleep.target
hello.service
hwdb-test.sh tree-wide: drop license boilerplate 2018-04-06 18:58:55 +02:00
loopy.service core: do not add dependencies to self 2014-08-07 20:42:58 -04:00
loopy2.service core: do not add dependencies to self 2014-08-07 20:42:58 -04:00
loopy3.service core: warn when merged units have conflicting dependencies 2014-08-07 20:46:49 -04:00
loopy4.service core: warn when merged units have conflicting dependencies 2014-08-07 20:46:49 -04:00
meson.build cgroup: Implement default propagation of MemoryLow with DefaultMemoryLow 2019-04-12 17:23:58 +02:00
mkosi.build.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
mkosi.default.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
mkosi.nspawn.networkd-test networkd-test: add mkosi snippet for building and running networkd-tets.py in a network namespaced container 2018-12-07 12:25:24 +01:00
networkd-test.py test: use newer verb to set log levels 2019-04-03 08:19:08 +02:00
nomem.slice cgroup: Add DisableControllers= directive to disable controller in subtree 2018-12-03 15:40:31 +00:00
nomemleaf.service cgroup: Add DisableControllers= directive to disable controller in subtree 2018-12-03 15:40:31 +00:00
parent-deep.slice
parent.slice core: translate between IO and BlockIO settings to ease transition 2016-05-18 17:35:12 -07:00
README.testsuite test: improve testsuite configuration documentation 2019-03-16 18:59:07 +01:00
rule-syntax-check.py rule-syntax-check: allow PROGRAM as an assignment 2019-02-10 19:06:58 +01:00
run-integration-tests.sh scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
run-unit-tests.py run-unit-tests: add option to run unsafe tests too 2018-09-24 15:42:50 +02:00
sched_idle_bad.service
sched_idle_ok.service
sched_rr_bad.service
sched_rr_change.service
sched_rr_ok.service
shutdown.target
sleep.service
sockets.target
son.service
splash.bmp sd-boot: add EFI boot manager and stub loader 2015-02-17 14:36:59 +01:00
sys-script.py tree-wide: use proper unicode © instead of (C) where we can 2018-06-14 10:20:20 +02:00
sysinit.target
sysv-generator-test.py tree-wide: use proper unicode © instead of (C) where we can 2018-06-14 10:20:20 +02:00
test-efi-create-disk.sh scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
test-exec-deserialization.py tree-wide: beautify remaining copyright statements 2018-06-14 10:20:21 +02:00
test-functions scripts: use 4 space indentation 2019-04-12 08:30:31 +02:00
testsuite.target
timers.target
udev-test.pl test-udev: fix alignment and drop unnecessary white spaces 2019-02-22 06:50:21 +09:00
unit-with-multiple-dashes.service test: add test for prefix unit loading 2018-04-13 11:34:48 +02:00
unstoppable.service tests: fix unstoppable service 2015-11-12 03:24:10 +00:00

The extended testsuite only works with UID=0. It contains of several
subdirectories named "test/TEST-??-*", which are run one by one.

To run the extended testsuite do the following:

$ ninja -C build  # Avoid building anything as root later
$ sudo test/run-integration-tests.sh
ninja: Entering directory `/home/zbyszek/src/systemd/build'
ninja: no work to do.
--x-- Running TEST-01-BASIC --x--
+ make -C TEST-01-BASIC BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run
make: Entering directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
TEST CLEANUP: Basic systemd setup
TEST SETUP: Basic systemd setup
...
TEST RUN: Basic systemd setup [OK]
make: Leaving directory '/home/zbyszek/src/systemd/test/TEST-01-BASIC'
--x-- Result of TEST-01-BASIC: 0 --x--
--x-- Running TEST-02-CRYPTSETUP --x--
+ make -C TEST-02-CRYPTSETUP BUILD_DIR=/home/zbyszek/src/systemd/build clean setup run

If one of the tests fails, then $subdir/test.log contains the log file of
the test.

To run just one of the cases:

$ sudo make -C test/TEST-01-BASIC clean setup run

Specifying the build directory
==============================

If the build directory is not detected automatically, it can be specified
with BUILD_DIR=:

$ sudo BUILD_DIR=some-other-build/ test/run-integration-tests

or

$ sudo make -C test/TEST-01-BASIC BUILD_DIR=../../some-other-build/ ...

Note that in the second case, the path is relative to the test case directory.
An absolute path may also be used in both cases.

Configuration variables
=======================

TEST_NO_QEMU=1
    Don't run tests under QEMU

TEST_NO_NSPAWN=1
    Don't run tests under systemd-nspawn

TEST_NO_KVM=1
    Disable QEMU KVM autodetection (may be necessary when you're trying to run the
    *vanilla* QEMU and have both qemu and qemu-kvm installed)

QEMU_MEM=512M
    Configure amount of memory for QEMU VMs (defaults to 512M)

QEMU_SMP=1
    Configure number of CPUs for QEMU VMs (defaults to 1)

KERNEL_APPEND='...'
    Append additional parameters to the kernel command line

NSPAWN_ARGUMENTS='...'
    Specify additional arguments for systemd-nspawn

QEMU_TIMEOUT=infinity
    Set a timeout for tests under QEMU (defaults to infinity)

NSPAWN_TIMEOUT=infinity
    Set a timeout for tests under systemd-nspawn (defaults to infinity)

INTERACTIVE_DEBUG=1
    Configure the machine to be more *user-friendly* for interactive debuggung
    (e.g. by setting a usable default terminal, suppressing the shutdown after
    the test, etc.)

The kernel and initramfs can be specified with $KERNEL_BIN and $INITRD.
(Fedora's or Debian's default kernel path and initramfs are used by default)

A script will try to find your QEMU binary. If you want to specify a different
one with $QEMU_BIN.

Debugging the qemu image
========================

If you want to log in the testsuite virtual machine, you can specify additional
kernel command line parameter with $KERNEL_APPEND and then log in as root.

$ sudo make -C test/TEST-01-BASIC KERNEL_APPEND="systemd.unit=multi-user.target" run

Root password is empty.