Not sure how I missed this, but we of course need to wait for the "systemd-run" commands to finish before we can check the output files this generated.
This deserves a test of its, given how broken on so many levels this previously was.