summaryrefslogtreecommitdiffstats
path: root/test/README.testsuite (follow)
Commit message (Collapse)AuthorAgeFilesLines
* test: Extend meson + mkosi integration test docsDaan De Meyer2024-05-271-41/+63
| | | | | Let's also put the meson + mkosi docs first to nudge readers towards it instead of the old fashioned way to run the integration tests.
* Rewrite testsuite README in markdownDaan De Meyer2024-05-271-117/+155
| | | | Let's use markdown here like we do for everything else as well.
* docs: add note about URL where to find recent Ubuntu CI logsLuca Boccassi2024-05-271-0/+7
|
* docs: move information from AUTOPKGTEST.md to test/README.testsuite and ↵Luca Boccassi2024-05-011-1/+14
| | | | | | | delete it This is not information that needs to be published on systemd.io as it's purely internal, so the README is enough
* test: Skip meson integration tests if SYSTEMD_INTEGRATION_TESTS != 1Daan De Meyer2024-04-251-4/+4
| | | | | | | | | We cannot mark a test suite as excluded by default in meson. Instead, let's require that SYSTEMD_INTEGRATION_TESTS=1 and skip any integration test if it's not set. This is effectively the same as excluding it by default. If the integration-test option is enabled, we'll set the environment variable by default, just like we do with SYSTEMD_SLOW_TESTS and the slow-tests meson option.
* test: Various mkosi integration test improvementsDaan De Meyer2024-04-231-3/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Stop using logging module since the default output formatting is pretty bad. Prefer print() for now. - Log less, logging the full mkosi command line is rather verbose, especially when it contains multi-line dropins. - Streamline the journalctl command we output for debugging failed tests. - Don't force usage of the disk image format. - Don't force running without unit tests. - Don't force disabling RuntimeBuildSources. - Update documentation to streamline the command for running a single test and remove sudo as it's not required anymore. - Improve the console output by having the test unit's output logged to both the journal and the console. - Disable journal console log forwarding as we have journal forwarding as a better alternative. - Delete existing journal file before running test. - Delete journal files of succeeded tests to reduce disk usage. - Rename system_mkosi target to just mkosi - Pass in mkosi source directory explicitly to accomodate arbitrary build directory locations. - Add test interactive debugging if stdout is connected to a tty - Stop explicitly using the 'system' image since it'll likely be dropped soon. - Only forward journal if we're not running in debugging mode. - Stop using testsuite.target and instead just add the necessary extras to the main testsuite unit via the credential dropin. - Override type to idle so test output is not interleaved with status output. - Don't build mkosi target by default - Always add the mkosi target if mkosi is found - Remove dependency of the integration tests on the mkosi target as otherwise the image is always built, even though we configure it to not be built by default. - Move mkosi output, cache and build directory into build/ so that invocations from meson and regular invocations share the same directories. - Various aesthetic cleanups.
* test: Add mkosi-based integration test runnerRichard Maw2024-04-181-0/+16
| | | | | The first two tests are included to ensure parallel test execution is demonstrable.
* test: add instructions on how to run Coverity locallyFrantisek Sumsal2024-04-121-0/+45
| | | | | | | This requires a Coverity license, so the usefulness of the instructions is somewhat limited, but at least I won't have to re-discover everything from scratch when I need to debug something Coverity-related again in the future.
* test: explain how Ubuntu CI log URLs are createdLuca Boccassi2024-03-241-0/+13
| | | | Not trivially obvious, so add a couple of paragraph to explain it
* test/README: document how to add a new empty release to the PPA to migrate ↵Luca Boccassi2024-02-281-0/+11
| | | | the CI to a new version
* test/README: update ubuntu IRC channel for CI helpLuca Boccassi2024-02-281-1/+1
|
* test: update Ubuntu CI instructionsFrantisek Sumsal2023-11-151-0/+1
|
* test: update Ubuntu CI instructionsFrantisek Sumsal2023-10-141-3/+5
|
* ci: Use add-apt-repository to enable sourcesJan Janssen2023-09-061-1/+1
| | | | This should also ensure that consistent mirrors are selected.
* test: allow running only specified subtests/testcasesFrantisek Sumsal2023-06-051-0/+7
| | | | | | | | Useful when debugging, e.g.: make -C test/TEST-74-AUX-UTILS clean setup run TEST_MATCH_SUBTEST=run Resolves: #27914
* test/README: fix advice for testsuite debuggingZbigniew Jędrzejewski-Szmek2023-05-301-5/+5
| | | | | | | KERNEL_APPEND="systemd.unit=multi-user.target" is not very useful, because the machine will still shut down as soon as the tests succeeds or fails. But INTERACTIVE_DEBUG=1 works great, so let's simplify the instructions and recommend that.
* test: shed some light into the whole coverage situationFrantisek Sumsal2023-04-011-0/+36
|
* test: update Ubuntu CI docsFrantisek Sumsal2023-01-191-7/+5
|
* test: fix the default timeout values described in README.testsuiteFranck Bui2022-11-181-2/+2
| | | | Unlike it was described, the default is 30 min.
* Merge pull request #24799 from poettering/initrd-ftwLuca Boccassi2022-09-231-2/+2
|\ | | | | use "initrd" rather than "initial RAM disk" or "initramfs" to refernce the concept
| * tree-wide: use the term "initrd" at most places we so far used "initramfs"Lennart Poettering2022-09-231-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | In most cases we refernced the concept as "initrd". Let's convert most remaining uses of "initramfs" to "initrd" too, to stay internally consistent. This leaves "initramfs" only where it's relevant to explain historical concepts or where "initramfs" is part of the API (i.e. in /run/initramfs). Follow-up for: b66a6e1a5838b874b789820c090dd6850cf10513
* | doc: drop remaining references to LGTM.comYu Watanabe2022-09-231-4/+4
|/
* docs: use lowercase "qemu" and other minor tweaks to test docsZbigniew Jędrzejewski-Szmek2022-05-041-10/+12
| | | | | | | | | We used both "qemu" and "QEMU", let's use the lower-case version everywhere since it's also the name of the binary and the version that people are most familiar with. The stuff under test/ is not only for the integeration tests, but also for various other test-related stuff, so adjust the docs a bit.
* test: document how to run CodeQL/LGTM stuff manuallyFrantisek Sumsal2022-03-111-0/+54
| | | | | Let's have this documented somewhere so I don't have to relearn all this stuff every time I need it.
* test: document how to manually run Ubuntu CI stuffFrantisek Sumsal2022-02-101-0/+45
| | | | | | Every time I need it I have to first relearn autopkgtest and find where all the necessary stuff lives, so let's document it somewhere close to systemd for (at least) future me.
* test: document autopkgtest CI infrastructureLuca Boccassi2021-09-151-0/+15
|
* test: allow run-integration-tests.sh to run without buildDan Streetman2021-01-261-0/+8
|
* test: find $BUILD_DIR in test-functions, remove from other scriptsDan Streetman2021-01-261-2/+2
| | | | | | | | The $BUILD_DIR is only used in test-functions, and doesn't need to be specified in any other scripts. Additionally, to be able to allow the integration test suite to be run against locally installed binaries, instead of built binaries, moving BUILD_DIR logic completely into test-functions allows later patches to be simpler.
* test: note where the bionic-* CI tool/integration livesLuca Boccassi2021-01-241-0/+5
|
* tests: add TEST_PREFER_NSPAWN variable to run as many as possible under nspawnLuca Boccassi2021-01-011-0/+3
| | | | | | | By default the test suite prefers qemu, and uses nspawn only if a test specifically says it doesn't support qemu. Add a variable to allow flipping the default, and run as many tests under nspawn as possible.
* tests: add TEST_QEMU_ONLY variable to run only tests where qemu is mandatoryLuca Boccassi2021-01-011-0/+3
| | | | | | | | | Allows to split the test run in two parts. Most tests can run under nspawn which is much faster, and they can be ran in one chunk with TEST_NO_QEMU=1. The qemu-only tests, which are just a handful, can be ran in another chunk with TEST_QEMU_ONLY=1. Allows autopkgtest to be split in two parts.
* test/README: notes about Ubuntu CI logs and dependenciesLuca Boccassi2020-10-171-0/+9
| | | | | Add a note about where to find the full journal, and how to add packages/dependencies for the Ubuntu CI.
* test: convert ubuntu-ci to use deny-listDan Streetman2020-08-011-7/+7
| | | | Follows #16262
* test: print test of name in outputZbigniew Jędrzejewski-Szmek2020-03-281-3/+3
|
* tree-wise: standarize on "auto-detection" spellingZbigniew Jędrzejewski-Szmek2019-11-301-1/+1
|
* test/README.testsuite: add section for Ubuntu CI blacklist filesDan Streetman2019-10-031-0/+23
| | | | | Add some docs explaining how blacklist individual test/TEST-* tests in Ubuntu CI using per-test blacklist files.
* test: allow use of nested KVMFrantisek Sumsal2019-09-281-0/+5
| | | | | Introduce TEST_NESTED_KVM variable, which allows use of nested KVM for QEMU VMs (which is disabled by default by KVM autodetection).
* test: improve testsuite configuration documentationFrantisek Sumsal2019-03-161-3/+30
|
* README.testsuite: update the documentation for mesonZbigniew Jędrzejewski-Szmek2018-10-091-26/+47
|
* test: explain why we explicitly make all despite test/Makefile's check ↵Chris Lamb2017-04-291-1/+1
| | | | target calling it (#5830)
* tests: fix initrd searching on Debian/UbuntuEvgeny Vereshchagin2015-11-201-1/+1
|
* remove gudev and gtk-docKay Sievers2015-06-031-2/+0
| | | | | The library moved to: https://git.gnome.org/browse/libgudev/
* test: rework run_qemuRonny Chevalier2013-12-101-3/+16
| | | | | | | | | | | | | | | It tries to find a suitable QEMU binary and will use KVM if present. We can now configure QEMU from outside with 4 variables : - $QEMU_BIN : path to QEMU's binary - $KERNEL_APPEND : arguments appended to kernel cmdline - $KERNEL_BIN : path to a kernel Default /boot/vmlinuz-$KERNEL_VER - $INITRD : path to an initramfs Default /boot/initramfs-${KERNEL_VER}.img - $QEMU_SMP : number of CPU simulated by QEMU. Default 1 (from Alexander Graf's script: http://www.spinics.net/lists/kvm/msg72389.html)
* test: some trivial fixes to test scriptsZbigniew Jędrzejewski-Szmek2013-01-301-2/+2
| | | | | | | - fix typo - use compiled systemd-nspawn - drop --capability=... from systemd-nspawn invocation, is is the default now - simplify sudo make invocations
* test/README.testsuite: add documentation for the testsuiteHarald Hoyer2012-05-291-0/+35