Hi
No they are not. As I said we also see this for passing tests.
To check, I just triggered a test with only the failing testcase
(autopkgtest option --test-name) and then tried to manually run the test
in the test bed where the test just ran (so before the testbed was
destroyed) and you see [1] that the test already returned 1. I couldn't
rerun the test because it failed with [2].
I then triggered only the passing test, installed the test dependencies
for the failing one in the testbed and ran the failing test. It failed
in a testbed which stayed alive even while testing.
All of this on the test infrastructure host, so no delta's.
Paul
[1]
autopkgtest [05:48:30]: test timesyncd-ntp-servers-from-dhcp:
[-----------------------
Preparing virtual interfaces...
Actual changes:
tx-checksum-ip-generic: off
tx-tcp-segmentation: off [not requested]
tx-tcp-ecn-segmentation: off [not requested]
tx-tcp-mangleid-segmentation: off [not requested]
tx-tcp6-segmentation: off [not requested]
tx-udp-segmentation: off [not requested]
tx-checksum-sctp: off
Preparing dnsmasq configuration...
Obtaining network configuration for veth1 via dhcp...
Check if the NTP server is made available to daemon...SUCCESS!
Release the current lease...
Check if the NTP server has been correctly removed... autopkgtest
[05:49:03]: test timesyncd-ntp-servers-from-dhcp: -----------------------]
autopkgtest [05:49:04]: test timesyncd-ntp-servers-from-dhcp: - - - - -
- - - - - results - - - - - - - - - -
timesyncd-ntp-servers-from-dhcp FAIL non-zero exit status 1
autopkgtest [05:49:04]: - - - - - - - - - - running shell - - - - - - -
- - -
You can now log into the VM through the serial terminal.
Depending on which terminal program you have installed, you can use one of
ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -p
10026 user@localhost
minicom -D unix#/tmp/autopkgtest-qemu.5qs_zm0t/ttyS0
nc -U /tmp/autopkgtest-qemu.5qs_zm0t/ttyS0
socat - UNIX-CONNECT:/tmp/autopkgtest-qemu.5qs_zm0t/ttyS0
The tested source package is in /tmp/autopkgtest.FtJQdg/build.Xvr/src
Press Enter to resume running tests.
[2]
root@host:/tmp/autopkgtest.FtJQdg/build.Xvr/src#
debian/tests/timesyncd-ntp-servers-from-dhcp ; echo $?
Preparing virtual interfaces...
RTNETLINK answers: File exists
2