#854494 execnet: FTBFS: test_waitclose_on_remote_killed is flaky

#854494#5
Date:
2017-02-07 18:04:51 UTC
From:
To:
Dear maintainer:

I tried to build this package in stretch with "dpkg-buildpackage -A"
but it failed:
--------------------------------------------------------------------------------
[...]
 debian/rules build-indep
dh build-indep --buildsystem=pybuild --with python2,python3,sphinxdoc
   dh_testdir -i -O--buildsystem=pybuild
   dh_update_autotools_config -i -O--buildsystem=pybuild
   dh_auto_configure -i -O--buildsystem=pybuild
I: pybuild base:184: python2.7 setup.py config
running config
I: pybuild base:184: python3.5 setup.py config
running config
   dh_auto_build -i -O--buildsystem=pybuild
I: pybuild base:184: /usr/bin/python setup.py build
running build
running build_py
creating /<<PKGBUILDDIR>>/.pybuild/pythonX.Y_2.7/build/execnet

[... snipped ...]

SKIP [16] /<<PKGBUILDDIR>>/testing/conftest.py:148: no python3.3 found
SKIP [16] /<<PKGBUILDDIR>>/testing/conftest.py:148: no jython found
SKIP [237] /<<PKGBUILDDIR>>/testing/conftest.py:200: could not import 'gevent'
SKIP [52] /usr/lib/python3/dist-packages/_pytest/config.py:1193: no 'gspecs' option found
SKIP [1] testing/test_channel.py:344: condition: sys.version>="3.0"
SKIP [16] /<<PKGBUILDDIR>>/testing/conftest.py:148: no python3.2 found
SKIP [16] /<<PKGBUILDDIR>>/testing/conftest.py:148: no pypy found
SKIP [16] /<<PKGBUILDDIR>>/testing/conftest.py:148: no python2.6 found
SKIP [237] /<<PKGBUILDDIR>>/testing/conftest.py:200: could not import 'eventlet'

=================================== FAILURES ===================================

testing/test_gateway.py:251: Failed
============================ pytest-warning summary ============================
WI1 /<<PKGBUILDDIR>>/testing/conftest.py:21 'pytest_runtest_setup' hook uses deprecated __multicall__ argument
WC1 None pytest_funcarg__specsocket: declaring fixtures using "pytest_funcarg__" prefix is deprecated and scheduled to be removed in pytest 4.0.  Please remove the prefix and use the @pytest.fixture decorator instead.
WC1 None pytest_funcarg__specssh: declaring fixtures using "pytest_funcarg__" prefix is deprecated and scheduled to be removed in pytest 4.0.  Please remove the prefix and use the @pytest.fixture decorator instead.
!!!!!!!!!!!!!!!!!!!! Interrupted: stopping after 1 failures !!!!!!!!!!!!!!!!!!!!
 1 failed, 222 passed, 607 skipped, 5 xfailed, 3 pytest-warnings in 11.16 seconds
E: pybuild pybuild:283: test: plugin custom failed with: exit code=2: python3.5 -m pytest -v -x -rs testing/
dh_auto_test: pybuild --test --test-pytest -i python{version} -p 3.5 returned exit code 13
debian/rules:8: recipe for target 'override_dh_auto_test' failed
make[1]: *** [override_dh_auto_test] Error 25
make[1]: Leaving directory '/<<PKGBUILDDIR>>'
debian/rules:5: recipe for target 'build-indep' failed
make: *** [build-indep] Error 2
dpkg-buildpackage: error: debian/rules build-indep gave error exit status 2
--------------------------------------------------------------------------------

This is just how the build ends, not necessarily the relevant part.

I've put several build logs here:

https://people.debian.org/~sanvila/build-logs/execnet/

If this is really a bug in one of the build-depends, please use reassign and affects,
so that this is still visible in the page for this package.

The bug should be reproducible with sbuild on a single CPU virtual machine,
provided you try enough times (as the failure happens randomly).

Thanks.

#854494#10
Date:
2017-02-17 23:00:47 UTC
From:
To:
https://people.debian.org/~sanvila/build-logs/execnet/execnet_1.4.1-3_amd64-20170207T152032Z
):

=================================== FAILURES
===================================

#854494#13
Date:
2017-02-17 23:00:47 UTC
From:
To:
https://people.debian.org/~sanvila/build-logs/execnet/execnet_1.4.1-3_amd64-20170207T152032Z
):

=================================== FAILURES
===================================

#854494#18
Date:
2017-03-08 00:01:05 UTC
From:
To:
severity 854494 serious
thanks

Dear maintainer:

I expected a general guideline from Release Managers regarding
packages which FTBFS randomly like this one, but that will most surely
not happen for stretch.

So, the only guideline I have left is the one expressed by Julien
Cristau (one of the RMs) in Bug #844264:

"if the failure rate is low enough I think a lower severity can make
sense"

I posted a list of bugs which FTBFS more than 10% of the time and
several people agreed on -devel that they should be serious and
maintainers should ask for stretch-ignore tag in case the bug should
not be RC (most bugs are about failing tests so this should not be
needed in general).

In the latest tests I made, this package fails for me more than 61% of
the time, and it also fails (randomly) in the reproducible builds autobuilders:

https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/execnet.html

(I think this addresses the comment made here by Rebecca: Most probably
the failures do not have anything to do with my machines being
single-CPU, as the reproducible builds autobuilders are multi-core).

This may affect any user trying to build this package (for example,
after making a change), our downstreams, and the Security Team once
that stretch is stable.

For this reason I'm raising this to serious.

Sorry for the long explanation.

Thanks.

#854494#25
Date:
2017-03-08 20:03:28 UTC
From:
To:
Hi.

As a summary, these are the tests which are known to fail.
(The number at the left is the number of times the test failed for me.

 106 testing/test_xspec.py::TestMakegateway::test_popen_nice FAILED
  69 testing/test_gateway.py::TestPopenGateway::test_waitclose_on_remote_killed FAILED

(Just in case you decide that the right fix for this bug is to disable
the flaky tests).

Thanks.

#854494#30
Date:
2017-03-08 20:12:09 UTC
From:
To:
... that's o.k. with me. Good work with those "randomly failing" test builds.

DS

#854494#39
Date:
2017-03-19 16:04:13 UTC
From:
To:
In the test builds for reproducible builds, this repeatedly occurs as segfault:

<cut>
testing/test_gateway.py::TestPopenGateway::test_waitclose_on_remote_killed PASSEDSegmentation fault
E: pybuild pybuild:283: test: plugin custom failed with: exit code=139: python3.5 -m pytest -v -x -rs testing/
dh_auto_test: pybuild --test --test-pytest -i python{version} -p 3.5 returned exit code 13
</cut>

https://tests.reproducible-builds.org/debian/rbuild/unstable/amd64/execnet_1.4.1-3.rbuild.log
https://tests.reproducible-builds.org/debian/rbuild/testing/armhf/execnet_1.4.1-3.rbuild.log

DS

#854494#46
Date:
2017-04-04 21:03:50 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
execnet, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 854494@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Thomas Goirand <zigo@debian.org> (supplier of updated execnet package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Tue, 04 Apr 2017 20:30:05 +0000
Source: execnet
Binary: python-execnet python3-execnet execnet-doc
Architecture: source all
Version: 1.4.1-3.1
Distribution: unstable
Urgency: medium
Maintainer: Daniel Stender <stender@debian.org>
Changed-By: Thomas Goirand <zigo@debian.org>
Description:
 execnet-doc - rapid multi-Python deployment (docs)
 python-execnet - rapid multi-Python deployment (Python 2)
 python3-execnet - rapid multi-Python deployment (Python 3)
Closes: 854494 858189
Changes:
 execnet (1.4.1-3.1) unstable; urgency=medium
 .
   * Non-maintainer upload.
   * Disable tests that are often failing (Closes: #854494, #858189).
Checksums-Sha1:
 cda5a2c8dffbf723335441ed2ab43526485c5553 2318 execnet_1.4.1-3.1.dsc
 ad9321e0241cd4a48883bbb132b54e1ae2b8be38 5792 execnet_1.4.1-3.1.debian.tar.xz
 cafec9766cfbfa24818497c230023c6639ba2c6b 145750 execnet-doc_1.4.1-3.1_all.deb
 75d9c3ff81552727bd0d04f5aa7d70634f6814a4 7577 execnet_1.4.1-3.1_amd64.buildinfo
 d438d6764de6e93da34fb6187378123069bc6fc0 38908 python-execnet_1.4.1-3.1_all.deb
 44a1f94a07ddccc6b34c80ba18aea2130614179d 38968 python3-execnet_1.4.1-3.1_all.deb
Checksums-Sha256:
 adcde47ca0ee4ca575a5df40fa78515ac068b87800cd6d734deceaa8b151ec7c 2318 execnet_1.4.1-3.1.dsc
 e34456a7ccc91489f1db1510a4546700b83a15162c4284ebf138c87df4bb3588 5792 execnet_1.4.1-3.1.debian.tar.xz
 c256c5c0bc7520b55df61f947628d41b81eb2a7c8fb665b18f801564e3229926 145750 execnet-doc_1.4.1-3.1_all.deb
 9a949426fc3c5d2c227e2bed48aaa75ef0da113aad8df966bcd524f5e6a1ae92 7577 execnet_1.4.1-3.1_amd64.buildinfo
 74c79b768add7bfa15a70ab2a9b6eee74bfc6077b44fd045e96f725d23df01c5 38908 python-execnet_1.4.1-3.1_all.deb
 399d1ade56e8397f4a69dd076c5339a97fbb8da7289c16fe6fce6965e4817f15 38968 python3-execnet_1.4.1-3.1_all.deb
Files:
 5689cfa919db230dfd1790c774b8cdbc 2318 python optional execnet_1.4.1-3.1.dsc
 9f3ff15ebdf963a0549426eac8e2ed31 5792 python optional execnet_1.4.1-3.1.debian.tar.xz
 dcc83f2f18d9927a22fb553de19fe81d 145750 doc optional execnet-doc_1.4.1-3.1_all.deb
 1af29e6d20024134e328f8297198b20f 7577 python optional execnet_1.4.1-3.1_amd64.buildinfo
 4a0c9ab03f12e31e041eca1b8e3f195f 38908 python optional python-execnet_1.4.1-3.1_all.deb
 b24a3c8427fdba16745604e0c38a6901 38968 python optional python3-execnet_1.4.1-3.1_all.deb
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEoLGp81CJVhMOekJc1BatFaxrQ/4FAljkBKAACgkQ1BatFaxr
Q/5sVg//Z3fHGVrr7a/gfzxdooUiRReyxX28XokEFjMu598Z1W1jwLN9cUd/obNk
KalaLrd+IRo7I3urj3/Zh8IDpogE5PZPiRFZlpEgkR5u3YKy5OSDQnUdHRiD4r7X
xPZ+k3gkFFAiUiFp6VZRTKXgaW2AKSq/Zg2Wod1vo59riYtAEGm+78rxBc9P1pzW
Op2zZsZt03AeXBaNgozM1aFT1AAnzGPUzs+1vqbUqvBAq6zCuTYscrIfGistP9xY
I5IDSWx1v/8382VHIfSD/VcgtaLmoMUqHTV+CC5dG81LDPG5g5Wtatdc16/VwES3
/VrLAE/H38OeYDJsPUcne3+YpjVN0TJMGK3hu4FYdAwz6D25Uf3b7FRF1lQetTjp
H4RpdbbE4DlqLGG97k6TFg2tkiTFsCtYUc1q6eGBAV5xscpUM8/s3SGRWXVVAoir
wBOeWtFZmdVTmsv0q7ZtqyDXqX6pU9sC0sfHsMgfnofVljWYtejc/BtJ1aJdPOoP
Bzx2dalBslfCb7U/oAGD7tlEudryo0C/gThfOD+CaqfQmO/Tw0Aal4texvl1BCNy
qgZAwyfRldu/1TzSqi9XOa/X495ZIMAthaYOFOQ/a8/6TkG8ILvChbWqazAUHZuk
JgaAGmjGfDy7qNGrQiVUbu36Nbj5o77kRGFIWcgeTh14WA4HnfU=
=btJs
-----END PGP SIGNATURE-----

#854494#51
Date:
2017-04-05 08:25:43 UTC
From:
To:
tag 854494 pending
thanks

Hello,

Bug #854494 reported by you has been fixed in the Git repository. You can
see the changelog below, and you can check the diff of the fix at:

https://anonscm.debian.org/cgit/collab-maint/execnet.git/commit/?id=667a3a9

    add changes from NMU

diff --git a/debian/changelog b/debian/changelog
index d37e07e..44bc19f 100644
--- a/debian/changelog
+++ b/debian/changelog
@@ -1,3 +1,10 @@
+execnet (1.4.1-3.1) unstable; urgency=medium
+
+  * Non-maintainer upload.
+  * Disable tests that are often failing (Closes: #854494, #858189).
+
+ -- Thomas Goirand <zigo@debian.org>  Tue, 04 Apr 2017 20:30:05 +0000
+
 execnet (1.4.1-3) unstable; urgency=medium

   * add test_gateway-fix-race-condition.patch (Closes: #840823 [thanks

#854494#62
Date:
2026-06-05 15:07:41 UTC
From:
To:
owner 854494 !
found 854494 2.1.1-1
forwarded 854494 https://github.com/pytest-dev/execnet/issues/53
tags 854494 trixie
thanks

Hi.

I'm reopening this old bug because it's happening again
(in both trixie and forky/sid).

On AWS instances of type m7a.medium and r7a.medium, the following
tests fail very often. As a result, the package always fail to build:

FAILED testing/test_gateway.py::TestPopenGateway::test_waitclose_on_remote_killed
FAILED testing/test_channel.py::TestChannelBasicBehaviour::test_channel_passing_over_channel
FAILED testing/test_gateway.py::TestBasicGateway::test__rinfo

Given that upstream has already applied the "xfail" mark to tests
behaving such way, I will do the same here.

(However, if somebody still would like to debug this, please email me
privately, I can provide a VM where the package always fail to build).

Thanks.

#854494#75
Date:
2026-06-05 15:33:45 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
execnet, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 854494@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Santiago Vila <sanvila@debian.org> (supplier of updated execnet package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Fri, 05 Jun 2026 17:10:00 +0200
Source: execnet
Architecture: source
Version: 2.1.1-2
Distribution: unstable
Urgency: medium
Maintainer: Debian Python Team <team+python@tracker.debian.org>
Changed-By: Santiago Vila <sanvila@debian.org>
Closes: 854494
Changes:
 execnet (2.1.1-2) unstable; urgency=medium
 .
   * Team upload.
   * Mark several tests as flaky. Closes: #854494.
   * Drop "Rules-Requires-Root: no" (default).
   * Drop "Priority: optional" (default).
   * Update standards-version.
   * Add debian/salsa-ci.yml.
Checksums-Sha1:
 3db2ac7e88dbaac4689336c2d442e84d6bb8bbca 1887 execnet_2.1.1-2.dsc
 a62d450797c712ecdacaa14a466807f83291e9b0 6004 execnet_2.1.1-2.debian.tar.xz
 a9e1515fa132f6799275323265388eeddc4af145 6621 execnet_2.1.1-2_source.buildinfo
Checksums-Sha256:
 51883decd8473366c29a000d818864a929a6be08acd12b9592ab777633ddb6d0 1887 execnet_2.1.1-2.dsc
 c2f8870b06fba7fd83a93d60a85b82b0791141a22230aeae27e11da7649f82c3 6004 execnet_2.1.1-2.debian.tar.xz
 3e3579bfb012ce78d83247c3fd27a7cd904c9e9b006fe3c30eed336861c92779 6621 execnet_2.1.1-2_source.buildinfo
Files:
 1420e3c8446e3307b8ebe5d62bd9e693 1887 python optional execnet_2.1.1-2.dsc
 1b337ba557aab55a77686ecd1d014969 6004 python optional execnet_2.1.1-2.debian.tar.xz
 8a75680b872dd0fedada2a872facb468 6621 python optional execnet_2.1.1-2_source.buildinfo
-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEE1Uw7+v+wQt44LaXXQc5/C58bizIFAmoi5wAACgkQQc5/C58b
izL5VAf+KLO8dUKQQLI160eCKACgKXvJoo9gwEx3ON/MluCNhXP5fikosDpk0Vxe
scOQKEkCUCILcFpctZpMZWvy0x/3qlrYFS4dvlGVPl9oKDoW0TXtH3NTUAC9PvMq
geHFPeXkqg0HE9ytE31na7l4Vczwn4fYv+GojfALJ8QmAvgqbjtRHRmuJWzLcKAE
r2LYAKCss/FXNmCxhDtkXPGN3Jjz4/FVsk6fCs0UXG9o8XkPlzk9PpJ8/fWhFPkS
yL+mD1ClGjMOJhUGbkFo+88y3HksFzpVVDwlAZI8SP9LTZU2+Wd3JdP9GjiMPFuE
D4FcyGtr7rXhOBFPEyutmdzuoX35uw==
=kwxi
-----END PGP SIGNATURE-----

#854494#82
Date:
2026-06-08 21:09:35 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
execnet, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 854494@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Santiago Vila <sanvila@debian.org> (supplier of updated execnet package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Sun, 07 Jun 2026 20:05:00 +0200
Source: execnet
Architecture: source
Version: 2.1.1-1+deb13u1
Distribution: trixie
Urgency: medium
Maintainer: Debian Python Team <team+python@tracker.debian.org>
Changed-By: Santiago Vila <sanvila@debian.org>
Closes: 854494
Changes:
 execnet (2.1.1-1+deb13u1) trixie; urgency=medium
 .
   * Team upload.
   * Mark several tests as flaky. Closes: #854494.
Checksums-Sha1:
 038cff7a343a160c08a85c511c860116c4201259 1919 execnet_2.1.1-1+deb13u1.dsc
 7ef81d1233076c5b2f290dd615f00f675e99408d 5872 execnet_2.1.1-1+deb13u1.debian.tar.xz
 a033d23f05aa925f6388ce465ef99a4cd1f04844 7440 execnet_2.1.1-1+deb13u1_source.buildinfo
Checksums-Sha256:
 dff7c7aef6b8f31081a67143a15ac3bcbf39856ceca3a0d8c5234815a2cf5ec6 1919 execnet_2.1.1-1+deb13u1.dsc
 3f660d7e9f858e079784b69f199a329a91369c6b85a875c309a3f2ebab892b57 5872 execnet_2.1.1-1+deb13u1.debian.tar.xz
 5ce6b18ee8bcc46501f73336a2542a40e762c7732fd581165b4cd846c127dd63 7440 execnet_2.1.1-1+deb13u1_source.buildinfo
Files:
 ed6fee619a759549c00513791b3fdd53 1919 python optional execnet_2.1.1-1+deb13u1.dsc
 b2c713c0568ac77b3d8fe0a9e9e3092f 5872 python optional execnet_2.1.1-1+deb13u1.debian.tar.xz
 87338c3590a45ab59ccad6ba42469ff2 7440 python optional execnet_2.1.1-1+deb13u1_source.buildinfo
-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEE1Uw7+v+wQt44LaXXQc5/C58bizIFAmoltIEACgkQQc5/C58b
izL0/ggAgjkz54UtxANg74QqrMWxp89Kn/g7i8T8yAUJq/gY2Ql2TaY9S8wzgQUj
Vam2fWMCnjdJiwvxg02t+PiN+i9hoGC9AXqMT/kPhfiNxgztAAz6IrkIxYbaP19r
GM3uhBROuloLY0L9s7W0S5PWS4EAApk5BxhgPcOu9JDGPIP7aKRUpQudEBeaicGU
8XNSSIVMGFkM83rxAw08dwXWPsIIhwMm43Lk00AXlqeW4UB9Q+IuzoeOiItZznYQ
8iD7btzwhxnL4EGcH4LDKp9XCdHwn5khC7Dhtl7Kc1DWookqdPh69LSBaPnCwIti
Z6wshXOx3xQZFSxGo1jKQs3EZSOAVQ==
=ZD45
-----END PGP SIGNATURE-----