#1029232 dask.distributed: broken by version mismatch with dask

#1029232#5
Date:
2023-01-20 07:57:53 UTC
From:
To:
dask.distributed has been failing its autopkgtests since dask was
upgraded to 2022.12.1.

This is the expected result of upgrading one but not the other: I'd seen
the same in my test PPA, and the upstream setup.py/requirements.txt
require exactly matching upstream versions of dask and dask.distributed.

Hence, it can probably be fixed by upgrading dask.distributed to
2022.12.1.  (See also discussion in #1028667.)

(Upgrading *both* dask.distributed and dask to 2023.1.0 probably also
works, but I haven't tested that.)

My PPA package of dask.distributed 2022.12 might be useful:
https://launchpad.net/~rebecca-palmer/+archive/ubuntu/dask2022p12v2/+sourcepub/14427094/+listing-archive-extra
(Don't upload that as-is: it tries to run more of the tests during the
build because PPAs don't have autopkgtest, which doesn't work.)

This and ulmo #1017573 (which has a patch) are the remaining blockers
for pandas 1.5.

#1029232#10
Date:
2023-01-20 17:22:07 UTC
From:
To:
Yep.

Andreas did the upload of dask 2022.12.1 with out asking me about it
first. I've been desperately trying to get dask.distributed 2022.12.1
to build and run all it's tests since then.

I'm still not done.

Sadly because of the networking use dask.distributed is incompatible
with xdist and so I can't speed up the tests.

#1029232#15
Date:
2023-01-20 21:02:28 UTC
From:
To:
Would you like some help?  If so, please push what you currently have to
Salsa so we can see it.

(No promises - #1029251 doesn't look like a big job but I might be wrong
about that.)

#1029232#20
Date:
2023-01-20 21:20:24 UTC
From:
To:
In shocking news, the build I did this morning actually finished.

I should hopefully be able to organize the hacks and commit them to
salsa tonight. Maybe even get it uploaded tonight to.

Diane

#1029232#25
Date:
2023-01-21 07:09:56 UTC
From:
To:
Unfortunately there was a lintian error that should get fixed before
release.

I pushed most of what changes I'd made to salsa, I need change the
d/rules to keep a __pycache__ file from getting added to the -doc
package, (not done yet)

But then it should be ready to upload, but I'm tired so I wont get to
it tonight.

Diane

#1029232#30
Date:
2023-01-21 19:09:04 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
dask.distributed, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1029232@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Diane Trout <diane@ghic.org> (supplier of updated dask.distributed package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Sat, 21 Jan 2023 08:52:22 -0800
Source: dask.distributed
Architecture: source
Version: 2022.12.1+ds.1-1
Distribution: unstable
Urgency: medium
Maintainer: Debian Python Team <team+python@tracker.debian.org>
Changed-By: Diane Trout <diane@ghic.org>
Closes: 1028691 1029232
Changes:
 dask.distributed (2022.12.1+ds.1-1) unstable; urgency=medium
 .
   * New upsream release. (Closes: #1029232)
   * Remove the following patches, resolved upstream
     - python-3.10-loop.patch
     - test_spillbuffer_remove_sizetest.patch
     - python3.11.patch
     - set-client-asynchronous-earlier.patch
   * Install tests to simplify running autopkgtests
   * add add-test-marks.patch to define some pytest test marks
   * add skip-pyarrow-tests.path as we don't have that dependency
     - consider reviewing this patch and focusing on the specific
       modules that are importing pyarrow.
   * Refresh patches
   * Add python3-jupyter-server to Build-Depends for tests
   * Add python3-aiohttp dependency to autopkgtests
   * Remove python3-keras autopkgtest dependency, it depends
     on an unmaintained package theano which breaks during the run.
   * Move autopkgtest script to it's own file run-tests
   * Remove python-numpy-doc dependency since it's not available.
     (closes: #1028691)
   * Update list of tests that don't run correctly during build
   * attempt to implement nocheck DEB_BUILD_OPTION in d/rules
   * adjust d/rules to prevent __pycache__ directory from being shipped in
     python-distributed-doc
Checksums-Sha1:
 5334e23eef7d3a0c1cd5c1676db76ecb0655c6f3 3214 dask.distributed_2022.12.1+ds.1-1.dsc
 d640d3efb8575bfd200eca1bcb0de713f6264d50 1463816 dask.distributed_2022.12.1+ds.1.orig.tar.xz
 bc5f1e6ebd70308f88f2c7025cf9aeac15b61dc4 2026168 dask.distributed_2022.12.1+ds.1-1.debian.tar.xz
 bbaded620f0c4a04651f4b59dfaa6542f4f8e8e9 11360 dask.distributed_2022.12.1+ds.1-1_amd64.buildinfo
Checksums-Sha256:
 d6c1ca1dd11135f57f1a5e1e2302edbc8454a265ce3ade74d74853e59ede0666 3214 dask.distributed_2022.12.1+ds.1-1.dsc
 d6c27c6f2ebd4a26d78e08b47c499915d463eb0708046afca04f3d71030a410f 1463816 dask.distributed_2022.12.1+ds.1.orig.tar.xz
 2983349aea7934c4bef634ab2e3eee118cb7c203e147fe9b23a6a826b5a797b9 2026168 dask.distributed_2022.12.1+ds.1-1.debian.tar.xz
 69b918521db919f2911c2c2d37dfd9025c11c071e2fa1f9b57729f8eece5961b 11360 dask.distributed_2022.12.1+ds.1-1_amd64.buildinfo
Files:
 b21a9dc5148a3e7019997f6a42f1775d 3214 python optional dask.distributed_2022.12.1+ds.1-1.dsc
 5bcb49b4a57386ab4120413019ea4b25 1463816 python optional dask.distributed_2022.12.1+ds.1.orig.tar.xz
 8cd0d9d3a45adcb674921c4fbdc57bbc 2026168 python optional dask.distributed_2022.12.1+ds.1-1.debian.tar.xz
 56a9e7343fcec46da32756ff0ac9eae3 11360 python optional dask.distributed_2022.12.1+ds.1-1_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEETQVcMeSBIEX5AQ11mQ04NnM013AFAmPMKuMACgkQmQ04NnM0
13AKjQ//TNrgqUk0V9aGpvN7Wf9b/uLUg9K9b7kQDSv0W1KVwn6pgaiRYY+w28WS
ZOomYrbJuHZusrm6UFA8OvB8C8s9bB/1E+lPvnQO9lYxqlH3OY1cWzbtDGiUj7gK
uFIwsuqvWFWn7CDzXGrterOpKy+jbarKy0MrihWcKCFk775hmXX41xhB29GNGdGr
zcsS9+xUx3DIzq4zj5xk1mfIQ1VTt7wMY74W+BfftoZBCGLogEEKkDVHIblPXcVf
koEipxtK7zhV2eIDMKECvzZc/XRCTNeCmrT5b6Ec68mvljlW4crXwfFe40gxJYs1
FcMUV3jDnfbvfi0/Ec3N9tt7VUNwqci1N2+pkGa++W7ICgcQGnGd0fme0fXH6J68
Iak1vFKXd78xxoXRAh6pg9A3iwyJH/jFTnSfQkg3lN/hTxAwmJ66Af5XGjsZNovb
06vWarIvoG++9NDEcMMM6+8STfCakvdrKnj/nkq66F02ngeRDQtaANElMh2IzBGy
br51Z5vc18AQjaa+glGBgmfATvqjr6qBHkUCal4iMU9L/gFX5QYZSrQK/XUNQHPL
N1XsHWhiamzyiluMk7kX9uOQ1iue/lh+ESonMerj/eZFfchDKV+HmAZQbJr4P2OZ
ED/hszT3rTDeHBLfZJNsod0PMmuwYefT+jb5Rl4OFiWPeosRyNE=
=hpbb
-----END PGP SIGNATURE-----