#1055801 pandas: test failures with Python 3.12

#1055801#5
Date:
2023-11-11 18:26:00 UTC
From:
To:
pandas 1.5 FTBFS with Python 3.12 with multiple test failures:
https://launchpadlibrarian.net/696823773/buildlog_ubuntu-noble-amd64.pandas_1.5.3+dfsg-6build1_BUILDING.txt.gz

The above upstream report suggests that this is fixed in pandas 2.1
(currently in experimental).  Given the number of test failures,
upgrading to that may be the only reasonable solution.  However, as
noted in #1043240, this will break other packages.

#1055801#14
Date:
2023-11-27 22:20:48 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
pandas, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1055801@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Rebecca N. Palmer <rebecca_palmer@zoho.com> (supplier of updated pandas package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Mon, 27 Nov 2023 20:16:44 +0000
Source: pandas
Architecture: source
Version: 1.5.3+dfsg-7
Distribution: unstable
Urgency: medium
Maintainer: Debian Science Team <debian-science-maintainers@lists.alioth.debian.org>
Changed-By: Rebecca N. Palmer <rebecca_palmer@zoho.com>
Closes: 1055801
Changes:
 pandas (1.5.3+dfsg-7) unstable; urgency=medium
 .
   * Be compatible with Python 3.12.  (Closes: #1055801, LP: #2043895)
   * Use cython3-legacy (workaround for #1056828).
Checksums-Sha1:
 8accade98d43314c88d96d81ca32bedb067aef0f 4883 pandas_1.5.3+dfsg-7.dsc
 0a90b3435cc7180b78682c9874a9ad1fb91e66da 76232 pandas_1.5.3+dfsg-7.debian.tar.xz
 195c9a76646753d9620641265cd907e118444c99 6587 pandas_1.5.3+dfsg-7_source.buildinfo
Checksums-Sha256:
 3138375784260258aba6059b55ec9bba51165791344aeb46ef27e3a1f001119a 4883 pandas_1.5.3+dfsg-7.dsc
 4cae8103fcd8afa363509c1dfcfe7dc90280eb6ab4eaa8f966769cee0fc5485e 76232 pandas_1.5.3+dfsg-7.debian.tar.xz
 20a6c2d36182cd3595c931a6d0a1847237b307cc0a11edd8f7579f211cd23c44 6587 pandas_1.5.3+dfsg-7_source.buildinfo
Files:
 749bb91db18deb05eb3d046d05654a91 4883 python optional pandas_1.5.3+dfsg-7.dsc
 a6e5052dc752c6db18c885041c98528b 76232 python optional pandas_1.5.3+dfsg-7.debian.tar.xz
 8fb65f737c506882d80c9bc57984a9af 6587 python optional pandas_1.5.3+dfsg-7_source.buildinfo
-----BEGIN PGP SIGNATURE-----

iQJMBAEBCgA2FiEEZ8sxEAXE7b4yF1MI3uUNDVZ+omYFAmVlCicYHHJlYmVjY2Ff
cGFsbWVyQHpvaG8uY29tAAoJEN7lDQ1WfqJm9msQAIkhVXle2HlgMcLBP9JzooKa
hWHVoRIRfU/oSU7BvY4s7xtHgYcNuYo9Cx2IXkiBvJkz+B6wY8RicY85+xwhXrqj
0AOHoasvq5S7h5AJ9uYjwf+jYHgZzRXz1DvRMrE5gGfEkrOUs+6TXSUHUfxmFHmY
TiqW3NViqBuqxjPoGhZByTCDbaHsZoCaaDSiNxTQQ/v3Dy4MhChkp5L/r9mXvQpe
lEfBPOxyD7fqHKvOFyFdO+MPsMuFxAFWBc4SyosOXCmIHkH72fKpdpGyjyf+U3yf
z7fcSpXRgjXDeiBB1SCLCjEwKxBp0PnnKbbf6TORBKCUN71HhCUusLdzgU4UNri2
6Pxwzpl7ttP6uKmcZoxBC4h14sG456tj/T1Nt3iMhHhhpg9eTDr8KyxABuBoz6gw
ED/GpylPU8NUIrx4jL1RUXsBQ3nu0nvn4M11ZKCBm6ZtecAMgrePPhuFcbmyAnei
a3oE4Xqr5yhhOeZKJQ3VNv+WNUs4LjImg04ao6KDW/OM3Ujc+t+ZQG4go3ExAW8p
yg8LOnC7c2dij+8cVWSPdHNyiLchbWL3KFjm2nnfgWuCpYJT7yQUE/sONtBez/3N
G+VFduoG7ylikrbWjlvQGxc/FK1uFkXhnd7mlx97w4zYXTjsJWFMJLDVGpfs/tBK
0rWl/igNehWbhoOVHxms
=OLhs
-----END PGP SIGNATURE-----

#1055801#19
Date:
2023-11-29 22:38:49 UTC
From:
To:
That doesn't actually fix them all (and it's now unclear why I ever
thought it did - possibly mistaking 'has a python3.12 package' for
'tests with python3.12 by default'?), but at least the ones that are
left all look like exceptions not wrong answers.

I intend to look into this further.

#1055801#28
Date:
2023-12-05 17:18:44 UTC
From:
To:
Hi Rebecca

We've reached the point in adding Python 3.12 as a supported version
[1] where these test failures should easily be reproducible in
unstable now.

Regards
Graham

[1] https://lists.debian.org/debian-python/2023/12/msg00000.html

#1055801#37
Date:
2023-12-07 08:02:44 UTC
From:
To:
The remaining test failures (all pytables-related) exist in both pandas
1.5 and 2.1, and do not appear to be known upstream.

If they are all crashes rather than wrong answers (which I think they
are), I intend to ignore them for now to unblock this, but still
consider them bugs.

#1055801#44
Date:
2023-12-07 09:06:20 UTC
From:
To:
Hi Rebecca

That sounds good, thank you!

Regards
Graham

#1055801#55
Date:
2023-12-08 19:32:45 UTC
From:
To:
In 1.5.3+dfsg-8, these are ignored, so are no longer an FTBFS but are
still a bug.  I don't know whether they're a pandas bug or a pytables
bug; they don't appear to be known to either upstream.

(The build failure on armhf, #1057805, was because this xfail took
precedence over the existing run=False xfail and hence exposed a
long-known crash, #790925.  This should be fixed in -9.)

If the 'affects' is because you were trying to test those reverse
dependencies in Python 3.12, this should now be possible.