#1029701 scikit-learn: tests fail with scipy 1.10

Package:
scikit-learn
Source:
scikit-learn
Submitter:
Drew Parsons
Date:
2024-02-18 00:45:18 UTC
Severity:
normal
Tags:
#1029701#5
Date:
2023-01-26 12:06:24 UTC
From:
To:
scipy 1.10 is now available in experimental.
scikit-learn fails debci tests using it.

We are considering uploading scipy 1.10 to unstable in order to
included it in the forthcoming stable release.  If we proceed with
that, then this bug will become Severity: serious.

test_search.py is affected
A sample from the failing test log is
E       assert -2147483648 == 3

/usr/lib/python3/dist-packages/sklearn/model_selection/tests/test_search.py:1630: AssertionError

#1029701#12
Date:
2023-01-26 19:51:23 UTC
From:
To:
Full log:
https://ci.debian.net/data/autopkgtest/unstable/amd64/s/scikit-learn/30693526/log.gz

There appear to be at least 2 separate failures here, both known and
probably fixed upstream.  So yes, 'new upstream version' is the first
thing to try, but we'll need to check what _that_ breaks.

https://github.com/scikit-learn/scikit-learn/issues/23626
https://github.com/scikit-learn/scikit-learn/issues/24424

#1029701#17
Date:
2023-01-27 09:25:14 UTC
From:
To:
Am Thu, Jan 26, 2023 at 07:51:23PM +0000 schrieb Rebecca N. Palmer:

Sure.  Thus I uploaded to experimental first.  I hope we can get
some enlightenment from

https://qa.debian.org/excuses.php?experimental=1&package=scikit-learn

soon (at the time of writing this is empty since the package was
just uploaded).  At least autopkgtest is passing.  I'll check
Debian Med related packages manually later.

Kind regards
    Andreas.

#1029701#22
Date:
2023-01-29 11:13:47 UTC
From:
To:
scikit-learn looks like it should manageable.

I've uploaded scipy 1.10 to unstable now.

Drew

#1029701#27
Date:
2023-02-07 07:33:34 UTC
From:
To:
Hi Drew

I think python3-scipy should declare a Breaks on python3-skbio less
than the version in unstable (0.5.8-3).
This should sort out the autopkgtest regressions of emperor,
python-skbio itself, q2-metadata and q2-quality-control, which are all
passing in unstable, and allow scipy and python-skbio to migrate
together.

Python-cooler seems to have a different failure, and I don't see a bug
filed for it.

Regards
Graham

#1029701#32
Date:
2023-02-07 08:05:28 UTC
From:
To:
Ok, I'll add that with the gammapy patch.

cooler seems to be fixed in experimental, I guess it just needs to be
uploaded to unstable.

Drew

#1029701#37
Date:
2023-02-07 19:36:26 UTC
From:
To:
Am Tue, Feb 07, 2023 at 09:05:28AM +0100 schrieb Drew Parsons:

Thanks a lot.

I'll do so

Thanks for the hint

     Andreas.

#1029701#42
Date:
2024-02-09 17:50:06 UTC
From:
To:
scikit-learn continues to fail with scipy 1.11 from experimental

648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/linear_model/tests/test_quantile.py::test_incompatible_solver_for_sparse_input[interior-point]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/linear_model/tests/test_quantile.py::test_linprog_failure
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/linear_model/tests/test_quantile.py::test_warning_new_default
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/metrics/tests/test_dist_metrics.py::test_cdist_bool_metric[X_bool0-Y_bool0-kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/metrics/tests/test_dist_metrics.py::test_cdist_bool_metric[X_bool1-Y_bool1-kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/metrics/tests/test_dist_metrics.py::test_pdist_bool_metrics[X_bool0-kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/metrics/tests/test_dist_metrics.py::test_pdist_bool_metrics[X_bool1-kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/metrics/tests/test_pairwise.py::test_pairwise_boolean_distance[kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/neighbors/tests/test_neighbors.py::test_kneighbors_brute_backend[float64-kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/neighbors/tests/test_neighbors.py::test_radius_neighbors_brute_backend[kulsinski]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/preprocessing/tests/test_data.py::test_power_transformer_yeojohnson_any_input[X3]
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/tests/test_base.py::test_clone_sparse_matrices
648s FAILED ../../../../usr/lib/python3/dist-packages/sklearn/tests/test_common.py::test_estimators[PowerTransformer()-check_fit2d_1sample]
648s = 13 failed, 24496 passed, 2459 skipped, 2 deselected, 116 xfailed, 43 xpassed, 2600 warnings in 577.48s (0:09:37) =

scipy 1.11 is currently in experimental but I'd like to upload soon to
unstable to resolve Bug#1061605, which would make this bug serious.

It's likely fixed in the newer upstream releases.

#1029701#47
Date:
2024-02-16 00:33:27 UTC
From:
To:
scipy 1.11 is now uploaded to unstable,
so bumping this bug severity to serious.

#1029701#54
Date:
2024-02-18 00:43:24 UTC
From:
To:
We believe that the bug you reported is fixed in the latest version of
scikit-learn, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1029701@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Andreas Tille <tille@debian.org> (supplier of updated scikit-learn package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Sat, 17 Feb 2024 14:59:42 +0100
Source: scikit-learn
Architecture: source
Version: 1.4.1.post1+dfsg-1
Distribution: unstable
Urgency: medium
Maintainer: Debian Science Maintainers <debian-science-maintainers@lists.alioth.debian.org>
Changed-By: Andreas Tille <tille@debian.org>
Closes: 1003165 1008369 1018635 1027208 1029701 1046775 1049646 1059206
Changes:
 scikit-learn (1.4.1.post1+dfsg-1) unstable; urgency=medium
 .
   * Team upload.
   * New upstream version
     Closes: #1029701, #1008369, #1027208, #1003165
   * Build-Depends: s/dh-python/dh-sequence-python3/ (routine-update)
   * Build-Depends: python3-sphinx-copybutton
   * Support loong64
     Closes: #1059206
   * Drop nose from Build-/Test-Depends
     Closes: #1018635
   * Fix clean target
     Closes: #1046775, #1049646
   * Work around unknown key 'recommender' in sphinx
   * Exclude minimized jquery JS from source and use symlink to Debian
     packaged min.js instead (crossing fingers that the version plays nicely)
Checksums-Sha1:
 978606cc96691237880a3a2be6ed02ab48cb8d66 3087 scikit-learn_1.4.1.post1+dfsg-1.dsc
 6ac713f80103107381d0b104041df96bddaa9fbd 6389528 scikit-learn_1.4.1.post1+dfsg.orig.tar.xz
 8fb820f431db091a454ef18754aca750e1b0ae61 23312 scikit-learn_1.4.1.post1+dfsg-1.debian.tar.xz
 22158fff23ff6e5925c620b3949954429b024a43 14091 scikit-learn_1.4.1.post1+dfsg-1_amd64.buildinfo
Checksums-Sha256:
 52a55300a41630a6a7a79bce38947f7dacfb643bfba558049944f4b5aad19a6a 3087 scikit-learn_1.4.1.post1+dfsg-1.dsc
 25cd7954717180112f66a8e8b0340021a58e3b2cdbd59f82c83d7991dca5ff9f 6389528 scikit-learn_1.4.1.post1+dfsg.orig.tar.xz
 62c3ee142fd41ee13bf925e2a1efa3cbbe835c1db3fb8a0a829ffaa1eb7f3ced 23312 scikit-learn_1.4.1.post1+dfsg-1.debian.tar.xz
 ce99b0a829e7f4ccbae52e3c609d4c00ae434524b01f5b58e0923fdad5ac422b 14091 scikit-learn_1.4.1.post1+dfsg-1_amd64.buildinfo
Files:
 afe4d752ce09c233ff177c28208ae191 3087 python optional scikit-learn_1.4.1.post1+dfsg-1.dsc
 313775874d682e4ababcbc4a08e740a6 6389528 python optional scikit-learn_1.4.1.post1+dfsg.orig.tar.xz
 459683bbda96e5072242b20d7e36bffe 23312 python optional scikit-learn_1.4.1.post1+dfsg-1.debian.tar.xz
 e16b327c5110e32b273e44290c324ff6 14091 python optional scikit-learn_1.4.1.post1+dfsg-1_amd64.buildinfo
-----BEGIN PGP SIGNATURE-----

iQJFBAEBCAAvFiEE8fAHMgoDVUHwpmPKV4oElNHGRtEFAmXQy6IRHHRpbGxlQGRl
Ymlhbi5vcmcACgkQV4oElNHGRtGbORAAm3M86V3z/Q/2ByGlDFQFHBnyaRCDxbTm
jrqSVT6JBW4YEQXs1jPw4a+4mV3mqh+pIQ2tmH5u+u4VJhNPqWiqjQjyG3RpeVhq
USiVX/7XaWYzcbvtyVynksqxGJY+of0RN1L16d6wLfJhSjNKBTBtKtyv4lL730eB
3q3YoRWeuUtH+/jrn1/uPIsjNry07l98TrauupZvLojKvuyQr9xgK3Me2yddu/v4
lcKigj5Yk+tJJLBy4f1ZqsWDtonGNT3YNnde3DbM+fmLheCOAlNo7OQaCuMhN1Om
dvCZEd65RdvfLJXzpYSq5RrExN/B0xtmO5BBn/2lAbTWHXadFKonLTOC/U4skUXP
4tp0C6j/Zj/a6uBy1ZejEKLYmqclChgahPRj6l4c3lTrfla1YpLOnsZRRBKQQ/PC
7GLjhZxusBzxIYCoprMXwktmCcICIi/wvEdszjS8MlEr+uRsnec45vbEu3+d7Z+C
njaG3TQAV7B1b988LrFLZ0ia2xq6WVYyO4NAth6J/+1emoLmk2nZdHwoDmXJu+rn
oh10ozbcT8/j3L84cxB3gZCa8lC1VgwA86EieZjE54Kl0afsZqUiwqWSW9OUqR1r
JWdLoWBHnkMYf0ogOVAm7rp4BkcBMV7BDp74O0SSRbfcbShTQgOuWTABhg/SrEWz
iSJHBfpNqAU=
=z95P
-----END PGP SIGNATURE-----