Occasionally a package uploaded to unstable and waiting for migration
is marked in tracker.debian.org as "Will attempt migration".  But it
does not migrate.

A current example is hdf5 1.10.6+repack-1, tracker page
https://tracker.debian.org/pkg/hdf5. Listed as ready for migration for
several days now with waiting time 15 days old (needed 5 days), but
still not migrated.

I suspect the actual hold-up is due to bitshuffle ("Too young, only 3
of 5 days old"), part of the auto-hdf5 transition,
https://release.debian.org/transitions/html/auto-hdf5.html

But the tracker page for hdf5 does not say that's the problem, does
not declare what is holding it up.

Obviously some part of the Debian infrastructure, dak or dinstall or
something, knows what's holding up package migration, otherwise it
would have migrated already.

That information should be conveyed to the package page on
tracker.debian.org (and probably also to the excuses page on
qa.debian.org, https://qa.debian.org/excuses.php?package=hdf5 )

Control: reassign -1 release.debian.org
Control: retitle -1 release.debian.org: britney: publish a dose report for each non-migrable item

This is the reason:

trying: openems/arm64 octave/arm64 hdf5 labplot/mipsel netcdf/mipsel ismrmrd/mipsel caffe/ppc64el opencv vtk6/mips64el netcdf/mips64el gdal/mips64el vtk6/i386 netcdf/i386 gdal/i386 gdal/arm64 netcdf/arm64 vtk6/mipsel gdal/mipsel gdal/armel netcdf/armel vtk6/armhf netcdf/armhf gdal/armhf vtk6/arm64 gdal/ppc64el netcdf/ppc64el gdal/amd64 netcdf/amd64 vtk6/ppc64el gdal/s390x netcdf/s390x vtk6/amd64 vtk6/armel vtk6/s390x h5py xmds2 libminc/s390x labplot/ppc64el openems/s390x octave/s390x nexus/arm64 nexus/armel scilab/s390x libmatio/s390x ismrmrd/amd64 trilinos/ppc64el netcdf4-python/ppc64el labplot/armhf pdal/i386 deal.ii/s390x petsc/s390x trilinos/s390x libvigraimpex/armel pbseqlib/arm64 blasr/arm64 ncl/i386 netcdf4-python/i386 pdal/s390x lammps/mips64el ncl/mips64el fclib/s390x cbflib/armhf ismrmrd/ppc64el netcdf4-python/arm64 pbseqlib/mips64el blasr/mips64el libminc/armhf grads/arm64 fclib/mips64el petsc/arm64 deal.ii/arm64 trilinos/arm64 netcdf4-python/mips64el fclib/armel ncl/amd64 nexus/mips64el grads/mips64el ismrmrd/s390x fast5/s390x blasr/amd64 pbseqlib/amd64 caffe/s390x caffe/armhf libminc/ppc64el netcdf4-python/armhf lammps/armel deal.ii/ppc64el petsc/ppc64el libvigraimpex/mipsel libvigraimpex/armhf nexus/i386 pdal/armel petsc/mipsel cbflib/armel lammps/amd64 netcdf4-python/s390x libvigraimpex/i386 octave/ppc64el caffe/i386 fast5/ppc64el petsc/armel ncl/armhf libvigraimpex/mips64el caffe/amd64 pbseqlib/ppc64el blasr/ppc64el octave/i386 qgis petsc/mips64el nexus/armhf grads/amd64 openems/ppc64el lammps/s390x labplot/arm64 ncl/armel cbflib/arm64 labplot/i386 grads/i386 libvigraimpex/ppc64el deal.ii/amd64 trilinos/amd64 petsc/amd64 petsc/i386 fclib/ppc64el ismrmrd/arm64 caffe/mips64el libmatio/i386 fast5/amd64 netcdf4-python/mipsel libmatio/armel cbflib/mipsel netcdf4-python/amd64 pdal/armhf libmatio/mipsel labplot/mips64el libminc/mipsel fclib/arm64 insighttoolkit4/i386 libminc/i386 grads/mipsel ismrmrd/armel lammps/arm64 fast5/mipsel octave/amd64 caffe/armel pandas/armel ismrmrd/mips64el openems/mipsel octave/mipsel lammps/ppc64el octave/armhf ncl/ppc64el libvigraimpex/s390x libmatio/ppc64el libvigraimpex/amd64 openems/amd64 libmatio/amd64 pdal/ppc64el fclib/i386 ncl/arm64 cbflib/i386 nexus/amd64 fast5/armhf lammps/i386 libvigraimpex/arm64 nexus/mipsel octave/armel caffe/arm64 fclib/mipsel octave/mips64el pdal/arm64 libmatio/armhf scilab/i386 lammps/armhf labplot/s390x pdal/amd64 fclib/armhf grads/armhf netcdf4-python/armel grads/s390x caffe/mipsel grads/armel scilab/ppc64el libmatio/mips64el fast5/armel nexus/ppc64el ncl/mipsel insighttoolkit4/amd64 libminc/amd64 pdal/mipsel labplot/amd64 labplot/armel cbflib/mips64el cbflib/amd64 libminc/mips64el libmatio/arm64 openems/i386 scilab/arm64 grads/ppc64el fast5/arm64 cbflib/ppc64el ncl/s390x libminc/armel petsc/armhf lammps/mipsel ismrmrd/i386 nexus/s390x libminc/arm64 openems/mips64el scilab/armhf fclib/amd64 cbflib/s390x fast5/i386 fast5/mips64el pdal/mips64el
skipped: openems/arm64 octave/arm64 hdf5 labplot/mipsel netcdf/mipsel ismrmrd/mipsel caffe/ppc64el opencv vtk6/mips64el netcdf/mips64el gdal/mips64el vtk6/i386 netcdf/i386 gdal/i386 gdal/arm64 netcdf/arm64 vtk6/mipsel gdal/mipsel gdal/armel netcdf/armel vtk6/armhf netcdf/armhf gdal/armhf vtk6/arm64 gdal/ppc64el netcdf/ppc64el gdal/amd64 netcdf/amd64 vtk6/ppc64el gdal/s390x netcdf/s390x vtk6/amd64 vtk6/armel vtk6/s390x h5py xmds2 libminc/s390x labplot/ppc64el openems/s390x octave/s390x nexus/arm64 nexus/armel scilab/s390x libmatio/s390x ismrmrd/amd64 trilinos/ppc64el netcdf4-python/ppc64el labplot/armhf pdal/i386 deal.ii/s390x petsc/s390x trilinos/s390x libvigraimpex/armel pbseqlib/arm64 blasr/arm64 ncl/i386 netcdf4-python/i386 pdal/s390x lammps/mips64el ncl/mips64el fclib/s390x cbflib/armhf ismrmrd/ppc64el netcdf4-python/arm64 pbseqlib/mips64el blasr/mips64el libminc/armhf grads/arm64 fclib/mips64el petsc/arm64 deal.ii/arm64 trilinos/arm64 netcdf4-python/mips64el fclib/armel ncl/amd64 nexus/mips64el grads/mips64el ismrmrd/s390x fast5/s390x blasr/amd64 pbseqlib/amd64 caffe/s390x caffe/armhf libminc/ppc64el netcdf4-python/armhf lammps/armel deal.ii/ppc64el petsc/ppc64el libvigraimpex/mipsel libvigraimpex/armhf nexus/i386 pdal/armel petsc/mipsel cbflib/armel lammps/amd64 netcdf4-python/s390x libvigraimpex/i386 octave/ppc64el caffe/i386 fast5/ppc64el petsc/armel ncl/armhf libvigraimpex/mips64el caffe/amd64 pbseqlib/ppc64el blasr/ppc64el octave/i386 qgis petsc/mips64el nexus/armhf grads/amd64 openems/ppc64el lammps/s390x labplot/arm64 ncl/armel cbflib/arm64 labplot/i386 grads/i386 libvigraimpex/ppc64el deal.ii/amd64 trilinos/amd64 petsc/amd64 petsc/i386 fclib/ppc64el ismrmrd/arm64 caffe/mips64el libmatio/i386 fast5/amd64 netcdf4-python/mipsel libmatio/armel cbflib/mipsel netcdf4-python/amd64 pdal/armhf libmatio/mipsel labplot/mips64el libminc/mipsel fclib/arm64 insighttoolkit4/i386 libminc/i386 grads/mipsel ismrmrd/armel lammps/arm64 fast5/mipsel octave/amd64 caffe/armel pandas/armel ismrmrd/mips64el openems/mipsel octave/mipsel lammps/ppc64el octave/armhf ncl/ppc64el libvigraimpex/s390x libmatio/ppc64el libvigraimpex/amd64 openems/amd64 libmatio/amd64 pdal/ppc64el fclib/i386 ncl/arm64 cbflib/i386 nexus/amd64 fast5/armhf lammps/i386 libvigraimpex/arm64 nexus/mipsel octave/armel caffe/arm64 fclib/mipsel octave/mips64el pdal/arm64 libmatio/armhf scilab/i386 lammps/armhf labplot/s390x pdal/amd64 fclib/armhf grads/armhf netcdf4-python/armel grads/s390x caffe/mipsel grads/armel scilab/ppc64el libmatio/mips64el fast5/armel nexus/ppc64el ncl/mipsel insighttoolkit4/amd64 libminc/amd64 pdal/mipsel labplot/amd64 labplot/armel cbflib/mips64el cbflib/amd64 libminc/mips64el libmatio/arm64 openems/i386 scilab/arm64 grads/ppc64el fast5/arm64 cbflib/ppc64el ncl/s390x libminc/armel petsc/armhf lammps/mipsel ismrmrd/i386 nexus/s390x libminc/arm64 openems/mips64el scilab/armhf fclib/amd64 cbflib/s390x fast5/i386 fast5/mips64el pdal/mips64el (10, 37, 270)
    got: 61+0: a-1:a-0:a-0:a-0:i-20:m-0:m-0:p-0:s-40
    * s390x: cdo, code-saturne, code-saturne-include, fenics, harp, lammps, libadios-bin, libdolfin-dev, libdolfin2019.1, libharp-dev, libharp10, liblammps-dev, liblammps0, libmedc-dev, libmedimport-dev, libmia-2.4-4, libmia-2.4-dev, libmiaviewit-dev, libmiaviewit0, libmshr-dev, libmshr2019.1, libncarg-bin, libncarg-dev, libncarg0, libpcl-conversions-dev, libpcl-dev, libpcl-ros-dev, libvtk7-dev, libvtk7-qt-dev, mia-tools, mia-viewit, ncl-ncarg, python3-cdo, python3-dolfin, python3-harp, python3-lammps, python3-mia, python3-mshr, python3-sfepy
https://release.debian.org/britney/update_output.txt - and it's not
really parsable.
The answer to "why doesn't it migrate" is: "migrating it would make
*something* not installable".

It's really not trivial to properly hunt down the reason, and often
needs to be tweaked in a case-by-case basis.


If we really want to do this, it should probably be done by the release
team, and, for example, have brtiney invoke dose and produce a report
for every migration group item.
I'm reassigning this with this in mind.

Thanks for the analysis, Mattia.

That processing output certainly is hard to parse.  Does it mean those
packages listed for s390x at the end of the dataset are the ones which
are making the problem?

Drew

Yes. Those packages would become uninstallable if the set listed before migrated
to testing.

Some notes to consider as well:

- s390x was not the only problem, just an example. britney picks a random
architecture to do the first tests, and if they fail it stops there, but if they
pass it will check every architecture to ensure that nothing breaks
- arch:all packages are only checked on amd64 and i386 atm so there likely were
some more uninstallable packages that were not reported there.

Emilio