#1003014 make_disc_trees.pl misdetects files missing for debootstrap when a proxy is used to retrieve packages - essentially making the installer ignore packages on the CDROM

Package:
debian-cd
Source:
debian-cd
Submitter:
Daniel Leidert
Date:
2022-01-06 11:39:03 UTC
Severity:
normal
#1003014#5
Date:
2022-01-02 19:30:45 UTC
From:
To:
I was recently building custom images using simple-cdd, and for some reason the
installer was completely ignoring the packages shipped with the media. With
some digging I found the installer reporting:

cdrom-detect: Base system not installable from CD, requesting choose-mirror

With some more digging I found that make_disc_trees.pl was reporting:

5 files missing for debootstrap, not creating base_installable

But the relevant make_disc_tree.log file only contained this at the end:

Missing debootstrap-required I:
Missing debootstrap-required Using
Missing debootstrap-required auto-detected
Missing debootstrap-required proxy:
Missing debootstrap-required http://127.0.0.1:8000/

So actually there were no packages missing. Disabling the proxy then "fixed"
the issue. There were no more complaints by make_disc_trees.pl, and the
installer was using all the package put on the CD.

So we somehow need to ignore messages like the above, which do not indicate
packages missing.

Regards, Daniel



- -- System Information:
Debian Release: bookworm/sid
  APT prefers unstable-debug
  APT policy: (500, 'unstable-debug'), (500, 'testing-debug'), (500, 'stable-security'), (500, 'stable-debug'), (500, 'unstable'), (500, 'testing'), (500, 'stable'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 5.15.0-2-amd64 (SMP w/8 CPU threads)
Kernel taint flags: TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE
Locale: LANG=de_DE.UTF-8, LC_CTYPE=de_DE.UTF-8 (charmap=UTF-8), LANGUAGE not set
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages debian-cd depends on:
ii  apt                        2.3.13
ii  bc                         1.07.1-3+b1
ii  bzip2                      1.0.8-5
ii  cpp                        4:11.2.0-2
ii  curl                       7.80.0-3
ii  dctrl-tools [grep-dctrl]   2.24-3+b1
ii  dpkg-dev                   1.21.1
ii  genisoimage                9:1.1.11-3.2
pn  libcompress-zlib-perl      <none>
pn  libdigest-md5-perl         <none>
ii  libdpkg-perl               1.21.1
ii  libfile-slurp-perl         9999.32-1
ii  libyaml-libyaml-perl       0.83+ds-1
ii  lynx                       2.9.0dev.10-1
ii  make                       4.3-4.1
ii  perl [libdigest-sha-perl]  5.32.1-6
ii  tofrodos                   1.7.13+ds-5
ii  wget                       1.21.2-2+b1
ii  xorriso                    1.5.4-2

Versions of packages debian-cd recommends:
ii  dosfstools       4.2-1
ii  hfsutils         3.2.6-15
ii  isolinux         3:6.04~git20190206.bf6db5b4+dfsg1-3
ii  mtools           4.0.33-1+really4.0.32-1
ii  syslinux-common  3:6.04~git20190206.bf6db5b4+dfsg1-3

debian-cd suggests no packages.

- -- no debconf information
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEvu1N7VVEpMA+KD3HS80FZ8KW0F0FAmHR/WUACgkQS80FZ8KW
0F3rbBAAzjD2Il4Oqjxj69IBaJe5luKnFOX8L66WEY6yG05MKGzJfICWKuuATHyy
B4wVFRhslM+4LvxcIqsY+V5ruFKssy1QxHRxRC6tQZ2gpwlGn5UzaA7chrPJ/Mgc
mEY3zgsiw7HiK0Vf4zBmT21G3op1jzTpoEiey8IPbIhA8KVv3b8agkt/aqTyIUna
GlEoxnAqRvcRgtcM0Xkk1JhriPlU6IKSBsvr+0vmMoXzDYC0Yss2WtRP/R8zrmU/
3ae2yQSXNq8knclIftQQunufDounOgjyTr8WPk2iFVkb9HtEAi/EGbnkiR4i7ssm
EXOHh6lyw4SKlEC0Fz3jrvqBoESaDALUFus3vIpwvHZ9oEg9rY9sxU5JYIpgVM6g
lVrochACh0gifIiM8fL30FEYhkT1AtYh3AHH59SrzSS5rmUjyE/0GdZKRAwDFRvN
RbbcqArFuR3hQmC08GuMrktAQNciwtDpiMhY/IZEvv3uV7R9pKbO+Xw4g8QIGS8+
XutWfsIlJWojm1p2msAZZ39kvz7+6PjNaxhc+mxcd84fYADEOeXifsdIpJUs3aFT
yzRToheDrjFoB4ZP79atvE+WJ/e8CZJoKqgmvvoR2BjjIS5TYZHng2ugZihhqMks
hEAvVDs0AmHPvvJHcrvVIwuhjWQl+B9dxqH0DeGT7ypPfY7M4Jk=
=F62J
-----END PGP SIGNATURE-----
#1003014#10
Date:
2022-01-06 11:27:01 UTC
From:
To:
Hi Daniel, and Happy New Year!

Argh, OK. That's clearly the apt wrapper getting confused by the extra
output from apt. I'm guessing you have extra environment config to set
up the proxy here?
#1003014#15
Date:
2022-01-06 11:35:24 UTC
From:
To:
Hi Steve and a Happy New Year to you as well!

Am Donnerstag, dem 06.01.2022 um 11:27 +0000 schrieb Steve McIntyre:

[..]

I run squid-deb-proxy and squid-deb-proxy-client locally, and the latter
installs /etc/apt/apt.conf.d/30autoproxy with the proxy configuration:

Acquire::http::ProxyAutoDetect "/usr/share/squid-deb-proxy-client/apt-avahi-discover";

And on this system I then use simple-cdd to build custom installer images.

Regards, Daniel