#991273 acng: for testing dist fails to download by-hash translations

Package:
apt-cacher-ng
Source:
apt-cacher-ng
Description:
caching proxy server for software repositories
Submitter:
Václav Ovsík
Date:
2021-07-30 15:42:03 UTC
Severity:
normal
#991273#5
Date:
2021-07-19 13:05:39 UTC
From:
To:
Package: apt-cacher-ng
Version: 3.3.1-2~bpo10+1
Severity: normal

Dear Maintainer,
I tried to install bullseye machine and it fails to download some
translations and installation fails:

 Jul 19 10:29:53 in-target: E: Failed to fetch http://debian.i.cz:9999/debian/dists/bullseye/non-free/i18n/by-hash/SHA256/1719a3a7f5c969d9780aec600763314a8b55aaaed3016a76fa9a7a020c1e584c  File has unexpected size (50436 != 91475). Mirror sync in progress? [IP: 10.0.156.66 9999]
 Jul 19 10:29:53 in-target:    Hashes of expected file:
 Jul 19 10:29:53 in-target:     - Filesize:91475 [weak]
 Jul 19 10:29:53 in-target:     - SHA256:1719a3a7f5c969d9780aec600763314a8b55aaaed3016a76fa9a7a020c1e584c
 Jul 19 10:29:53 in-target:     - MD5Sum:c3ad4b048f3df02478a64b33ef776008 [weak]
 Jul 19 10:29:53 in-target:    Release file created at: Mon, 19 Jul 2021 08:07:25 +0000
 Jul 19 10:29:53 in-target: E: Failed to fetch http://debian.i.cz:9999/debian/dists/bullseye/contrib/i18n/by-hash/SHA256/57e6201d62bf60faf1a188ac528d0717cce16b6cfa1c9b91a0b89cc5b16e10f3
 Jul 19 10:29:53 in-target: E: Some index files failed to download. They have been ignored, or old ones used instead.


Its obvious from the curl output:

 zito@ser1:~/admin$ curl --head http://debian.i.cz:9999/debian/dists/bullseye/non-free/i18n/by-hash/SHA256/1719a3a7f5c969d9780aec600763314a8b55aaaed3016a76fa9a7a020c1e584c
 HTTP/1.1 200 OK
 Content-Length: 50436
 Last-Modified: Tue, 15 Jun 2021 01:57:32 GMT
 Content-Type: application/octet-stream
 Date: Mon Jul 19 12:21:12 2021
 Server: Debian Apt-Cacher NG/3.3.1
 X-Original-Source: http://ftp.cz.debian.org/debian/dists/bullseye/non-free/i18n/by-hash/SHA256/1719a3a7f5c969d9780aec600763314a8b55aaaed3016a76fa9a7a020c1e584c
 Connection: Keep-Alive

 zito@ser1:~/admin$ curl --head http://ftp.cz.debian.org/debian/dists/bullseye/non-free/i18n/by-hash/SHA256/1719a3a7f5c969d9780aec600763314a8b55aaaed3016a76fa9a7a020c1e584c
 HTTP/1.1 200 OK
 Date: Mon, 19 Jul 2021 12:21:24 GMT
 Server: Apache/2.4.38 (Debian)
 Last-Modified: Tue, 08 Jun 2021 02:07:45 GMT
 ETag: "16553-5c4379fb85020"
 Accept-Ranges: bytes
 Content-Length: 91475


Maybe can be workarounded using some configuration pattern.
Regards

#991273#10
Date:
2021-07-26 12:49:22 UTC
From:
To:
Hallo,
* Václav Ovsík [Mon, Jul 19 2021, 03:05:39PM]:

That's an ancient version in backports. Sorry for not having updated
this for a long time.

That kind of corruption is supposed to be fixed in the Testing version.
I started the backport process but I am waiting for additionial
dependency to be accepted as backport in the archive
(https://buildd.debian.org/status/package.php?p=c-ares&suite=buster-backports).

This looks very wrong and indicates a file truncation in the cache. I
suggest to go to the admin webpage and run a cleanup operation
(Expiration task, with "check sizes and checksums" and "consider
incomplete files as damaged" checkboxes checked).

Best regards,
Eduard.

#991273#15
Date:
2021-07-30 15:39:36 UTC
From:
To:
Hello,

I am very sorry, but the problem is not in acng :-(.
Please, excuse me.
I have done upgrade of the host debian.i.cz with acng to Bullseye with
Apt-Cacher-NG/3.6.4, but the problem remains.
I have done some further investigations and the problem is in the Checkpoint
firewall of our organization :-/.

No truncated, but exchanged with other file (and yes, maybe truncated)!
The problem is with HTTP pipelining.

 bobekpc:~# file /var/lib/apt/lists/partial/ftp.debian.cz_debian_dists_sid_main_i18n_Translation-en.bz2.FAILED
 /var/lib/apt/lists/partial/ftp.debian.cz_debian_dists_sid_main_i18n_Translation-en.bz2.FAILED: gzip compressed data, max compression, from Unix, original size modulo 2^32 4212331769
 bobekpc:~# zcat /var/lib/apt/lists/partial/ftp.debian.cz_debian_dists_sid_main_i18n_Translation-en.bz2.FAILED|head
 bin/afio                                                utils/afio
 bin/bash                                                shells/bash
 bin/bash-static                                         shells/bash-static
 bin/brltty                                              admin/brltty
 bin/bsd-csh                                             shells/csh
 bin/btrfs                                               admin/btrfs-progs
 bin/btrfs-convert                                       admin/btrfs-progs
 bin/btrfs-find-root                                     admin/btrfs-progs
 bin/btrfs-image                                         admin/btrfs-progs
 bin/btrfs-map-logical                                   admin/btrfs-progs

This is Contents file, not Translations… (gzip/bzip2…)

Workarounds:
    * move to https transport (Checkpoint FW can't inspect it)
    * apt -o Acquire::http::Pipeline-Depth=0  update


I hope this report can help someone else with Checkpoint FW in his Internet
connection path with HTTP inspection turned on…

Excuse me, sorry for the effort you had with this report :-(
Regards