#1081048 devscripts: debrebuild from main branch does not work with a proxy

Package:
devscripts
Source:
devscripts
Description:
scripts to make the life of a Debian Package maintainer easier
Submitter:
Holger Levsen
Date:
2024-09-13 15:39:01 UTC
Severity:
normal
#1081048#5
Date:
2024-09-07 16:22:51 UTC
From:
To:
Dear josch,

when trying to use debrebuild from the main branch and when using a proxy
to cause less load on snapshot.debian.org, this fails for me:

holger@osuosl4-amd64:/srv/data/holger/devscripts$ export http_proxy="http://localhost:3128"
holger@osuosl4-amd64:/srv/data/holger/devscripts$ ./scripts/debrebuild.pl --builder=sbuild+unshare ../codespell_2.3.0-1_amd64.buildinfo
../codespell_2.3.0-1_amd64.buildinfo contained a GPG signature; it has NOT been validated (debrebuild does not support this)!
Using defined Build-Path: /build/codespell-2.3.0
0% [Working]Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55668)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55670)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Ign:1 http://localhost:53979/archive/debian/20240903T204216Z sid InRelease
0% [Working]Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55674)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55688)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Ign:1 http://localhost:53979/archive/debian/20240903T204216Z sid InRelease
0% [Working]Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55696)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Traceback (most recent call last):
  File "/usr/bin/debootsnap", line 137, in header_cb
    field, value = line.split(":", 1)
    ^^^^^^^^^^^^
ValueError: not enough values to unpack (expected 2, got 1)
----------------------------------------
Exception occurred during processing of request from ('127.0.0.1', 55708)
Traceback (most recent call last):
  File "/usr/lib/python3.11/socketserver.py", line 317, in _handle_request_noblock
    self.process_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 348, in process_request
    self.finish_request(request, client_address)
  File "/usr/lib/python3.11/socketserver.py", line 361, in finish_request
    self.RequestHandlerClass(request, client_address, self)
  File "/usr/lib/python3.11/http/server.py", line 667, in __init__
    super().__init__(*args, **kwargs)
  File "/usr/lib/python3.11/socketserver.py", line 755, in __init__
    self.handle()
  File "/usr/lib/python3.11/http/server.py", line 432, in handle
    self.handle_one_request()
  File "/usr/lib/python3.11/http/server.py", line 420, in handle_one_request
    method()
  File "/usr/bin/debootsnap", line 148, in do_GET
    c.perform()
pycurl.error: (23, 'Failed writing header')
----------------------------------------
Ign:1 http://localhost:53979/archive/debian/20240903T204216Z sid InRelease
0% [Working]^CTraceback (most recent call last):
  File "/usr/bin/debootsnap", line 694, in <module>
    main(sys.argv[1:])
  File "/usr/bin/debootsnap", line 680, in main
    download_packages(tmpdirname, sources, pkgs, nativearch, foreignarches)
  File "/usr/bin/debootsnap", line 600, in download_packages
    subprocess.check_call(
  File "/usr/lib/python3.11/subprocess.py", line 408, in check_call
    retcode = call(*popenargs, **kwargs)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 391, in call
    return p.wait(timeout=timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1262, in wait
    return self._wait(timeout=timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1997, in _wait
    (pid, sts) = self._try_wait(0)
                 ^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1955, in _try_wait
    (pid, sts) = os.waitpid(self.pid, wait_flags)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyboardInterrupt
debootsnap failed at ./scripts/debrebuild.pl line 423.
holger@osuosl4-amd64:/srv/data/holger/devscripts$ git describe HEAD
v2.23.7-78-gee16294f
holger@osuosl4-amd64:/srv/data/holger/devscripts$ git log --oneline -1
ee16294f (HEAD -> main, origin/main, origin/HEAD) Tidy lib/Devscripts/Salsa/Repo.pm
holger@osuosl4-amd64:/srv/data/holger/devscripts$
#1081048#10
Date:
2024-09-13 15:27:38 UTC
From:
To:
I think this is due to snapshot.d.o. returning HTTP 302 since ~summer.

[1] implements support for following (one) 302 redirection.

[1] https://salsa.debian.org/linus/devscripts/-/tree/ln5/debrebuild?ref_type=heads