#728752 [getbuildlog] get compressed buildlogs

Package:
devscripts
Source:
devscripts
Description:
scripts to make the life of a Debian Package maintainer easier
Submitter:
Lisandro Damián Nicanor Pérez Meyer
Date:
2024-01-17 14:09:02 UTC
Severity:
wishlist
#728752#5
Date:
2013-11-05 01:12:45 UTC
From:
To:
Since gcc became mor everbose on it builds it's not strange to find enourmous
build logs (200+MB).

It would be really cool if getbuildlog could get the compressed buildlog
to save bandwith.


Kinds regards, Lisandro.
--- /etc/devscripts.conf ---
DEBCHANGE_RELEASE_HEURISTIC=changelog
DEBCHANGE_MULTIMAINT_MERGE=yes
DEBCHANGE_MAINTTRAILER=yes

--- ~/.devscripts ---
BTS_MAIL=perezmeyer@cepanet.com.ar
BTS_MAIL_READER=kmail
BTS_SMTP_HOST=smtp.cepanet.com.ar:25
DEBCHANGE_MAINTTRAILER=yes
DEBUILD_PREPEND_PATH="/usr/lib/ccache"
#728752#10
Date:
2013-11-20 05:58:41 UTC
From:
To:
As far as I know, there isn't a "compressed buildlog" available.  We
could change our wget call to specify "Accept-Encoding: deflate, gzip"
but that relies on the server being configured to offer compression.

Cheers,
#728752#13
Date:
2024-01-17 14:06:09 UTC
From:
To:
* James McCoy <jamessan@debian.org>, 2013-11-20 00:58:
requests compressed responses and (IMHO) has a nicer API.

Yup, that should be a matter of passing --compress=auto to wget.

buildd.debian.org supports it. :) That said, it seems it compresses the
logs on the fly, which slows down things significantly. For example:

    $ url='https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1'
    $ wget "$url" -O /dev/null
    --2024-01-17 13:53:58--  https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1
    Resolving buildd.debian.org (buildd.debian.org)... 2607:f8f0:614:1::1274:60, 209.87.16.60
    Connecting to buildd.debian.org (buildd.debian.org)|2607:f8f0:614:1::1274:60|:443... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: unspecified [text/plain]
    Saving to: ‘/dev/null’

    /dev/null             [     <=>      ]  48.09M  15.6MB/s    in 3.4s

    2024-01-17 13:54:02 (14.2 MB/s) - ‘/dev/null’ saved [50423419]

    $ wget --compress=auto "$url" -O /dev/null
    --2024-01-17 13:54:08--  https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1
    Resolving buildd.debian.org (buildd.debian.org)... 2607:f8f0:614:1::1274:60, 209.87.16.60
    Connecting to buildd.debian.org (buildd.debian.org)|2607:f8f0:614:1::1274:60|:443... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: unspecified [text/plain]
    Saving to: ‘/dev/null’

    /dev/null             [         <=>  ]   2.70M  1.05MB/s    in 2.6s

    2024-01-17 13:54:12 (1.05 MB/s) - ‘/dev/null’ saved [50423419]

The compressed log was ~18 times smaller, but the download took only 25%
less time. It's not clear --compress=auto is always going be a net
benefit.