#562595 downloads some packages twice

Package:
aptitude
Source:
aptitude
Description:
terminal-based package manager
Submitter:
Stanislav Maslovski
Date:
2021-07-29 11:51:02 UTC
Severity:
normal
Tags:
#562595#5
Date:
2009-12-26 12:48:19 UTC
From:
To:
Doing 'aptitude upgrade':

....
Need to get 97.9MB of archives. After unpacking 1163kB will be used.
Do you want to continue? [Y/n/?]
Writing extended state information... Done
Get:1 http://ftp.us.debian.org unstable/main zlib1g-dev 1:1.2.3.4.dfsg-2 [187kB]
Get:2 http://ftp.us.debian.org unstable/main zlib1g 1:1.2.3.4.dfsg-2 [76.0kB]
Get:3 http://ftp.us.debian.org unstable/main grub-common 1.98~20091222-1 [1454kB]
Get:4 http://ftp.us.debian.org unstable/main dpkg 1.15.5.5 [2171kB]
Get:5 http://ftp.us.debian.org unstable/main adduser 3.112 [157kB]
Get:6 http://ftp.us.debian.org unstable/main bsdmainutils 8.0.4 [194kB]
Get:7 http://ftp.us.debian.org unstable/main nano 2.2.1-1 [525kB]
Get:8 http://ftp.us.debian.org unstable/main python-minimal 2.5.4-5 [14.7kB]
Get:9 http://ftp.us.debian.org unstable/main python 2.5.4-5 [148kB]
Get:10 http://ftp.us.debian.org unstable/main acpi-support-base 0.131-3 [17.1kB]
Get:11 http://ftp.us.debian.org unstable/main cdbs 0.4.63 [1019kB]
Get:12 http://ftp.us.debian.org unstable/main dosfstools 3.0.7-1 [87.9kB]
Get:13 http://ftp.us.debian.org unstable/main dosfstools 3.0.7-1 [87.9kB]
Get:14 http://ftp.us.debian.org unstable/main dpkg-dev 1.15.5.5 [762kB]
Get:15 http://ftp.us.debian.org unstable/main libinotifytools0 3.13-3 [21.6kB]
Get:16 http://ftp.us.debian.org unstable/main inotify-tools 3.13-3 [27.1kB]
Get:17 http://ftp.us.debian.org testing/main libfribidi0 0.10.9-1+b1 [42.6kB]
Get:18 http://ftp.us.debian.org testing/main libfribidi0 0.10.9-1+b1 [42.6kB]
Get:19 http://ftp.us.debian.org unstable/main libglib2.0-dev 2.22.3-2 [1039kB]
Get:20 http://ftp.us.debian.org unstable/main libglib2.0-0 2.22.3-2 [910kB]
Get:21 http://ftp.us.debian.org unstable/main libglib2.0-0 2.22.3-2 [910kB]
Get:22 http://ftp.us.debian.org unstable/main liblog4cxx10 0.10.0-1.1 [561kB]
Get:23 http://ftp.us.debian.org unstable/main libnids1.21 1.23-1.1 [24.7kB]
Get:24 http://ftp.us.debian.org testing/main libntfs10 2.0.0-1+b1 [125kB]
Get:25 http://ftp.us.debian.org testing/main libntfs10 2.0.0-1+b1 [125kB]
Get:26 http://ftp.us.debian.org unstable/main libofa0 0.9.3-3.1 [56.8kB]
Get:27 http://ftp.us.debian.org unstable/main libpoppler5 0.12.2-2.1 [921kB]
Get:28 http://ftp.us.debian.org unstable/main libpoppler5 0.12.2-2.1 [921kB]
...

You can see that some of the packages are downloaded twice. The same
is seen when using the ncurses interface.

Here is my apt.conf:

==================================================
Acquire::Cdrom::Mount "/cdrom";
APT::Periodic::Enable "0";

APT {
	Cache-Limit 50000000;
	Install-Recommends "false";
	Install-Suggests "false";
	CDROM {
		NoMount "true";
		Fast "true";
	};
};

Aptitude {
	Auto-Install "true";
	Auto-Fix-Broken "true";
	Purge-Unused "true";
	CmdLine {
		Always-Prompt "true";
		Show-Versions "true";
		Show-Deps "true";
	};
};
==================================================

and apt/preferences:

==================================================
Package: *
Pin: release o=Kaiba
Pin-Priority: 1001

Package: *
Pin: release a=stable,o=Debian
Pin-Priority: 500

Package: *
Pin: release a=testing,o=Debian
Pin-Priority: 500

Package: *
Pin: release a=unstable,o=Debian
Pin-Priority: 500

Package: *
Pin: release a=experimental,o=Debian
Pin-Priority: 100

Package: *
Pin: release a=testing,o=Unofficial Multimedia Packages
Pin-Priority: 100
==================================================

and sources.list:

==================================================
#deb cdrom:[Debian GNU/Linux testing _Lenny_ - Official Snapshot i386 NETINST Binary-1 20081013-09:41]/ lenny main

# Stable (lenny)
deb http://security.debian.org stable/updates main contrib non-free
deb-src http://security.debian.org stable/updates main contrib non-free
deb http://ftp.us.debian.org/debian/ lenny-proposed-updates main contrib non-free
deb http://volatile.debian.net/debian-volatile stable/volatile main
deb http://ftp.us.debian.org/debian/ stable main contrib non-free

# Testing
deb http://ftp.us.debian.org/debian/ testing main contrib non-free

# Unstable
deb http://ftp.us.debian.org/debian/ unstable main contrib non-free
deb-src http://ftp.us.debian.org/debian/ unstable main contrib non-free

# Experimental
deb http://ftp.us.debian.org/debian/ experimental main contrib non-free
deb-src http://ftp.us.debian.org/debian/ experimental main contrib non-free

# Old stable
deb http://ftp.us.debian.org/debian/ oldstable main contrib non-free
deb-src http://ftp.us.debian.org/debian/ oldstable main contrib non-free

# Trunk kernel
#deb http://kernel-archive.buildserver.net/debian-kernel trunk main

# package snapshots, sometimes very useful
#deb http://snapshot.debian.net/archive/ pool kbd aptitude
#deb http://snapshot.debian.net/archive/ pool smplayer
#deb http://snapshot.debian.net/archive pool linux-2.6.24
#deb http://snapshot.debian.net/archive/ pool gcc-3.4

# Marillat
deb http://www.debian-multimedia.org/ testing main

# Opera
#deb http://deb.opera.com/opera/ testing non-free

# Matroska tools
#deb http://www.bunkus.org/debian/lenny ./
#deb-src http://www.bunkus.org/debian/tenny ./

# Skype
deb http://download.skype.com/linux/repos/debian/ stable non-free

# Quake3
deb http://scorpius.homelinux.org/~marc/debian binary/

# Eternal Lands
deb http://www.twinmoons.org.uk/pkg/debian/ ./

# VirtualBox
deb http://download.virtualbox.org/virtualbox/debian lenny non-free

# Squeak
deb http://ftp.squeak.org/debian/ unstable main
deb-src http://ftp.squeak.org/debian/ unstable main
==================================================

#562595#10
Date:
2010-03-11 08:23:16 UTC
From:
To:
Any news regarding this bug? It is still there. If you need more
information, tell me what I have to look for. My apt.conf etc. was
included in the original bug report though.

This bug may seem harmless, but it may increase the load on the debian
mirrors if squeeze gets released with it.

#562595#15
Date:
2014-03-02 19:22:01 UTC
From:
To:
Control: tags -1 + moreinfo

Hi,

Is this bug still happening?  I haven't experience it, at least
recently, in several systems that I administer.

I don't have much idea about why this can be happening, if anybody can
provide any info it would be helpful.


Cheers.

#562595#22
Date:
2014-03-03 00:29:00 UTC
From:
To:
I suspect this is rather to do with duplicate lines in the progress
output as is seen with list updates.  At least list update duplicates
are due to the apt infrastructure sending the file through
decompression stages, which is considered a separate fetch.
start.  If you are interested in resolving such problems you must
understand the implementation and workings of these classes.

Questions you can look at:
* does the list update duplicates issues still occur?
* why does it occur (for your information only, and to help in further
investigating)
* does a similar process happen with package fetching?
* is that the issue here?

#562595#27
Date:
2014-03-03 00:32:54 UTC
From:
To:
Which sources are those systems using (for your info.), do they match
the ones with duplicate lines in the bug report, and do those servers
issue http redirects?

#562595#32
Date:
2016-02-17 11:58:30 UTC
From:
To:
2014-03-03 00:32 Daniel Hartwig:

#562595 is possibly related to #693847, and (at the moment, 6 years
later...) ftp.us.debian.org resolves to different IP addresses, like
http.debian.net does, so it is likely that the problem is the same.  The
submitter did not clarify if the double download did actually take
place, or if the print of the first one was "immediate" so the download
of the data could not have taken place so quickly.

I am not merging them because it is not confirmed if it's the same
issue.  Even if it was a duplicate it doesn't add important information
to the other one, so perhaps it could be closed.

#562595#37
Date:
2021-06-12 01:58:35 UTC
From:
To:
-- 
¿Recibiste realmente mi mensaje anterior?

#562595#42
Date:
2021-07-29 11:46:57 UTC
From:
To:
Did you receive my previous mail to you?