#1053935 www.debian.org: outdated debian-cd, debian-archive, debian-ports mirror lists

#1053935#5
Date:
2023-10-14 15:14:35 UTC
From:
To:
The debian-cd [1][2], debian-archive [3], debian-ports [4] mirror lists are
outdated. They do not reflect Mirrors.masterlist.in [5].
Related bug report: #1034832

Furthermore, the debian-cd mirroring instruction [6] says:
debian-cd mirrors, and new debian-cd mirror submission sent to the debian-cd
mailing lists have been ignored, all submission at least in the past 12 months
have no reply.
Related bug report: #1053934

If the mirror lists are not automatically generated from Mirrors.masterlist.in,
like /debian [8], maybe they really should be.

[1] https://www.debian.org/CD/http-ftp/
[2] https://www.debian.org/CD/mirroring/rsync-mirrors
[3] https://www.debian.org/distrib/archive
[4] https://www.ports.debian.org/mirrors
[5] https://salsa.debian.org/mirror-team/masterlist/-/blob/master/Mirrors.masterlist.in
[6] https://www.debian.org/CD/mirroring/
[7] https://www.debian.org/mirror/submit
[8] https://www.debian.org/mirror/list

#1053935#10
Date:
2023-10-20 17:46:22 UTC
From:
To:
Control: tags -1 + moreinfo
[...]

Note that Mirrors.masterlist.in is not used verbatim by any part of the
website. Rather, the Mirror Team's status monitoring tools (see e.g.
https://mirror-master.debian.org/status/mirror-status.html ) generate a
filtered list containing those mirrors which are considered to be
currently "good enough" (i.e. have managed to stay up-to-date for long
enough), so not all mirrors in the .in file will appear in the results.

I haven't checked the ports list, but the debian-cd and debian-archive
lists being published on the web pages certainly appear to match those
included in the generated version of Mirrors.masterlist.

Can you point to specific examples that you believe should be included
in each, but are not?

Regards,

Adam

#1053935#17
Date:
2023-10-23 11:44:25 UTC
From:
To:
Hello Adam,

First of all, I would like to thank the mirror team for all the hard
work.

I see. Is this information publicly available on www.d.o or gitlab?

Since there is a generated version of Mirrors.masterlist and it doesn't
appears to be publicly accessible, and the mirror team has its own
standard, there is really no way for any "outsider" to know if the lists
on the website is really good.

However, I do find one that should be included:
debian.cs.nycu.edu.tw looks up to date and should be on the debian-cd
list.

Also, in Mirrors.masterlist.in, there is a duplicated entry:
Line 999 and line 1009
debian.cs.nctu.edu.tw and debian.cs.nycu.edu.tw
The university changed its abbreviation and domain name from NCTU to
NYCU, these two are exactly the same. Also the sponsor's website
(http://www.cs.nctu.edu.tw/) (line 1007) of the first one (NCTU)
redirects to NYCU's website.

For debian-ports, linux.purple-cat.net is also up to date, but why is it
not on the debian-ports list? Do you not accept new ports mirror?

#1053935#22
Date:
2023-10-23 12:01:38 UTC
From:
To:
Which information?

It is publicly accessible. The generated file is in
https://mirror-master.debian.org/status/ (which you can verify in the
webwml repository is where the website downloads it from), and the
status of each mirror can be checked using the URL from my previous
mail.
debian.cs.nycu.edu.tw looks up to date and should be on the debian-
list.

It's up-to-date now, but as you can see from
https://mirror-master.debian.org/status/mirror-info/debian.cs.nycu.edu.tw.html
, it's been having some issues recently. The "score" column needs to be
at least 50 for it to be included.

That's in the generated Masterlist file, and has Ports-* fields, so
that might be one for the web team to look at, I think.

Regards,

Adam

#1053935#27
Date:
2023-10-25 07:01:07 UTC
From:
To:
The paragraph I quoted above and below.

It would be better to avoid future confusion for others if the Debian
web team can put this paragraph somewhere on www.d.o

Sorry that I wasn't clear. This is true *if* the same mirror mirrors
/debian _and_ debian-cd, etc. If a mirror site only mirrors debian-cd,
debian-archive, or debian-ports (although unlikely?), we will have to
manually check the trace file to see if it's updated. And in some (rare)
occasions, their /debian can be up-to-date while debian-ports is not. I
guess debian-cd, debian-archive and debian-ports are currently out of
scope for mirror-status?

Since Debian is a community project, for openness and transparency, I
suggest the web team add this "at least 50" rule to
www.d.o/mirror/list.en.html

@the web team