#1043539 project: Forwarding of @debian.org mails to gmail broken

#1043539#5
Date:
2023-08-12 15:54:47 UTC
From:
To:
If I try to mail e.g. Marcos Fouces <marcos@debian.org>, this no
longer works. I get the following error message:

This message was created automatically by mail delivery software.

A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:

  marcos.fouces@gmail.com
    host gmail-smtp-in.l.google.com [173.194.79.26]
    SMTP error from remote mail server after pipelined end of data:
    550-5.7.26 This mail is unauthenticated, which poses a security risk to the
    550-5.7.26 sender and Gmail users, and has been blocked. The sender must
    550-5.7.26 authenticate with at least one of SPF or DKIM. For this message,
    550-5.7.26 DKIM checks did not pass and SPF check for [helgefjell.de] did not
    550-5.7.26 pass with ip: [82.195.75.114]. The sender should visit
    550-5.7.26  https://support.google.com/mail/answer/81126#authentication for
    550 5.7.26 instructions on setting up authentication. v26-20020aa7d65a000000b005231f55294dsi4996663edr.385 - gsmtp

The IP 82.195.75.114 resolves to
114.75.195.82.in-addr.arpa is an alias for 114.64-26.75.195.82.in-addr.arpa.
114.64-26.75.195.82.in-addr.arpa domain name pointer mailly.debian.org.

And of course, SPF/DKIM checks for my domain (helgefjell.de) fail for
this IP, which is @debian.org.

I don't know how it worked so far, and the error could be on my side, as I
recently switched my e-mail setup; however, I don't see anything I can
do to make DKIM/SPF point to @debian.org instead of @helgefjell.de,
when transferring e-mail to gmail.

Greetings

         Helge

#1043539#10
Date:
2023-08-12 16:35:52 UTC
From:
To:
Hi,

Contacting DSA is generally a better way to ask about infrastructure
things than filing bugs on high-level pseudo-packages.

The DKIM signature warning has nothing to do with the forwarding, or
the involvement of debian.org at all. The reason that check fails is
that your mail has no DKIM signature, so obviously can't have a valid
one. Signing your mail would probably make gmail a lot happier with it
in general. (As a side note, the BTS breaks many common DKIM signature
strategies, but that's a different issue.)

The general issue is being worked on, as time and resources allow.

Regards,

Adam
(part of, but not on behalf of, DSA)

#1043539#15
Date:
2023-08-12 17:08:00 UTC
From:
To:
Hello Adam,
Am Sat, Aug 12, 2023 at 05:35:52PM +0100 schrieb Adam D. Barratt:

Thanks, then I know this for the future.

Sigh.

Directly gmail accepts it.

Thanks a lot!

Greetings

         Helge

#1043539#20
Date:
2023-08-12 17:11:43 UTC
From:
To:
[...]
[...]

I'm not sure why the sigh, but in any case your direct mail presumably
succeeds because it passes the SPF check. I was simply clarifying that
the DKIM check would fail in both cases.

Regards,

Adam

#1043539#25
Date:
2023-08-12 18:31:35 UTC
From:
To:
Helge Kreutzmann <debian@helgefjell.de> writes:

The mail to which I'm resonding also comes from your @helgefjell.de
domain, so I'm suspecting some DKIM/SPF issues there if you're using that
same address in your original mail message.  But just in case you were
trying to send from your @debian.org address, one option is to send all of
your outgoing mail that is from your debian.org address through the
debian.org mail servers.  See:

https://dsa.debian.org/user/mail-submit/

I don't think this is the direct answer to your original question, but I
suspect it would work around the problem.

#1043539#30
Date:
2023-08-12 19:40:49 UTC
From:
To:
Hello Adam,
Am Sat, Aug 12, 2023 at 06:11:43PM +0100 schrieb Adam D. Barratt:

Well, I did have trouble sending directly to gmail accounts, which now
seems to work. Now the next e-mail problem arises, which I need to see
how much I can configure it to work. That's the sigh.

It's just that I never had this problem with mails to people with
@debian.org addresses, so either my new configuration or some other
change, I don't know.

I hope this explains it a little.

Greetings

        Helge

#1043539#35
Date:
2023-08-12 19:42:07 UTC
From:
To:
Hello Russ,
Am Sat, Aug 12, 2023 at 11:31:35AM -0700 schrieb Russ Allbery:

Yes, this is my primary e-mail address

Thanks for taking care, but I don't have an @debian.org address.

Greetings

         Helge

#1043539#40
Date:
2023-08-12 20:41:46 UTC
From:
To:
Helge Kreutzmann <debian@helgefjell.de> writes:

The problem I suspect is with email forwarding, and specifically email
forwarding to Gmail, which has recently ramped up the amount of
verification it does on messages.  Because of email forwarding, Gmail sees
a message purportedly from helgefjell.de but actually delivered by
debian.org mail servers, and has now decided to be suspicious of that.

If that's correct, you'll only have this problem with Debian developers
who forward their @debian.org addresses to Gmail.  Gmail handles some
large percentage of all email on the Internet, so this probably isn't
rare, but Debian developers are less likely to use it than random Internet
users for obvious reasons, so it doesn't surprise me you've not run into
the problem before.  (In other words, I doubt this is a problem with your
local configuration.)

#1043539#43
Date:
2023-08-12 21:13:58 UTC
From:
To:
This is the exact use case that SRS was developer for, however gmail's
documentation does not recommend that (but the situation, as you noted,
worsened, so I tried it in some other similar setups and everything is
great, so...).
My understanding is that several DSA members were opposed to using SRS
for @debian.org forwarding, but maybe it's now time?

Alternatively, I wonder if ARC nowadays is respected enough (and if
Google cares about it)... I personally don't have any system with ARC
under my care.

#1043539#48
Date:
2023-08-13 09:57:19 UTC
From:
To:
They sort of recommend it now. But also not. It's complicated. [tm]

That's essentially what's being worked on. But life, and free time, and
other priorities, keep getting in the way.

Regards,

Adam

#1043539#53
Date:
2023-08-13 10:31:22 UTC
From:
To:
Hallo! Du (Russ Allbery) hast geschrieben:

As listmaster i can confirm that it is a big problem to deliver Mails to
gmail/outlook/yahoo. Yahoo Subscribers are mostly gone by now because they
bounced a lot, for gmail it is so much that we just ignore bounces because of
those rules.

If you decide to handle your mails to be curated by someone else you have to
live with an incomplete mailbox.

| helgefjell.de descriptive text "v=spf1 ip4:142.132.201.35 mx ~all"

so you flagged your mail has to come from that IP (or the MX) and from other
sources it should be considered suspicious.

Thats the result.

SRS/ARC and so on are just dirty patches that try to fix things that were
broken before, but they will break even more things like Mail signing.

As long as we have this Oligopol that doesn't care about what they send out
(i.e. Spamfloods through Outlook) things will only get worse.

Cord

#1043539#58
Date:
2023-08-13 11:04:00 UTC
From:
To:
Empty Message
#1043539#63
Date:
2023-08-13 23:57:45 UTC
From:
To:
Greetings,

* Mattia Rizzolo (mattia@debian.org) wrote:

Sadly, no, they don't seem to care one bit about ARC, except possibly if
it's their own ARC sigs.

If someone has some idea how to get them to care about ARC, I'd love to
hear about it, as I have folks on the one hand who view DKIM/DMARC as
too painful to set up but then they end up with bounces from gmail due
to my forwarding of messages through my server (which are being
ARC-signed by it and pass on that the SPF check was successful when they
arrived to my server)...

I'd encourage everyone running their own email servers to please get
DKIM/DMARC/ARC/SPF set up.  Yeah, it's annoying, but it's not actually
all *that* bad to do.

Thanks,

Stephen

#1043539#68
Date:
2023-08-14 00:02:29 UTC
From:
To:
Greetings,

* Cord Beermann (cord@debian.org) wrote:

As a maintainer or some pretty big lists ... we don't have *that* much
trouble delivering to gmail, or others for that matter.

... but if it's DKIM signed, then it'll generally get delivered
properly.

ARC doesn't break DKIM signatures (unless someone's got a very broken
DKIM setup which over-signs ARC headers ... but if so, then that's on
them).

Thanks,

Stephen

#1043539#73
Date:
2023-08-15 18:04:49 UTC
From:
To:
I do not know of any situation in which DMARC adoption would improve
deliverability, and most people that configure it are just engaging in
cargo cult sysadmining.
DMARC with p=reject is useful when the sender domain is a phishing
victim, e.g. a financial organization, but most users do not need it.

In other words: if these people want to support use cases like
forwarding and participating to mailing lists then they should adopt
DKIM and ignore DMARC.

#1043539#78
Date:
2023-08-17 17:52:11 UTC
From:
To:
An initial version, rewriting mails to Google-hosted domains from
"external" e-mail addresses (those for which debian.org's mail relays
don't consider themselves authoritative, so mostly not *.debian.org and
*.debconf.org) is now live.

Please let DSA know if you encounter any issues.

Regards,

Adam

#1043539#83
Date:
2023-08-17 18:36:03 UTC
From:
To:
Hello Adam,
Am Thu, Aug 17, 2023 at 06:52:11PM +0100 schrieb Adam D. Barratt:

Thanks a lot for the speedy fixing.

I'll report any issues (if any).

Greetings

          Helge

#1043539#88
Date:
2023-11-25 09:57:48 UTC
From:
To:
Hellow all,

Sorry for late feedback. By chance, i discovered this story
#1043539. Also i'm using Gmail via forwarding (Postfix+OpenDKIM). I love
Postfix and DKIM stuff.

Though i am not debian member, i would like to share this experience
with you. If your dkim signature is OK, then Gmail does accept all
mails. So never use SRS. DKIM is enough.

<quote: postfix log with debian-bugs-dist mailing>
Nov 25 09:51:14 yw-1204 postfix/smtpd[94851]: connect from yw-0919.doraji.xyz[2600:1900:4000:af49:0:3::]
Nov 25 09:51:14 yw-1204 postfix/smtpd[94851]: Trusted TLS connection established from yw-0919.doraji.xyz[2600:1900:4000:af49:0:3::]: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256
Nov 25 09:51:14 yw-1204 postfix/smtpd[94851]: D6A8A6D3: client=yw-0919.doraji.xyz[2600:1900:4000:af49:0:3::]
Nov 25 09:51:14 yw-1204 postfix/cleanup[94856]: D6A8A6D3: resent-message-id=<handler.1056557.B1056557.17009057453200686@bugs.debian.org>
Nov 25 09:51:15 yw-1204 postfix/cleanup[94856]: D6A8A6D3: message-id=<e98510e4-738c-1ea8-8741-0a0d1e869670@debian.org>
Nov 25 09:51:15 yw-1204 opendkim[631]: RFC2822-From: Andreas Beckmann <anbe@debian.org>
Nov 25 09:51:15 yw-1204 opendkim[631]: RFC2821-From: bounce-debian-bugs-dist=soyeomul=doraji.xyz@lists.debian.org
Nov 25 09:51:15 yw-1204 opendkim[631]: RFC2821-To: soyeomul+gcp@gmail.com
Nov 25 09:51:15 yw-1204 opendkim[631]: D6A8A6D3: DKIM-Signature field added (s=yw-1204-doraji-xyz, d=doraji.xyz)
Nov 25 09:51:15 yw-1204 opendkim[631]: D6A8A6D3: DKIM-Signature field added (s=YW, d=doraji.xyz)
Nov 25 09:51:15 yw-1204 postfix/qmgr[91844]: D6A8A6D3: from=<bounce-debian-bugs-dist=soyeomul=doraji.xyz@lists.debian.org>, size=7421, nrcpt=1 (queue active)
Nov 25 09:51:15 yw-1204 postfix/smtpd[94851]: disconnect from yw-0919.doraji.xyz[2600:1900:4000:af49:0:3::] ehlo=2 starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7
Nov 25 09:51:17 yw-1204 postfix/smtp[94857]: Verified TLS connection established to gmail-smtp-in.l.google.com[2607:f8b0:4023:1006::1b]:25: TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-256) server-digest SHA256
Nov 25 09:51:18 yw-1204 postfix/smtp[94857]: D6A8A6D3: to=<soyeomul+gcp@gmail.com>, relay=gmail-smtp-in.l.google.com[2607:f8b0:4023:1006::1b]:25, delay=3.4, delays=0.25/0.02/2.2/0.98, dsn=2.0.0, status=sent (250 2.0.0 OK  1700905878 ep1-20020a056808444100b003b85c5d06d8si386914oib.242 - gsmtp)
Nov 25 09:51:18 yw-1204 postfix/qmgr[91844]: D6A8A6D3: removed
</quote>

Sincerely, Byung-Hee (Debian user in South Korea)

#1043539#93
Date:
2024-02-02 05:08:52 UTC
From:
To:
Hellow Debian Hackers,

I did investigate about Gmail's behavior for lone time. Today i would
like to submit some evidences. There are two screenshot picture. Plus
one headr file and one postfix log file:

https://gitlab.com/soyeomul/Gnus/-/commit/9b352348a622a5bb2adf909fd3987e91d6c4205a

Thanks in advance,


Sincerely, Byunghee (South Korea's Debian user)

#1043539#98
Date:
2024-07-05 15:03:37 UTC
From:
To:
*HiHow are you doing I hope all is well. My name is Miss Amanda Kipkalya
Kones, I am 24 years old, I am a girl. Today I decided to extend my regards
to you. But I have the Mind you could be a good person, I think, and there
are good people who can appreciate the value of friendship. And i would
like to be your friend even more than that but as time goes by we will know
better well I will say that my mind convinced me that you may be the true
person to help me out in this my present condition i am now in a refugee
camp in Burkina Faso. I will tell you more about me as soon as I hear from
you.please reply me for more confidential discussions may be like that we
can become best friends in future sorry for my pictures i will enclose it
in my next mail and more about me when i hear from you okay i am living now
in a refugee camp, here is my WhatsApp number +226 55641872 and you can
also call me direct call on the phone number as well, i will be waiting to
hear from you,Kisses and warmest regardsYours,Miss Amanda Kipkalya Kones.*

#1043539#103
Date:
2025-07-16 05:34:56 UTC
From:
To:
Waiting for your reply for a long time now. Please Did you receive my
message? Can I confide in you? I await your urgent reply.

오랫동안 답장을 기다리고 있었습니다. 제 메시지는 받으셨나요? 믿어도 될까요? 긴급한 답장을 기다리겠습니다.

#1043539#108
Date:
2026-02-05 20:22:08 UTC
From:
To:
Kunnen we even praten?