Dear maintainer,

I am preparing a rust-compact-str transition, which will be uploaded soon.

tokienizers needs a small patch for its Cargo.toml.

I have attached a debdiff fixing this, which can be uploaded at any time.

Best regards,
Simon Quigley
tsimonq2@debian.org

Dear maintainer,

I've prepared an NMU for tokenizers (versioned as 0.23.1+dfsg-2.1) and
uploaded it to DELAYED/2. Please feel free to tell me if I should cancel it.

cu
Adrian

We believe that the bug you reported is fixed in the latest version of
tokenizers, which is due to be installed in the Debian FTP archive.

A summary of the changes between this version and the previous one is
attached.

Thank you for reporting the bug, which will now be closed.  If you
have further comments please address them to 1145427@bugs.debian.org,
and the maintainer will reopen the bug report if appropriate.

Debian distribution maintenance software
pp.
Adrian Bunk <bunk@debian.org> (supplier of updated tokenizers package)

(This message was generated automatically at their request; if you
believe that there is a problem with it please contact the archive
administrators by mailing ftpmaster@ftp-master.debian.org)
Format: 1.8
Date: Mon, 31 Aug 2026 15:59:50 +0300
Source: tokenizers
Architecture: source
Version: 0.23.1+dfsg-2.1
Distribution: unstable
Urgency: medium
Maintainer: Debian Deep Learning Team <debian-ai@lists.debian.org>
Changed-By: Adrian Bunk <bunk@debian.org>
Closes: 1145427
Changes:
 tokenizers (0.23.1+dfsg-2.1) unstable; urgency=medium
 .
   * Non-maintainer upload.
 .
   [ Simon Quigley ]
   * Allow compact_str 0.10. (Closes: #1145427)
Checksums-Sha1:
 4132e85745589ac68860a290f9bdc6ec43f6e716 3143 tokenizers_0.23.1+dfsg-2.1.dsc
 da611cdb575f5a9ef118da6bda804d4d86f9e418 5676 tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
Checksums-Sha256:
 9eb5f5fbc209f6082c1d82cd74aef9f184165d4dbaa73d32c0ea01c5c3fbbc33 3143 tokenizers_0.23.1+dfsg-2.1.dsc
 e89b589d9c999f248dd4ab670cde4f4776a25d0b40f2ed62da82b1366dd39bf6 5676 tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
Files:
 ea140a2f780651dd476bfb6ce7e4be5c 3143 python optional tokenizers_0.23.1+dfsg-2.1.dsc
 cf320afa8479bc234f6f4160d0ea7117 5676 python optional tokenizers_0.23.1+dfsg-2.1.debian.tar.xz
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEOvp1f6xuoR0v9F3wiNJCh6LYmLEFAmqVfooACgkQiNJCh6LY
mLHHkRAAuBMdIjhJU83SfhD86WR6MfRZXVg9kqE+MGgPw32HZVoCmORHtT0lqR8w
SE8+usKE99ImW6kYUR5xQQEFuOnaPXZQUxDlEQdo3hR/r9xvEkkXGQ07wdeeuGEX
DVpUIQmNn7X/kCp8rsKxzW7qomBfdGR2zZ4TNrKrXdaae7N2fIsAJDxvxwQ+RN01
HwrVKR5a3IY6rWZZBszRfs3/L1/wXBXOkorgYv7EXaZmbUQ3W8cEDuRxSVcdrwHg
3s9NiHRBg9GmO0rrwcXOefleu17BgQUnx0D5G2sHw5/0POVl/W5xkYaMJijoZhuu
IUlB7hpeS32IqMdaXU8XUH5GPrFJIFKncHKQMLHI9KjMxSOlEe+elqNBKfVdJK3x
Zri9Aqkp/ux0O9Mul1/IW9vBkomGJQ/DGmDENuzuByKSHOnejh+c/6f7J9m/3qs5
Bj+yhchS0043Ov26S7a5TKEDSupEPGQXnjEKMSPDWQcUZL8ZeS2WhwOq0LkBBjuv
vEFJJ+ShB/baL1M8mMAfclqRayg0A/3qoDS6RnrTUS+hoDLt+KBlZfCdOkhWDCRj
te37Gr4qHRWc4NN1kOmJwfO6DSaW81Buwpv9aOHgQiVlYKOKvabZW/+BxnO2CILm
DJx+ZiIT8/OQksqZ++okgY1P5LCgEDgr2uYOMn/Fcue5QYZ4kNA=
=RRgA
-----END PGP SIGNATURE-----