#867305 licensecheck: file parsing: misparses utf8-encoded files as Latin1 by default

Package:
licensecheck
Source:
licensecheck
Submitter:
Ximin Luo
Date:
2025-04-08 10:06:04 UTC
Severity:
normal
#867305#5
Date:
2017-07-05 16:00:28 UTC
From:
To:
Dear Maintainer,

licensecheck seems to generate bad output for unicode files such as:

https://sources.debian.net/src/sagemath/7.6-2/sage/src/doc/ja/tutorial/tour_rings.rst

An example command line is:

$ licensecheck -l250 --deb-machine --merge-licenses src/doc/ja/tutorial/tour_rings.rst

I get glyphs like <U+008D>ã<U+0081> suggesting that maybe it is getting utf-8-encoded twice.

X
#867305#10
Date:
2020-05-15 11:03:42 UTC
From:
To:
Quoting Ximin Luo (2017-07-05 18:00:28)

Explicitly tell licensecheck to use (or more accurately first try) utf8:

  licensecheck -l250 --deb-machine --merge-licenses --encoding utf8 tour_rings.rst

I agree that this is not optimal: Nowadays licensecheck should use utf8
by default.  I am just not quite certain how to go about that - if ok to
simply switch, or if I should make a mimor or major version bump when
doing such change.
#867305#19
Date:
2023-05-12 14:36:46 UTC
From:
To:
Good morning,

 Attached please find your PDF account statement and invoice as of 05/11/2023. Please notice you have a past due balance  for invoice IN0099203.

 Please provide payment as soon as possible.




 Best Regards,
 Shawneen Chisholm
 Accounts Receivable Coordinator

 UNITED RENTALS, INC.
Branch L02 BONNYVILLE
4920 56TH AVE
BONNYVILLE AB T9N 2N8 CA
780-826-7610


 CONFIDENTIALITY NOTICE: The contents of this email message and any attachments are intended solely for the addressee(s). This may contain confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message, please alert the sender immediately by reply email and then delete this message and any attachments. Any disclosure, reproduction, distribution or other use of this message or any attachments by an individual or entity other than the intended recipient is prohibited
#867305#24
Date:
2023-05-12 14:36:31 UTC
From:
To:
Good morning,

 Attached please find your PDF account statement and invoice as of 05/11/2023. Please notice you have a past due balance  for invoice IN0099203.

 Please provide payment as soon as possible.




 Best Regards,
 Shawneen Chisholm
 Accounts Receivable Coordinator

 UNITED RENTALS, INC.
Branch L02 BONNYVILLE
4920 56TH AVE
BONNYVILLE AB T9N 2N8 CA
780-826-7610


 CONFIDENTIALITY NOTICE: The contents of this email message and any attachments are intended solely for the addressee(s). This may contain confidential and/or privileged information and may be legally protected from disclosure. If you are not the intended recipient of this message, please alert the sender immediately by reply email and then delete this message and any attachments. Any disclosure, reproduction, distribution or other use of this message or any attachments by an individual or entity other than the intended recipient is prohibited