this post was submitted on 05 Feb 2026
679 points (99.3% liked)

Technology

80744 readers
3606 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] schwim@piefed.zip 77 points 1 day ago (2 children)

I am not intelligent enough to understand any of it but that was a fun read.

TIL the origin of Courier.

[–] kescusay@lemmy.world 183 points 1 day ago (4 children)

Long story short:

  • Some of the emails in the file dump had attachments.
  • The way attachments work in emails is that they're converted to encoded text.
  • That encoded text was included - badly - in the file dump.
  • So it's theoretically possible to convert them back to the original files, but it will take work to get the text back. Every character has to be exactly correct.

Source: I'm a software developer and I'm currently trying to recover one of these attachments.

[–] apftwb@lemmy.world 70 points 1 day ago

I'm a software developer and I'm currently trying to recover one of these attachments.

🫡

[–] proudblond@lemmy.world 77 points 1 day ago

Godspeed friend

[–] apftwb@lemmy.world 25 points 1 day ago* (last edited 1 day ago) (3 children)

Are you having as much trouble with OCR as the article author? I would have thought OCR was a solved problem in 2026 even with poor font selection.

[–] Taldan@lemmy.world 4 points 19 hours ago

OCR is mostly good enough. Problem here is we have 76 pages that we need to be read perfectly, with a low fidelity input

We also have very little in the way of error correction, since it's mostly not human readable

[–] kescusay@lemmy.world 20 points 1 day ago

I'm not having trouble with it as such, it's just a slow and painstaking process. The source is crappy enough that an enormous number of characters need to be checked manually, and it's ridiculously time-consuming.

[–] floofloof@lemmy.ca 9 points 1 day ago (1 children)

I wonder if they gave considered crowdsourcing this, having many people type in small chunks of the data by hand, doing their own character recognition? Get enough people in and enough overlap and the process would have some built-in error correction.

[–] apftwb@lemmy.world 14 points 1 day ago* (last edited 1 day ago) (1 children)

I mean the problem is that even with human eyes it's still really hard to tell l and 1 in that font.

See image

[–] Kevlar21@piefed.social 12 points 1 day ago* (last edited 1 day ago)

Not an expert at all but I’m genuinely curious how long it would take to check all possibilities for each I or 1? Is that the full length of the hash or whatever? So in this example image we have 2^8 =256 different possibilities to check? Seems like that would be easy enough for a computer.

Edit: actually read the article. It’s much more complicated than this. This isn’t really the only issue and the base64 in the example was 76 pages long.

[–] trolololol@lemmy.world 3 points 1 day ago (1 children)

Curious here, this is base 64? And what's behind it is more often than not an image or text? And you need to do ocr to get the characters?

Maybe for the text it could use a dictionary to rubber stamp whether that zero is actually a letter oh, etc etc?

I'm curious to know what the challenge is and what your approach is.

[–] kescusay@lemmy.world 16 points 1 day ago (1 children)

Yes, it's base64. And what's behind it could be anything that can be attached to an email.

In this case, it's a PDF. If the base64 text can be extracted accurately, then the PDF that was attached to the email can be recreated.

The challenge is basically twofold:

  1. There's a lot of text, and it needs to be extracted perfectly. Even one character being wrong corrupts it and makes it impossible to decode.
  2. As the article points out, there are lots of visual problems with the encoded text, including the shitty font it's displayed with, which makes automating the extraction damn near impossible. OCR is very good these days, but this is kind of a perfect example of text that it has trouble with.

As for my approach, I'm basically just slowly and painstakingly running several OCR tools on small bits at a time, merging the resulting outputs, and doing my best to correct mistakes manually.

[–] trolololol@lemmy.world 5 points 1 day ago

Ah yes pdf is a clusterfuck where anything is valid I think, so minimal redundancy.

Text and image formats are way more lenient and are full of redundancies.

[–] ZoteTheMighty@lemmy.zip 8 points 1 day ago (1 children)

There's an iOS game about the history of fonts you might enjoy. Struggling to find it at the moment, but you play a colon navigating through time, solving various puzzles.

[–] regedit@lemmy.zip 4 points 20 hours ago (1 children)

I'm failing to understand why or how a part of the large intestine would time travel, nor why it would be bothered to solve puzzles! 🤔

[–] ZoteTheMighty@lemmy.zip 4 points 19 hours ago* (last edited 3 hours ago)

Sound like your first puzzle is to list out all the meanings of colon and figure out which one of them looks like wheels when turned sideways.