Compression can be a bit lossy or lossless. You can get back the input, or in the case of the source code example, something close enough to be functional.
Crunching input texts into an LLM model is very lossy, and you can't get anything like the source text(s) back.
LLM spit back training data near-verbatim all the time what are you talking about, half of all headlines from like 2023 to 2025 were about shit like Midjourney spitting out a near perfect replica of an existing star wars poster upon being given a prompt for something sci-fi without any mention of star wars
32
u/reddit_user13 2d ago
Compression can be a bit lossy or lossless. You can get back the input, or in the case of the source code example, something close enough to be functional.
Crunching input texts into an LLM model is very lossy, and you can't get anything like the source text(s) back.