Reproducible canvas-aligned low-level patterns in somerandomllm-generated images and their possible relation to iterative editing artifacts [D]
Our take
![Reproducible canvas-aligned low-level patterns in somerandomllm-generated images and their possible relation to iterative editing artifacts [D]](https://preview.redd.it/6y81in1w08jh1.png?width=140&height=93&auto=webp&s=f3f68a4a6a484161f988ac1d47c988e74ed50114)
The recent Reddit post detailing reproducible canvas-aligned patterns in seemingly random LLM-generated images has sent ripples through the AI community, and rightfully so. The author's meticulous investigation, starting from a frustrating artifact in iterative image editing, has uncovered a potentially significant phenomenon: even "completely black" images generated by models like ChatGPT exhibit a discernible, reproducible spatial structure. This isn’t just a quirk; it suggests a deeper level of underlying organization within these generative processes than previously understood. It’s fascinating to see how Expedia Group has also been leveraging LLMs for generating GraphQL mocks [LLM-Generated GraphQL Mocks Arrive at Airbnb and Expedia, While the Spec Lags Behind], demonstrating the breadth of LLM applications beyond text generation, and also shows the ongoing quest for improving the efficiency and reliability of AI systems. The implications of this discovery are wide-ranging, impacting everything from image quality and editing workflows to concerns about potential watermarking and the very nature of randomness in AI generation.
The core of the author's findings revolves around the observation that independently generated "black" images display a surprisingly high degree of correlation in their non-zero pixel masks and spatial frequencies. Even after applying a significant Gaussian blur, a shared cloud-like structure emerges, strongly suggesting a canvas-locked pattern. The fact that this pattern persists even when the intention is to generate a completely uniform black image is particularly striking. This echoes concerns around the quality of context windows and the ability to manage them effectively, as explored in a recent presentation [Presentation: The Right 300 Tokens Beat 100k Noisy Ones: The Architecture of Context Engineering], highlighting the challenge of optimizing AI systems for both performance and output fidelity. The author rightly cautions against jumping to conclusions about watermarking, but acknowledges possibilities like deterministic dithering, decoder artifacts, or some other post-processing step. The key takeaway is that what was initially dismissed as “ordinary random noise” appears to be anything but.
The implications for iterative image editing are particularly compelling. The author's hypothesis – that repeated edits can accumulate or expose this underlying structured signal – provides a plausible explanation for the frustrating mottled textures observed after multiple editing passes. Shifting the image, as the author discovered, can influence the visibility of this pattern, hinting at a mechanism tied to the output canvas coordinates. This opens up new avenues for mitigating these artifacts, perhaps through techniques that intentionally decorrelate the signal or exploit its canvas-locked nature. It also underscores the importance of understanding the internal workings of generative models, moving beyond treating them as black boxes and delving into the low-level processes that shape their output. The effort to build text to ASCII diffusion models [Building text to ASCII diffusion model , need advice and guidance] exemplifies this drive to understand and manipulate the core components of generative AI.
Ultimately, this investigation serves as a powerful reminder that our understanding of generative AI is still evolving. While we’ve made remarkable progress in creating models capable of producing stunningly realistic images, we are only beginning to grasp the nuances of their internal behavior and the subtle artifacts that can arise. The question now is: how widespread is this phenomenon across different generative models and architectures? And, perhaps more importantly, what are the long-term consequences of these embedded patterns on the trustworthiness and reliability of AI-generated content? The author’s call for further investigation—into the mechanism producing these patterns, their prevalence across different models, and potential strategies for mitigation—is a crucial next step in ensuring the continued advancement of responsible AI development.
| | I may have stumbled onto something interesting while trying to figure out a recurring artifact in ChatGPT image generation and editing (maybe applicable to other models as well?). It started with a very practical problem: After several rounds of generative editing on portraits, I would sometimes get this faint cloudy / mottled texture in areas that should have stayed smooth — backgrounds, walls, skin, and other low-detail regions. At first I wrote it off as normal denoising or regeneration noise. But the more I tested it, the less random it looked. What first caught my attention
That made me wonder whether different parts of the image were being handled differently during editing — preserved in some areas, regenerated in others, perhaps based on some internal mask or segmentation step. The first useful experiment: shifting the imageThen I tried something slightly odd. Instead of repairing the image in place, I shifted the entire image by a fixed amount before running the repair. I eventually settled on 20 px for testing. The idea was simple: If some hidden spatial pattern is tied to the output canvas, moving the image relative to that pattern should change how strongly it shows up on the subject or background. And apparently, it did. I found that:
That was the first point where this stopped looking like ordinary random noise to me. Then I started looking at masks and intermediate behaviorI compared:
One thing stood out pretty clearly: The apparently “protected” area often resembled a coarse silhouette of the person. The face and body tended to remain more stable than the wall, which made me suspect that some regions were being preserved while others were being re-synthesized. That still didn’t explain the artifact itself, but it could explain why the artifact builds up unevenly. Then came the black-image testI tried something much simpler: Generate a completely black image. Visually, it looked black. Pixel-wise, though, it wasn’t actually all zeroes. There were sparse non-zero pixels and tiny variations throughout the image. So I generated multiple independent black images at the same resolution and compared them. This. It's a different one, I swear! Or this. A \"completely black image\". That’s where things got interesting. What I foundFor two independently generated “black” images of the same size:
Then I applied a large Gaussian blur to both images (sigma = 16). The result was surprisingly striking: both revealed a very similar large-scale cloud-like structure. Both \"completely black\" images The cross-correlation peaked at zero lag, meaning the structured pattern was already aligned at the same canvas coordinates across independent generations. So whatever this low-level signal is, it doesn’t look purely random. At least part of it appears to be reproducible and locked to the canvas coordinates. What I think this means — so farI want to be careful here. I’m not claiming that this proves OpenAI watermarking, SynthID, or any particular proprietary mechanism. What I do think the data suggests is this:
A few possible explanations come to mind:
What now seems much harder to explain this as is simply:
Why this might matter for iterative image editingSuppose a weak structured signal really is tied to the output canvas. An iterative edit might then look something like this:
That would fit several things I’ve observed:
Important caveatThis is still an investigation, not a conclusion. At this point I think I have reasonably good evidence for:
What I don’t have yet is proof of:
My current working hypothesis
Questions for anyone who has looked into this
If there’s interest, I can post the methodology in a follow-up. I started with:
and somehow ended up at:
Classic rabbit hole. [link] [comments] |
Read on the original site
Open the publisher's page for the full experience