Have you ever been there? You’re watching the most incredible sunset, the sky is on fire with pinks and oranges, and you whip out your phone to capture it. But when you look at the picture later… it’s just… meh. The photo is fine, but it’s flat. It doesn’t have the magic you felt standing there.
It’s one of the most common frustrations in photography. Our eyes and our memories capture a feeling, but the camera often just captures the data. Well, Apple’s on a mission to close that gap. And according to Jon McCormack, their VP of camera software engineering, the tool they’re going to use is AI.
He recently talked about giving users “superpowers” through their phone’s camera. Now, if that makes you picture some crazy sci-fi movie, hold on. What he’s talking about is actually a lot more subtle, and frankly, a lot more useful.
So, What Are These "AI Superpowers"?
Let’s get one thing straight. Apple isn’t talking about turning your vacation photos into fantasy art or creating images of things that never happened. That’s not their game.
Think of it more like having a world-class photo editor sitting on your shoulder, instantly fixing the little things that went wrong. It's about making the photo you took the best possible version of itself—the version that matches what you remember.
McCormack’s vision is about using AI to solve real-world photography problems. You know, the kind of stuff that happens to all of us:
- Someone blinked in the perfect group shot.
- A random tourist walked into the background of your otherwise perfect landscape.
- The lighting was tricky, and your friend’s face is lost in the shadows.
These are the moments where AI superpowers come in. It's not about faking reality, but rather, restoring the reality you intended to capture. It's about removing the imperfections so the actual memory can shine through.
Let's Talk About "Fake Pixels"
Okay, here’s where things get a little controversial for some people. To achieve these "superpowers," the software will sometimes have to generate new pixels. Or, as some might call them, "fake pixels."
That sounds a bit scary, right? Like the phone is just making things up. But here’s the thing: your phone is already doing this.
If you’ve ever used Portrait Mode, you’ve seen this in action. The software identifies the person, keeps them in focus, and then artificially blurs the background. That blur? It’s a bunch of algorithmically generated pixels designed to mimic a high-end DSLR camera.
Or think about Night Mode. When you take a photo in the dark, your iPhone isn't just taking one picture. It’s taking a bunch of them at different exposures and using AI to stitch them together, reduce noise, and brighten up the scene. It’s literally filling in the blanks with computed information.
What Apple is talking about now is just the next logical step. When you use the new "Clean Up" tool in iOS 18 to erase a photobomber from your beach picture, the AI isn't just smudging the pixels around. It’s analyzing the surrounding area—the sand, the water, the sky—and generating brand new pixels that seamlessly fill the hole. It’s a magic eraser, powered by some seriously smart tech.
Apple's Big Rule: Not Just "AI for the Sake of AI"
This is probably the most important part of the whole conversation. In a world where every company is scrambling to slap "AI" onto every product, Apple is being surprisingly deliberate.
McCormack was clear that they aren't interested in using AI "for the sake of AI." They aren't building a tool that lets you type "a cat riding a skateboard on Mars" and get a wild image back. There are other apps for that.
Instead, Apple's philosophy is grounded in solving a problem. The starting point is always a real photo that you, a real person, actually took. The AI is there to serve the photo, not to replace it.
It's a fundamentally different approach than what we're seeing from some other players in the tech world. The goal isn't to show off what a generative model can do; it's to help you preserve a memory. They believe the technology should be invisible, working in the background to make your life—and your photos—a little bit better.
It's All About Emotion
At the end of the day, that's what this all boils down to: emotion.
We don't take photos to just document photons hitting a sensor. We take them to remember how we felt in a specific moment. We want to look back at that sunset picture and feel the awe we felt standing on that cliff. We want to see the group photo and remember the laughter, not the fact that someone had their eyes closed.
Apple’s bet is that by giving us these small, computational “superpowers,” they can help our photos better reflect our memories. It's a subtle but powerful idea. It’s not about creating a fake world, but about making the world we capture feel as real and as magical as it did when we were living in it. And honestly, that’s a superpower I think we could all use.
