| ▲ | jrflo 3 hours ago |
| To be honest, I wouldn't be surprised if Apple isn't already doing this and just doesn't say so explicitly. There is a crazy amount of image processing going on behind the scenes in each smartphone photo. Would be interesting to compare a photo taken with the native camera app and photosynthesis to compare. I'm assuming your demo images on your site are the raw and processed images from your app that don't go through Apple's "secret sauce" processing pipeline. |
|
| ▲ | sajomes 3 hours ago | parent | next [-] |
| Yes exactly, the site shows photos all taken from within the app. I have done A/B tests against photos taken in Camera.app and the Photosynthesis composite does significantly beat the detail central area covered by the second lens in Photosynthesis. Because of the limitations of capturing multiple lenses at once through isVirtualDeviceConstituentPhotoDeliveryEnabled, there is a second capture mode in the app for 'Quality' which takes a simultaneous capture then takes sequential shots from each lens which do benefit from Deep Fusion, then uses those for the stitch (as long as the Deep Fusion images outperform the simultaneous capture results). That's also what I do for our Night mode. |
|
| ▲ | 101008 2 hours ago | parent | prev | next [-] |
| Hijacking this comment because of this line that reminded me of something: "There is a crazy amount of image processing going on behind the scenes in each smartphone" I bought the Pixel 10 because it said it had great zooming capabilities. After 5X (that means 10X), it's completely stupid. Basically it takes a very blurred photo and then tries to reconstruct it with AI. The final results are completely awful and really distant from reality. Any advice in how to improve that? |
| |
| ▲ | deepsun an hour ago | parent | next [-] | | One solution is to buy a more expensive Pro version that has optical 5x zoom (or, rather, a third camera that start at 5x). | |
| ▲ | nemomarx 2 hours ago | parent | prev | next [-] | | You can use third party camera apps - https://f-droid.org/en/packages/net.sourceforge.opencamera/ is a decent one. I know there's a few professional ish options too with dslr ish focus control. | |
| ▲ | dgacmu 2 hours ago | parent | prev | next [-] | | In photos after you can toggle between the AI modified and original. The original isn't as blurry as the preview shown - there's still a lot of image stacking happening and it's often very decent in my experience. Edited to add: I have a pixel 10 pro which has a better zoom lens, so I could be having a different experience than you... | |
| ▲ | cromka an hour ago | parent | prev | next [-] | | > Basically it takes a very blurred photo and then tries to reconstruct it with AI So the ENHANCE is no longer just some lazy movie writing! | | |
| ▲ | shye 5 minutes ago | parent | next [-] | | Can't wait for the first use of such images as evidence in court. | |
| ▲ | johnvanommen 29 minutes ago | parent | prev [-] | | Even funnier: The biggest of the "sharpening with AI" models, if you let 'em go, they'll turn you into a celebrity on accident. If you go to the Topaz AI forums on Facebook, you'll see examples of where the AI sharpening tool went off the rails and turned a blurry photo of someone (typically the user who bought the software, who is trying to clean up their own photos) into whichever celebrity that is in the AI model who resembles them. IE, it might turn a photo of YOU into a photo of Robert Downey Jr. | | |
| ▲ | cromka 6 minutes ago | parent [-] | | That's hilarious! Also wonder how how long until photos are no longer court-admissible evidence because they get overwhelmed with the burden of the amount (and the cost) of the "non-AI" certification? |
|
| |
| ▲ | RamblingCTO 2 hours ago | parent | prev [-] | | Wasn't that the same manufacturer that got caught with the moon AI stuff? Lol | | |
|
|
| ▲ | walrus01 3 hours ago | parent | prev | next [-] |
| Phones have been doing this for a LONG time, if you had a oneplus 7 pro (released may 2019) and took it into an extremely dark area, like where your eyes can't see anything at all, and take a 'night mode' photo, it asks you to hold it steady for about 4-5 seconds and is clearly taking a series of photos with long exposure time. Then it stacks them and uses data from the sensor of hand movement jitter to deblur. The result when done outdoors (like, standing in a dark forest at midnight) will be a photo where you can actually see what's around you, and details show up as if it was a brightly full moon lit night. |
| |
| ▲ | hbn 3 hours ago | parent | next [-] | | That's a bunch of photos from the same camera, not 2 lenses at the same time | | |
| ▲ | walrus01 2 hours ago | parent [-] | | I know, I just don't think it's a huge jump from "take multiple photos over a 2s period from one camera and stack them" to "take several photos from discrete physical cameras and stack them". As a subscription of paid app I am not the target market for the person who made this, I agree with another person commenting in here that said they should be working for a phone manufacturer. |
| |
| ▲ | xyzzy_plugh an hour ago | parent | prev | next [-] | | The Amazon Fire Phone did this in 2014. I'm not aware of any prior art in mainstream devices aside from gimmicks like 3D (stereoscopic) photos. I can't remember if the Fire Phone had any relevant gimmicks but it certainly used multiple lenses to produce a single image. | | | |
| ▲ | somehnguy 3 hours ago | parent | prev | next [-] | | I think it's interesting that the same functionality appeared on iPhone in 2019 as well. Google tells me it was the iPhone 11 and iOS 13. | | |
| ▲ | marmarama 2 hours ago | parent [-] | | Night Sight appeared on the Google Pixel camera app in 2018. I think Nokia was doing it first on phones before Microsoft destroyed the remains of their phone business. The reborn Nokia/HMD was also doing multi-sensor image stacking back in 2019 on the Nokia 9 Pureview. | | |
| |
| ▲ | LoganDark 2 hours ago | parent | prev [-] | | There is an iOS app that does this called Spectre: https://spectre.cam From the authors of Halide. | | |
| ▲ | ShinyLeftPad an hour ago | parent [-] | | It's different from just stacking exposures, it's a paid app that does progressive animation of exposures for creative effect and says it's "AI-powered" whatever that means. | | |
| ▲ | LoganDark an hour ago | parent [-] | | It's a paid app that I literally have, and all it does is take multiple photos and composite them together. It can either naïvely average them together in-place like a traditional long exposure, or align them using machine learning. I'm actually appalled they use the term "AI" considering who they are but that doesn't matter, it's ML. I don't use any of the animation crap, but the aligned long exposures can be useful for ultrawide takes since that camera is so noisy. Edit: actually I can't seem to find the setting that aligns them. I seem to remember it being able to do that but maybe it doesn't... which would be disappointing... | | |
| ▲ | walrus01 8 minutes ago | parent [-] | | People are slapping "AI" on anything these days to try to sell more units of whatever it is. |
|
|
|
|
|
| ▲ | selectodude 3 hours ago | parent | prev | next [-] |
| I think this is just Deep Fusion. |
| |
|
| ▲ | stavros 3 hours ago | parent | prev [-] |
| This should be easy to check. In these photos, the center of the image has higher detail than the edges. |
