WHAT IS GOING ON WITH ALL THE “AI” IN PHOTOGRAPHY SOFTWARE?
This blog is a little “long-winded” but it is something I have been trying to figure out and thought I would share. For the last several weeks I have been getting totally confused by all the new Artificial Intelligence (AI) software/plugins/filters and what qualifies them as AI software. This past week Adobe’s Lightroom/ACR modules gave us a new taste of their AI capability with the Enhance Detail command. I decided to do a quick recap on a few of the AI programs. The final image above used Topaz (see sidebar at my Tidbits Blog for website link) Studio’s AI Clear and AI ReMix. I have used the new AI masking capability in On1’s very recent update and gotten good basic masking results. Also Skylum has two filters, Accent AI Filter and AI Sky Enhancer Filter which are very nice effects on images – check out article on what Skylum’s AI team is doing. Adobe Photoshop has previously used AI to upscale images in the Image Size dialog and in the Quick Select Tool’s Select Subject option and now calls their AI Adobe Sensei. Since these other filters are a little different than these I am showing, I will try to do another blog on their AI Technology. There is so much info on AI that I could create a humongous blog!
WHAT IS THE DEFINITION OF ARTIFICIAL INTELLIGENCE
I found a blog from a C-Net article with this nifty definition -“Enter artificial intelligence — specifically the neural network technology loosely based on human brains’ ability to learn from real-world data, not rigid programming instructions.” In the article Adobe senior research scientist Vlad Morariu said “Using tens of thousands of examples of known, manipulated images, we successfully trained a deep learning neural network to recognize image manipulation.” This may be what started the whole AI software evolution for photographers.
As a good example of how AI is being used effectively in photography software, Topaz Labs ReMix adjustment says on their website that they collected hundreds of classic and contemporary artistic samples; then spent hundreds of hours developing a custom neural network to identify specific artistic styles and replicating the textures, colors, edges and shapes of those styles; and finally the results were put into an adjustment for Topaz Studio. This seems to be the basic process for a lot of the AI software being developed.
LIGHTROOM/PHOTOSHOP’S ACR’S ENHANCE DETAIL VS TOPAZ AI CLEAR
Here is a screen shot of the flower shown above zoomed in to 100% to show a comparison of Lightroom/ACR’s Enhance Detail applied (for LR Develop Module right click and select and in ACR right click on the left strip and select) vs. Topaz Studio’s AI Clear, which was applied with LR as the host program. For a larger view in Flickr, click on image.
The results to me looks like the DNG file has more texture in it but very similar sharpening – that would make sense since AI Clear has both Noise Reduction which will reduce the texture effect and Sharpening capabilities. All the settings were the same including the Details Panel sharpening and noise before applying the Enhance Detail or AI Clear. (I know, Topaz says do not do this but I do it all the time and it works just fine.) This may be a draw as far as which looks best in this case – the new LR/ACR Enhance Detail works pretty good as well as the AI Clear. But Lightroom/ACR creates a much larger DNG file while Topaz creates a Tiff. I find AI Clear probably the best product out there for subtle sharpening that is needed, especially when hand-holding your camera while shooting. Also Detail Enhance is not available in the Camera Raw filter as far as I can tell, only available when doing your original post-processing. Therefore, if you may want to get back to apply it, definitely open as a Smart Object from ACR or Edit ->Open as a Smart Object in Photoshop from LR. For the Enhance Detail command Julieanne Kost, a PS evangelist, says “I would suggest applying it on an image-by-image basis starting with images that have visible artifacts and which require the highest level of quality (images that will be printed in large format, for example).” Topaz Labs says for AI Clear use it on all kinds of images including High ISO with lots of grain, Nighttime with noisy skies, Action images with some blur, and Telephoto lens shots. My choice at this point is Topaz AI Clear – often my images are just a bit soft and this works wonders – and I can access it as a filter using Topaz Studio in PS on a layer – very easy and quick.
TOPAZ JPEG TO RAW AND TOPAZ GIGAPIXEL
Image above is the final result after running this file through the various Topaz AI programs – it was from a very old IPhone and had a lot problems already. I do not believe there is an easy way to compare these two standalone packages from Topaz – they each do something that the other does not do, but there appears to be some overlap to me, like in sharpening or noise reduction. JPEG to RAW was specifically developed to take old phone (or current in some cases) and old digital camera jpg images and put them into a RAW format for better post-processing. (See my What Is Topaz’s New JPEG to RAW AI? blog.) I have always loved Topaz AI Gigapixel because it will take a really small image and enlarge it to something that looks pretty nice and detailed. (See my The Best New Software Around-Topaz A.I. Gigapixel! blog for more on it.) Below is a screen capture of how this image actually looked as the original windmill image, then after running running it through JPEG to RAW, then AI Clear adjustment in Topaz Studio, and finally AI Gigapixel (which is at half the zoom since it was doubled in size). This gives a pretty good idea of what is happening here and what basic order to use the software in. For a larger view in Flickr, click on image. The final image was finished up with some Topaz ReStyle effects (not an AI plugin but still one of my favorite Topaz plugins).
Personally I believe that Topaz is setting the standard for implementing AI use in software and it has some of the big giants scrambling. It is amazing to me to see Photoshop trying to emulate some of Topaz’s software and that can be nothing but good for us Photoshop users. The AI technology seems to be breaking open right now and I can hardly wait to see what is coming next! Okay – I am done!!! Hope everyone has a great one!……Digital Lady Syd