Photoshop: FFT-based pattern remover (filter)

  • 9
  • Idea
  • Updated 2 weeks ago
A filter that automatically removes/reduces repeating patterns like raster patterns or paper texture.

It would be of great help for anyone who ever encounters a scanned image with a repeating pattern (typical for image restoration work or when the only source for an image is a printed copy).

Before/after example (click to see gif animation):


How to make such a filter: This can be done by doing a Fast Fourier Transform (FFT) to split an image into frequency components. The frequencies that make up repeating patterns will stand out and can be removed (today we do this manually with a black brush, but a filter can remove the "peaks" automatically). And inverse FFT is then performed to transform the image back. This entire process can be automated into one step; perhaps just with a slider to let the user choose how aggressively the filter removes frequencies.

I posted a detailed explanation here with a short tutorial on how this is done step by step.

Note that this only works on a single channel, so normally you would just bother to do this on the Luminosity component. Filtering each RGB-channel separately can also be done. I will leave that up to you Adobe... ;)
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
  • hopeful

Posted 6 years ago

  • 9
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
Example of this done to an image with a raster pattern:

(click to see before/after. Healing brush used to clean up some damage.)

Another example: This is just the FFT-filter, and I automated it using actions (with the help Threshold to find the "peaks"). Can't make it fully automated with actions yet though, but it can greatly speed things up until someone makes a proper filter.

(click to see before/after)

I think such a filter could generate a little "wow!" when demoed... ;)

Edit:
Some more examples and a downloadable plugin for doing the transform (but not the cleanup):
http://dl.dropbox.com/u/6795661/4N6si...
Photo of 4N6site.com

4N6site.com

  • 2 Posts
  • 0 Reply Likes
Excellent demonstrations of the Fourier transform plug-in, and great results. This plug-in comes from the 4N6site.com website.
Currently the website is aimed at forensic scientists but the plug-ins are at least as useful in photo restoration and retouching. Removal of stains, ink, discolorations and silvering can be done with the color deconvolution plug-in (examples).
For perspective manipulation and ligning up warped images there is the warping plug-in (examples), and for the repeating patterns there is the mentioned Fourier transform plug-in (examples).

Happy photo restoring!
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
Actually, I used the version modified to work on 64-bit images (the one on 4N6site.com is only 32-bit). Found here:
http://www.retouchpro.com/forums/soft...

What I miss is an OSX-compatible version (and ofc. for Adobe to make a fully automated "pattern/raster remover" based on FFT - the point of this thread).

Perhaps 4N6site is up for the job instead? I'm sure you'd make some really good friends in the retouching and image processing communities. ;)

--
Edit: Oh, just wanted to say, thanks for the neat plugins! :D
Photo of 4N6site.com

4N6site.com

  • 2 Posts
  • 0 Reply Likes
The number of requests I have received for a Mac version of the 4N6site plug-ins is actually surprizingly small...
The number of people that included a retina-display MacBook pro to motivate me was even smaller!

--
Edit: Thanks, am glad you enjoy them!
Photo of Jeff Grant

Jeff Grant

  • 51 Posts
  • 0 Reply Likes
I would dearly love to get this for Mac.
Photo of Jerry Schneider

Jerry Schneider

  • 4 Posts
  • 0 Reply Likes
Yes indeed. A Mac version cannot be that great of a stretch. I am very frustrated by this lack of Mac development of an FFT filter. Who wants to step up to the plate and make this happen?
Photo of Ángela Gesteira Seijo

Ángela Gesteira Seijo

  • 2 Posts
  • 0 Reply Likes
I would love love to have it for mac too!!
Photo of JEA

JEA

  • 158 Posts
  • 133 Reply Likes
Unfortunately, there is/was a mac FFT filter for photoshop, but the author has removed it from the download site.

http://www.retouchpro.com/forums/software/38969-developing-mac-photoshop-64-bit-fft-ifft-plugins.html

http://djjoofa.com/download/fft_mac_ps_cc_2015


Both ImageJ and Affinity Photo have built in FFT filters and work on the mac os.

https://imagej.nih.gov/ij/

https://affinity.serif.com/en-us/photo/
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
I've made an attempt at automatic the FFT pattern removal process using actions in Photoshop CC:
http://www.retouchpro.com/forums/soft...

Not quite as good as when I do it manually yet, but with some tweaking it could be just as good.

Example on color image:

Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
The above comment was proof that this could be a fully automated 1-click process if Adobe wanted to. If I can get a good result using a basic FFT filter plugin and a convoluted action, then it should be possible for Adobe to automate this as well.
Photo of Jerry Schneider

Jerry Schneider

  • 4 Posts
  • 0 Reply Likes
How do we lobby Adobe to get an FFT filter for the Mac. I see a FFT-Brush in my Tool Preset Manager but it does not seem to do anything.
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
That is probably just a regular brush shaped a bit like a star... Maybe you downloaded it at some point?

For Mac if you need FFT, us imagej (or affinity photo beta). There's no option for Photoshop unfortunately.
Photo of Jerry Schneider

Jerry Schneider

  • 4 Posts
  • 0 Reply Likes
ImageJ is something I have been trying to get to work but have had only marginal success. I appreciate the response concerning this issue. Thanks
Photo of Stuart Smith

Stuart Smith

  • 7 Posts
  • 0 Reply Likes
Not necessary we have a 64bit version for mac Photoshop releasing soon over at Joofa FFT. I just tested the beta port and it worked flawlessly.
Photo of Stuart Smith

Stuart Smith

  • 7 Posts
  • 0 Reply Likes
JOOFA FFT 64bit for mac IS NOT LIVE.
http:www.djjoofa.com/download
(Edited)
Photo of Ángela Gesteira Seijo

Ángela Gesteira Seijo

  • 2 Posts
  • 0 Reply Likes
Please!! Make it available again :)
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
I just found out that the Affinity Photo beta (OSX only) has got an FFT-based "noise remover" (pattern remover). With live preview of what you're doing! Hey Adobe, this is kinda what we wanted!
So this is an option for Mac-users who need FFT (for color images it appears to use the per-channel approach). It's not automated, but it cuts the painting time in half by mirroring your strokes, so that's nice. :)

Ps: A bit off-topic, but it also has a frequency separation filter (with live preview). Something a lot of Photoshop-users currently have to use actions for (and lack preview).
Photo of JEA

JEA

  • 180 Posts
  • 138 Reply Likes
Gimp also has an FFT filter after you install the Gimp GMIC add-on

There is also an FFT/IFFT filter for macs, but it no longer works in newer versions of photoshop.

http://www.djjoofa.com/download
Photo of Jerry Schneider

Jerry Schneider

  • 4 Posts
  • 0 Reply Likes
I will check that out. Thanks
Photo of Stuart Smith

Stuart Smith

  • 7 Posts
  • 0 Reply Likes
the GIMP solution is so painfully clumsy you will be angry. JOOFA FFT for Mac is releasing 64bit plugins soon. I tested them and am redesigning the website.
Photo of Jeff Grant

Jeff Grant

  • 51 Posts
  • 0 Reply Likes
Have you actually used it? I just tried and nothing seems to happen. Going to the help menu and typing in FFT denoise filter puts help into a loop, and the forum has it already as a bug.
Photo of Jonas M. Rogne

Jonas M. Rogne

  • 75 Posts
  • 7 Reply Likes
It worked when I tested it (see screenshot in previous post). But to be fair the whole application is still in Beta...

If it is bugged, perhaps try the Gimp GMIC add-on that JEA suggests (I have not heard of that one before).
Photo of Jeff Grant

Jeff Grant

  • 51 Posts
  • 0 Reply Likes
It's working now. The latest Beta fixed it. It looks very good.
Photo of JEA

JEA

  • 185 Posts
  • 138 Reply Likes
gimp for mac

http://gimp.lisanet.de

Already comes with the gmic plugin, but you can get the latest version of gmic from here:

http://gmic.eu/gimp.shtml

Photo of Stuart Smith

Stuart Smith

  • 7 Posts
  • 0 Reply Likes
http://www.djjoofa.com/download
We are trying to get him to update his port by encouraging him to start a crowd funding project.

http://imagej.nih.gov/ij/download.html
Here is a standalone software that does FFT for modern Macs; but I cannot find a tutorial on how to apply it to 3 channel RGB images. I know it can do it, but it's a real pain to figure out and frustrating with no brush approach that I can figure out how to use. If you do a YouTube search for "Image J FFT" you will find a few but they are not as helpful for they do not explain how to merge channels after the repair.
Photo of Richard Cobb

Richard Cobb

  • 1 Post
  • 0 Reply Likes
I used the procedure for ImageJ in this tutorial for color images, and it worked fine.  The tutorial uses grayscale images, but I applied it directly to rgb jpg images with no changes:

https://photo.stackexchange.com/questions/23445/what-is-the-best-way-to-remove-texture-from-a-scanne...
(Edited)
Photo of Carlos Gordillo

Carlos Gordillo

  • 12 Posts
  • 0 Reply Likes
I dont know if works but I think would if you try IMAGE > COLOR > Stack to RGB
Photo of Jonas Madsen Rogne

Jonas Madsen Rogne

  • 21 Posts
  • 2 Reply Likes
Recently, me and Ronc fixed fresh (and free) Windows-plugins for doing the Fourier Transform (fixed the old bugs), and made actions to semi-automate the suppression and also increase the quality of the results. Makes the process 100x faster, with better results.

https://www.retouchpro.com/forum/tools/software/39278-ft-pattern-suppressor

This is right now the best way of doing FT-based pattern removals. Beats e.g. the implementation in Affinity.

Note: After posting v1 we have made some great improvements, and implemented both per-channel and 3D transformation for doing color images. It will be in v2 that will be posted on the same link around the end of the month I think (may/june 2018) - I just gotta record some video first. If anyone's able to make an OSX-version of the plugins the actions should be trivial to adapt.
(Edited)