Photoshop CC / CAMERA RAW - slows down dramatically during batch conversion of files from Nikon nef to jpg.

  • 2
  • Problem
  • Updated 3 years ago
  • (Edited)
I've been using the feature of Photoshop CC to convert a large number of Nikon raw files (D800 NEF format) and their associated sidecar XMP files to .jpg format for sharing with my family. I select a folder that I want to convert and then let Photoshop process all the files in that folder, writing the jpg file to another directory. The NEF files are stored on an external drive and the jpg files go to a folder on my C drive. If there are only a few files in the input folder I will typically see it take about 8 to 10 seconds to convert each file. The D800 produces 36 mega pixel images. However, I have a few folders with upwards of 200 images. On these larger folders things usually start out OK, but after processing a few tens of files, things slow down dramatically to the point that it takes about 70 seconds to process each file. I'm running on Windows 7 with all updates installed. I've also noticed that if I have the Windows Explorer open and I look at one of the directories involved in the conversion, I can often cause the slowdown to happen. Unfortunately it's not a completely repeatable test case. The symptoms have the characteristic of either a conflict in file permissions and accessing, a temporary deadlock, or maybe an improperly handled return code from an attempted file access. This problem can add hours to a task that should take minutes.
Photo of Bill Junk

Bill Junk

  • 85 Posts
  • 4 Reply Likes
  • irritated

Posted 3 years ago

  • 2
Photo of Jon Baker

Jon Baker

  • 2 Posts
  • 0 Reply Likes
I have a similar experience, processing 200,000 (yes, two hundred thousand) files via a batch script; when it starts I'm getting a rate of 2 images per second, after running for a couple of hours it's down to 12 images per minute. My script is just drawing a box to scrub sensitive data off of scanned documents and saving the new file.

My timing is based on using the find command in OSX terminal:

find . -mmin 5 | grep tif | wc -l

to see how many files have been processed in the last 5 minutes.
Photo of Bill Junk

Bill Junk

  • 85 Posts
  • 4 Reply Likes
If I had to guess it sounds a lot like a memory leak problem. I have not run any batch processing since a few days after my original post so I don't know if I still have the problem with the latest updates to CC and a move to Windows 10.
Photo of Jon Baker

Jon Baker

  • 2 Posts
  • 0 Reply Likes
Yeah, that is what it looks like to me, too. I ended up bailing on Photoshop and writing a script using ImageMagick instead, since what I was trying to do was so simple. It way outpaced Photoshop even from the beginning.