Lightroom CC: Import duplicates failing

  • 1
  • Problem
  • Updated 3 months ago
  • (Edited)
Hi, 

 

I've made the bold move to import my very messy and unorganised library to Lightroom CC by just importing everything. Its currently taken 6+ days to sync to your cloud system. However Im struck with 3999 files. 

 

Now I have to clarify I've been a useless twit for over 12 years and I've owned many cameras. I don't regular clean my library and I've built it and stripped my catalog  down that many times I have encountered tons of duplicates and I've lost files along the way - My own fault I know. I'm trying to remedy my years of mistakes by using the cloud based library.

 

However I can't just accept that Lightroom CC matches duplicates on these metrics below (this is what I've read elsewhere);



1, File Name

2, Metadata time stamp

3, General metadata.

Of the log file Lightroom CC generated I've looked up just one file thats currently listed as in the new Lightroom CC library and in the existing library its been taken from. There are 9 files in total that share that duplicate name. You can clearly see 5 are in both libraries however, 4 are missing.




I can't go through the log file one by one for 4,000 files. What are my options? Lightroom gives me only the option to okay the window or save a log file.   Any help would be greatly appreciated.
Photo of Jonathan Clulow

Jonathan Clulow

  • 11 Posts
  • 1 Reply Like
  • frustrated

Posted 3 months ago

  • 1
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4300 Posts
  • 1565 Reply Likes
You were probably reading about Lightroom Classic, which uses filename, capture time and file size. Lightroom CC creates a hash of the file to identify duplicates, so the duplicate detection should be more accurate. There have been a couple of bugs around the new duplicate detection, so it's possible you've hit a new one.

One tip that might help identify the missing photos - which would then give some clues about why it thought they were duplicates - is in the Lightroom Classic, open the Metadata Filter at the top and set a column to Date view. You can compare the numbers by year (against the By Date view in CC). If you find a year that doesn't match, you can quickly drill down to the month and even day to see what's missing.

Also note that filename text search might not show all copies until they've finished uploading.
Photo of Jonathan Clulow

Jonathan Clulow

  • 11 Posts
  • 1 Reply Like
Hello Victoria,

Thanks for the reply. 

Please note that I've taken your point about the sync completing. This has now completed and the same results are being displayed. Whatever algorithm Lightroom CC is using it has missed 4 images in regards to this one file name. 
I'll post the results of your tip when I get home. Either way I won't be able to batch anything for 4000 missing duplicates. I know my true duplicate count would only be in a very low hundreds at best. 
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4261 Posts
  • 1544 Reply Likes
If we can find out why it thinks they're duplicates, we may be able to find a way to batch it though.
Photo of Jonathan Clulow

Jonathan Clulow

  • 11 Posts
  • 1 Reply Like
Thats the metadata taken from Lightroom Classic CC where all the files are. Lightroom CC rejects the import of the first 4 of them.  Other meta data changes are ISO, Exposure & GPS. Everything else is static. 
(Edited)
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4261 Posts
  • 1544 Reply Likes
Would you be comfortable sending me those 9 files Jonathan? If I can reproduce it here, I can pass them on to the engineers for inspection, so they can figure out why it's failing. If so, probably easiest to use Dropbox or www.wetransfer.com to send to uploads AT lightroomqueen DOT com
Photo of Jonathan Clulow

Jonathan Clulow

  • 11 Posts
  • 1 Reply Like
Hello Victoria, Yes I'm very happy to do that. Please bare with me whilst I prepare the transfer. 

Thank you. 
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4261 Posts
  • 1544 Reply Likes
Got them... and would you believe it, they all imported perfectly in a single import. Have you tried importing them again?
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4300 Posts
  • 1565 Reply Likes
Jonathan, can I get you to confirm the first few lines of Help menu > System Info please? I'm looking for clues...