Lightroom CC: Some Photos Invalid after migrating catalog from Lightroom 6.0

  • 1
  • Problem
  • Updated 8 months ago
  • (Edited)
I have migrated my Lightroom 6.0 catalog to Lightroom CC. The originals are stored on NAS folder in line with official instructions and the option to "Store a copy of all originals in a specified locatoin" has been set before the catalog migration.
The migration has completed successfull and Lightroom CC has been busy with syncing the photos to the cloud. Unfortunatelly after syncing 34000 out of 54000 photos it has stopped the synchronization with an error message "Some Photos Invalid".
I've tried the solution provided in the adobe Known Issues DB (LINK) and in some other threads but without success.
Press Ctrl+A (Win) or Command+A (Mac) to select all the photos displaying in the grid and then do any of the following:- Delete the selected photos by choosing the Edit > Delete option and then add the photos in Lightroom CC again.- Apply a flag or a star rating to selected photos.

In case I take the second option to just change a flag or star rating the photo is synchronized but only the metadata, the original is still on local drive only (the NAS).
If I choose the second option the files are added successfully and synchronized to the cloud but I'm losing all edits performed on such photos. And it is very inconvenient for almost 20000 files, not even knowing in which folders they are located.

How can I fix this issue? If this is not resolved I don't see a point in continuing the CC subscription, now I can't even re-import the entire catalog as this can be only done once (not to mention that migration of 400GB in 54000 files is very time consuming even on a fiber channel internet connection.
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
  • disappointed

Posted 9 months ago

  • 1
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5967 Posts
  • 1312 Reply Likes
Adam,

I don't really have enough information to go on.  Where were your Lightroom Classic CC catalog and images located prior to the attempt at migration into Lightroom CC?

It is possible to remigrate a catalog a couple of different ways. I would rather try and understand what went wrong the first time than just blindly try to remigrate. 
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes

Hi Rikk,

My set up Lightroom Classic CC catalog is located on an SSD drive on my PC. It also hosts LR Cache. Images are stored on NAS, normally I'm importing all RAW photos from my camera converting them to DNG format. As I shoot RAW+JPG LR is nicely keeping the pair of DNG and JPG of imported photos.

When migrating the catalog and photos to Lightroom CC I've configured LR to keep originals on the same NAS. The migration went ok so all my photos have been copied to the new originals folder and are visible in Lightroom CC for desktop application. Total number of imported photos was over 56000. 37000 were synchronized with the cloud and are now visible on any device or web app but 19000 of the photos have not synchronized with the error mentioned above.

Please let me know if you need any further details or technical information, logs etc.

Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
@Rikk, any news?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5967 Posts
  • 1312 Reply Likes
None so far. I have pinged the team again on your issue. Thanks for your patience.
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Thanks for info. I'll wait another 2 weeks and will cancel my subscription as in this shape it does not work for me. Not to mention that the CC Desktop app is very slow anyway.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5967 Posts
  • 1312 Reply Likes
2.2 was released yesterday. Are you able to try again and see if the error still appears?
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Well, I've cancelled my subscription as it was useless. Not sure if I have an energy to try again. Is there a way to try the migration process without paying the subscription again?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5967 Posts
  • 1312 Reply Likes
The trial should have reset with the 2.2 release. You should be able to use it for 7 days.
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Will I be able to load large amount of files to the cloud as well?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5967 Posts
  • 1312 Reply Likes
For 7 days. I think the trial is limited to 1TB
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
OK, great, I'll give it a try and will report back :) This will take a while...
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Btw, is there any indication in change log that such problem has been resolved in this version?
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Here is my experience after installation of the 2.2 release. I have not tried with the same LR6 catalog but I have split it into smaller chunks. I've migrated a catalog of over 11000 images and size of over 170GB and so far so good. Entire catalog was migrated and all photos synchronized to Adobe Cloud!
This is good news. I'll now give it a try with remaining catalogs to end up with my entire collection.
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Apparently it was a bad idea to split the catalog. I have done this by making 2 additional copies of my original catalog and removed unnecessary files from all 3 catalogs (so I have now a catalog for photos until 2010, one for 2011-2015 and one for photos from 2016 till now). I have migrated the latest photos (2011-2019 catalog) successfully but I can't migrate the other 2 catalogs as apparently Ligtroom CC for Desktop recognizes them as the same catalog that I've already migrated. 
How can I solve this problem? Migrating the entire huge catalog at once is not my preferred option.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5951 Posts
  • 1309 Reply Likes
The better method is to divide your catalog into sections by creating a collection for each migration and calving the fragments into catalogs.  Here is an overview of the process.

  1. Create a collection called Migration 1
  2. Put a fraction of your files into this collection segregated by capture date or some other definitive identification method. (e.g Collections for: 2012 and older, 2013-2016, 2017 and newer) or however many you need to split it up into manageable chunks.
  3. Right-click on the collection and choose "Export this collection as a catalog"
  4. Migrate this created catalog from step 3
  5. Repeat for the next fraction.
This will create distinct versions of your catalog for migrating into Lightroom CC and avoid the issue you are seeing.  Rather than carve the elephant out of single block of stone - build it from smaller pieces. 
(Edited)
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Thanks for the suggestion. Will try it over the weekend and report back the result. One issue I was facing so far is that I could not export photos or folders to a new catalog, nothing was happening. When I've split the catalog into smaller ones for on it was working OK but not for another. Seems like if the catalog is too big the export as catalog feature does not work at all. Is that a known limitation?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5951 Posts
  • 1309 Reply Likes
I just tested on a 380,000 image catalog and it worked ok for me.
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
OK, so I'm done with the second attempt. Over 54'000 image catalog migrated, so much better than before.
Ended up with 170 photos with the same error as before "The local original has been corrupted or modified after import. Please delete the image and re-import it."
This time it looks a bit different though as those 170 photos don't display in Lightroom CC for Desktop - they are just black rectangles (in my previous migration attempt those photos were normally visible in Lightroom CC). And when trying to save them using the "Save to" option the output files' size is 0B. Now at least I have them all in one place and can run some scripts to re-import them from the original files (although I'll loose the edits, assignment to albums etc.).
Does it look like a known issue?
(Edited)
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5951 Posts
  • 1309 Reply Likes
I've had no reports of this. I would recommend double checking your hard drives for errors. These type of symptoms sometimes point to a failing drive. 
Photo of Adam Dr.

Adam Dr.

  • 36 Posts
  • 8 Reply Likes
Well, neither any other application nor NAS itself is reporting any drive issues. I'm extensively using it also for other media eg video editing, movies and music streaming etc. After the Lightroom update it has been much better. I've just noticed that those images impacted this time share the same name with other ones, they are coming from various cameras and are stored in different folders so this was not an issue in Lightroom Classic. How does Lightroom Cc manage duplicate file names?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5951 Posts
  • 1309 Reply Likes
CC has no issue with duplicate file names. Without going into excruciating technical detail, duplicates are identified by use of a Hash. Lightroom CC creates a hash of the file to identify duplicates, so the duplicate detection should be more accurate. 

Additionally each photo ingested has assigned a unique Asset ID that can't be duplicated but that also isn't user facing so it will be invisible to you.