Lightroom Desktop: Syncing Issues when Originals are stored on a NAS

  • 28
  • Problem
  • Updated 22 hours ago
  • In Progress
  • (Edited)
Hi Rikk,
besides the outage, I am trying to sync my cloud stored data since several weeks on my NAS (Synology), connected via Gigabit Ethernet. in the beginning it works fine but after 10.000 pictures and movies its not going further (I have about 35.000) and plenty of storage. LR freezes, have to start again then additional 2-3 pictures are synced, that's it. Also I can't use LR since then (open pictures, look into people etc.), when I disconnect the NAS I can work, but not sync. Dont understand why this is not a background task and does LR really look up local backuped NAS Data when I work on data (should only be a backup?). Its frustrating, as this would be the major advantage of the solution?? Any Idea?Note: This conversation was created from a reply on: Lightroom CC: Mobile syncs but desktop app doesn't.
Photo of Stephan Siehl

Stephan Siehl

  • 1 Post
  • 0 Reply Likes

Posted 1 year ago

  • 28
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 7266 Posts
  • 1647 Reply Likes
You can check the status of issues at the top of the page. This one is still "In-Progress". When fixed, it will say solved. We are continuing to investigate this issue. Thank you for your continued patience. 
Photo of Steve Harksen

Steve Harksen

  • 1 Post
  • 0 Reply Likes
Rikk, there seems to be variations of a basic problem, and I would like confirmation that my problem is the same.  I work on a PC (Windows 10) and my local storage for Lightroom Desktop is a Synology NAS.  I have about 35K items in Lightroom.  Most are jpg or CR2 photos, TIF scanned photos/35mm slides, and around 400 videos.  After loading new pictures into Lightroom, they sync very quickly (100 new images are processed in less than 10 to 15 minutes). My problem is syncing always fails to advance below 9 images.  This has been occurring ever since I migrated my photos from Lightroom Classic about 2 months ago.  When I filter on SyncStatus = Syncing, I get the "Oh no! A black hole." screen, but the Cloud status indicates "Syncing 9 photos." I would like to know if this is the same problem that is being worked by Adobe support or do I have to do something different to have someone work on it.  Thanks for your attention.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 7266 Posts
  • 1647 Reply Likes
This doesn't sound related to the thread.  It sounds like you have nine images that are stuck.  Check for assets in your Deleted Items first and see if you can clear anything there. 

Next, go to https://lightroom.adobe.com and see if you have any images in the special album called Sync Errors (upper left):  The black thumbnails, if any, will advise you on steps to take from there. 
Photo of Jim

Jim

  • 1 Post
  • 0 Reply Likes
I am experiencing the same issue. 

2014 Mac Mini on Catalina.
Latest version of Lightroom from the App Store (3.0 MAS)
ReadyNAS 104 with 4x 4TB HDDs setup in Raid 5 (Firmware 6.10.2)

Lightroom would freeze and not sync when a mapped drive on the NAS was selected as the location to store originals.

As a work around I selected a local location and successfully downloaded all originals (approx 25000 photos/150gb). I then tried changing the location to the NAS. After a restart, Lightroom started moving the folders to the NAS but it froze after moving around 3500 photos.  


Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
Any updates on this topic? I have the same issue. Syncing stops mostly every time. After Lightroom start I see a cloud connection for just a few seconds. In these seconds I can switch between my 44k images. After a few seconds Lightroom looses connection and I am not able to switch between images. I see only the blue loading circle until I close Lightroom.

I use the latest Lightroom cloud version on Mac OS X Catalina with a Synology NAS.
Photo of Bonnie Gray

Bonnie Gray

  • 2 Posts
  • 1 Reply Like
I am still having the same issue. It's been ongoing for over six months now. Is there any more information we can provide to speed up a fix?

I am using a 2019 Macbook Pro on Catalina with a WD MyCloud NAS setup.

When clicking on the cloud icon in the top right-hand corner of Lightroom, it frequently says "Unable to connect to network" and during this time nothing syncs.

Occassionally it does connect and allows the syncing of three or four photos, then it disconnects again.

I currently have a library of 119,000 photos which I'm slowly reducing with a purge, but this isn't helping anything.

My NAS is connected and working without issue for other programs such as media streaming through Plex, and browsing files on the NAS works fine too, so it's nothing to do with the functionality of the NAS itself.

Six months down the line I am extremely disheartened. Unfortunately I've looked at alternatives to Lightroom and none of them offer the functionality I need. I LOVE Lightroom CC as a program but the syncing issue is intolerable... I bought my NAS specifically to store my photos. :-(
(Edited)
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
How did you add your files to Lightroom Cloudy? I've had similar issue after migrating library from Lightroom Classic and I have resolved it by resetting the cloud library to zero and reimporting Classic library in batches. Since then no more issues with sync and all originals are stored on my local NAS.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
I had the Apple Photos library stored locally on my MacBook and then I did the migration. The Lightroom Cloud folder to store the files locally is on the Synology NAS.

The problem is that Lightroom Classic is not able to migrate/import the Apple Photos Library. This Library is different from iPhotos and for sure also different from the Aperture Library. So if you want to migrate the Apple Photos Library there is - from my point of view - the only chance to use Lightroom Classic.

Maybe we can try to deactivate the option to store all files locally during migration. But at least after activating again during normal process, the syncing won't be really work.

I am sorry, but this situation with Lightroom is not acceptable. The bills should be refunded...
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
OK, so I understand you've just added all the files in local folder with photos. I don't see other option to migrate from Apple Photos library. I would still clean up the entire library on https://lightroom.adobe.com/ and add photos again but in smaller batches - move to the next batch only after it is fully synchronized.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
I didn’t pull out the photos out of the Apple photos Library. I saved the apple photos Library locally on my MacBook. And from there I did the migration. Double check my replies below. From my point of view the issue is the connection to the NAS.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
I recognized the following behavior with Lightroom cloud on my MacBook. If I flip through my 41k images, which are still show as has to be synchronized and they are all already downloaded to my Synology NAS, I see several "blank" images without any content.

If I select one of these image, close Lightroom and open it again it shows this image and around this image about 50 to 100 images, which where also blank before the restart of Lightroom. And the selected image gets the information, that it is synchronized and downloaded. All other not selected images - although they are downloaded already - show up with the open sync circle.

When I select another image - it doesn't matter if it shows content or it is blank - with the restart of Lightroom I see the same behavior. The selected image gets marked as synchronized and locally download. I did this now more than 20 times and it was always the same. As I mentioned 41k images, let me repeat this closing and opening again and again of Lightroom. Just kidding :)...

My Synology NAS "talks" with my network/MacBook via the SMB3 protocol. I haven't tried AFP yet.

From my point of view it seems, that the connection between Lightroom and the network drive (Synology NAS) holds only during the start for a few seconds. After this short time the connection is lost. I am not able two show other photos or switch albums. The cloud icon only shows me during this short time period the amount of images, which have to be synched.

So how can we fix this? Adobe should give all clients who have trouble with a voucher for at least one year free.

If there is a beta group, please invite me to help to fix this issue. Because with the behavior it is not possible to use Lightroom...
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
If I just select (one click only) other images during the start up period, they get also marked as synched and stored locally. 
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
It seems CR2 images will be get status "synced and stored" easier than JPG, MOV or HEIC.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
After some other tests it doesn't matter if I use SMB or AFP and direct IP or NASName will have the same outcome in Lightroom.

So now I shut down my NAS and the Lightroom build up the local library from 0. The cloud still have all images. This works really good and I see the number of images grows continuously up to 41k. As soon as I make the NAS drive available the sync process stops as described in my last replies.

How can get Lightroom a stable connection to the NAS? In my local network I use several UniFi devices and the connection to every device is 100% stable for each program except Lightroom :(...

Also my internet connection is 100% stable to my network. Somewhere Lightroom struggles with shared network drives.

So how can I get in contact with the developers, that we can fix this for everyone?
Photo of Nate M

Nate M

  • 1 Post
  • 0 Reply Likes
+1 to this problem. For me, it just started recently after working for months. Side note: It took me WAY to long to find this thread and realize it was a bug. I wasted HOURS troubleshooting.

Dear Adobe - Please tell your marketing dept that having two totally different programs with the same name is dumb. Google "Lightroom" or even "Lightroom cc" and 95% of the results are for "Classic"... Infuriating.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
I tried now an Apple Photos migration with 65 GB and round about 11k images. The NAS was not online during this time. The whole process took less than 10 minutes instead of several days/weeks with an online NAS. The uploading will take more time for sure. But this is a huge time difference.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
With my 10 Mbit/s upstream the Upload of 65 GB should take about 14.44 hours (just maths). After 1 hour 1.800 out of 11.5k images are shown in the iOS Lightroom app on my iPhone. These photos should be uploaded already. Let’s see how it goes on.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
After 8 hours syncing 5.5k photos are done. The NAS is still offline. This workflow is ready for 5 other libraries of the same size.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 7262 Posts
  • 1646 Reply Likes
Thanks for the continued updates, Moe. I have this thread linked to our bug investigation on our internal system. The engineers will be able to review your comments. 
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
All done a little bite more than 14 hours.
Photo of Michael Kent

Michael Kent

  • 5 Posts
  • 2 Reply Likes
Me as well. Everything has been said already above. 
In Adobe Creative Cloud I can see that I am connected, however, I am not able to connect in Lightroom CC. 


Migrating to Lightroom CC has been an absolute nightmare for me that has cost me hundreds of dollars and hours of wasted time, not to mention pushing my computer to its limits, all the while making photography much less enjoyable because of all the frustrations from have an extremely inefficient, labour intensive, time intensive workflow. 
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
Although I sympathise with you on the migration process (I had to restart migration of over 55k images from Lightroom Classic catalogue after the first attempt failed) I am interested how did you manage to spend hundreds of dollars on it?
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
My workflow for now since last week looks like to shut down the NAS and migrate all 100k images to the cloud. When this is done, I try to store all locally on the NAS. But let’s wait, there will be the trouble again
Photo of Nick Eales

Nick Eales

  • 3 Posts
  • 0 Reply Likes
In my case it was mainly down to the NAS being  a bit slow whilst transferring a lot of data. Seems like there is some rather aggressive timeouts in place.
Photo of Ed Morgan

Ed Morgan

  • 1 Post
  • 0 Reply Likes
This is the conclusion I came to, too. 
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
I recently purchased a Synology DS118 and a 4TB hard drive with a goal, among other things, of storing a copy of my Lightroom originals on the NAS.  Previously, I was successfully running Lightroom with a copy of my original stored on a USB-connected external hard drive.  My computer is a MacBook Air circa 2013 running Catalina v.10.15.2 and Lightroom 3.1 Build 20191126-2330-434c343.  Library includes 40,000 photos totaling ~900 GB, all of which have been successfully uploaded into the adobe cloud.  So far I've made two un-successful attempts to transition to storage of originals to NAS.

Attempt #1 - After downloading all copies successfully to the USB drive, copied those files via USB to the Synology drive's "photos" folder.  Opened Lightroom, changed storage location to the NAS ("Volumes/photos").  Restarted Lightroom and receive the message "Uploading local photo indices...This may take a few minutes."  Attempted the restart several times...usually it freezes prior to advancing to the "Moving your photos" message.  Once I did make it to that message, but progress remained at "Checking photo 0 of XXXXX".

Attempt #2 - Removed all files from my Synology target folder, and reset the local storage option, unchecking the box to store originals.  Closed Lightroom.  Re-opened Lightroom and set the target location to the NAS ("Volumes/photos"), then restarted the program.  Attempted to download all images from the adobe cloud to my target NAS folder.  It was slow going for the first several thousand images, then somewhere between 10K-20K images it ground to a halt.  After opening and closing Lightroom several times, doing a full reboot of my computer, etc. and confirming I still had a solid connection to NAS could never advance past this stage.
(Edited)
Photo of David Cullen

David Cullen

  • 6 Posts
  • 5 Reply Likes
I had the same problem with a DS218j and got around it as follows.  I believe the primary problem is that LR wants to use the local network originals as the primary data source (when it should use the cloud).

First step is to create a iSCSI drive on the Synoloogy (google helped here).  You then need a program to connect to the new drive (I used globalSAN - free trial then small fee to buy).  This creates a virtual local drive on your MAC which points to the NAS partition.  LR sees a local drive and seems to work fine.

I do not have the drive automatically mount as if you are not on the LAN and try to connect the MAC has spaz (apparently).

Hope this helps.
Photo of Moe

Moe

  • 39 Posts
  • 1 Reply Like
@David Thanks, for the idea of iSCSI. I’ll check it the next days. This can be a good workaround until Adobe manages to fix this issue with network shared drives over SMB.

https://www.synology.com/de-de/knowle...

https://www.synology.com/en-global/kn...
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
I would not be too optimistic with iSCSI. It is performing much worse (at least on windows client) compared to SMB protocol (not sure if MAC is using SMB in this case).
https://docs.microsoft.com/pl-pl/archive/blogs/larryexchange/iscsi-or-smb-direct-which-one-is-better
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
@David...I just spent the last hour looking into iSCSI thinking this might be my last resort.  Returned to this thread to see your post and am glad to hear you've successfully implemented this approach.  I was exploring iSCSI Initiator X from Kernsafe as a free tool, but may end up downloading the globalSAN trial given your positive review.

Thanks for the tip on not automatically mounting the drive.  I've seen mention of issues as well.  

Will report back if I have success.
Photo of David Cullen

David Cullen

  • 6 Posts
  • 5 Reply Likes
Good luck - advise if you hit a wall and I will try to remember what I did :)
Photo of Moe

Moe

  • 39 Posts
  • 1 Reply Like
Good luck and let us know
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
Update....iSCSI works!  Here are some step-by-step instructions for others who may want to attempt the same solution:

1) Configure Synology drive as an iSCSI Target, using Synology's out-of-the-box iSCSI Manager utility.  Instructions here.

2) Download and install iSCSI client software for Mac.  I attempted and was unsuccessful in installing a trial package from globalSAN.  Ended up going with iSCSI Initiator X v3.0 from Kernsafe, which has the added benefit of being free for non-commercial use.  Note that Mac security settings will block you multiple times during the install process for non-App Store software.  You will need to go into Security & Privacy under System Preferences to allow the software to install and run.

3) Configure iSCSI/Synology as target drive.  Instructions here.

4) Format drive.  Although the walk-through resources linked above for set up of iSCSI Initiator X indicate that after you configure your target drive, it will automatically prompt you to format that drive I found this not to be the case.  After connecting to the target drive on the Synology, you can manually launch Disk Utility on your Mac then format/configure the drive for use.  Instructions here.

5) Migrate photos.  Since I already had a copy of all Lightroom originals on an external USB drive, I copied the Lightroom CC folder and all of its subfolders onto the iSCSI drive on the Synology.  To do this, I attached the USB drive to my Mac, connected to the iSCSI/Synology, and copied the sub-folders which are organized into years in several batches (e.g. 2000 - 2005, 2006 - 2010).  I ran into some issues with a handful of individual files stopping the process when attempting to copy everything in a single batch, so broke things up and was able to address a handful of duplicate file errors as they occurred.  In the end, I made sure that the folder/ sub-folder structure on the Synology matched my original files on the USB drive.

6) Pointed Lightroom at the new storage location.  Under Mac Preferences, changed the storage location for backups to the iSCSI/Synology.  Closed and restarted Lightroom. The process of locating over 40,000 files took several hours, but ultimately everything was re-indexed successfully.

7) As noted above by @David, it's best to unmount the iSCSI drive when Lightroom is not in use.  Prior to launching Lightroom, go into iSCSI Initiator and "Logon" to the drive.  After closing Lightroom, return to the program and "Logoff".  I receive an error message from Mac OS that the drive was not ejected properly, but I've attempted to eject in a few different ways and always receive the message.  Doesn't seem to be an issue.

Good luck to all, and hopefully Adobe ultimately resolves this NAS issue so we can avoid the extra steps.
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
Update....iSCSI works!  Here are some step-by-step instructions for others who may want to attempt the same solution:

1) Configure Synology drive as an iSCSI Target, using Synology's out-of-the-box iSCSI Manager utility.  Instructions here.

2) Download and install iSCSI client software for Mac.  I attempted and was unsuccessful in installing a trial package from globalSAN.  Ended up going with iSCSI Initiator X v3.0 from Kernsafe, which has the added benefit of being free for non-commercial use.  Note that Mac security settings will block you multiple times during the install process for non-App Store software.  You will need to go into Security & Privacy under System Preferences to allow the software to install and run.

3) Configure iSCSI/Synology as target drive.  Instructions here.

4) Format drive.  Although the walk-through resources linked above for set up of iSCSI Initiator X indicate that after you configure your target drive, it will automatically prompt you to format that drive I found this not to be the case.  After connecting to the target drive on the Synology, you can manually launch Disk Utility on your Mac then format/configure the drive for use.  Instructions here.

5) Migrate photos.  Since I already had a copy of all Lightroom originals on an external USB drive, I copied the Lightroom CC folder and all of its subfolders onto the iSCSI drive on the Synology.  To do this, I attached the USB drive to my Mac, connected to the iSCSI/Synology, and copied the sub-folders which are organized into years in several batches (e.g. 2000 - 2005, 2006 - 2010).  I ran into some issues with a handful of individual files stopping the process when attempting to copy everything in a single batch, so broke things up and was able to address a handful of duplicate file errors as they occurred.  In the end, I made sure that the folder/ sub-folder structure on the Synology matched my original files on the USB drive.

6) Pointed Lightroom at the new storage location.  Under Mac Preferences, changed the storage location for backups to the iSCSI/Synology.  Closed and restarted Lightroom. The process of locating over 40,000 files took several hours, but ultimately everything was re-indexed successfully.

7) As noted above by @David, it's best to unmount the iSCSI drive when Lightroom is not in use.  Prior to launching Lightroom, go into iSCSI Initiator and "Logon" to the drive.  After closing Lightroom, return to the program and "Logoff".  I receive an error message from Mac OS that the drive was not ejected properly, but I've attempted to eject in a few different ways and always receive the message.  Doesn't seem to be an issue.

Good luck to all, and hopefully Adobe ultimately resolves this NAS issue so we can avoid the extra steps.
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
Any observation about performance of this setup? And one more: can you access that folder from Synology or now it is accessible only via iSCSI?
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
@Adam: After 24 hours of use, I’ve noticed it takes about 20 seconds for Lightroom to fully launch (wheel spins for a bit). Previously with my USB drive setup it was almost instantaneous. After launch, I haven’t noticed significant performance delays. Note that I haven’t done much heavy editing yet, and a majority of my images are JPG as opposed to RAW.
Photo of Will Teichman

Will Teichman

  • 6 Posts
  • 2 Reply Likes
And regarding file access on the Synology it is only visible when the iSCSI Target is mounted (not within the normal Synology interface).
Photo of Moe

Moe

  • 39 Posts
  • 1 Reply Like
Thanks for you report. Currently I use the Synology NAS with Shared Services over SMB. There is already a shared service drive with all images copied manually. If I create an iSCSI "drive", do I have to format/delete parts of the NAS? After creating an iSCSI "drive" I could manually copy all images from the SMB drive. Or I let Lightroom do the work from zero. 
Photo of Marcus Suzuki

Marcus Suzuki

  • 2 Posts
  • 0 Reply Likes
I have the same problem with my synology NAS.  Just chatted and was told that LR does not support using NAS.  I must switch to an internal or external hard drive.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 7230 Posts
  • 1641 Reply Likes
That information is not correct. 

I have my Lightroom originals on a NAS and do not have any issues.  Not everyone experiences the issues mentioned in this thread which why we are investigating it as a bug. That said, we still are unable to reproduce this issue. 

If you have a case number from your chat, I would love to review it. 
Photo of Adam Dr.

Adam Dr.

  • 49 Posts
  • 9 Reply Likes
Same here, after some initial problems, probably not related to the NAS, all is working fine since over a year now. The only issue is the speed of Lightroom CC Desktop, which is much slower than the Lightroom Classic on the same PC, the same network (1GB/s) and the same NAS.
Photo of Marcus Suzuki

Marcus Suzuki

  • 2 Posts
  • 0 Reply Likes
Rikk, thanks for your quick reply.  I didn't save the chat, however, I received this e-mail shortly after my chat ended so hopefully this is it.
  • Case Number: ADB-12225254-X7K2 
  • Issue:  Performance 
Given that this does seem to be a known issue experienced by multiple users I have decided to switch to an external hard drive for the time being.  However, the better solution for me would be to use my NAS for its intended purpose.  My LR library is in the process of being rebuilt and I am importing with the new external hard drive location.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 7230 Posts
  • 1641 Reply Likes
Thank you.
Photo of Moe

Moe

  • 42 Posts
  • 1 Reply Like
Is iSCSI still the only way to get Lightroom running with Catalina?
Photo of Marco Martins

Marco Martins

  • 81 Posts
  • 5 Reply Likes
I'm facing the same problem more than 1 year now. And this is not a problem related to synology NAS as I've had this issue with my previous NAS that was just a Linux computer.