Lightroom CC: Syncing Issues when Originals are stored on a NAS

  • 9
  • Problem
  • Updated 13 hours ago
Hi Rikk,
besides the outage, I am trying to sync my cloud stored data since several weeks on my NAS (Synology), connected via Gigabit Ethernet. in the beginning it works fine but after 10.000 pictures and movies its not going further (I have about 35.000) and plenty of storage. LR freezes, have to start again then additional 2-3 pictures are synced, that's it. Also I can't use LR since then (open pictures, look into people etc.), when I disconnect the NAS I can work, but not sync. Dont understand why this is not a background task and does LR really look up local backuped NAS Data when I work on data (should only be a backup?). Its frustrating, as this would be the major advantage of the solution?? Any Idea?

Note: This conversation was created from a reply on: Lightroom CC: Mobile syncs but desktop app doesn't.
Photo of Stephan Siehl

Stephan Siehl

  • 1 Post
  • 0 Reply Likes

Posted 4 months ago

  • 9
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5593 Posts
  • 1182 Reply Likes
Stephan we need to get a diagnostic log from you to further investigate your issue.  
Go to Preferences>Account and hold down the [Opt/Alt] key. Click the [Diagnostic Log] button and send the resulting log to:

Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5593 Posts
  • 1182 Reply Likes
I am moving this thread to In-progress. We've opened an issue with the engineering team to track this though we haven't yet reproduced this internally. 
Photo of Rafael Sampaio

Rafael Sampaio

  • 1 Post
  • 0 Reply Likes
Any update on this? I have almost 49 thousands pics and I really can't say what is real sync status. 
Photo of rachalmers

rachalmers

  • 99 Posts
  • 8 Reply Likes
What happened Here? This thread is very old. Was the issue solved?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5593 Posts
  • 1182 Reply Likes
Please see my comment from 4 weeks ago. When the status changes we will update this thread. 
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
I have this same issue when trying to save all originals to my network folder (windows).  I'll send along my diagnostic log as well.
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
Unfortunately, the diagnostic log never completes.  It just gets stuck in the same way that the sync gets stuck.  Is it possible to grab the log somewhere even if it's incomplete?  Would that be useful?
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5548 Posts
  • 1168 Reply Likes
Are you Mac of Windows, Matthew?
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
Mac
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5548 Posts
  • 1168 Reply Likes
Do you see this file? ~/Library/Application Support/Adobe/Lightroom CC/lrcc_console.log

If so, Zip that and email it to me please!
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
I dont have any log files on my machine that are similar to that name
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
I was able to get one to complete: DiagnosticLog.html
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5548 Posts
  • 1168 Reply Likes
Send the resulting log to:

You cannot attach it to a forum post. 
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5548 Posts
  • 1168 Reply Likes
@Matthew - can you go to Help>System Info... and reply with your exact installed Lightroom Version number?
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
Lightroom CC version: 2.2.1 [ 20190312-1546-e438717 ] (Mar 13 2019)
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
Rikk, I hope you received my email yesterday.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5548 Posts
  • 1168 Reply Likes
Can you get me a screenshot of your ~/Library/Application Support/Adobe/Lightroom CC/ folder?
Photo of rachalmers

rachalmers

  • 99 Posts
  • 8 Reply Likes
Forgive me for asking but I’ve read the OPs question and am trying to understand just what is being synced and what is being stored and where?

On my setup here, I have some 30,000 plus images. I import new images via iPad, iPhone or the Desktop into ‘the cloud’. The Library is stored on the main drive, and I have the settings set to store originals on another internal drive used only for that purpose.
It doesn’t seem to matter where the originals are imported from, they end up in the storage location as well as in the cloud.
When I first set it all up it took forever to sync all the images, but now it’s fine.
So what I’m trying to understand from Stephens question is just what is being synced that involves the NAS. If the NAS is just storage for the originals, then it won’t need syncing will it? They get stored there as originals on import. I’m assuming? As well as going to the cloud.
Or have I misunderstood this whole thing.?

But also... if you are trying to sync a lot of images to the cloud at the same time, that probable won’t work. For some reason the link to Adobe seems to be very poor.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5584 Posts
  • 1181 Reply Likes
Setting your Preference to store Originals on the NAS tells it to store images being actively used by Lightroom CC on the NAS. This includes images yet to be synced to the cloud and images being pulled back down for editing, exporting, sending to Photoshop, etc.  It also includes Albums where you've set the album to Store Album Locally. 

Note that it is not a separate backup of your images. 
Photo of rachalmers

rachalmers

  • 99 Posts
  • 8 Reply Likes
I didn't think LRCC used the Originals for editing? 

This is where I've stored a copy of my originals. According to Preferences - > Local Storage.
Nothing in there gets edited, modified or otherwise altered. Just stored.



I have them stored in Date order, and these are the last imports, stored as backups in that location.



All images are stored in the Cloud, from where they are pulled to be worked on, modified or retouched. via Smart Previews. They are then available to all my devices. iPad, iPhone, and Desktop. 
If I need to revert to the original - it is pulled from the Cloud, not local storage.
If I Save the modified image, it is saved to the Cloud as a smart preview, or I can Export it as a new file entirely.
When I import new images, from any of my devices, they are immediately stored up in the Cloud and I can check this by going to the web interface, but they are also stored in the above location at the same time and left there. Becoming effectively a 'backup'

In the Cloud, via lightroom.adobe.com the images and structure are exactly the same as on my Desktop and devices.

Cloud (Web) base


Desktop base



As I mentioned in passing previously when I first imported all my images 43,854 of them, into Lightroom CC I originally had them in LRClassic. I also had them stored as originals on a spare drive. The import from LRClassic simply wouldn't work properly. Big mess.
So I cleaned out LRCC, and reset it to 0. Carefully set up Preferences as you see, with the Originals stored on an Internal drive used only for that purpose.
I then began the Import from the other image file repository. So the images were imported to LRCC, sent to the Cloud - I have a Fibre Optic connection the Internet, and stored locally at the same time in the designated storage location.
The Import and Sync process took about a week to complete. Beware Adobe's pathetic Cloud/internet link.
Even then, there ended up some six I think images that simply would not sync. They just sat there. On them, I gave up. I have no idea what happened to them in the end, because now some two months later everything seems to run smoothly.

Now, if the original posters Local Storage of Original Copies are on a NAS drive, it shouldn't make a blind bit of difference.
Unless there are Spaces somewhere in the Pathname to the folder on the NAS. That shouldn't matter - but sometimes it does.
That's the whole idea of LightroomCC. You can work on your images from anywhere, as everything is stored in the Cloud. That's what I understand anyway? It works for me.
Just out of curiosity - if the OP doesn't have that log file in
 ~/Library/Application Support/Adobe/Lightroom CC/
then there is probably something wrong somewhere else. The file lrcc_console.log should be there. Don't forget the tilde at the start of the path.

My apologies if I'm interrupting - but I find this interesting. because I've seen something somewhere else about NAS problems... 

and ... maybe the OP doesn't have enough Cloud storage? or a fast internet connection. Not that that matters because Adobe's isn't.







Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4969 Posts
  • 1929 Reply Likes
> I didn't think LRCC used the Originals for editing? This is where I've stored a copy of my originals. According to Preferences - > Local Storage. Nothing in there gets edited, modified or otherwise altered. Just stored.

Stored... and read when you start editing or zoom to 1:1. And new photos added to there, or removed when deleted.

> All images are stored in the Cloud, from where they are pulled to be worked on, modified or retouched.

If there's a local original available, as there is in this case, Lightroom will use the local copy, because it's faster than downloading from the cloud.
Photo of rachalmers

rachalmers

  • 99 Posts
  • 8 Reply Likes
Thanks, yes. You reminded me. But the original doesn’t get modified. Just a working copy of it. Which is kept in the catalog.
However. In the OPs case that shouldn’t have any effect on the ability to sync a collection if the originals are stored on a NAS Drive I’d have thought? Unless maybe the NAS is in sleep mode or some other idle state?
???
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4969 Posts
  • 1929 Reply Likes
> In the OPs case that shouldn’t have any effect on the ability to sync a collection if the originals are stored on a NAS Drive I’d have thought? Unless maybe the NAS is in sleep mode or some other idle state?

Yep, it should be "just another storage location" just as if it's an external drive, although they can suffer from LAN connection issues with the amount of data being passed not only up to the cloud but also across the local network to the NAS, and there's an extra layer of NAS software in the mix too. There seems to be a pattern here worth investigating, as sync shouldn't just fail, even if it were to be slower.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5593 Posts
  • 1182 Reply Likes
Greetings to all on this thread. I have been thus far unable to duplicate this issue. Is anyone still experiencing this since the 2.3 update?
Photo of Vimo

Vimo

  • 10 Posts
  • 0 Reply Likes
Hello, I had the same issue, even with much less pictures (on 2.3). I have since disabled the "store original locally" because Lightroom became completely unuseable: opening 1 picture for editing would take 20 minutes while "syncing" (which stopped progressing).

Sometimes, I managed to get it to resync by pasting whatever edit-settings onto the photos that were not yet synced. It seems that this action re-activated the syncing progress but it was overall very sluggish. I had the impression that it was a bandwidth-related problem, meaning that I think Lightroom could manage to upload to the cloud and to the NAS at the same time.

Having a NAS-based copy of all my pictures is very important to me - As the OP, I'm using a Synology NAS; A feature request I have would be to allow for a Background sync directly between a NAS and the Creative Cloud Library.
Photo of Matthew Pardini

Matthew Pardini

  • 8 Posts
  • 3 Reply Likes
Rikk I am still experiencing this issue.  My problems were never resolved.  Lightroom is basically unusable until I disconnect my network drive, which of course defeats the purpose of storing my originals there.

My laptop drive is relatively small.  My NAS drive is big.  I'm happily paying for 1TB of Adobe Cloud Storage, but I feel uncomfortable having ~40k pictures of my family not backed up somewhere else.

If Adobe would just make a small program to sync pictures to a drive that would be ideal.  Lightroom is simply broken in this regard.

I have confirmed I am running on Lightroom 2.3 (May 3rd, 2019) macOS.  It appears to be able to move 1-10  pictures every time the program starts before it locks up.
Photo of Chris Mulligan

Chris Mulligan

  • 1 Post
  • 0 Reply Likes
This is incredibly frustrating and poorly implemented. This is a key feature for Cloud adoption. I wish I could export back to Classic.
Photo of Charrisa King

Charrisa King

  • 1 Post
  • 0 Reply Likes
I'm having the same issues. Syncing is incredibly slow. Lightroom CC is unusable as an editing tool. I'm about to cancel my subscription is a solution isn't found soon - its been months without any progress on this thread.
Photo of Vimo

Vimo

  • 10 Posts
  • 0 Reply Likes
I can confirm that NAS-backups and Lightroom CC are not working as the sync progress gets stuck.
As I explained in another thread, sometimes you can get it to resume uploading/copying by pasting edit settings (even without any changes) onto the unsynced pictures. But it remains extremely sluggish and slow.

No feedback from Adobe so far.

I have tried every possible combination of wired/wireless connection, Mac/Windows, Desktop/Laptop - very unfortunate that Adobe does not put any emphasis on this as I feel this is a huge feature that could close some of the gap between LR and LR CC (for those 'semi-pros' that are fine with the limited capabilities of LR CC). As others have pointed out, I too would like to have the Creative Cloud backup, but I need the .raw files along with the edit settings on a local backup (NAS), otherwise it's a no-go for me.
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5593 Posts
  • 1182 Reply Likes
Greetings all,

Since my last comment on this thread 30 days ago I've deployed another Synology NAS configured as closely as I can to what I can glean from the comments found in this thread.  Thus far, we've been unable to reproduce this behavior with our NAS systems in QE.  Syncing operates at the same speed regardless of whether the NAS is connected or not.  We are running Mac 10.14.5 and Win 10 on the NAS and both seem to be performing fine. 

I am hoping someone can provide some additional information that will help us discover where the issue may lie. 

(Edited)
Photo of pascal chabriel

pascal chabriel

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled Lightroom CC stuck when backing up on NAS.





























































































Hello,  

I have a library of 90000 pics for about 1.5 T and I use Lightroom CC to play with them.

I want a backup solution on my NAS on top of the cloud storage.

 

In LR CC preference I have set the local storage of originals to my NAS.

However the following issues are encountered which makes LR CC unusable:

 

1. Syncing is extremely slow.

2. Sync gets stuck at around 22500 pictures. Restarting app and computer allows the sync of a couple more and that's it.

3. While Syncing the application is just stuck with the infamous circle turning and turning for ever.

4. Cannot navigate into my pics while syncing which should work in the background without affecting the app usage.

5. There is no information whatsoever on the status of the sync progress so I dont know where it will end up. If ever.

 

I read some posts that other users are encountering similar issues but Adobe does not come with any proper answer .

 

Note that my computer, NAS, internet, intranet speeds are optimum and work perfectly otherwise.

I have been using this set up locally with Aperture since years with no issues.

 

I am losing my time, money and nerves with all these LR CC issues.

So I would appreciate if you could be of any help.

 

Thanks in advance.





















































































































































Photo of Brian Jonson

Brian Jonson

  • 2 Posts
  • 0 Reply Likes
I'm happy to see this topic being resurrected. I spent no less than 20 hours (yes, actual hours) in chat or on the phone with a half-dozen or more official adobe support agents, and in the end, the only solution I could find (not they) to make this work was to forget the NAS and use only a local hard disk for the "store a copy of originals at the specified location" option, then for backup purposes to manually sync the Lightroom CC folder from that to my NAS. Not ideal. 
I'm running a Synology NAS. 1GB LAN connection between computer and NAS, 300/15 Mbps WAN connection. First 1,000-1,800 are no problem, after that a slow and steady grind to a halt. I've sent in several kinds of very large diagnostic files and apparently that was of no help to Adobe. Currently running Lightroom CC 2.3 on macOS 10.14. And internet and LAN are blazing fast for any other kind of activity, so this is a special Adobe cloud sync issue, not a general LAN or WAN issue.
Photo of christoph.romer

christoph.romer

  • 8 Posts
  • 3 Reply Likes
Hi guys

I'm having the exact same problem. I recently switched to Lightroom CC and I have about 260GB of images on Adobe's servers. I then configured Lightroom CC to download the master images to a folder on my Synology NAS. At first everything seemed fine and Lightroom started downloading. However, after about 80GB the problems started and the download became slower and slower. With a lot of playing I managed to get to about 120GB but in the end the download halted completely. At some point I came up with the idea to reset my masters downloads folder to a local folder. So I opened the preferences, set everything correctly, clicked "Done" and then Lightroom prompted me with the dialog that it needed to restart in order for my settings to apply. I clicked restart. However, the application did not restart. I could reproduce this problem and I further noticed that when changing something in the application settings and then reopening the application settings my changes weren't even there anymore. Also other aspects of the application began behaving very weirdly (extreme long load times when looking at images, I could not pause the sync anymore, etc...). In essence Lightroom behaved completely unpredictable. After a lot of fiddeling around I somehow managed that Lightroom accepted my choice of a local folder and about 5GB of my 120GB of downloaded images made it to from my NAS to my local drive. That's a bit weird.... where have the other 115GB gone?? However, Lightroom then immediately began downloading at full speed from the servers and my masters were on my machine in a matter of hours. 

In conclusion I can say that putting the master folder on a NAS does not work with Lightroom CC. At least in my setup. Something seems very wrong when attempting this.

I'm running MacOS Mojave, I have a DS1415+ and I normally get an upload speed of about 700 Mbit/s to my NAS (on WIFI). My Mac is connected via WIFI to the local network. The network drive is mounted using the SMB protocol (not AFP).

Since syncing to a NAS is officially documented on the Lightroom CC help pages I hope that Adobe fixes this issue in a timely manner.

As a sidenote to Adobe: please make it also possible to "back up" all albums and not only the masters. I want to have a worst case scenario backup of my work on my harddrive as well.   
(Edited)
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4970 Posts
  • 1931 Reply Likes
Guys, can you help me test a theory please? Can you post how many photos are in All Photos? And how much cloud space they take up?
Photo of Adam Dr.

Adam Dr.

  • 33 Posts
  • 8 Reply Likes
55083 photos; 424 GB
Photo of Adam Dr.

Adam Dr.

  • 33 Posts
  • 8 Reply Likes
What's the theory?
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4970 Posts
  • 1931 Reply Likes
Thanks. Adobe's having a little trouble reproducing it, but I suspect they need to test with a larger number of photos. Mine seems to grind to a halt at about 22k out of 100kish. I'm wondering if anyone sees it with smaller volumes (e.g. 20k or less)
Photo of Adam Dr.

Adam Dr.

  • 33 Posts
  • 8 Reply Likes
I was facing the same problem as described in this thread, deleting my online catalog and re-synchronizing it from scratch fixed the issue, only 170 images were not synchronized and I have to fix them manually. Since then all new photos or edits are synchronizing without any issue (although speed is far from my expectations or LR classic).
Photo of Vimo

Vimo

  • 10 Posts
  • 0 Reply Likes
Hello, The problem is exactly the same with small databases, I have one set up with <5000 pictures and 200 GB.

I would bet that it is a problem of ressource/bandwidth allocation when uploading and copying. I experience similar "freezes" for example when I copy files to the NAS and try to sync LR CC. Very often LR would "lose track" of the number of pictures to be synced and just stay unresponsive.
Photo of Bonnie Gray

Bonnie Gray

  • 1 Post
  • 0 Reply Likes
117,448
338GB
Photo of Brian Jonson

Brian Jonson

  • 2 Posts
  • 0 Reply Likes
84,000 photos; 687 GB