Lightroom: Exporting a catalog across MacOS 10.10.2 file share network causes source/destination computers to die (OS bug)

  • 1
  • Problem
  • Updated 4 years ago
  • Solved
  • (Edited)
I have a source Mac Pro and a destination Mac Pro. Both are 10.10.2 and using gigabit ethernet and directly connected without router (CAT5E cable). In Finder, the computers are mutually discoverable and I can navigate folder trees. I can also transfer 15GB files (zip) back and forth at speed over 100MB/sec. I have an assistant that I have filtering my photography so I export her "jobs" one at a time over the network then reimport when she's applied star ratings and color tags:

1. Open LR on Mac Pro 1
2. Right click on folder containing 3000 photos (1:1 previews exist for all)
3. Select "export this folder as catalog"
4. Choose destination Mac Pro 2.
5. Choose "include Previews"
6. Click button [Export Catalog]

At this time, LR starts sending the catalog + previews over the network. I see speeds hit about 40MB/sec. After a few GB of data, the export totally stalls and both computers go into a beachball state. All network traffic dies. Finder goes unstable. LR is still responsive. I can stop the export. Both computers require OS reboot to regain normal operation.

Again, I can send tens of gigabytes of data over network between computers without fail. LR specifically has a very large problem with it. Console ("Desktop" is on Mac Pro 2):

KernelEventAgent[77]: tid 54485244 received event(s) VQ_NOTRESP (1)
KernelEventAgent[77]: tid 54485244 type 'afpfs', mounted on '/Volumes/Desktop', KernelEventAgent[77]: tid 54485244 found 1 filesystem(s) with problem(s)

kernel: AFP_VFS afpfs_DoReconnect: connect to the server /Volumes/Desktop
kernel: AFP_VFS afpfs_DoReconnect: connect on /Volumes/Desktop failed 51.
kernel: AFP_VFS afpfs_DoReconnect: sleep for 2 seconds and then try again
kernel: AFP_VFS afpfs_DoReconnect: connect to the server /Volumes/Desktop
kernel: AFP_VFS afpfs_DoReconnect: connect on /Volumes/Desktop failed 51.
kernel: AFP_VFS afpfs_DoReconnect: sleep for 4 seconds and then try again
netbiosd[303]: network_reachability_changed : network is not reachable, netbiosd is shutting down
Photo of sean

sean

  • 266 Posts
  • 43 Reply Likes
  • waiting for LR to work.

Posted 4 years ago

  • 1
Photo of Chris Cox

Chris Cox

  • 20280 Posts
  • 813 Reply Likes
You need to report this to Apple - they will need to get details on your systems and network configuration to fix the issue (which sounds like a nasty low level filesystem bug).

The fact that Finder and other network traffic has issues means that the problem exists in the OS, not the application.

(and the last few lines of the console log you posted confirm that this is a low level OS issue - ouch!)
Photo of sean

sean

  • 266 Posts
  • 43 Reply Likes
If it was low level, I can't explain how large file transfers work without issue external to LR. In fact, that's been how we operate now. I export the catalog out of my main, large catalog to my desktop and drag the folder to her Mac Pro. That works. Direct export via LR kills the computers.
Photo of Chris Cox

Chris Cox

  • 20280 Posts
  • 813 Reply Likes
Without knowing the exact bug, I can't explain it either.
But an application cannot generate those kernel message, nor stop the network activity of other applications.

Apple really needs to get details on this so they can fix the bug.
Photo of sean

sean

  • 266 Posts
  • 43 Reply Likes
Maybe there's something here: Maybe large ZIP contiguous files work but large groups of smaller files crash the network?

OK, just tried to move over a folder of 1000 15MB photos. Kills the network. Does LR send over preview files as individuals or as a container?

So, this is definitely not a LR issue.
Photo of sean

sean

  • 266 Posts
  • 43 Reply Likes
LR6: .... :) ... are we getting multi-user via LAN/cloud with smart preview and metadata edit sync back to master catalog? (like iPad app). I have employees here that edit my photography! iPads are too slow so I have them on Mac Pros using this hack export/import catalog scheme.... not fun.
Photo of Becky Sowada

Becky Sowada, Adobe Employee

  • 508 Posts
  • 105 Reply Likes
sean, thanks for the investigation on this. Did you report the issue to Apple?
Photo of sean

sean

  • 266 Posts
  • 43 Reply Likes
Sorry I didn't get back to this yet. I ended up buying a new NIC with a different Intel chip. The problem persisted so I tried a different job export in LR (catalog + 1:1 previews with no Smart Previews) which did work and actually had over 4000 photos. So, I trashed the 1:1 previews for the original job, rebuilt the 1:1 previews and retried exporting over the network to the other Mac Pro and it works flawlessly now. It seems to have been some sort of corruption in the previews.