Lightroom video cache import bug causing large amounts of HD space to be used up, and I'm not importing videos!

  • 6
  • Problem
  • Updated 3 years ago
Merged

This conversation has been merged. Please reference the main conversation: Lightroom 6.2.1: Video Cache is out of control

I think I've discovered a bug with LR: it seems to be creating a cache of videos without it being told to, or even importing the videos. LR also disobeys the preference of how much video cache to keep.

Last week I cleaned up my HD, so I knew exactly how much space I had on it.

Starting it up today I found I had 12GB less so I used a program that analyses the hard disk space.

It showed that in C:\Users\[User]\AppData\Local\Adobe\Lightroom\Caches\Video\[All subfolders]

were numerous cached MP4 files from tutorials that I have collated over the years.

These tutorials are on a memory stick and not on a HD.

Previously I had imported some images from the memory stick and copied them onto the HD via LR, so I knew that was where they had come from. I did not import any videos.

I deleted the video cache and tried the following:

1) Open the folder above
2) Insert the memory stick
3) Open LR (nothing happens)
4) Open the import dialogue box and select the memory stick as source, but not do anything, certainly do not import. (at this point notice that files start appearing in the above folders).
5) Cancel the import dialogue box. (notice that files are still going in the above folders)
6) Watch, with LR still open, the above folders bloat out.

I've repeated this several times with the same effect. As I type this it's still growing. I'm now up to 30GB... and it's still going.

My video cache is set to 1GB.

Anyone else had an issue or can repeat this?

32GB now.....

LR6.1,

Operating system: Windows 7 Home Premium Edition

Version: 6.1 [7601]

Application architecture: x64

System architecture: x64

Logical processor count: 4

Processor speed: 2.5 GHz

Built-in memory: 7862.7 MB

Real memory available to Lightroom: 7862.7 MB

Real memory used by Lightroom: 351.6 MB (4.4%)

Virtual memory used by Lightroom: 328.7 MB

Memory cache size: 2.0 MB

Maximum thread count used by Camera Raw: 1

Camera Raw SIMD optimization: SSE2

System DPI setting: 96 DPI

Desktop composition enabled: No

Displays: 1) 1366x768

Input types: Multitouch: No, Integrated touch: No, Integrated pen: Yes, External touch: No, External pen: Yes, Keyboard: No

D
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes

Posted 4 years ago

  • 6
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
And just to add, I've tried this using a new memory stick and new catalogue: it happens every time.
Photo of Steve Sprengel

Steve Sprengel, Champion

  • 2672 Posts
  • 347 Reply Likes
What I see are PEK and CFA files, audio files, that are being extracted from video files that LR "sees". Which are either ones already in your catalog, or any videos in a potential import folder.

The extraction is being handled by a separate executable called:

DynamicLinkMediaServer.exe

which is why cancelling the import or closing LR doesn't affect things and why it doesn't care what LR's video cache size is set to.

I imagine that LR is telling the DLMS where to scan and where to put the results, and will find the results, later, if you do import those videos and try to play or export them. Of course that doesn't help if you merely open a folder in Import and never do anything, which seems like your situation.
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
Well thanks for clearing that up, I guess it answers where the root cause of the problem lies.

I have only a few videos on my main PC HD (I discovered the problem on my laptop). The size is probably <20MB worth. Sure enough, even on my main PC, LR cached them too, but the problem is obviously less significant, so I never noticed it.

A friend complained that when he installed LR that his HD space disappeared overnight and he never found out why until now.

It seems that to me anyone having a large quantity of videos on there HD is going to have a massive problem.

At the moment I have just written a batch file to go off whenever I start windows to erase any files in these folders, but I feel that this is a major issue that Adobe should address.
Photo of Steve Sprengel

Steve Sprengel, Champion

  • 2672 Posts
  • 347 Reply Likes
If you keep the videos out from "under" where LR is pointed to for Import functions, then LR would never see them to tell the DLMS to scan them for audio and cache the results.

I mean the DLMS isn't scanning all your HDs for videos continuously, it's just scanning where LR is importing from or when you bring up thumbnails of videos you've already imported, or at least that was my experience. Is something else happening to you or your colleague?

You might have to turn off auto-insert import notifications, to get around the problem for external drives, otherwise, it would probably start scanning at the root of the drive every time you plugged it in and LR popped up an Import window.

I have auto-insert turned off and always just drag-and-drop my photos onto my HD then drag-and-drop the HD location onto LR to initiate an Import so the only folders LR "sees" are the ones I'm actually importing from and it doesn't rescan older photos and videos that I'm not interested in importing.
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
Auto-play has always been turned off (I loathe it).

The reason seems to come from the fact that include subfolders is ticked (mainly because my camera creates subfolders, so it's easier to keep it on by default).

Basically as soon as you click on the root directory of the drive, memory card or stick it scans the whole drive for files and videos, so there are always going to be videos "under" the initial selection of the drive.

I've also noticed it carries on even after I have closed LR!!!

Your method of importing does overcome the issue for now however.

I would mark it as correct but I believe that is is an issue that Adobe need to address: IMHO only videos that are actually imported should be cached. Someone else has added to the list in the main forum that they are experiencing issues too, I can't imagine it being long before there is a plethora of complaints.
Photo of Steve Sprengel

Steve Sprengel, Champion

  • 2672 Posts
  • 347 Reply Likes
It carries on because it is a distinct process unconnected to LR except for the initial communication about where to scan and where to put the results.

By doing what it's doing, LR is precaching possible import results to speed up the Import when you actually initiate it, but the problem is there is no limit and nothing that removes them automatically if they haven't been used in a particular time period.

If there are photos or videos that remain on your flash after you've imported then there's something non-expected occurring in your workflow from Adobe's point-of-view.

Normally cameras write their photos and video to a memory card, you import them, then you erase them from the card.

It seems like your workflow is either using a memory card as intermediate storage or is using another form of intermediate storage for storing new photos.
--
I understand about clicking the root folder and having All-subfolders enabled, but is there a way to choose the initial folder without clicking on it, by merely expanding the device with the arrow at the left and then expanding the subfolders beneath with their arrow at the left before you actually click on the folder above where the new photos are, or is clicking on the arrow at the left to expand it enough to select it as a potential import source?
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
>If there are photos or videos that remain on your flash after you've imported then there's something non-expected occurring in your workflow from Adobe's point-of-view.

I see your point, but that's only if you use LR to edit videos. If you shoot video and stills and use LR to edit the stills but not the video, then LR is still going to import that into it's cache.

If you shoot lots of videos and stills there will always be video on the media.

Plus if someone uses an external HD and copies the files to an external HD during their travel, for example, and only imports them when they get back home, and that HD has videos on it, then it's always going to cache the videos.

>I understand about clicking the root folder and having All-subfolders enabled, but is there a way to choose the initial folder without clicking on it, by merely expanding the device with the arrow at the left and then expanding the subfolders beneath with their arrow at the left before you actually click on the folder above where the new photos are, or is clicking on the arrow at the left to expand it enough to select it as a potential import source?

I did try that, but for some reason merely clicking the expansion button still selects the drive and kicks off the import process, even before I've drilled down to the level I want.
Photo of Steve Sprengel

Steve Sprengel, Champion

  • 2672 Posts
  • 347 Reply Likes
The current behavior of caching all the audio from video on a drive is good if you'll actually be importing all the videos but not good if you're not going to be importing most or none.

However, there isn't much change that Adobe could do and still keep the pre-caching benefit other than maybe not start it when you click the arrow to open the top-level drive, and only start it when you left click to select an import folder.

You could always do Task Manager - End Task on the DigitalMediaLinkServer process and manually clear the video cache in LR if things get too far out of hand, but I think Adobe should do something to make it not index an entire hard-drive of video files if you merely want to import a single folder down deep in the folder structure.
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
To anyone reading this with the same problem, this is a little drastic, but it seems to work.... I need to trial it a little longer but it doesn't seem to affect LR stability. YMMV.

Locate dynamiclinkmediaserver.exe in

C:\Program Files\Adobe\Adobe Lightroom\Helpers\DynamicLinkMediaServer\dynamiclinkmediaserver\1.0

Rename it. I just appended it with "old", i.e olddynamiclinkmediaserver. If it's running in taskmanager, you'll need to kill it first before renaming it.

LR can't find it, hence it doesn't run. The downside is that you can't preview any videos, but if like me you don't care much for the video functionality, this works.

Any problems, just rename it back.
Photo of Gary Freestone

Gary Freestone

  • 1 Post
  • 0 Reply Likes
This doesn't seem to be a new problem. I have seen reports similar to this dating back to 2013.
Photo of Björn Svensson

Björn Svensson

  • 2 Posts
  • 0 Reply Likes
Maybee you can help me sort out my workflow guys?

I just sorted photos dating back from 2003 - like 30K photos... So It would be nice to have a correct workflow from now on. I also have the problem with LR eating up my root drive for video cache...

I bought a new desktop containing flashbased root drive, a secondary flash drive for scratch (catalogue/thumbnails) and a third hybrid drive for long term storage. Also upgraded to LR 6.1.1

For some reason I kept my LTS drive (Long term storage) imported and maybe thats why I suffer from the video cache problem.

When importing photos and videos I import them from a flash-card onto the scratch disk.
Edit photos from there and the export them to the LTS-drive.

Should I simply remove the LTS drive containing all photos from LR ? I mean, They are all done - so I wont need to edit them any longer (or well, I should really add tagging to them - something I have postponed for years...)

What do you think?

Regards
Björn
Photo of Ken Yaecker

Ken Yaecker

  • 1 Post
  • 0 Reply Likes
Same problem.

LR has saved all my tutorial videos into its cache. I never do any video in LR yet there they are. Any way to stop this process from happening over and over?
Photo of Gordon Gao

Gordon Gao

  • 5 Posts
  • 2 Reply Likes
Same problem here. Video cache is 170 GB! And totally throttled my C drive. Any solution? Is Adobe listening?
Photo of Josh Ross

Josh Ross

  • 3 Posts
  • 0 Reply Likes
Same problem. I imported a single still image off my desktop and Lightroom saw a folder of my sons videos that is also on the desktop. The media cache is now huge.
Photo of Gordon Gao

Gordon Gao

  • 5 Posts
  • 2 Reply Likes
I hope Adobe can fix this bug ASAP--- lightroom now leaves only 1 MB space on my C drive, and makes my computer completely useless.

Adobe, please listen and escalate this issue to your higher priority!
Photo of Keith Thompson

Keith Thompson

  • 4 Posts
  • 2 Reply Likes
I can see this is not going to help me much, but same problem here....57 GB and rising.....

anyone there?
Photo of Björn Svensson

Björn Svensson

  • 2 Posts
  • 0 Reply Likes
No, this Thread is dead. My main problem is that the "video cache" setting does not reflect the actual video cache. That, to me - is a bug - regardless of what Adobe or any one else thinks.
This behaviour is by default and thats what keep messing up peoples computers.
The solution is to not import videos - change your workflow.
Photo of Josh Ross

Josh Ross

  • 3 Posts
  • 0 Reply Likes
Even when you don't import a video it creates the cache files though. Just having a bunch of videos in a sub folder of the one I was importing from, and having the look inside sub folders option checked, meant that it created something like 60GB of cache files. I didn't import the videos, they were simply visible to the import dialog. No way that makes sense as anything but a bug.
Photo of Steve Sprengel

Steve Sprengel, Champion

  • 2672 Posts
  • 347 Reply Likes
On another thread, Adobe has agreed to look into this problem, again, after fixing an earlier issue where it would cache the videos from the entire drive. Now it is just caching videos that show up in the Import grid, even momentarily, if you click on a folder to get to the folder to import from, even if you don't import them.

The workaround, for now, is to rename the DynamicLinkMediaServer.exe under the LR program folders. I just added an extra x before the .exe.

On my Windows 10 64-bit computer that program is here:

C:\Program Files\Adobe\Adobe Lightroom\Helpers\DynamicLinkMediaServer\dynamiclinkmediaserver\1.0

The executable exists under the Bridge CC and Photoshop CC program folders as well although I don't know that LR would use those copies.
Photo of Josh Ross

Josh Ross

  • 3 Posts
  • 0 Reply Likes
Yes, I used diskinventoryx and found duplicates of the cached files in folders related to other Adobe creative suite programs.

That workaround may be helpful to someone but useless to me since I'm running OSX.

This conversation is no longer open for comments or replies.