Lightroom 6.2.1: Video Cache is out of control

  • 31
  • Problem
  • Updated 2 months ago
  • In Progress
  • (Edited)
I recently upgraded to Lightroom 6.2.1 So far there has been a lot of fuss over the import dialog... ok, well sure, it has a few issues, but they can be either worked around or just revert back to 6.1.1

I would like to report and ACTUAL bug in 6.2.1

My D drive recently ran out of space... I tried deleting some stuff I didn't need, but still it kept running out of space... So I finally ran windirstat and had a look at it.. Nearly HALF of my drive was FULL of D:/temp/Adobe Local/Lightroom/caches/video/media Cache Files. Now here's the kicker... NONE of these video files are even on the hard drive that has my catalog on it. My lightroom database is on drive L:\ all my lightroom photos and very few lightroom videos are all on L:\ I have a few scans on drive K:\ that I import to lightroom... but these videos are ALL on Drives E:\ and F:\

here's another thing.. I knew Adobe wasted space caching videos, and I do have a GOPRO and I record a little video,.. .VERY LITTLE, maybe 1 video a year... so I don't really want ANY of the video cached.. I will wait for it to load... SO a long time ago, I set my video cache in Preferences>File Handling to the minimum of 1GB (It's was always a BUG to not allow 0GB) I don't want to cache any videos!!!!!!!!!! but here it is.. NEW BUG It's STILL SET TO 1GB!!!!!!!!!!! How is it gobbling up almost 1TB of space when I have it set to 1GB??????????????? So.... here's another problem... I have Cache files that are 4GB for a movie that only takes up 2GB on my hard drive.. what's up with THAT??????????????? I randomly checked a few, and the worst one was a 5GB cache file for a movie that only takes up 750MB on my hard drive... two things, first of all... you NEVER EVER EVER need to cache an entire movie... caching more than 1 minute of a video is useless... if you're going to watch the video in lightroom, it can just play the video on the hard drive fast enough that it doesn't need further caching.. second... DON'T CACHE THE VIDEO AT ALL!!!! just capture the thumbnail of it so you don't have a blank square on the catalog and call it a day... if someone wants to play the video, it will load and play plenty fast enough, Lightroom Can't work with video files, only play them, so WHY BOTHER TO CACHE THE WHOLE THING?? come on Adobe, some COMMON SENSE please!!!!

so now ANOTHER BUG, it's already set to limit video cache to 1GB, so I figure, the new import thing must have built this RIDICULOUS Cache, so I will just Purge it, that will bring it down to 1GB right??/ WRONG!!! It pops up a message saying "Video cache is being purged, this message will be dismissed when the purge is finished... I wait 5 Seconds, and the message disappears, I have NO hard drive activity, and well... I STILL have 1GB of Video Cache files!!!!!!!!!!! Ok, maybe it didn't take.. let me set it to 2GB, then purge.. NOPE! let me set it back to 1GB then purge, NOPE..

ok, so I suspect how to fix it will be, (I Hope) click import, and select the movies folder and then select Ignore source... by the way, how do I add my E:\scans folder as a legitimate source.. I just removed a source, how do I add a nice shortcut button for a new one? ok, now that source is removed, I hope it won't scan it again... now that it will HOPEFULLY not scan that hard drive again, I'll manually delete the offending Video cache.. ok manual delete complete, Ahh my drive can breathe again.. Lets open light room and see what happens.... ok.. open.. lets open the Import dialog because eventually I'll need to import something... oh-o..... What's this??? Scanning Common Locations... OH-NO!!!!!!!!!! first of all E:\Moves and F:\TV are NOT COMMON LOCATIONS FOR PHOTOS Second, I REMOVED THOSE LOCATIONS.. It has a valid location listed, WHY IS IS LOOKING FOR SOMEWHERE ELSE????? Yes it's now scanning VIDEOS and the only reason for it to be taking so long is it went back to my E and F drive... lets look at the cache folder... oh yes, MediaCache already has 3,876 files in it.... not looking very good. Why is it caching files that are not even imported into lightroom??? and why is the cache for each file taking up more space than the entire video??? If you want to make a video cache.. just cache the THUMBNAIL ONLY!!!!! we don't need or want anything else cached.. a thumbnail is all we need cached for our few relevant videos so we don't have a black square in our catalog.

Crap, I'm going to be FORCED to revert to 6.1.1 even though I had every intention of working around the other 6.2.1 issues. TEST TEST TEST Test your software!!! the monkeys you have testing it are not doing a good enough job! send it to me, I'll test it for you, It needs to be tested on a real computer, one that is used for other things.. that way you would KNOW it's finding stupid things like CD cover art and every movie and tv show on my hard drive. I seem to find glaringly obvious issues within one day of using the product. I've been developing software for the last 28 years, I know how it should be done, and how things should be tested, and this is NOT being done AT ALL. Your programmers are sub-standard and are missing the mark, and your non-existent SQA department is NOT testing even the simplest of functions.
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes

Posted 4 years ago

  • 31
Photo of Audrey Julian

Audrey Julian

  • 9 Posts
  • 2 Reply Likes
Test results...

Identified Cache Directories
(DIR 1) /Users/username/Library/Caches/Adobe/Lightroom/Video/Media Cache Files
(DIR 1) /Users/username/Library/Application Support/Adobe/Common/Media Cache Files

General Usage
PASS - Turn off Secure Erase in Finder (Command + , then Advanced, then uncheck "Empty trash securely"
PASS - Delete all files DIR 1
PASS - Delete all files DIR 2
PASS - Empty Trash 
PASS - Change DIR 1 to read only
PASS - Change DIR 2 to read only
PASS - Launch Lightroom 
PASS - Able to see video thumbnails in grid view
PASS - Able to move mouse over video files and see various time points in grid view
FAIL - Able to play the video in Loupe view - error message “There was an error working with the video”
PASS - Able to see photo thumbnails in grid view
PASS - Able to see photo thumbnails in Loupe View

Import Usage
PASS - Test directory 1 photo file and 1 video file
PASS - Able to see preview of photo in grid view
FAIL - Able to see video preview in gride View - error message “Preview unavailable for this file”
PASS - Able to see preview of photo in Loupe View
FAIL - Able to see video preview in Loupe View - error message “Could not read preview”
PARTIAL FAIL - Import both files - photo imported but video file import failed.

Summary
The failure behavior here is acceptable and more in line with my expectations. My guess, because I was able to move mouse over already imported video files and see various different points in time in the grid view, there is another cache directory out there representing those files. The question is whether or not that 3rd directory has cache data beyond the 6 video files I've accidentally imported into Lightroom. I am hoping that further import data usage will be stable, but given the existence of a likely 3 directory, I will still continue to monitor disk usage.


Simon, any idea where this 3rd directory might reside on the hard drive?
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1574 Posts
  • 514 Reply Likes
Once Lightroom was able to successfully retrieve the thumbnails for videos from the DLMS, it would store the thumbnails as regular preview files in the Lightroom preview system. It is the folder named something like *Previews.lrdata next to your catalog.
Photo of Audrey Julian

Audrey Julian

  • 9 Posts
  • 2 Reply Likes
I ran mdfind kind:folder "Previews" from terminal and only the following came up. I don't see anything with either Adobe or Lightroom in this list. Is that a Windows or a Mac piece of advice?


/Users/username/Pictures/Photos Library.photoslibrary/Previews /Users/username/Downloads/My15 Selected Photos/My15 Select Photos - Lightroom Export/My15 Select Photos Previews.lrdata /Library/Application Support/Apple/Photos/Print Products/Themes/Picture_Book_Photos_OSX.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/YearInReview-Postcard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/YearInReview-FoldedCard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/Travelogue.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/SquareBySquare.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/PremiumClassic-FoldedCard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/Portfolio.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/PictureCard-Postcard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/PictureCard-FoldedCard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/Picture-Calendar.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/PhotoEssay-Large.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/ModernLines-Large.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/ModernLines-Calendar.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/Journal-Large.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/HolidayColors-Postcard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/HolidayColors-FoldedCard.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/BigDate-Calendar.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Themes/BentoBox.pptheme/Contents/Resources/ThemePreviews /Library/Application Support/Apple/Photos/Print Products/Previews /Users/username/Library/Application Support/HandBrake/Previews /Users/username/Pictures/iPhoto Library.migratedphotolibrary/Previews /Users/username/Library/Mobile Documents/com~apple~Keynote/iWorkPreviews /Users/username/Library/Mobile Documents/com~apple~Pages/iWorkPreviews /Users/username/Library/Mobile Documents/com~apple~Numbers/iWorkPreviews
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1574 Posts
  • 514 Reply Likes
If your Lightroom catalog is located at

/Users/username/Pictures/Lightroom/Lightroom 6 Catalog.lrcat

Then Lightroom preview files is located at 

/Users/username/Pictures/Lightroom/Lightroom 6 Catalog Previews.lrdata
Photo of Audrey Julian

Audrey Julian

  • 9 Posts
  • 2 Reply Likes
Thanks. There is no folder in that location called "Preview", but the size of the entire Lightroom directory is reasonable around ~8 GB at this point. So if the the cache files for video in the catalog that permit for mouse scrolling in the application are only located there, then I think I've found everything. 

I will still keep a close eye on things and if I spot any other caching directories, I vill be back ~
Photo of Rune Flaaten Bjørk

Rune Flaaten Bjørk

  • 1 Post
  • 0 Reply Likes
Hi there

For some reason I'm not able to import or play videos in Lightroom CC 2015, v4 anymore. I'm getting this message at import. Purging the video cache did not solve the problem. Please help :-)
Rune


Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1574 Posts
  • 514 Reply Likes
Try repair user folder permission tip to see if it helps. See https://feedback.photoshop.com/photoshop_family/topics/lightroom-cc2015-4-locks-up.
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4974 Posts
  • 1935 Reply Likes
Can you please confirm this is fixed for you in the 2015.5 / 6.5 update released today?  Thanks.
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
I will download it right now and try it!
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
Unfortunately this bug still exists in version 6.5, however they have made an improvement.  The cache STILL gets completely out of control, but when you exit lightroom, it deletes a lot, but not all of the erroneous files.

It's very easy to test and the problem shows up immediately.

Here are the precise steps I took to test it:
1. Upgrade to lightroom 6.5
2. Open Lightroom 6.5
3. Edit > Preferences Verify Video Cache size... Verified 1.0GB
4. Purge Video Cache
5. Verify Purge...  Verified Video cache located at C:\Users\James\AppData\Local\Adobe\Lightroom\Caches is now 3Kb
6. click Import
7. select Drive E:  (a drive which happens to have existing video on it
8. DO NOT SELECT ANYTHING FOR IMPORT
9. DO NOT CLICK THE IMPORT BUTTON.. just looking at the import screen here....
10.Check video cache... in the amount of time it took to switch to the folder, it is now 850+GB
11. CANCEL import dialog...
12. continue to monitor Video cache.... keeps growing..
13. in the time it took me to type this, it has grown to 8GB
14. check contents of C:\Users\James\AppData\Local\Adobe\Lightroom\Caches\Video\Media Cache Files
15.  it's filling up with HUGE copies of the videos that are on my E Drive,  not just the folder I was looking at... but EVERY folder on the entire drive.. these files are HUGE even larger than the original video files.
16. in the time it took for me to type #14 and # 15 it has increased to 8.5GB
17. Close lightroom
18. Surprisingly..  this is NEW for 6.5...  moments after closing lightroom 6.5, my video cache has suddenly reduced to 1.85GB.  The contents are still incorrect huge duplicates from videos on my E Drive, but there are now only 8 files.
19. Re-open lightroom
20 re-check video cache size.. still verified at 1.0GB
21 Purge Cache again
22 do not import
23 everything seems fine
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
I just repeated my test above.. and this time it did NOT clean up after I closed lightroom and in fact with lightroom closed it is STILL filling up my hard drive with videos from my E: drive.  It's up to 19GB and growing rapidly...

it does not always terminate the process
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
up to 34.6GB and I have to terminate Adobe Dynamic Link Manager.  I opened lightroom again and did not do an import and again it did reduce the files in the video cache,  this time down to 2.4GB

I tried a 3rd test,  I opened the import dialog, switched to drive E: closed the import,  as expected my cache began to grow out of control.. I closed lightroom,  waited for it to get to 7GB, then did NOT terminate Adobe Dynamic Link Manager,  but I just re-opened lightroom instead.. lightroom did knock back the cache to 1.5GB but it immediately continued to grow.. because Adobe Dynamic Link Manager was still running.. even after closing Lightroom again.. it was still running and still filling up my drive.   If I do not terminate Adobe Dynamic Link Manager, my C drive will become completely FULL and my computer will no longer function correctly.

Non-tehcnical lightroom users will not know how to terminate Adobe Dynamic Link Manager and this presents a very big problem for them.
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
After playing with this new version a while,  it's quite apparent that Adobe has been able to implement a system to delete these useless video cache when you open lightroom 6.5 and this is a good thing.. many users will suddenly have hundreds of GB suddenly free on their C: drives after they open lightroom 6.5 as these useless files are mostly removed, however after testing this over and over, I have found that it does not remove ALL the files, it always leaves between 1 and 4 files, but at least it's not thousands of files.

There is STILL no option to disable the video cache.. why not let me set it to zero? and in fact until this is completely resolved, why not make zero video cache the default?

While cleaning up things is helpful, nothing has been done about the actual problem which starts filling up your hard drive very very fast and for no reason.  The root bug has not been addressed at all and is still a very big problem.   Do I need to make a video to demonstrate this bug?  It is very easy to replicate and I have done so on more than one computer.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
I think 6.4 already implemented a cleanup at startup. So it sounds like there has been no further improvement.

Presumably the dynamiclinkmediaserver just runs amok whenever it gets launched, so it continues to fill the cache even after LR closes.

Ugh. This is still a pain in the rear. I find I have to cycle LR daily (or more) to keep it from blowing up my ssd.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Thanks for conducting a detailed test.
Photo of Simon Chen

Simon Chen, Principal Computer Scientist

  • 1573 Posts
  • 514 Reply Likes
In Lr 6.5, it is doing periodic cleaning up when needed. To fix the root cause, it will need a new version of the Dynamic Link Server that enforce its own limit across all its clients. Lr 6.5 does not have that. It is scheduled for a future update.
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
Dynamic Link Server is not even working correctly, when it runs out of control like this, it's not just ignoring limits, it's doing it WRONG.. the files it's generating are HUGE even larger than the original videos.. how is a file that is larger and will need to take longer to load in any way a cache of the original file?  

The problem is, sometimes Dynamic Link Server DOES work correctly, which leads me to believe the problem is something like this:

If Dynamic Link Server is executed with all the correct parameters and variables.  then it will work correctly.. but something in the import module is launching it with some incorrect parameter causing it to do what it is doing.... there is some parameter or variable un-initialized or un-defined, or defined incorrectly and THAT is causing the problem.

Go to the import module and analyze how Dynamic Link Server is being called when you select a source drive something in that procedure is launching it differently than when it is run correctly.
**EDIT Correction..  Go to import module and find where Dynamic Link Server is being launched and REMOVE IT.  it does not need to cache anything that has not been imported yet, and that's been part of the problem all along.  These files are just on a drive I was looking at,  Caching is being attempted prematurely.  Import first, then worry about caching things***

Yes this is a huge Dynamic Link Server bug because it should NEVER do what it is doing under ANY condition, and if it is launched with a missing or bad parameter or variable, it should spit out an error instead of going out of control, and it should have it's own checks to make it's doing something reasonable...

but my point here is that there is also something wrong with the way it is being launched that is different than other times when the video cache is built correctly.. with very small files representing actual videos in lightroom.   That error in the way it is launched is within lightroom and still exists and WILL still exist even after Dynamic Link Server is fixed

I hope the root of this problem will be solved soon. 
(Edited)
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
I don't think a 0 cache limit is the answer, because then you have no video thumbnails (at least that's what happens when you rename the dynamiclinkmediaserver to prevent it from running).

However, fixing the root cause is not merely a matter of the dynamiclinkmediaserver behavior. The very idea of creating a larger cache file for an entire video, when the original is potentially huge already, makes absolutely no sense for Lightroom, which can't edit the video anyway.

One of the following would be a far better approach for Lightroom:
- cache only a thumbnail image for the video, and run playback straight off the original file (if VLC can do it, surely Adobe can figure this out)
- cache the video, but at greatly reduced resolution and/or framerate, so that the cache file is much smaller than the original (this would be handy for quick previews, but seems like overkill)
Photo of James Richters

James Richters

  • 73 Posts
  • 32 Reply Likes
Your second option is how video cache is currently working.  The only time you get cache files as large or larger than the original is during the import cache bug.

If you do this quick test... purge the cache, then go to a lightroom catalog location where you have videos already imported... then go check out the cache,  you will see the video cache files are they are intended to be.. they are defiantly not the entire video, they are smaller files,  the largest seemed to be about 1/5 the size of the original video.  It is nice to set the preview frame, and I believe the cache is what enables you to do a quick preview by moving your mouse around inside the frame in grid view.   

I believe this test shows the cache working properly and while not ideal, it does seem to be under control and not just running wild.   I looked at two videos in a folder with 7 videos in it, and it cached the two I was looking at first, and then everything else in the folder,  which I guess makes sense.. perhaps to get me faster response if I did want to go preview something.. but it also cached videos from other folders as well.. a total of 13 videos were cached. so it could have a tighter control and only cache videos that I actually look at.  After running my test, my video cache settled in at 610MB and Dynamic Link server terminated by itself.

When looking at the cache, I see that most of the files there has a duplicate..  there are files like gopr0176.mp4 48000.cfa and gopr0176.mp4 48000_1.cfa both identical files. both exactly 119,296K  if you got rid of the duplicates my cache would only be 305MB.

The problem is this caching system was designed before SSDs have become so popular and so with everyone having 1TB hard drives for their C drive, they didn't have to care how many writes they made to a drive or how much space they gobbled up.  but now we do care about write efficiency and especially about space.   One good solution to both these issues would be to let us choose where the video cache is stored, the way we are able to choose where the camera raw cache is stored.  A lot of people with an SSD for their OS also have a mechanical drive for data, so giving the option to move the video cache to the much larger and non-write sensitive data drive makes perfect sense.

There are two very good reasons to prevent the above mentioned duplicates. first, there ARE a lot of users who have nothing but an SSD on their computer. second, if you do have a cache size limit (that works), why fill the allowable space with duplicates, it would be much better to have that allowable space for twice as much content, instead of wasting it with duplicates.


When the cache is running out of control during the import dialog, it's running in a way that is not how it is meant to run.  I can safely be completely disabled during the import dialog... you do not need to preview your videos during import, either just import them all and decide later, or if you aren't sure you want to import them, then just go browse your import source with windows and figure it out.

I agree that even with files 1/5 the size of the video, the cache is using up more space than it should for users who are mainly interested in photographs and who have space-sensitive SSDs  So I would really like to see an option for the video cache as to cache "thumbnails only" or "video Preview"  I would prefer thumbnails only, but I could see where some people might like the existing video preview, so why not give an option in the cache settings box?  

It would also be great to allow user control over the cache resolution or frame rate. so if someone did decide to use video preview mode, they could perhaps to 1 frame out of 1000 instead of 1 frame out of 100... just as an example there could be an option to help balance this..




Summary of action items:
1. disable caching during import.. it is not needed and that is the only time the problem shows up
2. fix dynamic link server so it can never run out of control under any circumstance
3. allow an option to cache thumbnails only or cache video preview
4. allow user to define location of video cache same as camera raw cache
5. make the cache more efficient.. there is no need for the duplicate files there.
Photo of Victoria Bampton - Lightroom Queen

Victoria Bampton - Lightroom Queen, Champion

  • 4974 Posts
  • 1935 Reply Likes
Thanks for the update. I'll leave the bug open!
Photo of TommoT

TommoT

  • 1 Post
  • 0 Reply Likes
Have the same problem... any progress to report?
thanks
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Nothing recently that I've seen. Lightroom completely filled my SSD a few days ago - 30Gb of cache. However, the problem is now semi-solved by a quit/open cycle, which triggers a purge of the cache.
Photo of Jury Lukin

Jury Lukin

  • 4 Posts
  • 2 Reply Likes
Thank you for your discussion.
I understand Adobe product management's task is to sell more copies of Lightroom via enabling video import in it.
But what can I do with video in Lightroom? Basically, nothing.
There is cheap Adobe Premiere Elements where I can do almost anything with video, why should I bother importing video in Lightroom?
So, the management told the programmers to integrate video import in Lightroom. And there is no way they will take it back.
So, we all have to clean Lightroom video cache folders every time after we browse drives with lots of video with Lightroom.

Or, as I've done - rename dynamiclinkmediaserver.exe to any other name (or delete entirely) hence disabling video import feature.

Just in case, your video cache files are ocated in 2 (TWO! places) (in Windows)
1st is Adobe Premiere/Adobe Lightroom shared cache
C:\Users\<you user name>\AppData\Roaming\Adobe\Common\Media Cache Files
2nd is Lightroom only cache
C:\Users\<your user name>\AppData\Local\Adobe\Lightroom\Caches\Video\Media Cache Files

Clear them, rename or delete dynamiclinkmediaserver.exe (make sure it's not currently running and caching another video you wouldn'd import) in 
C:\Program Files\Adobe\Adobe Lightroom\Helpers\DynamicLinkMediaServer\dynamiclinkmediaserver\1.0\

and you are free!
Photo of Matthias Kloppmann

Matthias Kloppmann

  • 1 Post
  • 0 Reply Likes
This reply was created from a merged topic originally titled LIGHTROOM - How to move the *video* cache location to another drive?.

In LR CC 2015, I can change the location for the camera raw cache, and limit its size. In the same preference panel, there is an option to limit the video cache, but no option to change its location. Currently, LR puts the video cache on my (small!) boot SSD, where I'd like to have it on my (big!) other SSD. That prevents LR from creating a slide show that combines images and video, as it runs out of cache memory (I observe the drive is full and the files sit in the LR app data folder (this is Windows). I do not even get an error message from LR, it runs forever -- however, once I then kill LR, the drive has enough space again. Currently I cannot use LR for that simple task.
Photo of Ken Frowley

Ken Frowley

  • 1 Post
  • 1 Reply Like
This reply was created from a merged topic originally titled Lightroom: How can I prevent Lightroom from filling my hard drive by caching vide....

Serious problem. I have an SSD drive of 120gb which I keep for basic program files windows etc. But LR can max out my drive in minutes which you can imagine is critical for a computer. I have a large internal drive for storage of large files but LR wont let me move the video cache location. Help !!!
Photo of Benjamin

Benjamin

  • 6 Posts
  • 2 Reply Likes
This reply was created from a merged topic originally titled Lightroom 2015.2.1: "Video/Media cache files" folder taking all hd space.

Hi,
"Library/Caches/Adobe/Lightroom/Video/Media files" cache
folder is eating ALL the available space of my HD. Videos files are constantly scanned and copied in this folder, even after purging the cache, and this directory out of control is now over 150 gb on my small SSD drive.

All my file are on an external storage drive for good reason.

I just can't use this software as it kills my HD space. There should be a way to limit the size of this folder (the option in the preferences DON'T have any effect on this folder) or move it. Better: we should be able to prevent this behavior: there is no point in limiting the size of this folder if the system keeps indexing videos continuously, overwriting files contantly to respect the size limit of the folder.

Disabling video caching would be best.
Photo of Andrew Freeman

Andrew Freeman

  • 6 Posts
  • 2 Reply Likes
This reply was created from a merged topic originally titled Lightroom video cache import bug causing large amounts of HD space to be used up,....

I think I've discovered a bug with LR: it seems to be creating a cache of videos without it being told to, or even importing the videos. LR also disobeys the preference of how much video cache to keep.

Last week I cleaned up my HD, so I knew exactly how much space I had on it.

Starting it up today I found I had 12GB less so I used a program that analyses the hard disk space.

It showed that in C:\Users\[User]\AppData\Local\Adobe\Lightroom\Caches\Video\[All subfolders]

were numerous cached MP4 files from tutorials that I have collated over the years.

These tutorials are on a memory stick and not on a HD.

Previously I had imported some images from the memory stick and copied them onto the HD via LR, so I knew that was where they had come from. I did not import any videos.

I deleted the video cache and tried the following:

1) Open the folder above
2) Insert the memory stick
3) Open LR (nothing happens)
4) Open the import dialogue box and select the memory stick as source, but not do anything, certainly do not import. (at this point notice that files start appearing in the above folders).
5) Cancel the import dialogue box. (notice that files are still going in the above folders)
6) Watch, with LR still open, the above folders bloat out.

I've repeated this several times with the same effect. As I type this it's still growing. I'm now up to 30GB... and it's still going.

My video cache is set to 1GB.

Anyone else had an issue or can repeat this?

32GB now.....

LR6.1,

Operating system: Windows 7 Home Premium Edition

Version: 6.1 [7601]

Application architecture: x64

System architecture: x64

Logical processor count: 4

Processor speed: 2.5 GHz

Built-in memory: 7862.7 MB

Real memory available to Lightroom: 7862.7 MB

Real memory used by Lightroom: 351.6 MB (4.4%)

Virtual memory used by Lightroom: 328.7 MB

Memory cache size: 2.0 MB

Maximum thread count used by Camera Raw: 1

Camera Raw SIMD optimization: SSE2

System DPI setting: 96 DPI

Desktop composition enabled: No

Displays: 1) 1366x768

Input types: Multitouch: No, Integrated touch: No, Integrated pen: Yes, External touch: No, External pen: Yes, Keyboard: No

D
Photo of santymontesdeoca

santymontesdeoca

  • 1 Post
  • 2 Reply Likes
I use an external SD card as a media "hard drive" on a Surface Pro 4 to extend 254GB of SSD hard drive.

This automatic cache creation is killing my Lightroom experience. Every time I import photos from a connected camera, my media SD card with a lot of videos gets opened by default, and just by previewing those videos in the import dialog, 40GB of media cache is automatically created (that is more than 15% of my hard drive...). I can't seem to be able to change the default location of the import dialog, which means that every time I want to import photos from my camera, 40GB of useless media cache gets created automatically, before I even navigate to the actual SD card with the photos to import.

The logic way to go about this is to create a media cache, but ONLY if the video files are imported, not just by previewing them...
Please fix this Adobe, Lightroom 6.6 still presents this issue.
Photo of Benjamin

Benjamin

  • 6 Posts
  • 2 Reply Likes
You must realize that it's been years that this problem exist. They just don't care.
They find it fantastic to impose full indexation of videos with no way to disable it.
Because the software is just unusable because of this I since moved to another product.
Photo of Jury Lukin

Jury Lukin

  • 4 Posts
  • 2 Reply Likes
Well, if you are workind on Windows machine, I suggested temporary solution above - delete dynamiclinkmediaserver.exe from Lightroom folder.
Unlit next program update, when you'll have to delete it again.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
That's an effective workaround, but it does have the unfortunate effect of eliminating video preview entirely.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
It would seem that Adobe doesn't care about this - it's gone ages without a fix. They're just using the product as a cash cow.
Photo of Mikalai Semianiuk

Mikalai Semianiuk

  • 1 Post
  • 2 Reply Likes
How many years you need to fix this problem, Adobe?
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Evidently more than 2. Foolish on Adobe's part - when an application has hidden perfomance drags, users will be dissatisfied without knowing exactly why, and they'll quit using it without giving a clear signal as to the cause. Just look around photo forums - what's the one thing LR users complain about (aside from having to actually pay for something)? Performance!
Photo of Rikk Flohr

Rikk Flohr, Official Rep

  • 5596 Posts
  • 1184 Reply Likes
Thanks for the reminder Mikalai, I've bumped this up to the team. 
Photo of jcmills4 .

jcmills4 .

  • 2 Posts
  • 1 Reply Like
Is this ever going to get fixed?!?
Photo of jcmills4 .

jcmills4 .

  • 2 Posts
  • 1 Reply Like
For everyone who struggles with this bug, you can use this as a workaround:

https://www.howtogeek.com/201930/how-to-automatically-delete-files-in-your-download-folder-on-a-sche...

Just change the download folder to the video cache file folder.
Photo of RzzB

RzzB

  • 25 Posts
  • 1 Reply Like
Many thanks for this - very helpful for all sorts of things.
One question - what happens if this runs when Lightroom is open and using this cache?
Photo of David Fidler

David Fidler

  • 4 Posts
  • 2 Reply Likes
If it runs while dynamiclinkmediaserver.exe is encoding some of the files, the deletes of the files will fail.  This will only work if dynamiclinkmediaserver.exe has already completed copying files into the cache already.
Photo of RzzB

RzzB

  • 25 Posts
  • 1 Reply Like
I just spent ages recovering from a full system C: SSD drive. Turned out to be this problem.

In preferences, Lightroom Cache is set to N: - and video cache is set to 3G.

Video cache on C: = over 60G :-(

Two years! Is there any development work happening on Lightroom, other than new lenses and mobile stuff - in which I have no interest?

Things seem to be at a standstill - and I'm paying out monthly.

Should I be looking elsewhere for my photo editing? 

Not impressed, not impressed at all. 
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
There is a new version, "Classic," that improves performance in a few areas, particularly previews and the grid view.

I'm not sure if it changes anything about the Dynamic Link Server behavior though. My guess is not.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Classic is much improved in some areas, particularly thumbnail and preview generation.

Video is, if anything, worse. It's status quo for the dynamiclinkmediaserver - it still seems to respect the new cache limit, at least between sessions. But performance loading large videos is poor and I've seen a few glitches, like failing to read .mov files until I restarted LR. Also, video display still consumes massive amounts of memory.

My guess is that the overall strategy is still just completely mismatched for the application. Pre-Classic, cached video files were uncompressed, making them ridiculously large on disk and in memory, and that doesn't seem to have changed. That might be useful for a video editor, but it's useless for LR. It would be far better to create a lo-res cache file, perhaps using just keyframes, with full audio but minimal video content.
Photo of David Fidler

David Fidler

  • 4 Posts
  • 2 Reply Likes
Here we go again...

Affected Lightroom Version: 7.0.1  (LR Classic)
Computer:  Surface Pro 3
Computer Disks:
  • C: 256GB SSD; system disk
  • D: 128GB Micro SD card in the built-in SD card reader; disk containing videos organized in folders by genre
LR Video Cache settings:
  • Limit video cache:  Checked
  • Maximize Size:  3GB
Issue Description:

Copies of videos from D: drive are added to the LR video cache directory when a user tries to import images.  This inevitably ends up filling up the system volume (C:) requiring manual intervention to delete the cached files, as the video cache size limit is not honoured.

Video Cache Folder: C:\Users\***** \AppData\Local\Adobe\Lightroom\Caches\Video\Media Cache Files

Steps to Reproduce:
  1. Per above configuration, copy video files onto Micro SD card and put into card reader
  2. Create directory c:\windows\temp\_deleteme_
  3. Copy some large files (in excess of 5 GB) into c:\windows\temp\_deleteme_
  4. Open Lightroom CC Classic (7.0.1)
  5. Click Import
  6. Windows Explorer: Open video cache directory; files are being created, including copies of the videos themselves (as CFA files - some of which are several gigs large)
  7. CMD Prompt:  tasklist | find "dynamiclinkmedia" ; this shows that dynamiclinkmediaserver.exe is running.  
  8. Click Cancel
  9. Click File / Exit  (close LR)
  10. Windows Explorer:  Video cache flies are still being created and all of the videos are being copied into the cache
  11. Task Manager: Sort processes by Disk and see that dynamiclinkmediaserver.exe is doing 100MB/s or more of disk activity - WTF?  LR is closed...
  12. Wait until disk fills up; sometimes, windows will tell you that your disk is full
  13. Monitor disk space; it drops down to about 128KB free, and then it appears to delete a file from the video cache to make more space for the next file.  Therefore, the process is thrasing writes to my SSD disk (thereby reducing the MTBF of it, effectively costing me money!)
  14. Delete the files from c:\windows\temp\_deleteme_; dynamiclinkmediaserver.exe consumes all remaining disk space with more cached files
  15. Monitor dynamiclinkmediaserver.exe until it dies (and the disk stops thrashing).  In my last test, when it was finally done, I was left with 31.2 MB free on C:
  16. Start Lightroom; wait 5 minutes - the video cache is eventually cleared (unless there is a hung dynamiclinkmediaserver.exe process, which does appear to happen sometimes).

Issue Details:


There are so many different things going wrong here it's amazing.  They are as follows:
  1. LR starts caching any files that are on the SD card immediately, even though I have not browsed into any directory that holds a video (they are all in subfolders).  I'm presuming that this is because D: is in a card reader and, for convenience purposes, card reader/external disks are displayed first because that's how many people get photos into their systems.
  2. dynamicmedialinkserver.exe does not honour the "LR Video Cache Size Limit" of 3.0 GB that I've set in Lightroom.  I don't care that LR deletes the cache the next time that it starts (provided that dynamiclinkmediaserver.exe has not hung)
  3. Adobe software is scanning and making copies of my files WITHOUT MY PERMISSION.  It should not be copying the videos.  I can understand LR wanting to make thumbnails of the videos - but I DO NOT GRANT ADOBE SOFTWARE PERMISSION TO PROACTIVELY SCAN MY DISKS FOR FILES AND MAKE COPIES OF THE FILES THAT IT FINDS
  4. Adobe software is actively decreasing the MTBF of my SSD disks because it is making unnecessary writes to my SSD.  I am not alone here - using SSD's for system volumes is now a ubiquitous configuration and so Adobe's software is actively causing unnecessary wear-and-tear on it's customer's hardware.  This happens in two ways:  1)  By filling up the disk, Adobe software is performing at least one write to every remaining sector of the disk.  2) By filling up the disk, it reduces the pool of sectors that other programs can write to, thereby more rapidly decreasing their MTBF
  5. Adobe software is thrashing both my CPU and my disks with unnecessary writes, causing slow performance impacts to other software on my computer.  Adobe software is, effectively, performing a denial of service attack on my computer.  This happens even AFTER I have closed Ligthroom!!!!!
  6. With legislation increasingly focusing on data protection and end user privacy, having programs that indiscriminately scan users disks for files is going to be an increasingly dangerous legal position to be in - not to mention that it is clearly antagonizing your user base.
  7. !!!!!ALL OF THESE THINGS HAPPEN EVERY TIME I USE LIGHTROOM!!!!!
Bugs like this have presented themselves in both Ligthroom and Premiere, going back as far 2014 (and possibly earlier).  The first post, alone, in this thread is over two years old. Come on guys, this has gone on long enough.

To date, I have not seen a single good explanation, from Adobe, as to why your software is performing a denial of service attack on my computer and why your software is actively reducing the effective lifetime of my hardware.

Adobe has clearly made a bad architectural decision and has implemented a very destructive process.  I can forgive bad architectural decisions (being an architect, my bad decisions have cost companies millions of $ over the years).  But this one has gone on for long enough.

!!!!!!!!!!!!!! PLEASE STOP CACHING VIDEO FILES !!!!!!!!!!!!!!
!!!!!!!!!!!!!! PLEASE STOP CACHING VIDEO FILES !!!!!!!!!!!!!!
!!!!!!!!!!!!!! PLEASE STOP CACHING VIDEO FILES !!!!!!!!!!!!!!
!!!!!!!!!!!!!! PLEASE STOP CACHING VIDEO FILES !!!!!!!!!!!!!!

Quite frankly, if someone were to contact me saying that a class action lawsuit against Adobe were underway seeking damages for this bug, I would add my name to the list in a heartbeat.
Photo of Jury Lukin

Jury Lukin

  • 4 Posts
  • 2 Reply Likes
sigh
I delete Dynamic Link Manager every time I upgrade or install Lightroom.
That's the only workaround here.
Photo of David Fidler

David Fidler

  • 4 Posts
  • 2 Reply Likes
Yep, I've read that in former posts. 

I don't know how much you know about the software industry so forgive me if I'm covering old ground here.  The job of any support person is to work on a problem until there is a workaround and then file a bug.  In the bug, they list the workaround and Product Management/Engineering assess each bug and assign it a priority.  Bugs that have "workarounds" are given the lowest priority because... well... there is a workaround.

This isn't a minor annoyance with an easy workaround. 

This is a bug that will impact a high percentage of LR users (potentially millions of users), and which causes significant, and unnecessary, wear and tear to their hardware.  And many of those people won't ever know it.  

A headline like that could be very damaging to Adobe.

That is the context that Product Management/Engineering need to see this bug under - not that it's just some annoyance with a workaround.
Photo of Jury Lukin

Jury Lukin

  • 4 Posts
  • 2 Reply Likes
Unfortunately, it's not a bug, it's an (unnesessary) feature.

Nobody in sane mind won't edit video in Lightroom, but The Marketing told that video import will boost sales.

And here we are.
Photo of David Fidler

David Fidler

  • 4 Posts
  • 2 Reply Likes
Jury - This isn't about importing videos - this is about LR scanning your entire disk and making copies of each video it finds, then deleting them - completely ignoring the cache max size.  

This is not a feature. This is a bug.

I understand your frustration but sarcasm sends the wrong message to product management. 

This is a bug.  

Say it with me...

This is not a feature. This is a bug.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Whether it's a bug or a feature, it's bad for users. But they probably get relatively few complaints because it happens behind the scenes.

For some of us, video preview is helpful because there are frequently video and stills of the same event. That makes disabling dynamiclinkmediamanager a very unnatractive workaround.

The real insanity of it is that there's no reason to cache video at all - you only need that for editing. VLC and 1000 other programs can play video right off the source file. Why can't Lightroom? LR's playback performance is worse than most, probably due to the cache lag.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
What they should really do is:
- create a still thumbnail for each video in the catalog (already happens)
- ditch the dynamiclinkmediamanager entirely
- open videos for playback in the system default or user-designated external player
If it takes more than a day to code and test that, something's wrong.
Photo of Tom Fiddaman

Tom Fiddaman

  • 61 Posts
  • 16 Reply Likes
Incidentally, this thread is marked "in progress," so I think this is ticketed as a bug somewhere.
Photo of Nils Hodys

Nils Hodys

  • 3 Posts
  • 1 Reply Like
This reply was created from a merged topic originally titled Lightroom Classic CC - Video Cache is literally exploding.

I've encountered a huge issue with the Lightroom cache today. I was sorting through my personal movie library on a network drive when my Mac freaked out about having no disk space left. When I looked into what was filling up my previously half empty drive, I saw that the Lightroom Video Cache took up 160GB (!!!). I didn't even open Lightroom today (!!!)



As if that wasn't enough, most of the original Files aren't even as big as the corresponding cache files!
Why is Lightroom doing that?! I now terminated every Adobe service in the background out of fear of it destroying my SSD! This ist absolutely unacceptable! Lightroom is on the Brink of being unusable with this issue!