-
1. Re: Found a significant LR4 speedup - regenerate ACR cache
SeanMcCormack Mar 21, 2012 7:41 PM (in response to jfriend0)Just check that the old preview cache isn't orphaned on the old drive and taking up space.
-
2. Re: Found a significant LR4 speedup - regenerate ACR cache
jfriend0 Mar 21, 2012 7:43 PM (in response to SeanMcCormack)1 person found this helpfulSeán McCormack wrote:
Just check that the old preview cache isn't orphaned on the old drive and taking up space.
I hit the Purge Cache button before changing the cache directory for that exact reason.
-
3. Re: Found a significant LR4 speedup - regenerate ACR cache
SeanMcCormack Mar 21, 2012 7:47 PM (in response to jfriend0)I just found the 'Like' button. Good man/woman/person.
-
4. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 2:49 AM (in response to jfriend0)For future reference, generating 1:1 previews (e.g. via library menu selection) also generates develop cache entries.
-
5. Re: Found a significant LR4 speedup - regenerate ACR cache
rosalynsam Mar 22, 2012 7:21 AM (in response to jfriend0)I have significant problems with near lock up in LR4 and have posted a discussion (it takes HOURS to import a couple hundred photos, minutes to load a photo just to view sometimes). There have been no suggestions in reply to my original post -so maybe I can tag along here for some assistance? Please? In LR, I opened the preferences (in Edit) and found that my Camera Raw Cache Settings were set at 1. GB maximum size, with the Video Cache set at 3.0 GB. Hate to be dense, but I want to be sure I am not causing with more problems.....so, I should purge cache on each first, then change maximum size to 100? Since mine is set on 1. that seems pretty drastic, since my system says it has 308 GB free out of 465.
I have an HP server which I can can use (instead of the default C drive which it is set to). My system is less than 2 years old, Windows 7- my processor is AMD Phenon(tm) II x 4 925 Processor. My hard drive back up has plenty of space - 4 terabytes. Could Purge Cache and change these settings in any way cause another problem? Should I change this to my hard drive -if so, would I use the same file location, except change to my server?
I have a Mac with the same cache settings, and it is lightening fast with LR3 compared to this. I really don't know how to ask the right questions -my knowlege about computer systems, etc. is limited.
-
6. Re: Found a significant LR4 speedup - regenerate ACR cache
SistersCountry Mar 22, 2012 1:39 PM (in response to rosalynsam)Rosalynsam,
The 1 Gb seems very low. I just checked my cache folder and it is actively using around 3 Gb and has not done extensive work since a last purge a few days ago. 100 Gb may be more than you need but I think suggestions to allot at least 20 Gb are common. Mine is set for 35 Gb but is probably more than needed. I believe that the Video cache is just for displaying video files in LR and has no effect on still photos.
I would not think putting your cache on a network server a good idea. Network connections are not fast compared to drive writes. You would want it on a fast local drive for best performance. If you have more than one drive you may want to see if separating the catalog and the photos helps out your performance at all.
Another thing to try would be to totally delete your Previews and see if letting them rebuild from scratch helps out at all.
-
7. Re: Found a significant LR4 speedup - regenerate ACR cache
Keith_Reeder Mar 22, 2012 1:47 PM (in response to SistersCountry)SistersCountry wrote:
Rosalynsam,
The 1 Gb seems very low.
50 gb here...
-
8. Re: Found a significant LR4 speedup - regenerate ACR cache
jfriend0 Mar 22, 2012 2:02 PM (in response to rosalynsam)rosalynsam wrote:
I have significant problems with near lock up in LR4 and have posted a discussion (it takes HOURS to import a couple hundred photos, minutes to load a photo just to view sometimes). There have been no suggestions in reply to my original post -so maybe I can tag along here for some assistance? Please? In LR, I opened the preferences (in Edit) and found that my Camera Raw Cache Settings were set at 1. GB maximum size, with the Video Cache set at 3.0 GB. Hate to be dense, but I want to be sure I am not causing with more problems.....so, I should purge cache on each first, then change maximum size to 100? Since mine is set on 1. that seems pretty drastic, since my system says it has 308 GB free out of 465.
I have an HP server which I can can use (instead of the default C drive which it is set to). My system is less than 2 years old, Windows 7- my processor is AMD Phenon(tm) II x 4 925 Processor. My hard drive back up has plenty of space - 4 terabytes. Could Purge Cache and change these settings in any way cause another problem? Should I change this to my hard drive -if so, would I use the same file location, except change to my server?
I have a Mac with the same cache settings, and it is lightening fast with LR3 compared to this. I really don't know how to ask the right questions -my knowlege about computer systems, etc. is limited.
One of my symptoms before fixing my cache was that importing was ridiculously slow (hours to import a few hundred images) so my experience does overlap with your symptoms. How big a cache you need depends upon what you're processing and how many you work on at a time. I presume the ACR cache (which is what I wrote about here) is mostly (or perhaps only) used for RAW images so it's most applicable if you shoot RAW. Secondly, you need to think about your working set of images (how many you work on at a time). What you want is a cache that is big enough to hold cached versions of every image in the set you work on. That way, you can import the images into LR which will build previews and fill the cache in the process and then you can go back and work on your images and they will all be precached. If your cache size is a little smaller that the working set, then by the time it gets to the end of building previews, the cache is full and it's kicking your first images out of the cache. Then, you go to start working on the first images and there's nothing cached so it keeps having to back to the RAW file for every new image. This is when it's going to be really slow. OTOH, if your cache is larger than your working set, then all images you are working on in a particular shoot can stay in the cache for the duration of working on them.
I think the norm for the ACR cache is around 50GB just to make sure it's big enough for a large shoot. 1GB is miniscule and won't be doing you much good at all.
-
9. Re: Found a significant LR4 speedup - regenerate ACR cache
Scooby007 Mar 22, 2012 2:12 PM (in response to jfriend0)Adobe recommends ACR cache of "10gb or more" for Lightroom
http://helpx.adobe.com/lightroom/kb/optimize-performance-lightroom.html
I think the norm for the ACR cache is around 50GB just to make sure it's big enough for a large shoot.
That would be one heck of a shoot - about 140,000 images! (with the cache per image for a 21mp capture averaging 350k)
-
10. Re: Found a significant LR4 speedup - regenerate ACR cache
jfriend0 Mar 22, 2012 2:15 PM (in response to Scooby007)B r e t t wrote:
Adobe recommends ACR cache of "10gb or more"
http://helpx.adobe.com/lightroom/kb/optimize-performance-lightroom.htm l
In practice how large an ACR cache you need would depend upon whether you work with RAW images, how big your RAW images are and what a typical working set of RAW images that you work with are (200, 500, 1000, etc...). The more you process together, the larger a cache you would need. I figure that 2x the max amount of images you ever import at a time is probably a good safe minimum to work on that particular shoot. So, since I sometimes come near to filling up two 16GB cards in a big sports shoot, a safe min for me would be 2x16 x 2 = 64GB. I set mine to 100GB.
-
11. Re: Found a significant LR4 speedup - regenerate ACR cache
Scooby007 Mar 22, 2012 2:24 PM (in response to jfriend0)I was simply passing along what Adobe - the author of the software - recommends.
I figure that 2x the max amount of images you ever import at a time is probably a good safe minimum to work on that particular shoot. So, since I sometimes come near to filling up two 16GB cards in a big sports shoot, a safe min for me would be 2x16 x 2 = 64GB. I set mine to 100GB.
The cache is not the same size as the capture. It's about 2 or 3% of the size (e.g. 97% smaller). Your 100gb is enough for almost 350,000 photos.
-
12. Re: Found a significant LR4 speedup - regenerate ACR cache
ssprengel Mar 22, 2012 2:24 PM (in response to jfriend0)I would think your ACR cache be 3 to 4 times larger than the total size of all the RAW images you want to work with at a time. I am saying that because the ACR cache contains the 3-colors-per-pixel versions of your 1-color-per-pixel RAW images and depending on if the data is compressed much if at all, it could be much larger than the RAW size of the corresponding image. If you normally barely fill up a 2GB card with your RAWs, then a 5-8GB cache might be ok. If you fill up a 32-GB card, then a 100-150GB cache would be ok.
-
13. Re: Found a significant LR4 speedup - regenerate ACR cache
Scooby007 Mar 22, 2012 2:31 PM (in response to ssprengel)I would think your ACR cache be 3 to 4 times larger than the total size of all the RAW images you want to work with at a time. I am saying that because the ACR cache contains the 3-colors-per-pixel versions of your 1-color-per-pixel RAW images and depending on if the data is compressed much if at all, it could be much larger than the RAW size of the corresponding image.
The cache is 97% smaller than the capture, not 3 to 4 times larger. Average cache size is 350kb. Just look on your HDD.
If you fill up a 32-GB card, then a 100-150GB cache would be ok.
If you fill up a 32gb card you need about 400mb for the acr cache in LR
-
14. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 2:59 PM (in response to jfriend0)In my experience, when Lightroom is operating normally, ACR cache hits generally have only a very minor effect on performance. If it has a big effect, I think you've got some wonky cachin' goin' on, like jfriendl0 had...
-
15. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 3:05 PM (in response to Scooby007)Interesting - I just checked my cache - old entries are very big - new entries are very small. How about that?
Perhaps there were some significant changes in what the cache does in Lr4???
-
16. Re: Found a significant LR4 speedup - regenerate ACR cache
Cornelia-I Mar 22, 2012 3:16 PM (in response to areohbee)Hi Rob,
Since I use DNG with fast load data embedded the ACR cache seems to be used much less.
That is a new LR4-feature.
Cornelia
-
17. Re: Found a significant LR4 speedup - regenerate ACR cache
jfriend0 Mar 22, 2012 3:26 PM (in response to ssprengel)ssprengel wrote:
I would think your ACR cache be 3 to 4 times larger than the total size of all the RAW images you want to work with at a time. I am saying that because the ACR cache contains the 3-colors-per-pixel versions of your 1-color-per-pixel RAW images and depending on if the data is compressed much if at all, it could be much larger than the RAW size of the corresponding image. If you normally barely fill up a 2GB card with your RAWs, then a 5-8GB cache might be ok. If you fill up a 32-GB card, then a 100-150GB cache would be ok.
I follow your logic, but when I look at my ACR cache which is virgin from LR4, it's full of files ~400KB in size whereas my D300 RAW files are around 13MB each. Either ACR is using a whole bunch of cache files for each image (seems unlikely) or they are caching something much smaller than a whole processed RAW file. There is a bit of mystery here. So, perhaps a few GB of size is enough to hold the working set of several shoots.
-
18. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 3:30 PM (in response to Cornelia-I)Hi Cornelia,
Right - I had forgotten about that. I wish they would have allowed non-DNG users to take advantage of that technology too, but since I don't use DNG, I wonder what the deal is in my case.
Rob
-
19. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 3:34 PM (in response to jfriend0)Something has definitely changed or is screwed up now.
Like you, my cache entries used to run about 5MB for 13MB D300 file. Now they are in the 400K range - whoa, that's quite a difference!
Haven't done any benchmarks since noticing this difference.
-
20. Re: Found a significant LR4 speedup - regenerate ACR cache
SistersCountry Mar 22, 2012 3:39 PM (in response to areohbee)And my largest is only 3.9 with an overwhelming majority closer to 500k. 12mp .arw raw files. All over the map from 99k to 999k for 95% of them.
-
21. Re: Found a significant LR4 speedup - regenerate ACR cache
Scooby007 Mar 22, 2012 3:44 PM (in response to jfriend0)I have cache going way back and the max is 3.9mb, with the average being 350k. In any case it is somehting like 75-95% smaller than the file, not 3 to 4 times bigger.
-
22. Re: Found a significant LR4 speedup - regenerate ACR cache
SeanMcCormack Mar 22, 2012 3:57 PM (in response to Scooby007)13 sounds big. 500k sounds about right for a standard preview. Have you been doing a lot of 1:1 preview recently? They should be bigger.
I'm moving to a DNG workflow for the Fast Load Data. Older non selects will go to Lossy DNG. They're already backed up as Raw and right now, I've probably mere thousands of shots I'd be lost without.
-
23. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 4:03 PM (in response to Scooby007)Pre Lr4, all cache entries were exactly the same size (and big), given the same preview settings (I can't remember if it was quality or resolution that affected it, but it was not what one might think), and the same model camera. Now, the sizes are image dependent, and small. Something has definitely changed, ACR-cache-wise, a lot, in my copy/system. Not using DNG.
-
24. Re: Found a significant LR4 speedup - regenerate ACR cache
Jim Wilde Mar 22, 2012 4:03 PM (in response to Scooby007)I was used to seeing cache entries in the 17mb range for my circa 25mb raw files. However a few days ago I purged my ACR cache, deleted my preview cache, then rebuilt 1:1 previews. Checking on the cache this evening I was surprised to find average cache entry size well below 1mb, probably about 400k. Just ran a quick test:
Copied 9 raw files, all more or less identical night shots (around 25mb each, hardly any variation) to my desktop. Then imported 3 each into LR2, LR3, and LR4, then checked the cache.
For the 3 LR2 imports, the cache entry was 17,404kb for each one, no variation
For the 3 LR3 imports, the cache entries were 497kb, 942kb, 942kb
For the 3 LR4 imports, the cache entries were 1218kb, 932kb, 327kb
Go figure. I have no idea of the significance of the huge difference between LR2 versus LR3&4.
-
25. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 4:07 PM (in response to Jim Wilde)Somebody needs to do some benchmarking!
-
26. Re: Found a significant LR4 speedup - regenerate ACR cache
SeanMcCormack Mar 22, 2012 4:07 PM (in response to areohbee)Just had a look. I've a mix of 500k and 8.8Mb files recently.
-
27. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 4:13 PM (in response to SeanMcCormack)All small for me since purging recently (minutes ago) - regardless of process version.
-
28. Re: Found a significant LR4 speedup - regenerate ACR cache
SeanMcCormack Mar 22, 2012 4:11 PM (in response to SeanMcCormack)Purged.. some of them were well old and despite the 50 gig limit I entered, it was 56Gb..
-
29. Re: Found a significant LR4 speedup - regenerate ACR cache
rosalynsam Mar 22, 2012 5:35 PM (in response to jfriend0)I purged the cache and increased it to 50GB - no significant improvement - if I try to scroll through the catalog, I may get a few that load quickly, (or not), then it will bog down, and take over a minute just to preview (load). Develop seems to work okay once I get to it. I don't even dare to try to load or export, because that was even worse previously - either locked up or exceedingly slow.
I am on a severe time crunch, so at this point, LR4 is unusable, so I want to revert back to 3.6 - how do I do that? I fear just removing LR4 from my system will cause more problems....any idea about that? I am so incredibly frustrated with Adobe, with the only support from Adobe requires me to pay to fix what I believe to be is their problem, unless I am missing something. I do appreciate the replies as to how to try to fix this.
Thanks in advance
-
30. Re: Found a significant LR4 speedup - regenerate ACR cache
jfriend0 Mar 22, 2012 5:39 PM (in response to rosalynsam)rosalynsam wrote:
I purged the cache and increased it to 50GB - no significant improvement - if I try to scroll through the catalog, I may get a few that load quickly, (or not), then it will bog down, and take over a minute just to preview (load). Develop seems to work okay once I get to it. I don't even dare to try to load or export, because that was even worse previously - either locked up or exceedingly slow.
I am on a severe time crunch, so at this point, LR4 is unusable, so I want to revert back to 3.6 - how do I do that? I fear just removing LR4 from my system will cause more problems....any idea about that? I am so incredibly frustrated with Adobe, with the only support from Adobe requires me to pay to fix what I believe to be is their problem, unless I am missing something. I do appreciate the replies as to how to try to fix this.
Thanks in advance
To know whether this cache change improved things, I would recommend purging the cache, then do some operation to an entire directory of images (I chose to change sharpening by one unit) and then tell it to regenerate previews. This will cause it to access every image in the directory and will rebuild the cache for that directory. After it's done rebuilding previews, you can then see if normal operations in that directory have an acceptable performance.
If things are still slow after rebuilding previews, then you obviously have a different issue than I did.
If you don't cause it to rebuild the cache by doing some operation that causes it to recache everything, then it will be hard to know whether things are slow just because it has to recache every RAW file on each access or because you have some other issue.
-
31. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 22, 2012 5:44 PM (in response to rosalynsam)I would definitely try to get to some ground zero, then work back up if possible, which means:
New catalog
import one new photo - same problem? import a half dozen more - problem now?
If it works when you have a freshly created catalog, catalog was the culprit.
Else:
Reboot machine
Reinstall Lightroom
Reboot machine
Try again... try other things...
R
-
32. Re: Found a significant LR4 speedup - regenerate ACR cache
Scooby007 Mar 22, 2012 6:07 PM (in response to areohbee)To know whether this cache change improved things, I would recommend purging the cache, then do some operation to an entire directory of images (I chose to change sharpening by one unit) and then tell it to regenerate previews. This will cause it to access every image in the directory and will rebuild the cache for that directory... If you don't cause it to rebuild the cache by doing some operation that causes it to recache everything, then it will be hard to know whether things are slow just because it has to recache every RAW file on each access or because you have some other issue.
Render 1:1 previews. It does the cache also
-
33. Re: Found a significant LR4 speedup - regenerate ACR cache
Lou Dina Mar 28, 2012 3:26 PM (in response to Scooby007)Man....I'm confused. I'm on a Mac, OSX 10.6.8 and always shoot and convert RAW CR2 files to DNG (Canon 5Dmk2) when importing to LR. I set my ACR cache to 35.0 GB and also purged it.
I edited a bunch of photos and synchronized them, just to make sure I had some changes. I generated some standard previews and also half a dozen 1:1 previews. My cache is totally empty....as in "NADA". There is not a single file there. I double checked to make sure I had the right folder and drive. Could the files be hidden or invisible? Could it be that I am shooting DNG files?
Even on the 1:1 previews, there is a delay when showing the image at 100% magnification. Going from one image to the next initially shows the image sharply, but just for a split second, and then it defocuses as if there was no cached preview at all. After 2-3 seconds, it comes back into sharpness. This is a brand new catalog (I decided to start from scratch, since the original transfer was a total dog).
Does this sound right??
Thx,
Lou
-
34. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 28, 2012 4:19 PM (in response to Lou Dina)I've been complaining about this for years - it's how Lightroom has always worked.
The develop module shows you, if not cached in ram, but cached on disk (ACR):
1. The present Library preview: good.
2. An initial develop view based on the cache: bad.
3. A final develop view: best.
If I had my way, it would just skip phase 2 altogether, unless there is no library preview avaliable.
Better still, invent a disk caching scheme that does more good - ACR caching makes for only very minimal performance improvement, at best < 15%.
Note: if cached in ram, then it's lightening fast.
Rob
-
35. Re: Found a significant LR4 speedup - regenerate ACR cache
Hal P Anderson Mar 28, 2012 4:29 PM (in response to Lou Dina)Lou,
I experienced something similar. Nothing appeared in the cache folder.
Try hitting the "Choose" button in your preferences and then choosing the folder that you want your cache kept in. I did that and that folder started filling up as I brought various raw files up in the Develop Module.
Hal
-
36. Re: Found a significant LR4 speedup - regenerate ACR cache
Lou Dina Mar 28, 2012 5:22 PM (in response to Hal P Anderson)Try hitting the "Choose" button in your preferences and then choosing the folder that you want your cache kept in. I did that and that folder started filling up as I brought various raw files up in the Develop Module.
Hal, thanks for the comment.
I did select "Choose" before I posted and again after reading your message (just to be sure), but nothing at all is being written to my cache folder, even after editing images. These are all DNG files.
Are you on a Mac or PC?
-
37. Re: Found a significant LR4 speedup - regenerate ACR cache
Hal P Anderson Mar 28, 2012 5:28 PM (in response to Lou Dina)Lou,
PC, and I did it with NEF files. If you have DNG and created them with fast load data, I think the ACR cache won't be used.
Hal
-
38. Re: Found a significant LR4 speedup - regenerate ACR cache
areohbee Mar 28, 2012 5:33 PM (in response to Lou Dina)Lou,
I'd be very interested in the results if you benchmark improvements resulting from fast-load data.
Rob
-
39. Re: Found a significant LR4 speedup - regenerate ACR cache
clvrmnky Mar 28, 2012 6:02 PM (in response to areohbee)Just a reminder that the ACR cache is used in a few places, mostly for read only. All you have to do is scroll through grid mode in the Library against some photos you haven't looked at in awhile, and you will see new entries. If you are like me and have a 4x4 grid in the library as a default, you will see 16 new cache files. You will know it is doing this if the grid previews are greyed-out at first.