5 Replies Latest reply on May 8, 2015 11:46 AM by fnordware

    How to speed up compositing when using open exr files?

    flowstorm

      The main question is covered in the title but to help give you some background, here is a concise summary of my workflow:

       

      Hopefully someone can help.

       

      I produce 3d animations composited from .exr files saved out of 3ds max using vray.

      Usually I use separate .exr sequences for each of the render elements....rgb, reflections, material ids etc...rather than saving a single .exr sequence with all elements embedded within each frame.

      I do this for flexibility but am open to the idea of using the second approach above - certainly makes finding and replacing file sequences easier.

       

      I am finding the Extractor plugin a bit slow when loading multiple sequences of exrs and even one single sequence is so much slower than other file formats i may look at other floating point options.

      I have tried the new cache options for exr files in CC 2014 but it's still sluggish.

       

      Files are saved on a single internal sata 2tb hd drive but performance seems no different when compositing from an internal ssd or ssd in another pc over the network.

      Strangely, an external drive connected to usb 2 or 3 seems the fastest after several tests but still way slower than png, tiff etc...

       

      Any suggestions on improving my workflow for faster feedback from AE?

       

      Many thanks

       

        • 1. Re: How to speed up compositing when using open exr files?
          Mylenium Most Valuable Participant

          Nope. AE simply has the most awful EXR handling one can imagine. Even free apps like Blender or Natron work faster.

           

          Mylenium

          • 2. Re: How to speed up compositing when using open exr files?
            flowstorm Level 1

            Thanks Mylenium.

             

            Have you tried any other file formats as an alternative?

            I Tried saving out of max as 32bit tiff and hdr but get different results so ideally wanted to stick with exr.

            tiff's seem to have more noise in them! Simply saving the buffer out as different formats seems to give different results even though both are floating point files.

            Interestingly the exrs look slighty softer and hdrs save with a different gamma With more noise.

             

            looks like I will stick with exr for now and put up with slower speed.

            (Dont really want to buy Nuke just yet but it may come to that)

             

            Anyone else out there noticed this or found an alternative solution?

             

            Many thanks

            • 3. Re: How to speed up compositing when using open exr files?
              Mylenium Most Valuable Participant

              I stuck with 16 bit whenever possible. This has the advantage that the 3D Programs themselves do a conversion to integer values and it's therefore pretty much consistent across formats and applications based on standardized assumptions like this and that Gamma and sRGB space. 16bit TIFFs are pretty snappy in AE. The issues with float TIFFs and HDR files are pretty much expected, since as far as I know there is no fixed value range defined in the file format specs and everyone uses their own mish-mash. Inevitably you can't completely eliminate EXR, but you may wish to reserve it for things where you actually need it like normal or motion vector passes. in my admittedly hacky workflows inflating a 16bit file back to 32bit never made much of a difference to native 32bit files, but of course you may use subtly lit night scenes al lthe time where this could be of greater relevance than for my reasonably uniformly lit technical visualizations and motion graphics stuff...

               

              Mylenium

              • 4. Re: How to speed up compositing when using open exr files?
                flowstorm Level 1

                Thanks again Mylenium.

                 

                Just to clarify - I do save 3d renders out of Max as 16 bit (half float) .exr's

                I always like to save as some kind of floating point file to give me maximum options in post - especially useful for darkening slightly over exposed renders and getting information back out of the blown out highlights. Also, as 3d renders often take so much time to process, I like to save out as much information in the render file as possible.

                 

                So it seems I'm currently stuck with my current workflow, although I may try converting the .exr's to tiff's in AE and then comp with them (if there are no issues with highlights)

                 

                Thanks again for your help.

                • 5. Re: How to speed up compositing when using open exr files?
                  fnordware Level 3

                  When using multi-channel EXRs in AE, you probably want to turn on the Channel Cache. The more channels you have, the more it will speed things up. Everything you could ever want to know about it here.

                   

                  Comparing 16-bit EXRs to 16-bit TIFF isn't really a fair comparison because the 16-bit EXRs quickly become 32-bit float buffers inside AE. Working with 16-bit files in a 16-bit AE project will surely be faster than working 32-bit. It may even be the way to go if you're not taking advantage of any of the benefits of float.

                   

                   

                  Brendan