7 Replies Latest reply: Apr 12, 2012 1:00 PM by the_wine_snob RSS

    Conforming & Indexing of Files

    the_wine_snob CommunityMVP

      Wil Renczes, from Adobe, just posted a great outline of what happens with Conforming and Indexing of files on Import. He was replying in the PrPro forum, but you can substitute PrE for PrPro in his post, as they are the same here. He also addresses why/how Conforming can not take, and the program will do this every time that the Project is opened, though the processes have already taken place before.

       

      Wil writes:

       

      PPro generates two potential sidecar files for audio - PEK and CFA files.  The PEK file is simply a quick data pass of the audio data that allows the app to draw waveforms (ie it should be pretty quick) - the CFA files are required if the file source is either too slow to decode the audio in realtime (like some MPEG long GOP, for instance), or if there's a mismatch in the sample rate depth.  The idea is that the conform files will match your sequence's audio bitrate settings so that the app can play & mix audio in realtime.

       

      How does PPro track these additional files?  Every file that is imported is stamped with XMP, which is how we handle metadata on source files.  XMP creates a unique ID which the app uses as a lookup value when it wants to find the PEK & CFA files that it generated for a file.  So, usually, if you have a project where certain clips constantly reconform, it has something to do with XMP.  Why? Usually it's because XMP can't write to the file.  So, every time you launch PPro and open the same project, the media file has no XMP data, so it tries to generate a new ID, so any old CFA/PEK files have an ID mismatch and the app thinks it needs to generate new ones.

       

      Typical cases why XMP can't stamp files:

       

      - the media file is read-only.

      - the media's hard drive is read-only.

      - the file itself is corrupted/malformed, and XMP takes the safe route & decides not to try to write any additional data to the file.  (I've personally witnessed this occur with WAV files captured by a Tascam field recorder.)

      - someone deleted the XMP files by hand (certain media types have it as a sidecar .XMP file instead of embedded).  (Don't laugh - I recently encountered a case where people had instituted a server folder rule to delete all files on a network share that weren't .mpg. )

       

      A workaround you can try:

       

      There's a preference setting to turn off injecting XMP into your media.  If that setting is in effect, PPro will not rely on the XMP ID for the CFA/PEK files.

       

      One other note, if your problem is specific to MPEG files:  it might be that PPro isn't able to index the file properly.  If it can't index, it might be trying to re-index on each launch;  audio conforming always triggers after indexing.   So watch for it constantly indexing - if that's the case, all the XMP stuff I described above has nothing to do with the problem.  It's a side effect of something in the MPEG stream that we're barfing on.  If you do see it constantly re-indexing MPEG files, it would be really helpful to send in a sample so that we can examine the stream.

       

      Cheers Wil

       

      If someone is having problems with continuing Conforming, though it completed earlier, think about what Wil has said.

       

      Good luck,

       

      Hunt

        • 1. Re: Conforming & Indexing of Files
          the_wine_snob CommunityMVP

          Along with Wil's comments, here is a bit of background on the Conforming and PEK generation process. Premiere will need to Conform the Audio Stream to create the CFA files, which will be 48KHz and 32-bit, floating point, for accurate editing. Premiere can handle a lot of popular Sample-Rates and Bit-Depths, but some can create problems. The closer that the Audio Stream is to 48KHz 16-bit (the DVD/BD standard), the easier it is for Premiere to Conform. The farther away the Audio Stream from those specs., the longer that it will take. The total time to Conform is related to how far off the Audio Stream is, the Duration of the file(s) Imported and the speed of one's computer. The progress bar tells you how much Conforming has been done per file, and gives an indicataion of how much Conforming is left to do. It is a good practice to not touch the computer, while Conforming is on-going, as this can cause the process to stop (usually leading to truncated Audio), the program to crash/hang, or even the computer to crash/hang.

           

          The PEK file is the Waveform Display, that one sees, when the Audio Clip is placed onto the Timeline, or opened in the Source Monitor.

           

          The CFA and PEK files are stored in the Media Cache, and located where one sets them in the Edit>Preferences>Scratch Disks.

           

          For some background info on the Media Cache, see this ARTICLE.

           

          Hunt

          • 2. Re: Conforming & Indexing of Files
            Pedaling Duo Productions Community Member

            If you do see it constantly re-indexing MPEG files, it would be  really helpful to send in a sample so that we can examine the stream.

             

             

            Where would I look to see this indexing?

            • 3. Re: Conforming & Indexing of Files
              the_wine_snob CommunityMVP

              Where would I look to see this indexing?

               

              There is a progress bar in the lower-right of the GUI. The progress bar was blue, but in later versions of PrPro, I think that it is now yellow.

               

              For short Duration files on a fast system, this progress might well go by too quickly to even display. With longer Durations, or on slower systems, it will definitely appear.

               

              Hope that this helps,

               

              Hunt

              • 4. Re: Conforming & Indexing of Files
                Paraknight28 Community Member

                Could you please explain exactly how to get to the Preference about injecting XMP data and turning it off?

                • 5. Re: Conforming & Indexing of Files
                  the_wine_snob CommunityMVP

                  That would be a question to post to the appropriate forum for your version of PrPro.

                   

                  I do not have an answer for you, but feel certain that others will. If you are using PrPro CS 5, or 5.5, Colin, Wil or Todd can probably answer all of your questions.

                   

                  Good luck,

                   

                  Hunt

                  • 6. Re: Conforming & Indexing of Files
                    the_wine_snob CommunityMVP

                    Also, see the Adobe KB Article on Conforming Audio.

                     

                    Hunt

                    • 7. Re: Conforming & Indexing of Files
                      the_wine_snob CommunityMVP

                      For info on the Media Cache Database, see this Adobe KB Article.

                       

                      Hunt