There's no way to do this in Ch now, but I've added your request to our feature backlog.
Inside AE proper, you can do this using Convert Audio to Keyframes and drive the Y position of a jaw layer. See Adobe After Effects CS6 - Converting Audio to keyframes (Tutorial by VOXLAB) - YouTube for an example (though that one uses scale).
Can I second this feature request? It's cool that Nutcracker Jaw can actually watch my mouth, but I think a lot of us would prefer it be driven by sound. I'm having a hard time trying to open my mouth wide even for words where my mouth doesn't naturally open!
But I do want to mention how much I'm enjoying this tool - although no amount of reminders is going to stop me from hitting command-S.
On the contrary! I find the Nutcracker Behaviour as is now very good! I would and will post a feature request that will talk about the possibility to increase mouth shape control I think gives the best results and there's lots of potential there still encumbered.
I CAN speak softly with an very open mouth but I can not shout with my lips closed… That's one reason why I would challenge for the nutcracker to stay tuned to video, not audio.
EL Wombat, I think it would be an option that you could opt out of- like many of the properties that can be armed/ enabled or disabled in your scene recording settings.
I find myself acting to camera, trying to match a recorded voice track ( recorded in a proper sound both, with a pop guard etc, by voice talent). I was SOOOO grateful to find the 'analyze imported audio' feature, after having tried my best to live lip sync on several projects!
I just wish that the Nutcracker Jaw could use this analysis as well!
Making a formal feature request now
Since the original post in Jan 2016, we have added Audio Input and Audio Flappiness in Beta 6. This lets you move the mouth proportional to audio loudness. While it still doesn't support a direct connection to imported audio (like Timeline > Compute Lip Sync From Scene Audio), you can fake it out by importing an audio file and doing a real-time recording with Nutcracker Jaw > Audio Input armed for record. The audio will play out of the speaker and be heard by the microphone, thus driving the Jaw.
1 person found this helpful
Here's my workaround if you have pre-recorded audio and want to use a Nutcracker Jaw.
Connect a device that can play the audio to your computer using the line-in or mic jack.
Change the audio preferences in Character Animator to use that recording device (the line-in).
Change Nutcracker Jaw > Audio Input armed for record.
Adjusting the audio Flappiness while playing the audio through the line-in.
Finally, record the audio.
Then record your eye gaze, blinks, etc. however you like...
This is my work-around for "Compute Lip Sync from Scene Audio" for Nutcracker Jaws until an official feature is added.