Pixel Instruments - LipTracker

LipTracker is a non-invasive measurement tool for in-service lip sync analysis. After detecting a face in the video, LipTracker compares selected sounds in the audio with the mouth shapes that create them in the video. The relative timing of these sounds and corresponding mouth shapes (called Mutual Events or MuEvs) is analyzed to produce a measurement of the lip sync error. Audio offsets of up to ± 5 video frames can be measured. This unique approach of analyzing real time video and audio content does not require the insertion of cues, codes or watermarks into the program material. Therefore, LipTracker can be used at any point in the transmission path.

Download video presentation (32.90 MB)