Tracking Facial Features Using Cluster of Point Distribution Models

Invention Summary:

Investigators at Rutgers have developed a technology for real time tracking of facial feature shapes and expressions on a non-linear manifold applied to pose prediction, expression recognition and eye tracking. The technology proposes a novel framework for tracking faces across large head rotations at near real time processing rate. It also provides an integration of shape registration and tracking frameworks for shapes lying on any manifold by approximating non-linearities as piece¬wise linear surfaces.

Market Application:

  • Monitoring driver alertness
  • Homeland security applications
  • Medical applications
  • Games and entertainment
  • Product placement applications in stores and customer related analysis of interest in products


Speed and accuracy. We use a dynamic analysis of the features (as opposed to static that all other methods do). The technology tracks the face across any generic movement. The frame¬work runs at real time and the tracking is robust to full head turning and for any head shape.

Intellectual Property & Development Status:

Patent pending; US 2008-0187174 A1

Rutgers ID: 2007-015
Information Technology
Physical Sciences
Andrea Dick
Senior Licensing Manager
Dimitris Metaxas
Atul Kanaujia
Homeland Security
Research Applications