Extraction of object structure

A method was developed to automatically extract the structure (parts and joints) of objects (articulated, but also rigid). First, the movement and behavior of features (e.g. corner points) in a triangulated graph is analyzed over time in order to select interest points belonging to object parts (see Video 1 and 2). The corresponding triangles are labeled as relevant (on an ob-ject) or separating (connecting different objects). Look at Video 3 for a visualization. Then a Minimum Spanning Tree pyramid (see next result for details) is built to group relevant triangles and identify the `rigid' parts of the articulated foreground object (see Figure 1). Joints connecting the parts are determined and verified with the trajectories and orientation changes of the parts in the video sequence (see Figure 2). Related publications [37,42,51] (see publications).

Video 1: Tracking of features over time.

Video 2: Analysis of motion in a triangulated graph.

Video 3: Labeling of triangles as relevant (blue) and not relevant (gray).

Figure 1: Rigid parts of object identified with graph pyramid.

Figure 2: Found articulation points (joints) of foreground object.

Last modified: May 07, 2010 by Nicole M. Artner