This paper proposes an improved method for multiple-object tracking in video using hierarchical kernel-based localization. First, all moving objects (e.g., hands, bodies) are detected in each frame.