A Spatiotemporal Approach to Extract the 3D Trajectory of the Baseball from a Single View Video Sequence
Objectives
To retrive the 2D baseball trajectory in a television broadcast
To reconstruct the 3D trajectory of the baseball using physical model
Difficults
Complex background containing objects similar to baseball
Post video effects such as man-made score table
Small size of baseball
Motion blur of baseball due to slow frame rate
White-on-white scenario: baseball overlap with white objects
Solution to 2D recognition
Background subjection, color filtering in IUV space, morphological filtering, pattern recognition
Spatiotemporal approach for global trajectory recognition
Solution to 3D reconstruction
Aerodynamic equation for depth estimation
Very accuracate, less than 0.1% error
Applications
Baseball pitching analysis
Baseball hitters training
Virtual baseball games
Publication
Hubert P. H. Shum and Taku Komura, "A Spatiotemporal Approach to Extract the 3D Trajectory of the Baseball from a Single View Video Sequence", Proceedings of the 2004 IEEE International Conference on Multimedia and Expo (ICME 2004) [BibTeX]