A General Dense Image Matching Framework Combining Direct and Feature-Based Costs

Abstract : Dense motion field estimation (typically optical flow, stereo disparity and surface registration) is a key computer vision problem. Many solutions have been proposed to compute small or large displacements, narrow or wide baseline stereo disparity, but a unified methodology is still lacking. We here introduce a general framework that robustly combines direct and feature-based matching. The feature-based cost is built around a novel robust distance function that handles key points and ``weak'' features such as segments. It allows us to use putative feature matches which may contain mismatches to guide dense motion estimation out of local minima. Our framework uses a robust direct data term (AD-Census). It is implemented with a powerful second order Total Generalized Variation regularization with external and self-occlusion reasoning. Our framework achieves state of the art performance in several cases (standard optical flow benchmarks, wide-baseline stereo and non-rigid surface registration). Our framework has a modular design that customizes to specific application needs.
Document type :
Conference papers
Complete list of metadatas

https://hal-cea.archives-ouvertes.fr/cea-01836523
Contributor : Vincent Gay-Bellile <>
Submitted on : Thursday, July 12, 2018 - 1:28:38 PM
Last modification on : Wednesday, January 23, 2019 - 2:39:23 PM

Identifiers

Citation

Jim Braux-Zin, Romain Dupont, Adrien Bartoli. A General Dense Image Matching Framework Combining Direct and Feature-Based Costs. IEEE International Conference on Computer Vision (ICCV), Dec 2013, Sydney, Australia. ⟨10.1109/ICCV.2013.30⟩. ⟨cea-01836523⟩

Share

Metrics

Record views

169