Guide Local Feature Matching by Overlap Estimation
Ying Chen, Dihe Huang, Shang Xu, Jianlin Liu, Yong Liu
[AAAI-22] Main Track
Abstract:
Local image feature matching under large appearance, viewpoint, and distance changes is challenging yet important. Conventional methods detect and match tentative local features across the whole images, with heuristic consistency checks to guarantee reliable matches. In this paper, we introduce a novel Overlap Estimation method conditioned on image pairs with TRansformer, named OETR, to constrain local feature matching in the commonly visible region. OETR performs overlap estimation in a two-step process of feature correlation and then overlap regression. As a preprocessing module, OETR can be plugged into any existing local feature detection and matching pipeline, to mitigate potential view angle or scale variance. Intensive experiments show that OETR can boost state-of-the-art local feature matching performance substantially, especially for image pairs with small shared regions. Code will be available upon publication.
Introduction Video
Sessions where this paper appears
-
Poster Session 3
Red 2
-
Poster Session 8
Red 2
