Learning to Model Pixel-Embedded Affinity for Homogeneous Instance Segmentation
Wei Huang, Shiyu Deng, Chang Chen, Xueyang Fu, Zhiwei Xiong
[AAAI-22] Main Track
Abstract:
Homogeneous instance segmentation aims to identify each instance in an image where all interested instances belong to the same category, such as plant leaves and microscopic cells. Recently, proposal-free methods have received increasing attention due to their efficient pipeline, which straightforwardly generate instance-aware information to group pixels into different instances. However, they often fail to distinguish adjacent instances due to similar appearance, dense distribution and ambiguous boundaries of instances in homogeneous images. In this paper, we propose a pixel-embedded affinity modeling method for homogeneous instance segmentation, which is able to preserve the semantic information of instances and improve the distinguishability of adjacent instances. Instead of predicting affinity directly, we propose a self-correlation module to explicitly model the pairwise relationships between pixels, by estimating the similarity between embeddings generated from the input image through CNNs. Based on the self-correlation module, we further design a cross-correlation module to maintain the semantic consistency between instances. Specifically, we map the transformed input images with different views and appearances into the same embedding space, and then mutually estimate the pairwise relationships of embeddings generated from the original input and its transformed variants. In addition, to integrate the global instance information, we introduce an embedding pyramid module to model affinity on different scales. Extensive experiments demonstrate the versatile and superior performance of our method on three representative datasets.
Introduction Video
Sessions where this paper appears
-
Poster Session 3
Fri, February 25 8:45 AM - 10:30 AM (+00:00)
Red 3
-
Poster Session 7
Sat, February 26 4:45 PM - 6:30 PM (+00:00)
Red 3