Accurate 3D car pose estimation

F. Chabot (1) , M. Chaouch (1) , J. Rabarisoa (1) , C. Teuliere (2) , T. Chateau (2)

1 DIASI - Département Intelligence Ambiante et Systèmes Interactifs
2 IP - Institut Pascal

We propose a new approach for accurate car pose estimation in images using only a dataset of 3D untextured models. Our algorithm detects both a car and its 3D pose. It is based on the matching of 3D models with the car in the image. With a part detector based on Convolutional Neural Networks, interest points corresponding to predefined 3D parts are extracted from the image. Then, we use the car geometry to find which parts are relevant across viewpoints. Finally, a 2D/3D pose estimator is used to recover the 3D pose of the car. The main contribution is to learn appearance and geometry models from 3D models dataset only. Experiments show that the method is very competitive for car detection and coarse viewpoint classification and improves the 3D pose estimation over the state-of-the-art methods.

Keywords: Convolution; Image matching; Neural networks; Object detection; 3D models; 3D pose estimation; Car detection; Convolutional neural network; Geometry model; New approaches; Pose estimation; State-of-the-art methods; Image processing

Domains: Signal and Image processing

F. Chabot, M. Chaouch, J. Rabarisoa, C. Teuliere, T. Chateau. Accurate 3D car pose estimation. 2016 IEEE International Conference on Image Processing (ICIP), Sep 2016, Phoenix, AZ, United States. pp.3807-3811, ⟨10.1109/ICIP.2016.7533072⟩. ⟨cea-01841166⟩