Feedback

Faculté des Sciences appliquées
Faculté des Sciences appliquées
MASTER THESIS
VIEW 5 | DOWNLOAD 0

Master thesis : 3D object registration with deep learning

Download
Wallon, Robin ULiège
Promotor(s) : Van Droogenbroeck, Marc ULiège
Date of defense : 27-Jun-2022/28-Jun-2022 • Permalink : http://hdl.handle.net/2268.2/15685
Details
Title : Master thesis : 3D object registration with deep learning
Author : Wallon, Robin ULiège
Date of defense  : 27-Jun-2022/28-Jun-2022
Advisor(s) : Van Droogenbroeck, Marc ULiège
Committee's member(s) : Boigelot, Bernard ULiège
Phillips, Christophe ULiège
Greffe, Nathan 
Language : English
Discipline(s) : Engineering, computing & technology > Computer science
Institution(s) : Université de Liège, Liège, Belgique
Degree: Master : ingénieur civil en science des données, à finalité spécialisée
Faculty: Master thesis of the Faculté des Sciences appliquées

Abstract

[en] This thesis was realized within the company Euresys. The main objective is to implement an easy-to-implement deep learning solution to infer the pose of an object on a Zmap image acquisition to replace the existing non-deep learning solution from Euresys whose robustness could be improved. Indeed, the previous solution encounters difficulties when the object is far from being perpendicular to the point of view, as the solution is based mainly on 2D alignment. This new deep learning solution offers more flexibility to capture the object in any view.

Since obtaining annotation for the 3D object registration can be costly and time-consuming. Thus, synthetic images of the Zmap format are created by projecting a 3D model on a reference plane.

By exploring different existing methods, an extension of the model YOLOV5small to solve this task is proposed in two steps. First, a 2D object detector is designed to show us the feasibility of training a model on the synthetic dataset to infer predictions on the acquisition. In the process, we noticed that good results can be achieved by changing the reference plane of the Zmap acquisition during the test and by using appropriate data augmentation during training.

Then, an extension of the 2D model detector to infer the 3D object registration is proposed by discretizing the model space into viewpoints and adding a regression parameter to infer the in-plane rotation. Unfortunately, we did not obtain metrics of the accuracy of the prediction on the acquisition but proposed a comparaison between the acquisition and a synthetic reproduction. This gave us interesting results but we thought that they could be improved. For example, by using the refinement step (ICP) already used by Euresys for the previous solution which could help to have better results. This thesis concludes with information on potential improvements and scope extensions that could be made for further work.


File(s)

Document(s)

File
Access synthesis.pdf
Description: One page summary
Size: 209.85 kB
Format: Adobe PDF
File
Access master_thesis_report.pdf
Description: Thesis report
Size: 17.36 MB
Format: Adobe PDF

Annexe(s)

File
Access dataset_2D.zip
Description: Annexe to illustrate the synthetic dataset used for the 2D object detector
Size: 5.16 MB
Format: Unknown
File
Access test_set_300viewpoint.zip
Description: Annexe to illustrate the synthetic dataset used
Size: 5.75 MB
Format: Unknown
File
Access test_set_rotation_1view.zip
Description: Annexe to illustrate the synthetic dataset used
Size: 18.89 MB
Format: Unknown
File
Access test_set_rotation_300viewpoints.zip
Description: Annexe to illustrate the synthetic dataset used
Size: 43.11 MB
Format: Unknown

Author

  • Wallon, Robin ULiège Université de Liège > Master ingé. civ. sc. don. à . fin.

Promotor(s)

Committee's member(s)

  • Boigelot, Bernard ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Informatique
    ORBi View his publications on ORBi
  • Phillips, Christophe ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Dép. d'électric., électron. et informat. (Inst.Montefiore)
    ORBi View his publications on ORBi
  • Greffe, Nathan
  • Total number of views 5
  • Total number of downloads 0










All documents available on MatheO are protected by copyright and subject to the usual rules for fair use.
The University of Liège does not guarantee the scientific quality of these students' works or the accuracy of all the information they contain.