Feedback

Faculté des Sciences appliquées
Faculté des Sciences appliquées
MASTER THESIS
VIEW 67 | DOWNLOAD 18

Transport protocol for machine/deep learning

Download
Chavet, Thibaut ULiège
Promotor(s) : Mathy, Laurent ULiège
Date of defense : 6-Sep-2018/7-Sep-2018 • Permalink : http://hdl.handle.net/2268.2/5513
Details
Title : Transport protocol for machine/deep learning
Author : Chavet, Thibaut ULiège
Date of defense  : 6-Sep-2018/7-Sep-2018
Advisor(s) : Mathy, Laurent ULiège
Committee's member(s) : Donnet, Benoît ULiège
Geurts, Pierre ULiège
Louppe, Gilles ULiège
Language : English
Discipline(s) : Engineering, computing & technology > Computer science
Institution(s) : Université de Liège, Liège, Belgique
Degree: Master en ingénieur civil en informatique, à finalité spécialisée en "computer systems and networks"
Faculty: Master thesis of the Faculté des Sciences appliquées

Abstract

[en] Datasets for machine learning can be very large in size, and are usually transferred to dedicated servers that have the computing power necessary for complex model training.
This transfer is done losslessly by TCP, but could allow some losses without affecting too much the quality of the trained model, which would make the transfer faster.

The first part of this work looks at how packet loss on different datasets affect the accuracy of the corresponding model, and how the different ways to deal with packet loss compare to one another. It finds that it is indeed possible to lose packets during the transfer without affecting the model too much, but it requires some data preparation to repair the files if parts of it
are lost, and some parts cannot be lost and are absolutely necessary to the files.

Using those results, a protocol is designed and implemented to transfer datasets partly by TCP and partly by UDP depending on which parts of the files are required or can be lost without too many consequences. Focus is mainly set on JPEG files.
Tests then show that the protocol can be indeed be faster, but parameters need to be set to the right values or the ratio speed/loss becomes too bad.


File(s)

Document(s)

File
Access master_thesis.pdf
Description: -
Size: 981.78 kB
Format: Adobe PDF
File
Access summary.pdf
Description: -
Size: 203.61 kB
Format: Adobe PDF

Annexe(s)

File
Access code.zip
Description: -
Size: 50.24 kB
Format: Unknown

Author

  • Chavet, Thibaut ULiège Université de Liège > Master ingé. civ. info., à fin.

Promotor(s)

Committee's member(s)

  • Donnet, Benoît ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Algorithmique des grands systèmes
    ORBi View his publications on ORBi
  • Geurts, Pierre ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Algorith. des syst. en interaction avec le monde physique
    ORBi View his publications on ORBi
  • Louppe, Gilles ULiège Université de Liège - ULiège > Dép. d'électric., électron. et informat. (Inst.Montefiore) > Big Data
    ORBi View his publications on ORBi
  • Total number of views 67
  • Total number of downloads 18










All documents available on MatheO are protected by copyright and subject to the usual rules for fair use.
The University of Liège does not guarantee the scientific quality of these students' works or the accuracy of all the information they contain.