Theses in Progress

Application of the Lottery Ticket Hypothesis in NLP and Early Pruning of Neural Networks

September 01, 2019 – ,

Investigate if the Lottery Ticket Hypothesis [1] also holds for NLP tasks. Additionally, the approach should be extended to investigate the amount of training necessary to identify winning tickets.

 

[1] Frankle, J., & Carbin, M. (2018). The lottery ticket hypothesis: Finding sparse, trainable neural networks. arXiv preprint arXiv:1803.03635.

 

 

Keywords: NLP, Deep Learning

Research Area(s): Knowledge & Educational Technologies

Tutor: Filighera, Christoph Rensing

Student: Tim Unverzagt

Theses in Progress