Title: Pretraining is all you need

Abstract: This talk will discuss the role of pretraining as a general paradigm behind the progress in Deep Learning. After introducing the relevant concepts, the talk will highlight the use of pretraining in some of our research work, cutting across diverse domains such as Natural Language Processing and Crystal Property Prediction.

Bio: Pawan Goyal is an Associate Professor at the Department of Computer Science and Engineering, IIT Kharagpur. Prior to joining IIT Kharagpur, he received his B. Tech. degree in Electrical Engineering from IIT Kanpur in 2007 and his PhD degree from University of Ulster, UK in 2011. He was then a postdoctoral fellow at INRIA Paris Rocquencourt. His research interests include Natural Language Understanding, Information Retrieval and Sanskrit Computational Linguistics. He has published his research work in various top conferences including ACL, EMNLP, NAACL, KDD, SIGIR, WSDM, AAAI, IJCAI, as well as journals such as Computational Linguistics, ACM and IEEE Transactions. He was the recipient of Google India AI/ML research awards 2020 and INAE Young Engineers Award 2020.