An Open Class is to be held at 08:00 PM on wednesday 28-09-2022 on Postgraduate in Artificial Intelligence with Deep Learning (Face-to-face) and Postgraduate in Artificial Intelligence with Deep Learning (Online).
Deep learning has achieved remarkable results in fields including computer vision, speech recognition and natural language processing. Some of the most important breakthroughs in recent years have taken place thanks to the Transformer, a type of neural network based on the attention mechanism. This architecture, which initially brought about a significant improvement in machine translation, has revolutionised a wide range of research fields, and even impact beyond natural language processing.
In this talk, Gerard I. Gállego will provide an introduction to the Transformer and discuss its most important applications. The session will begin with an introduction to the attention mechanism, which is the main component of the Transformer. He will then define the modules that are part of its basic architecture. Afterwards, he will describe the best-known variants of Transformer, such as BERT and GPT-3, and their most important characteristics. Finally, he will present some applications of the Transformer that have transcended fields beyond written language processing from a more general point of view.
This openclass will take place in English.
The speaker
Gerard I. Gállego holds a degree in Telecommunication Technologies and Services Engineering from the Universitat Politècnica de Catalunya (UPC) and a master's degree in Advanced Telecommunication Technologies, specializing in Deep Learning for Multimedia Processing. He is PhD student in Machine Translation at the Department of Signal Theory and Communications at the UPC, and the co-director of the master's degree in Artificial Intelligence with Deep Learning at the UPC School.
The session will take place on-line using Google Meet.
As well, you can follow the Open Class using your mobile device by downloading the corresponding Google Meet application for your Android or iOS.
This event is open and free. To attend, please confirm using the "I Will attend". Limited places.
