This website uses cookies

The website of the Fundació Politècnica de Catalunya uses its own and third-party cookies to improve the browsing experience and for statistical purposes. For more information about cookies you can consult the cookie policy.

Manage cookies
Allow all cookies

Campus in maintenance
User and / or password incorrect
You have no active environment
Your access has been restricted. Consultation with the department of administration
Due to technical problems, the virtual campus is inaccessible. We are working to solve it. Sorry for the inconvenience.
Username is not an email
Start   >  Events  >  Open Class "Deep Learning: The Transformer Revolution"
Date: 28-09-2022
Timetable: 8:00 pm to 9:30 pm
Location: Online
Contact: 937068035

An Open Class is to be held at 08:00 PM on wednesday 28-09-2022 on Postgraduate in Artificial Intelligence with Deep Learning (Face-to-face) and Postgraduate in Artificial Intelligence with Deep Learning (Online).

Deep learning has achieved remarkable results in fields including computer vision, speech recognition and natural language processing. Some of the most important breakthroughs in recent years have taken place thanks to the Transformer, a type of neural network based on the attention mechanism. This architecture, which initially brought about a significant improvement in machine translation, has revolutionised a wide range of research fields, and even impact beyond natural language processing.

In this talk, Gerard I. Gállego will provide an introduction to the Transformer and discuss its most important applications. The session will begin with an introduction to the attention mechanism, which is the main component of the Transformer. He will then define the modules that are part of its basic architecture. Afterwards, he will describe the best-known variants of Transformer, such as BERT and GPT-3, and their most important characteristics. Finally, he will present some applications of the Transformer that have transcended fields beyond written language processing from a more general point of view.

This openclass will take place in English.

The speaker

Gerard I. Gállego holds a degree in Telecommunication Technologies and Services Engineering from the Universitat Politècnica de Catalunya (UPC) and a master's degree in Advanced Telecommunication Technologies, specializing in Deep Learning for Multimedia Processing. He is PhD student in Machine Translation at the Department of Signal Theory and Communications at the UPC, and the co-director of the master's degree in Artificial Intelligence with Deep Learning at the UPC School.

The session will take place on-line using Google Meet.

As well, you can follow the Open Class using your mobile device by downloading the corresponding Google Meet application for your Android or iOS.

This event is open and free. To attend, please confirm using the "I Will attend". Limited places.