31/07/2018 - Διάλεξη | Overcoming the Challenges of Distributed Learning (Χανιά)

Την Τρίτη 31/7/2018 και ώρα 12:00, στο Μεγάλο Αμφιθέατρο του Κτηρίου Επιστημών, θα πραγματοποιηθεί ομιλία με τίτλο "Overcoming the Challenges of Distributed Learning" από τον Καθηγητή Dimitris Papailiopoulos (University of Wisconsin-Madison, USA).

Σύντομη περίληψη ομιλίας:

In this talk, I will highlight a few key challenges that limit our capacity to effectively deploy machine learning solutions in real distributed systems. I will first focus on communication bottlenecks during model training, and discuss how they lead to poor speedup gains when scaling out to hundreds of compute nodes.

I will present theoretical insights which suggest that we can only overcome these challenges either by building new classes of neural networks, or by designing novel training algorithms that require far less communication.

We will then focus on issues of robustness and discuss how model training is susceptible to hardware failures and adversarial attacks. I will explain how simple algebraic ideas, borrowed from coding theory, can be used to enable robust distributed training.

I will conclude with several open problems that lie in the intersection of machine learning, optimization, and distributed systems.

Αναλυτικές πληροφορίες: tuc.gr