CS Talk
Aldo Pacchiano
Host: Steve Zucker
Title: Learning Systems in Adaptive Environments. Theory, Algorithms and Design
Abstract:
Recent years have seen great successes in the development of learning algorithms in static predictive and generative tasks, where the objective is to learn a model that performs well on a single test deployment and in applications with abundant data. Comparatively less success has been achieved in designing algorithms for deployment in adaptive scenarios where the data distribution may be influenced by the choices of the algorithm itself, the algorithm needs to adaptively learn from human feedback, or the nature of the environment is rapidly changing. These are some of the most important challenges in the development of ML driven solutions for technologies such as interactive web systems, ML driven scientific experimentation, and robotics. To fully realize the potential of these technologies we will necessitate better ways of identifying problem domains and designing algorithms for adaptive learning.
To achieve this, in this talk I propose adopting a systems view of adaptive learning mechanisms along with the following algorithm design considerations 1) development of sample efficient and tractable algorithms, 2) generalization to unseen domains via effective knowledge transfer and 3) human centric decision making. I will give an overview of my work along each of these axes and introduce a variety of open problems and research directions inspired by this conceptual framing.
Bio:
Aldo is a Postdoctoral Researcher at Microsoft Research NYC. He obtained his PhD at UC Berkeley where he was advised by Peter Bartlett and Michael Jordan. His research lies in the areas of Reinforcement Learning, Online Learning, Bandits and Algorithmic Fairness. He is particularly interested in furthering our statistical understanding of learning phenomena in adaptive environments and use these theoretical insights and techniques to design efficient and safe algorithms for scientific, engineering, and large-scale societal applications.