Sidebar

mehrtash-harandi
Learning to Forget, Learning to Remember

Speaker: Associate Professor Mehrtash Harandi, Monash University

Date: April 30 2025, Wednesday
Time: 10:30 AM – 11:30 AM SGT
Venue: COM3 Meeting Room 20, (#02-59) 11 Research Link, Singapore 119391

 

Please register for the seminar here.

Abstract: 

Modern machine learning systems must navigate the dual demands of forgetting and retaining knowledge—whether to comply with data deletion requests or to adapt continually in dynamic environments. In this talk, I will present two of our recent works that address these challenges using principles from game theory and geometry.

The first part of the talk focuses on machine unlearning, where the goal is to selectively erase behaviors without retraining from scratch. We formulate the problem as a cooperative two-player game between a forgetting player and a preservation player, each proposing gradients toward their respective objectives. Drawing on Nash bargaining theory, we derive a closed-form update rule that guides the model toward a Pareto-optimal solution. We demonstrate the effectiveness of the resulting algorithm across both classification and generative tasks.

In the second part, I turn to the challenge of lifelong learning in State-Space Models (SSMs), particularly in the exemplar-free setting. We introduce a geometry-driven regularization method that operates on the infinite-dimensional Grassmannian. This framework captures the long-term dynamical behavior of SSMs over an infinite horizon and uses it to preserve prior knowledge—without relying on memory buffers or data replay. Our method achieves strong performance across multiple vision benchmarks, significantly reducing catastrophic forgetting while maintaining adaptability to new tasks.

Biography:

Mehrtash Harandi is an Associate Professor of AI in the Department of Electrical and Computer Systems Engineering (ECSE) and the Director of the AI discipline at the Faculty of Engineering, Monash University. His research focuses on machine learning, computer vision, and optimization, with particular interests in learning with limited supervision, continual and lifelong learning, optimization over structured spaces (e.g., Riemannian geometry), and responsible AI (e.g., machine unlearning). His work aims to make AI systems more adaptable, robust, and ethically aligned.

Before joining Monash, he was a Research Scientist at National ICT Australia (NICTA) and Data61-CSIRO, where he contributed to the development of several award-winning technologies, including a face detection and recognition system that received the Best Research and Development Software award (iAward National, Australia). His research has been recognized through competitive grants, including ARC Discovery and DARPA funding.

  • Home
  • Learning to Forget, Learning to Remember