La prochaine séance du [GdT Programmation / séminaire IRILL ] est jeudi 09 février 2023 à 14h (salle séminaire, plateau Scai, Bâtiment Esclangon) :
Séance du jeudi 09 janvier 2023, 14h-16h : <-- Attention à l'horaire
Catarina Urban (Inria & École Normale Supérieure | Université PSL)
« Interpretability-Aware Verification of Machine Learning Software »
Machine learning (ML) software is increasingly being employed in high stakes or sensitive applications. This poses important safety, privacy, and non-discrimination challenges. As a consequence, research in ML verification rapidly gained popularity and demand for interpretable ML models is more and more pronounced. Interpretability and verification are typically seen as orthogonal concerns. Research in ML interpretability is mainly carried out in the ML community, while research in ML verification is mostly carried out in the formal methods community, without much communication and exchanges between these research areas. In this talk, we advocate for closing this gap by presenting our recent and ongoing work on interpretability-aware verification of ML software. On the one hand, we show how verification can aid interpretability by providing a new feature importance measure for support vector machines. On the other hand, we discuss how interpretability can guide verification by proposing a new saliency-guided robustness verification problem for deep neural networks. We conclude with plans and perspectives on future work.
En chair et en os en salle séminaire, plateau SCAI, bâtiment Esclangon, 1er étage. 4 place Jussieu, 75005 Paris métro Jussieu (lignes 7 et 10)