Probabilistic Dataset Reconstruction from Interpretable Models - Équipe Recherche Opérationnelle, Optimisation Combinatoire et Contraintes
Communication Dans Un Congrès Année : 2024

Probabilistic Dataset Reconstruction from Interpretable Models

Résumé

Interpretability is often pointed out as a key requirement for trustworthy machine learning. However, learning and releasing models that are inherently interpretable leaks information regarding the underlying training data. As such disclosure may directly conflict with privacy, a precise quantification of the privacy impact of such breach is a fundamental problem. For instance, previous work have shown that the structure of a decision tree can be leveraged to build a probabilistic reconstruction of its training dataset, with the uncertainty of the reconstruction being a relevant metric for the information leak. In this paper, we propose of a novel framework generalizing these probabilistic reconstructions in the sense that it can handle other forms of interpretable models and more generic types of knowledge. In addition, we demonstrate that under realistic assumptions regarding the interpretable models' structure, the uncertainty of the reconstruction can be computed efficiently. Finally, we illustrate the applicability of our approach on both decision trees and rule lists, by comparing the theoretical information leak associated to either exact or heuristic learning algorithms. Our results suggest that optimal interpretable models are often more compact and leak less information regarding their training data than greedily-built ones, for a given accuracy level.
Fichier principal
Vignette du fichier
article.pdf (780.91 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04189566 , version 1 (28-08-2023)
hal-04189566 , version 2 (02-04-2024)

Identifiants

Citer

Julien Ferry, Ulrich Aïvodji, Sébastien Gambs, Marie-José Huguet, Mohamed Siala. Probabilistic Dataset Reconstruction from Interpretable Models. 2nd IEEE Conference on Secure and Trustworthy Machine Learning, Apr 2024, Toronto, Canada. ⟨10.1109/SaTML59370.2024.00009⟩. ⟨hal-04189566v2⟩
399 Consultations
66 Téléchargements

Altmetric

Partager

More