Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure

Abstract : This paper presents a new efficient black-box attribution method based on Hilbert-Schmidt Independence Criterion (HSIC), a dependence measure based on Reproducing Kernel Hilbert Spaces (RKHS). HSIC measures the dependence between regions of an input image and the output of a model based on kernel embeddings of distributions. It thus provides explanations enriched by RKHS representation capabilities. HSIC can be estimated very efficiently, significantly reducing the computational cost compared to other black-box attribution methods. Our experiments show that HSIC is up to 8 times faster than the previous best black-box attribution methods while being as faithful. Indeed, we improve or match the state-of-the-art of both black-box and white-box attribution methods for several fidelity metrics on Imagenet with various recent model architectures. Importantly, we show that these advances can be transposed to efficiently and faithfully explain object detection models such as YOLOv4. Finally, we extend the traditional attribution methods by proposing a new kernel enabling an orthogonal decomposition of importance scores based on HSIC, allowing us to evaluate not only the importance of each image patch but also the importance of their pairwise interactions.
Complete list of metadata
Contributor : Paul Novello Connect in order to contact the contributor
Submitted on : Wednesday, July 6, 2022 - 3:15:28 PM
Last modification on : Sunday, October 2, 2022 - 3:40:33 AM


Files produced by the author(s)


  • HAL Id : hal-03715558, version 1
  • ARXIV : 2206.06219


Paul Novello, Thomas Fel, David Vigouroux. Making Sense of Dependence: Efficient Black-box Explanations Using Dependence Measure. 2022. ⟨hal-03715558v1⟩



Record views


Files downloads