Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

A majorization-minimization algorithm for nonnegative binary matrix factorization

Paul Magron 1 Cédric Févotte 2, 3 
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
2 IRIT-SC - Signal et Communications
IRIT - Institut de recherche en informatique de Toulouse
Abstract : This paper tackles the problem of decomposing binary data using matrix factorization. We consider the family of mean-parametrized Bernoulli models, a class of generative models that are well suited for modeling binary data and enables interpretability of the factors. We factorize the Bernoulli parameter and consider an additional Beta prior on one of the factors to further improve the model's expressive power. While similar models have been proposed in the literature, they only exploit the Beta prior as a proxy to ensure a valid Bernoulli parameter in a Bayesian setting; in practice it reduces to a uniform or uninformative prior. Besides, estimation in these models has focused on costly Bayesian inference. In this paper, we propose a simple yet very efficient majorization-minimization algorithm for maximum a posteriori estimation. Our approach leverages the Beta prior whose parameters can be tuned to improve performance in matrix completion tasks. Experiments conducted on three public binary datasets show that our approach offers an excellent trade-off between prediction performance, computational complexity, and interpretability.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.inria.fr/hal-03647772
Contributor : Paul Magron Connect in order to contact the contributor
Submitted on : Wednesday, April 20, 2022 - 8:59:13 PM
Last modification on : Monday, July 4, 2022 - 9:17:00 AM

File

main.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03647772, version 1

Citation

Paul Magron, Cédric Févotte. A majorization-minimization algorithm for nonnegative binary matrix factorization. 2022. ⟨hal-03647772⟩

Share

Metrics

Record views

32

Files downloads

9