Phase Diagram and Approximate Message Passing for Blind Calibration and Dictionary Learning

Abstract : We consider dictionary learning and blind calibration for signals and matrices created from a random ensemble. We study the mean-squared error in the limit of large signal dimension using the replica method and unveil the appearance of phase transitions delimiting impossible, possible-but-hard and possible inference regions. We also introduce an approximate message passing algorithm that asymptotically matches the theoretical performance, and show through numerical tests that it performs very well, for the calibration problem, for tractable system sizes.
Document type :
Journal articles
Liste complète des métadonnées

https://hal-cea.archives-ouvertes.fr/cea-01140799
Contributor : Emmanuelle de Laborderie <>
Submitted on : Thursday, April 9, 2015 - 3:23:28 PM
Last modification on : Friday, March 29, 2019 - 11:28:10 AM

Links full text

Identifiers

Collections

Citation

Florent Krzakala, Marc Mézard, Lenka Zdeborová. Phase Diagram and Approximate Message Passing for Blind Calibration and Dictionary Learning. IEExplore, 2013, Information Theory Proceedings (ISIT), 2013 IEEE International Symposium, pp.659 - 663. ⟨10.1109/ISIT.2013.6620308 ⟩. ⟨cea-01140799⟩

Share

Metrics

Record views

318