L. Bottou, Large-scale machine learning with stochastic gradient descent, Proceedings of COMPSTAT'2010, pp.177-186, 2010.

M. Welling and Y. Teh, Bayesian learning via stochastic gradient Langevin dynamics, Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp.681-688, 2011.

Y. Lecun, Y. Bengio, and G. Hinton, Deep learning, Nature, vol.521, issue.7553, pp.436-444, 2015.

J. Bouchaud, L. F. Cugliandolo, J. Kurchan, and M. Mézard, Out of equilibrium dynamics in spin-glasses and other glassy systems, Spin glasses and random fields, pp.161-223, 1998.

H. S. Seung, H. Sompolinsky, and N. Tishby, Statistical mechanics of learning from examples, Phys. Rev. A, vol.45, pp.6056-6091, 1992.

L. Zdeborová and F. Krzakala, Statistical physics of inference: thresholds and algorithms. Advances in Physics, vol.65, pp.453-552, 2016.

Y. Deshpande and A. Montanari, Finding hidden cliques of size (N/e) in nearly linear time, Foundations of Computational Mathematics, vol.15, issue.4, pp.1069-1128, 2015.

J. Barbier, F. Krzakala, N. Macris, L. Miolane, and L. Zdeborová, Phase transitions, optimal errors and optimality of message-passing in generalized linear models, COLT'18, 2017.
URL : https://hal.archives-ouvertes.fr/cea-01614258

J. Barbier, M. Dia, N. Macris, F. Krzakala, T. Lesieur et al., Mutual information for symmetric rank-one matrix estimation: A proof of the replica formula, Advances in Neural Information Processing Systems, vol.29, pp.424-432, 2016.
URL : https://hal.archives-ouvertes.fr/cea-01568705

T. Lesieur, L. Miolane, M. Lelarge, F. Krzakala, and L. Zdeborová, Statistical and computational phase transitions in spiked tensor estimation, 2017 IEEE International Symposium on, pp.511-515, 2017.
URL : https://hal.archives-ouvertes.fr/cea-01555504

B. Aubin, A. Maillard, J. Barbier, F. Krzakala, N. Macris et al., The committee machine: Computational to statistical gaps in learning a two-layers neural network, Advances in Neural Information Processing Systems, 2018.
URL : https://hal.archives-ouvertes.fr/cea-01933130

A. David-l-donoho, A. Maleki, and . Montanari, Message-passing algorithms for compressed sensing, Proceedings of the National Academy of Sciences, vol.106, issue.45, pp.18914-18919, 2009.

F. Krzakala, C. Moore, E. Mossel, J. Neeman, A. Sly et al., Spectral redemption in clustering sparse networks, Proceedings of the National Academy of Science, vol.110, pp.20935-20940, 2013.
URL : https://hal.archives-ouvertes.fr/cea-01223434

B. Samuel, D. Hopkins, and . Steurer, Bayesian estimation from few samples: community detection and related problems, 2017.

J. Baik, G. Ben-arous, and S. Péché, Phase transition of the largest eigenvalue for nonnull complex sample covariance matrices. The Annals of Probability, vol.33, pp.1643-1697, 2005.

M. Iain, A. Johnstone, and . Lu, On consistency and sparsity for principal components analysis in high dimensions, Journal of the American Statistical Association, vol.104, issue.486, pp.682-693, 2009.

E. Richard and A. Montanari, A statistical model for tensor PCA, Advances in Neural Information Processing Systems, pp.2897-2905, 2014.

J. Samuel-b-hopkins, D. Shi, and . Steurer, Tensor principal component analysis via sum-ofsquare proofs, Conference on Learning Theory, pp.956-1006, 2015.

R. Ge and T. Ma, On the optimization landscape of tensor decompositions, Advances in Neural Information Processing Systems, pp.3653-3663, 2017.

G. Ben-arous, R. Gheissari, and A. Jagannath, Algorithmic thresholds for tensor PCA, 2018.

V. Ros, G. Ben-arous, G. Biroli, and C. Cammarota, Complex energy landscapes in spiked-tensor and simple glassy models: ruggedness, arrangements of local minima and phase transitions, 2018.

A. Anandkumar, R. Ge, D. Hsu, M. Sham, M. Kakade et al., Tensor decompositions for learning latent variable models, The Journal of Machine Learning Research, vol.15, issue.1, pp.2773-2832, 2014.

F. Krzakala and L. Zdeborová, Hiding quiet solutions in random constraint satisfaction problems, Physical review letters, vol.102, issue.23, p.238701, 2009.

A. Decelle, F. Krzakala, C. Moore, and L. Zdeborová, Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications, Physical Review E, vol.84, issue.6, p.66106, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00661643

F. Antenucci, S. Franz, P. Urbani, and L. Zdeborová, On the glassy nature of the hard phase in inference problems, Phys. Rev. X, 2018.
URL : https://hal.archives-ouvertes.fr/cea-01930645

A. Crisanti, H. Horner, and . Sommers, The spherical p-spin interaction spin-glass model, Zeitschrift für Physik B Condensed Matter, vol.92, issue.2, pp.257-271, 1993.

F. Leticia, J. Cugliandolo, and . Kurchan, Analytical solution of the off-equilibrium dynamics of a longrange spin-glass model, Physical Review Letters, vol.71, issue.1, p.173, 1993.

G. Ben-arous, A. Dembo, and A. Guionnet, Cugliandolo-Kurchan equations for dynamics of spin-glasses, Probability theory and related fields, vol.136, pp.619-660, 2006.

Y. Deshpande and A. Montanari, Information-theoretically optimal sparse PCA, IEEE International Symposium on, pp.2197-2201, 2014.

T. Lesieur, F. Krzakala, and L. Zdeborová, Constrained low-rank matrix estimation: Phase transitions, approximate message passing and applications, Journal of Statistical Mechanics: Theory and Experiment, vol.2017, issue.7, p.73403, 2017.
URL : https://hal.archives-ouvertes.fr/cea-01447222

M. Lelarge and L. Miolane, Fundamental limits of symmetric low-rank matrix estimation, Probability Theory and Related Fields, pp.1-71, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01648368

J. David, . Thouless, R. Philip-w-anderson, and . Palmer, Solution of'solvable model of a spin glass, Philosophical Magazine, vol.35, issue.3, pp.593-601, 1977.

A. Javanmard and A. Montanari, State evolution for general approximate message passing algorithms, with applications to spatial coupling. Information and Inference: A, Journal of the IMA, vol.2, issue.2, pp.115-144, 2013.

A. Crisanti and L. Leuzzi, Spherical 2+ p spin-glass model: An exactly solvable model for glass to spin-glass transition, Physical review letters, vol.93, issue.21, p.217203, 2004.

A. Crisanti and L. Leuzzi, Spherical 2+ p spin-glass model: An analytically solvable model with a glass-to-glass transition, Physical Review B, vol.73, issue.1, p.14412, 2006.

P. Cecil-martin, E. D. Siggia, and H. A. Rose, Statistical dynamics of classical systems, Physical Review A, vol.8, issue.1, p.423, 1973.

M. Mézard, G. Parisi, and M. Virasoro, Spin glass theory and beyond, 1987.

B. Kim and A. Latz, The dynamics of the spherical p-spin model: From microscopic to asymptotic, Europhysics Letters), vol.53, issue.5, p.660, 2001.

L. Berthier, G. Biroli, J. Bouchaud, W. Kob, K. Miyazaki et al., Spontaneous and induced dynamic fluctuations in glass formers. I. General results and dependence on ensemble and dynamics, The Journal of chemical physics, vol.126, issue.18, p.184503, 2007.

S. Sarao-mannelli, G. Biroli, C. Cammarota, F. Krzakala, P. Urbani et al., Langevin state evolution integrators, 2018.

T. Rizzo, Replica-symmetry-breaking transitions and off-equilibrium dynamics, Physical Review E, vol.88, issue.3, p.32135, 2013.
DOI : 10.1103/physreve.88.032135

URL : http://arxiv.org/pdf/1305.2070

S. Kirkpatrick, D. Gelatt, and M. P. Vecchi, Optimization by simulated annealing. science, vol.220, pp.671-680, 1983.

A. Crisanti and L. Leuzzi, Exactly solvable spin-glass models with ferromagnetic couplings: The spherical multi-p-spin model in a self-induced field, Nuclear Physics B, vol.870, issue.1, pp.176-204, 2013.

M. Mézard and A. Montanari, Information, physics, and computation, 2009.

S. Boucheron, G. Lugosi, and O. Bousquet, Concentration inequalities, Advanced Lectures on Machine Learning, pp.208-240, 2004.
URL : https://hal.archives-ouvertes.fr/hal-00751496

B. Satish, N. Korada, and . Macris, Exact solution of the gauge symmetric p-spin glass model on a complete graph, Journal of Statistical Physics, vol.136, issue.2, pp.205-230, 2009.

F. Krzakala, J. Xu, and L. Zdeborová, Mutual information in rank-one matrix estimation, 2016 IEEE Information Theory Workshop (ITW), pp.71-75, 2016.

M. Aizenman, R. Sims, and S. Starr, Extended variational principle for the sherringtonkirkpatrick spin-glass model, Physical Review B, vol.68, issue.21, p.214403, 2003.

J. Barbier and N. Macris, The adaptive interpolation method: A simple scheme to prove replica formulas in bayesian inference, Probability Theory and Related Fields, 2017.

A. E. , A. , and F. Krzakala, Estimation in the spiked wigner model: A short proof of the replica formula, 2018 IEEE International Symposium on Information Theory (ISIT), pp.1874-1878, 2018.

J. Mourrat, Jacobi equations for mean-field disordered systems, 2018.
URL : https://hal.archives-ouvertes.fr/hal-01913504

,. S. Dongning-guo, S. Shamai, and . Verdú, Mutual information and minimum mean-square error in gaussian channels, IEEE Transactions on Information Theory, vol.51, issue.4, pp.1261-1282, 2005.

H. Georgii, Gibbs measures and phase transitions, vol.9, 2011.
DOI : 10.1515/9783110850147

N. Macris, Griffith-Kelly-Sherman correlation inequalities: A useful tool in the theory of error correcting codes, IEEE Transactions on Information Theory, vol.53, issue.2, pp.664-683, 2007.

A. Montanari, Estimating random variables from random sparse observations, European Transactions on Telecommunications, vol.19, issue.4, pp.385-403, 2008.
URL : https://hal.archives-ouvertes.fr/hal-00290792

A. Coja-oghlan, F. Krzakala, W. Perkins, and L. Zdeborova, Information-theoretic thresholds from the cavity method, Proceedings of the 49th Annual ACM SIGACT Symposium on Theory of Computing (STOC), pp.146-157, 2017.
URL : https://hal.archives-ouvertes.fr/cea-01448087

H. Nishimori, Statistical physics of spin glasses and information processing: an introduction, vol.111, 2001.

F. Guerra and F. L. Toninelli, The thermodynamic limit in mean field spin glass models, Communications in Mathematical Physics, vol.230, issue.1, pp.71-79, 2002.

F. Ricci-tersenghi, G. Semerjian, and L. Zdeborová, Typology of phase transitions in bayesian inference problems
URL : https://hal.archives-ouvertes.fr/cea-01933097

. Leticia-f-cugliandolo, Course 7: Dynamics of glassy systems, Slow Relaxations and nonequilibrium dynamics in condensed matter, pp.367-521, 2003.

T. Castellani and A. Cavagna, Spin glass theory for pedestrians, Journal of Statistical Mechanics: Theory and Experiment, p.5012, 2005.
DOI : 10.1088/1742-5468/2005/05/p05012

URL : http://arxiv.org/pdf/cond-mat/0505032

E. Agoritsas, G. Biroli, P. Urbani, and F. Zamponi, Out-of-equilibrium dynamical mean-field equations for the perceptron model, Journal of Physics A: Mathematical and Theoretical, vol.51, issue.8, p.85002, 2018.
URL : https://hal.archives-ouvertes.fr/cea-01682940

L. Berthier, G. Biroli, J. Bouchaud, W. Kob, K. Miyazaki et al., Spontaneous and induced dynamic correlations in glass formers. II. Model calculations and comparison to numerical simulations, The Journal of chemical physics, vol.126, issue.18, p.184504, 2007.
DOI : 10.1063/1.2721555

URL : https://tsukuba.repo.nii.ac.jp/?action=repository_action_common_download&item_id=21263&item_no=1&attribute_id=17&file_no=1

R. Monasson, Structural glass transition and the entropy of the metastable states, Physical review letters, vol.75, issue.15, p.2847, 1995.

F. Zamponi, Mean field theory of spin glasses, 2010.

A. Crisanti and H. Sommers, The spherical p-spin interaction spin glass model: the statics, Zeitschrift für Physik B Condensed Matter, vol.87, issue.3, pp.341-354, 1992.
DOI : 10.1007/bf01309287

L. F. Cugliandolo and . Kurchan, Weak ergodicity breaking in mean-field spin-glass models, Philosophical Magazine B, vol.71, issue.4, pp.501-514, 1995.
DOI : 10.1080/01418639508238541

URL : http://arxiv.org/pdf/cond-mat/9403040

L. F. Cugliandolo and . Kurchan, On the out-of-equilibrium relaxation of the Sherrington-Kirkpatrick model, Journal of Physics A: Mathematical and General, vol.27, issue.17, p.5749, 1994.

F. Leticia, J. Cugliandolo, and . Kurchan, Aging and effective temperatures in the low temperature modecoupling equations, Progress of Theoretical Physics Supplement, vol.126, pp.407-414, 1997.