Skip to Main content Skip to Navigation
Journal articles

Phase transitions in optimal unsupervised learning

Abstract : We determine the optimal performance of learning the orientation of the symmetry axis of a set of P = $\alpha$N points that are uniformly distributed in all the directions but one on the N-dimensional space. The components along the symmetry breaking direction, of unitary vector B, are sampled from a mixture of two gaussians of variable separation and width. The typical optimal performance is measured through the overlap R$_{opt}$ = B $\dot$ J$^∗$ where J$^∗$ is the optimal guess of the symmetry breaking direction. Within this general scenario, the learning curves Ropt(α) may present first order transitions if the clusters are narrow enough. Close to these transitions, high performance states can be obtained through the minimization of the corresponding optimal potential, although these solutions are metastable, and therefore not learnable, within the usual bayesian scenario.
Document type :
Journal articles
Complete list of metadata

https://hal-cea.archives-ouvertes.fr/cea-02531330
Contributor : Arnaud Buhot Connect in order to contact the contributor
Submitted on : Friday, April 3, 2020 - 4:00:18 PM
Last modification on : Wednesday, July 6, 2022 - 4:24:53 AM

Links full text

Identifiers

Citation

Arnaud Buhot, Mirta Gordon. Phase transitions in optimal unsupervised learning. Physical Review E , American Physical Society (APS), 1998, 57 (3), pp.3326-3333. ⟨10.1103/PhysRevE.57.3326⟩. ⟨cea-02531330⟩

Share

Metrics

Record views

26