Skip to Main content Skip to Navigation
New interface
Conference papers

Kernel learning as minimization of the single validation estimate

Abstract : In order to prevent overfitting in traditional support vector kernel learning, we propose to learn a kernel (jointly with the cost parameter C) by minimizing the single validation estimate with a sequential linear filter algorithm. Additionally, we introduce a simple heuristic in order to improve risk estimation, which randomly swaps several points between the validation and the training sets. Contrarily to previous works, which use several validation sets to improve risk estimation, our strategy does not increase the number of optimization variables. This is easily done thanks to Karasuyama and Takeuchi's multiple incremental decremental support vector learning algorithm. A synthetic signal classification problem underlines the effectiveness of our method. The main parameters of the learned kernel are the finite impulse responses of a filter bank.
Complete list of metadata
Contributor : Léna Le Roy Connect in order to contact the contributor
Submitted on : Monday, May 9, 2022 - 3:59:38 PM
Last modification on : Tuesday, May 10, 2022 - 3:53:08 AM
Long-term archiving on: : Wednesday, August 10, 2022 - 8:06:01 PM


Files produced by the author(s)



Maxime Sangnier, Jérôme Gauthier, A. Rakotomamonjy. Kernel learning as minimization of the single validation estimate. 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP), Sep 2014, Reims, France. pp.6958855, ⟨10.1109/MLSP.2014.6958855⟩. ⟨cea-01830640⟩



Record views


Files downloads