How to prove that for the radial basis function $k(x, y) = exp(-frac{||x-y||^2)}{2sigma^2})$ there is no finite-dimensional feature space $H$ such that for some $Phi: text{R}^n to H$ we have $k(x, y) = langle Phi(x), Phi(y)rangle$?
Best Answer
The Moore-Aronszajn theorem guarantees that a symmetric positive definite kernel is associated to a unique reproducing kernel Hilbert space. (Note that while the RKHS is unique, the mapping itself is not.)
Therefore, your question can be answered by exhibiting an infinite-dimensional RKHS corresponding to the Gaussian kernel (or RBF). You can find an in-depth study of this in "An explicit description of the reproducing kernel Hilbert spaces of Gaussian RBF kernels", Steinwart et al.
Similar Posts:
- Solved – Intuition behind RKHS (Reproducing Kernel Hilbert Space}
- Solved – Can someone provide a brief explanation as to why reproducing kernel Hilbert space is so popular in machine learning
- Solved – Are “kernel methods” and “reproducing kernel Hilbert spaces” related
- Solved – Understanding the reproducing property of RKHS
- Solved – Understanding the reproducing property of RKHS