I use milk chocolate ganache under my fondant on all my cakes. I have never had a complaint that it altered the taste of the cake or the filling.
Jennifer, https://www.facebook.com/PrimaCakesandCookies