I use italian meringue buttercream for almost all my cakes and you should see some of the stuff I stick to the sides, LOL. Go for it, just make sure the petals are rolled thin so they will be lighter in weight. ;) Good luck!
TheCakeChic