photo taken from iStockphotos.
Any object that is less dense than water will float. Your observation can be explained if the orange peel is less dense than water, but the orange without the peel is slightly more dense than water. That's basically why the orange will float. Because the orange peel is less dense than the water and beacuse of the air that is in between the flesh and the skin, the orange will float. Lemons float in water too.