Occasionally the icons will not display in Internet Explorer Remote Desktop Applications.
Open up the Remote Desktop Connection, usually found in Start > All Programs > Accessories. Click on the Options button. Configuring Local Resources