If you don't want to use a registry editor you can simply right click the icon, select the General Tab, and check the box 'Hidden' ...
Then, to view/not view the icons open the Control Panel > Folder Options > View, and select the option you want there...