It's not a good idea to completely get rid of Internet Explorer for one main reason. Internet Explorer and Windows Explorer ("explorer.exe" in the Task Manager) are pretty much one in the same. If you completely got rid of IE, you'd most likely be in for a fun reinstall of Windows.