.inf files are just info for windows, usually to let it know what a piece of hardware is, and what driver to use on that hardware.
Instaling the .inf file just copies that file to the windows\inf folder, where it can be refferenced for driver information. It won't hurt anything by letting it be there. If you feel like you must remove it, just go to your windows\inf folder and delete it.