Nothing will happen to IE. It just stays there. Firefox is a separate browser all together. You need to keep IE for whenever you use Windows Update, or for other site compatibility issues. Some sites only work in IE...
I love Firefox, and I highly reccomend it.