You are correct in that the integrated video unit disappears automatically and completely when you plug an AGP card.
Now, what you actually need to figure out is the correct setup of that AGP card - possibly including installation of the AGP drivers for the chipset you have there.