First, open up Windows Explorer, go to the "View" menu and select "List".
Your other choices will be "Thumbnails, "Tiles", "Icons", "List" and "Details". The default in XP for most folders is "Tiles". Icons are smaller than "Tiles".
Then go to Tools>Folder Options>Select the "View" tab>select the tab that says "Apply to all Folders".
All your folders will now have the "List" view.