Create cluster in XP (supercomputer)

[rob-antwerpen]

Quote:

Originally Posted by quickoldcar

Hi all,

For a long time I always wanted to combine my good and some of my useless computers together to make a sort of supercomputer. I recently played around and did tons and tons of reading and accomplished my goal. It's easier to do this with linux than with xp. There are Live CD's for linux that you simply just boot off of on all your computers and have an instant cluster. But I prefer to stick with XP and I'm used to it. So with that said I use a live cd version of linux called Knoppix.

I'm not an expert at this nor do I claim to know a lot about this subject.
What I am going to do for everyone is try to tell the easiest way to accomplish this task and mention a few things about it.

I run XP Professional on all my computers. I am using vmware Program (The free vmplayer is supposed to work also) . All my computers are networked together in a home filesharing environment. Meaning they are all on the same router. And it will do wireless usb's as well.

First item you'll need to get will be the latest copy of Clusterknoppix. Download the .iso image and save it in a folder somewhere on your computer. I use this for a number of reasons as I'll explain. The cluster in the title tells me there is a program called Openmosix already installed into the linux os. One less item for you to do. I seem to have less driver issues with the Knoppix versions of linux.

Get this: :: ClusterKnoppix - Get it while it's hot!

Some openmosix reading material: openMosix, an Open Source Linux Cluster Project

Vmware reading and information: VMware: Virtualization via Hypervisor, Virtual Machine & Server Consolidation - VMware

A good article describing clusterknoppix and openmosix: Craft a load-balancing cluster with ClusterKnoppix

Here is the order to make your cluster:

1. Have 2 or more running computers with XP operating systems.

2. Install Vmware program on all computers.

3. Start vmware , it will create a new virtual system inside xp.
(clusterknoppix will run inside this)

4. We now need to create a new virtual machine. Click "file", then "new", then "new vitual machine". To make this easy just keep clicking next untill you are done. Ignore what settings you choose.

5. Now we "edit virtual machine settings"

6. Highlight this: CD-ROM (IDE 1:0)
Checkmark "Use ISO image".........now browse for the .iso of your clusterknoppix and use that.

7. There are 2 tabs...Hardware and Options. You can go to options and rename your server if you like but isn't necessary.
The default settings for memory usage seem to work well and it's different on any machine you try it on. I suggest you keep default to try first.

8. Click "OK" and look towards the left side under commands. "Start the virtual machine". You should now see a Knoppix screen. Click inside the virtual window and hit enter to speedy things along. Knoppix should find all your drivers and be ready to go.

To get your "mouse is stuck inside virtual machine window" out you hit the shortcut which is Ctrl+Alt. You now have 1 machine set up and must do it on any others the same way I described above.

The nice thing about all this is that the openmosix program is already running and will autodetect the other computers. Wireless sometimes takes longer so be patient.
If you would like to see the openmosix program in action you click the yellow K at the lower left of the taskbar. Then scroll up to openmosix in the start menu.


Hopefully everything works out for you and you can get some good use from my somewhat of a tutorial. I wanted to say that this does a load-balancing network cluster and will share cpu power as well as alloted physical memory. helps me for doing some of my huge 3dmax renders I do. Otherwise I can not do them at all.

I'm sure there is many people out there wanting to be able to Run XP and also Linux at the same time. Well here you go.

If you just need to cluster a few computers together you can just burn a few clusterknoppix cd's. Then set the computers to boot from cdrom.

Clusterknoppix is a livecd and doesn't even require there to be a harddrive in the computer.


Here's my cluster: quickscluster.jpg - Image - Photobucket - Video and Image Hosting
and also
quickcluster4comps.jpg - Image - Photobucket - Video and Image Hosting

I use dual monitors and thats why the screen is so wide.

hi
another question
how can i see inside clusterknoppix which computers are connected?


thx,
rob

[ShyguyXPC]

ahhh, I see, when you mentioned solid works thought maybe was some sort of complex/hi-res rendering that needed to be done or something.

[hecavigo]

I don't quite understand if you are using the 3dmax directly in your xp or inside one of your vms. could you specify if there is a way you found to link the vm clusters to the host OS (in this case XP) so the applications running in XP get the benefit of extra CPUs/Memory?
btw Thanks for the Thread and the links associated, excellent info.

[spektyr]

I've been looking to see if there is a way to cluster XP systems and found this thread. I haven't tried it yet but I take it that this procedure creates a virtual Knoppix cluster running within XP but XP programs have no direct access to it and therefore cannot benefit from it. I may try booting the systems to clusterKnoppix and test it with Qosmic and Electric Sheep just to get a performance benchmark for my network, which consists of PIII and P4 systems.

It will be nice when more applications become CUDA compatible so that the new quad-Tesla systems can be used. Talk about the Ferrari of rendering machines! ;-)

Spek

"I'm a PC and I run Linux. B-p"