Create cluster in XP (supercomputer)

[quickoldcar]

Hi all,

For a long time I always wanted to combine my good and some of my useless computers together to make a sort of supercomputer. I recently played around and did tons and tons of reading and accomplished my goal. It's easier to do this with linux than with xp. There are Live CD's for linux that you simply just boot off of on all your computers and have an instant cluster. But I prefer to stick with XP and I'm used to it. So with that said I use a live cd version of linux called Knoppix.

I'm not an expert at this nor do I claim to know a lot about this subject.
What I am going to do for everyone is try to tell the easiest way to accomplish this task and mention a few things about it.

I run XP Professional on all my computers. I am using vmware Program (The free vmplayer is supposed to work also) . All my computers are networked together in a home filesharing environment. Meaning they are all on the same router. And it will do wireless usb's as well.

First item you'll need to get will be the latest copy of Clusterknoppix. Download the .iso image and save it in a folder somewhere on your computer. I use this for a number of reasons as I'll explain. The cluster in the title tells me there is a program called Openmosix already installed into the linux os. One less item for you to do. I seem to have less driver issues with the Knoppix versions of linux.

Get this: http://clusterknoppix.sw.be/download.htm

Some openmosix reading material: http://openmosix.sourceforge.net/

Vmware reading and information: http://www.vmware.com/

A good article describing clusterknoppix and openmosix: http://www-128.ibm.com/developerwork...clustknop.html

Here is the order to make your cluster:

1. Have 2 or more running computers with XP operating systems.

2. Install Vmware program on all computers.

3. Start vmware , it will create a new virtual system inside xp.
(clusterknoppix will run inside this)

4. We now need to create a new virtual machine. Click "file", then "new", then "new vitual machine". To make this easy just keep clicking next untill you are done. Ignore what settings you choose.

5. Now we "edit virtual machine settings"

6. Highlight this: CD-ROM (IDE 1:0)
Checkmark "Use ISO image".........now browse for the .iso of your clusterknoppix and use that.

7. There are 2 tabs...Hardware and Options. You can go to options and rename your server if you like but isn't necessary.
The default settings for memory usage seem to work well and it's different on any machine you try it on. I suggest you keep default to try first.

8. Click "OK" and look towards the left side under commands. "Start the virtual machine". You should now see a Knoppix screen. Click inside the virtual window and hit enter to speedy things along. Knoppix should find all your drivers and be ready to go.

To get your "mouse is stuck inside virtual machine window" out you hit the shortcut which is Ctrl+Alt. You now have 1 machine set up and must do it on any others the same way I described above.

The nice thing about all this is that the openmosix program is already running and will autodetect the other computers. Wireless sometimes takes longer so be patient.
If you would like to see the openmosix program in action you click the yellow K at the lower left of the taskbar. Then scroll up to openmosix in the start menu.


Hopefully everything works out for you and you can get some good use from my somewhat of a tutorial. I wanted to say that this does a load-balancing network cluster and will share cpu power as well as alloted physical memory. helps me for doing some of my huge 3dmax renders I do. Otherwise I can not do them at all.

I'm sure there is many people out there wanting to be able to Run XP and also Linux at the same time. Well here you go.

If you just need to cluster a few computers together you can just burn a few clusterknoppix cd's. Then set the computers to boot from cdrom.

Clusterknoppix is a livecd and doesn't even require there to be a harddrive in the computer.


Here's my cluster: http://s57.photobucket.com/albums/g2...ckscluster.jpg
and also
http://s57.photobucket.com/albums/g2...ster4comps.jpg

I use dual monitors and thats why the screen is so wide.

[rob-antwerpen]

hi,

I was reading you article and it seems very simple
Were this the only things you did to make it work?

How much faster was your cluster?
Here in school i have the possibility to cluster 40 dualcore pc's 2,7 GHz with 2 GB RAM each
so i guess it should be pretty fast

cheers,
Rob
t.linders@ha.be

[quickoldcar]

I never did do any speed tests, but was a very big difference.

I used vmware, virtualpc2007 is free now, or can run the live cd's directly each computer.

What makes this great is that your cpu should never hit 100%, it will take from the "pool", and you should not run out of memory as easily.

40 dual cores and 80 gig physical memory, that would be pretty good I'd say.

You will still have to deduct any usage from the main os and clusterknoppix, but it didn't matter to me much when you have access to the "pool"

[bobthebob]

what all is shared? like if i do this with 2 computers each with a high end graphics card, will those also be shared and it be like i have 2 highend graphics cards plugged in or will the only graphics card in the main computer work?

[rob-antwerpen]

Hi again
Which software from VMware did you use; there are soo many!!!
I tried VMPlayer but that didn't work

thx

[rob-antwerpen]

hi

i installed vmware desktop and made a virtual machine that started up
the knoppix iso as descirbed (so far no problem :-))

But i use Solidworks and i don't seem to find it back.
Do i have to re-install SolidWorks in order to let it run?

Can i only use software that can run on knoppix?



thx,
Rob

[GroundZero3]

So my understanding is you are just running clustering Linux distribution in a vm application. How does this exactly help improve the performance of XP?

[J1mmy]

Interesting...

Do you have any comparison charts as to how well it increases performance? Do they do a similar like this to manage large traffic websites?

[ShyguyXPC]

Quote:

Originally Posted by rob-antwerpen

hi

i installed vmware desktop and made a virtual machine that started up
the knoppix iso as descirbed (so far no problem :-))

But i use Solidworks and i don't seem to find it back.
Do i have to re-install SolidWorks in order to let it run?

Can i only use software that can run on knoppix?



thx,
Rob

If your using Solidworks, doesn't it have a Network rendering feature or Render node aspect of it? allowing you to use multiple PC's on the network to assist in rendering? Most decent mid level to high end 3D CAD/CGI programs usually have something like that.

[rob-antwerpen]

Quote:

Originally Posted by ShyguyXPC

If your using Solidworks, doesn't it have a Network rendering feature or Render node aspect of it? allowing you to use multiple PC's on the network to assist in rendering? Most decent mid level to high end 3D CAD/CGI programs usually have something like that.

i don't know, but the main reason i want to use a cluster is for
fea calculations. In our present configuration some calculations tend
to take about 6-8 hours. Hopefully clustering will bring down the time


Rob