Stephen Kratzer | 19 Sep 20:01

clustering solution

All,

I'm looking for an enterprise-class clustering and virtual server solution 
that would allow me to:

- aggregate the resources of a large number of physical servers into 
allocatable pools of resources including CPU, memory, disk space, etc.
- create a large number of virtual servers which can each be allocated, with 
fine granularity, a fixed or variable amount of resources from each pool
- replicate virtual servers across clusters so that any cluster, in addition 
to running its own virtual servers, can act as a secondary, backup server for 
another cluster (with failover happening automatically in the event of an 
entire cluster failure or even a virtual server failure)
- easily manage clusters and virtual servers

Does anything currently available even come close, or is this wishful 
thinking?

Stephen Kratzer

Alex Barger | 19 Sep 20:08

Re: clustering solution


Take a look see
http://www.penguincomputing.com/cluster_computing/scyld_clusterware

-Alex
aka http://cruzinthegalaxie.com


On Fri, Sep 19, 2008 at 2:04 PM, Stephen Kratzer <kratzers-klZd6gPk7zM@public.gmane.org> wrote:
All,

I'm looking for an enterprise-class clustering and virtual server solution
that would allow me to:

- aggregate the resources of a large number of physical servers into
allocatable pools of resources including CPU, memory, disk space, etc.
- create a large number of virtual servers which can each be allocated, with
fine granularity, a fixed or variable amount of resources from each pool
- replicate virtual servers across clusters so that any cluster, in addition
to running its own virtual servers, can act as a secondary, backup server for
another cluster (with failover happening automatically in the event of an
entire cluster failure or even a virtual server failure)
- easily manage clusters and virtual servers

Does anything currently available even come close, or is this wishful
thinking?

Stephen Kratzer




_______________________________________________
CPLUG mailing list
To unsubscribe send a mail to cplug+unsubscribe-n/VI1dMKjLJeoWH0uzbU5w@public.gmane.org
Archives: http://dir.gmane.org/gmane.org.user-groups.linux.cplug.general


Ed Asbury | 19 Sep 23:35

RE: clustering solution

Here are a couple of other options you may want to consider;

 

Medium priced or no cost software;

RedHat Advanced Platform ($1500/server/year retail, but can be found cheaper) and Centos cluster suite (free and same as RedHats Advance Platform, but no support) that will take on hot failover of complete servers and/or virtuals for most every application except Samba (due to the nature of the Windows beast).  The downside is the limited support for fencing drivers though and it may take you quite some time to setup.  You can read a bit of an overview here; http://www.redhatmagazine.com/2007/08/23/automated-failover-and-recovery-of-virtualized-guests-in-advanced-platform/ .  

No Starch Press also has a book (“The Linux Enterprise Cluster”) about doing it on the cheap as long as you have a lot of time on your hands and enjoy recompiling kernels and “getting your hands dirty”.

 

On a considerably bigger budget; there is always VMware with VMotion, etc.

 

Ed Asbury

 

Ed Asbury | 19 Sep 23:38

RE: clustering solution

OOPS, migrating VM’s across clusters, I don’t know if RHAP will do that or not.

 

Ed Asbury

Re: clustering solution

To second Ed's mention, VMWare Infrastructure is really going to match
all of your needs.  It will take you about $3000 to get started with
it, but if you put that cost alongside the hardware you'll be using,
it starts to make sense.

ESX and ESXi are installed "bare-metal" on each physical server.
These are based on a Linux kernel.  ESX is a full-blown version for
about $500 and ESXi is free, but supports less hardware.
Virtual Center is what controls the ESX/ESXi servers.  For some reason
this only runs on Windows Server, which is odd considering their
commitment to Linux elsewhere.

So you setup your Virtual Center and install ESX/ESXi on your physical
machines.  The thing here is that you can just "throw" hardware at it
and build your virtual machines.  Virtual Center will look at what
resources is available and pick the best physical machines to move
your virtuals to, automatically (without downtime).  As you add
machines to the cluster, VMWare will move virtual machines as needed.

Another great feature is that it will try and consolidate your virtual
machines on as few physical machines as possible.  The unused physical
machines?  Placed into hybernate/sleep mode.  That way, instead of 20
machines doing very little, you end up with 12 machines working hard.
As more physical resources are needed, Virtual Center will wake up the
sleeping machines as needed and migrate with zero downtime.

Of course, there are overrides to lock virtuals in place or keep
virtuals from being moved to a physical host (for example, if you're
only testing new hardware and don't want it to be swamped with mission
critical virtual machines).

-John

On Fri, Sep 19, 2008 at 2:04 PM, Stephen Kratzer <kratzers@...> wrote:
> All,
>
> I'm looking for an enterprise-class clustering and virtual server solution
> that would allow me to:
>
> - aggregate the resources of a large number of physical servers into
> allocatable pools of resources including CPU, memory, disk space, etc.
> - create a large number of virtual servers which can each be allocated, with
> fine granularity, a fixed or variable amount of resources from each pool
> - replicate virtual servers across clusters so that any cluster, in addition
> to running its own virtual servers, can act as a secondary, backup server for
> another cluster (with failover happening automatically in the event of an
> entire cluster failure or even a virtual server failure)
> - easily manage clusters and virtual servers
>
> Does anything currently available even come close, or is this wishful
> thinking?
>
> Stephen Kratzer
>
>
>
>
> _______________________________________________
> CPLUG mailing list
> To unsubscribe send a mail to cplug+unsubscribe@...
> Archives: http://dir.gmane.org/gmane.org.user-groups.linux.cplug.general
>
>

--

-- 
John Hogenmiller - ytjohn@...
Used for mailing lists - sporadic response

Stephen Kratzer | 20 Sep 04:33

Re: clustering solution

Thanks everyone for the suggestions. I'll probably look into VMWare first.

----- Original Message ----- 
From: "John (yt) Hogenmiller" <ytjohn@...>
To: <cplug@...>
Sent: Friday, September 19, 2008 9:11 PM
Subject: Re: [CPLUG] clustering solution

> To second Ed's mention, VMWare Infrastructure is really going to match
> all of your needs.  It will take you about $3000 to get started with
> it, but if you put that cost alongside the hardware you'll be using,
> it starts to make sense.
>
> ESX and ESXi are installed "bare-metal" on each physical server.
> These are based on a Linux kernel.  ESX is a full-blown version for
> about $500 and ESXi is free, but supports less hardware.
> Virtual Center is what controls the ESX/ESXi servers.  For some reason
> this only runs on Windows Server, which is odd considering their
> commitment to Linux elsewhere.
>
> So you setup your Virtual Center and install ESX/ESXi on your physical
> machines.  The thing here is that you can just "throw" hardware at it
> and build your virtual machines.  Virtual Center will look at what
> resources is available and pick the best physical machines to move
> your virtuals to, automatically (without downtime).  As you add
> machines to the cluster, VMWare will move virtual machines as needed.
>
> Another great feature is that it will try and consolidate your virtual
> machines on as few physical machines as possible.  The unused physical
> machines?  Placed into hybernate/sleep mode.  That way, instead of 20
> machines doing very little, you end up with 12 machines working hard.
> As more physical resources are needed, Virtual Center will wake up the
> sleeping machines as needed and migrate with zero downtime.
>
> Of course, there are overrides to lock virtuals in place or keep
> virtuals from being moved to a physical host (for example, if you're
> only testing new hardware and don't want it to be swamped with mission
> critical virtual machines).
>
> -John
>
> On Fri, Sep 19, 2008 at 2:04 PM, Stephen Kratzer <kratzers@...> wrote:
>> All,
>>
>> I'm looking for an enterprise-class clustering and virtual server 
>> solution
>> that would allow me to:
>>
>> - aggregate the resources of a large number of physical servers into
>> allocatable pools of resources including CPU, memory, disk space, etc.
>> - create a large number of virtual servers which can each be allocated, 
>> with
>> fine granularity, a fixed or variable amount of resources from each pool
>> - replicate virtual servers across clusters so that any cluster, in 
>> addition
>> to running its own virtual servers, can act as a secondary, backup server 
>> for
>> another cluster (with failover happening automatically in the event of an
>> entire cluster failure or even a virtual server failure)
>> - easily manage clusters and virtual servers
>>
>> Does anything currently available even come close, or is this wishful
>> thinking?
>>
>> Stephen Kratzer
>>
>>
>>
>>
>> _______________________________________________
>> CPLUG mailing list
>> To unsubscribe send a mail to cplug+unsubscribe@...
>> Archives: http://dir.gmane.org/gmane.org.user-groups.linux.cplug.general
>>
>>
>
>
>
> -- 
> John Hogenmiller - ytjohn@...
> Used for mailing lists - sporadic response
>
>
>
>
> _______________________________________________
> CPLUG mailing list
> To unsubscribe send a mail to cplug+unsubscribe@...
> Archives: http://dir.gmane.org/gmane.org.user-groups.linux.cplug.general
>
> 


Gmane