Xen Cluster Management With Ganeti On Debian Lenny

Discussion in 'HOWTO-Related Questions' started by SAVERSERVER, Mar 23, 2010.

  1. SAVERSERVER

    SAVERSERVER New Member

    Hi,

    I have to "Xen Cluster Management With Ganeti On Debian Lenny."
    Once after I apt-get install ganeti and make adjustments dug a reboot, the system starts normally. Only the server under node1.example.com IP address 192.168.0.100 is not ping from other machines. The server is 192.168.0.100 but with the net on eth0.

    Has jeman a proposed solution?

    best regards
    loisl
     
  2. falko

    falko Super Moderator

    Can you post the outputs of
    Code:
    ifconfig
    and
    Code:
    route -nee
    on node1?
     
  3. SAVERSERVER

    SAVERSERVER New Member

    Hi falco,

    Many thanks you for your help

    if I boot with the normal kernel, the network connection is OK ...
    I can not do anything under XEN times out with a ping.

    ifconfig:
    Code:
    x602:~# ifconfig
    eth0      Link encap:Ethernet  Hardware Adresse 00:30:48:84:f0:94
              inet Adresse:192.168.178.118  Bcast:192.168.178.255  Maske:255.255.255.0
              inet6-Adresse: fe80::230:48ff:fe84:f094/64 Gültigkeitsbereich:Verbindung
              UP BROADCAST RUNNING MULTICAST  MTU:1500  Metrik:1
              RX packets:170 errors:0 dropped:0 overruns:0 frame:0
              TX packets:97 errors:0 dropped:0 overruns:0 carrier:0
              Kollisionen:0 Sendewarteschlangenlänge:100
              RX bytes:15130 (14.7 KiB)  TX bytes:13038 (12.7 KiB)
    
    lo        Link encap:Lokale Schleife
              inet Adresse:127.0.0.1  Maske:255.0.0.0
              inet6-Adresse: ::1/128 Gültigkeitsbereich:Maschine
              UP LOOPBACK RUNNING  MTU:16436  Metrik:1
              RX packets:8 errors:0 dropped:0 overruns:0 frame:0
              TX packets:8 errors:0 dropped:0 overruns:0 carrier:0
              Kollisionen:0 Sendewarteschlangenlänge:0
              RX bytes:560 (560.0 B)  TX bytes:560 (560.0 B)
    
    x602:~#
    
    route -nee:
    Code:
    x602:~# cat /root/route.txt
    Kernel-IP-Routentabelle
    Ziel            Gateway         Maske           Flags Metric Ref    Benutzer Iface    MSS   Fenster irtt
    192.168.178.0   0.0.0.0         255.255.255.0   U     0      0        0 eth0     0     0      0
    0.0.0.0         192.168.178.1   0.0.0.0         UG    0      0        0 eth0     0     0      0
    x602:~# route -nee
    Kernel-IP-Routentabelle
    Ziel            Gateway         Maske           Flags Metric Ref    Benutzer Iface    MSS   Fenster irtt
    192.168.178.0   0.0.0.0         255.255.255.0   U     0      0        0 eth0     0     0      0
    0.0.0.0         192.168.178.1   0.0.0.0         UG    0      0        0 eth0     0     0      0
    x602:~#
    
    /etc/network/interfaces:
    Code:
    # This file describes the network interfaces available on your system
    # and how to activate them. For more information, see interfaces(5).
    
    # The loopback network interface
    auto lo
    iface lo inet loopback
    
    # The primary network interface
    #allow-hotplug eth0
    #iface eth0 inet dhcp
    auto eth0
    iface eth0 inet static
            address 192.168.178.118
            netmask 255.255.255.0
            network 192.168.178.0
            broadcast 192.168.178.255
            gateway 192.168.178.1
            # dns-* options are implemented by the resolvconf package, if installed
            dns-nameservers 192.168.178.1
            dns-search saferwww.com
    
    /etc/hosts:
    Code:
    127.0.0.1       localhost.localdomain   localhost
    192.168.178.118   x602.saferwww.com     x602
    192.168.178.119   x606.saferwww.com     x606
    192.168.178.120   clu1.saferwww.com     clu1
    192.168.178.121   ins1.saferwww.com     ins1
    
    # The following lines are desirable for IPv6 capable hosts
    ::1     localhost ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters
    ff02::3 ip6-allhosts
    
    best regards
    loisl
     
    Last edited: Mar 25, 2010
  4. falko

    falko Super Moderator

    Is there a firewall on node1? What's the output of
    Code:
    iptables -L
    ?
    Is it possible that there's another system with the IP 192.168.178.118 in your subnet?
     
  5. SAVERSERVER

    SAVERSERVER New Member

    Hi falco,

    I have found the cause ...
    it has nothing to do with the network!

    if I have the changes to the /boot/grub/menu.lst I get to run the network problem:
    Code:
    [...]
    ## Xen hypervisor options to use with the default Xen boot option
    # xenhopt=dom0_mem=256M
    
    ## Xen Linux kernel options to use with the default Xen boot option
    # xenkopt=console=tty0 nosmp
    [...]
    I'm using now STANDARD:
    The network is now OK!
    What does this have implications for?
    Code:
    [...]
    ## Xen hypervisor options to use with the default Xen boot option
    # xenhopt=
    ## Xen Linux kernel options to use with the default Xen boot option
    # xenkopt=console=tty0 nosmp
    [...]
    cat /proc/cpuinfo:
    Code:
    602:~# cat /proc/cpuinfo
    processor       : 0
    vendor_id       : GenuineIntel
    cpu family      : 15
    model           : 4
    model name      :                   Intel(R) Xeon(TM) CPU 3.60GHz
    stepping        : 10
    cpu MHz         : 3600.316
    cache size      : 2048 KB
    physical id     : 0
    siblings        : 1
    core id         : 0
    cpu cores       : 1
    apicid          : 0
    initial apicid  : 0
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 5
    wp              : yes
    flags           : fpu de tsc msr pae cx8 apic sep mtrr cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc pni cid cx16 lahf_lm
    bogomips        : 7205.09
    clflush size    : 64
    cache_alignment : 128
    address sizes   : 36 bits physical, 48 bits virtual
    power management:
    
    processor       : 1
    vendor_id       : GenuineIntel
    cpu family      : 15
    model           : 4
    model name      :                   Intel(R) Xeon(TM) CPU 3.60GHz
    stepping        : 10
    cpu MHz         : 3600.316
    cache size      : 2048 KB
    physical id     : 3
    siblings        : 1
    core id         : 0
    cpu cores       : 1
    apicid          : 6
    initial apicid  : 6
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 5
    wp              : yes
    flags           : fpu de tsc msr pae cx8 apic sep mtrr cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc pni cid cx16 lahf_lm
    bogomips        : 7205.09
    clflush size    : 64
    cache_alignment : 128
    address sizes   : 36 bits physical, 48 bits virtual
    power management:
    
    processor       : 2
    vendor_id       : GenuineIntel
    cpu family      : 15
    model           : 4
    model name      :                   Intel(R) Xeon(TM) CPU 3.60GHz
    stepping        : 10
    cpu MHz         : 3600.316
    cache size      : 2048 KB
    physical id     : 0
    siblings        : 1
    core id         : 0
    cpu cores       : 1
    apicid          : 1
    initial apicid  : 1
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 5
    wp              : yes
    flags           : fpu de tsc msr pae cx8 apic sep mtrr cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc pni cid cx16 lahf_lm
    bogomips        : 7205.09
    clflush size    : 64
    cache_alignment : 128
    address sizes   : 36 bits physical, 48 bits virtual
    power management:
    
    processor       : 3
    vendor_id       : GenuineIntel
    cpu family      : 15
    model           : 4
    model name      :                   Intel(R) Xeon(TM) CPU 3.60GHz
    stepping        : 10
    cpu MHz         : 3600.316
    cache size      : 2048 KB
    physical id     : 3
    siblings        : 1
    core id         : 0
    cpu cores       : 1
    apicid          : 7
    initial apicid  : 7
    fpu             : yes
    fpu_exception   : yes
    cpuid level     : 5
    wp              : yes
    flags           : fpu de tsc msr pae cx8 apic sep mtrr cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall nx lm constant_tsc pni cid cx16 lahf_lm
    bogomips        : 7205.09
    clflush size    : 64
    cache_alignment : 128
    address sizes   : 36 bits physical, 48 bits virtual
    power management:
    

    THE NEXT PROBLEM:


    aptitude install drbd8-modules-`uname -r` drbd8-utils
    or better
    aptitude install drbd8-modules-2.6.26-2-xen-amd64 drbd8-utils

    echo drbd minor_count=64 >> /etc/modules
    modprobe drbd minor_count=64

    602:~# modprobe drbd minor_count=64
    FATAL: Module drbd not found.
    602:~#


    Many thanks you for your help and
    best regards
    loisl
     
    Last edited: Mar 26, 2010
  6. falko

    falko Super Moderator

    Please run
    Code:
    aptitude install drbd8-modules-`uname -r` drbd8-utils
     
  7. SAVERSERVER

    SAVERSERVER New Member

    Code:
    Please run
    Code:
    
    [CODE]aptitude install drbd8-modules-`uname -r` drbd8-utils
    [/CODE]

    sorry is not

    would like load drbd8-modules-`uname -r` == drbd8-modules-2.6.26-1-xen-amd64

    and not found !!!

    Many thanks you for your help and
    best regards
    loisl
     
  8. falko

    falko Super Moderator

    I think you should upgrade your kernel to 2.6.26-2-xen-amd64 first - then the other command should work.
     
  9. SAVERSERVER

    SAVERSERVER New Member

    DRBD is working OK.

    Why do I only have 128MB of memory available??

    Code:
    x602:/# gnt-node list
    Node              DTotal  DFree MTotal MNode MFree Pinst Sinst
    x602.saferwww.com 442600 442600   8191  7930   128     0     0
    x606.saferwww.com 442600 442600   8191  7930   128     0     0
    x602:/#
    Code:
    x602:/# gnt-instance add -t drbd -n x606.saferwww.com:x602.saferwww.com -o debootstrap -s 5g --swap-size 256 -m 256 --kernel /boot/vmlinuz-`uname -r` --ip 192.168.0.105 ins1.saferwww.com
    Failure: prerequisites not met for this operation:
    Not enough memory on node x606.saferwww.com for creating instance ins1.saferwww.com: needed 256 MiB, available 128 MiB
    x602:/#
    I test with 128MB and I get:
    Code:
    x602:/# gnt-instance add -t drbd -n x606.saferwww.com:x602.saferwww.com -o debootstrap -s 5g --swap-size 256 -m 128 --kernel /boot/vmlinuz-`uname -r` --ip 192.168.0.105 ins1.saferwww.com
    * creating instance disks...
    adding instance ins1.saferwww.com to cluster config
     - INFO: Waiting for instance ins1.saferwww.com to sync disks.
     - INFO: - device sda:  2.60% done, 767 estimated seconds remaining
     - INFO: - device sdb: 12.40% done, 41 estimated seconds remaining
     - INFO: - device sda:  7.30% done, 691 estimated seconds remaining
     - INFO: - device sda: 20.60% done, 332 estimated seconds remaining
     - INFO: - device sda: 33.90% done, 281 estimated seconds remaining
     - INFO: - device sda: 47.20% done, 227 estimated seconds remaining
     - INFO: - device sda: 60.50% done, 171 estimated seconds remaining
     - INFO: - device sda: 73.80% done, 287 estimated seconds remaining
     - INFO: - device sda: 87.10% done, 43 estimated seconds remaining
     - INFO: - device sda: 96.70% done, 14 estimated seconds remaining
     - INFO: - device sda: 100.00% done, 1 estimated seconds remaining
     - INFO: Instance ins1.saferwww.com's disks are in sync.
    creating os for instance ins1.saferwww.com on node x606.saferwww.com
    * running the instance OS create scripts...
    * starting instance...
    Failure: command execution error:
    Could not start instance
    x602:/# 
    Many thanks you for your help and
    best regards
    loisl
     
  10. SAVERSERVER

    SAVERSERVER New Member

    I will absolutely ganeti, I have now started a new trial and the entire installed lenny 5.0.4 i386.

    Code:
    x602:~# uname -r
    2.6.26-1-xen-686
    x602:~#
    korrekt wie im howto

    Code:
    x602:~# cd /boot
    x602:/boot# ln -s vmlinuz-`uname -r` vmlinuz-2.6-xenU
    x602:/boot# ln -s initrd.img-`uname -r` initrd-2.6-xenU
    x602:/boot# aptitude install drbd8-modules-`uname -r` drbd8-utils

    Then come the error!!
    [...]
    Lese Task-Beschreibungen... Fertig
    Konnte kein Paket finden, dessen Name oder Beschreibung auf »drbd8-modules-2.6.26-1-xen-686« passt.
    Konnte kein Paket finden, dessen Name oder Beschreibung auf »drbd8-modules-2.6.26-1-xen-686« passt.
    Es werden keine Pakete installiert, aktualisiert oder entfernt.
    [...]


    Has anyone still a help to me

    Thank you and
    best regards
    loisl
     
  11. falko

    falko Super Moderator

    Have you tried to update your kernel to 2.6.26-2-xen-686?
     
  12. SAVERSERVER

    SAVERSERVER New Member

    many thanks

    works perfect


    best greetings
    loisl
     
  13. meercura

    meercura New Member

    Code:
    node1:~# gnt-instance add -t drbd -n node2.example.com:node1.example.com -o debootstrap -s 5g --swap-size 256 -m 64 
    --kernel /boot/vmlinuz-`uname -r` --ip 192.168.1.105 inst1.example.com
    * creating instance disks...
    Unhandled error in Deferred:
    Traceback (most recent call last):
      File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 526, in expressionReceived
        method(*sexp[1:])
      File "/usr/lib/python2.5/site-packages/twisted/spread/pb.py", line 895, in proto_answer
        d.callback(self.unserialize(netResult))
      File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 243, in callback
        self._startRunCallbacks(result)
      File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 312, in _startRunCallbacks
        self._runCallbacks()
    --- <exception caught here> ---
      File "/usr/lib/python2.5/site-packages/twisted/internet/defer.py", line 328, in _runCallbacks
        self.result = callback(self.result, *args, **kw)
      File "/var/lib/python-support/python2.5/ganeti/rpc.py", line 94, in cb_done
        tb))
    ganeti.errors.RemoteError: Remote procedure error calling blockdev_create on node1.example.com:
    Traceback (most recent call last):
      File "/usr/sbin/ganeti-noded", line 87, in perspectiveMessageReceived
        state = method(*args, **kw)
      File "/usr/sbin/ganeti-noded", line 104, in perspective_blockdev_create
        return backend.CreateBlockDevice(bdev, size, owner, on_primary, info)
      File "/var/lib/python-support/python2.5/ganeti/backend.py", line 839, in CreateBlockDevice
        " daemon logs" % errorstring)
    BlockDeviceError: Can't assemble device after creation, very unusual event - check the node daemon logs
    
    failed to create volume sda (<DRBD8(hosts=node2.example.com-node1.example.com, port=11002, configured as 192.168.1.100:11002 192.168.1.101:11002, backend=<LogicalVolume(/dev/xenvg/49cb0ae4-81ce-4874-9270-0c536744b499.sda_data, not visible,size=5120m)>, metadev=<LogicalVolume(/dev/xenvg/4ebc598d-0355-4ab5-af2d-9f5e1d16                                                     0680.sda_meta, not visible, size=128m)>, visible as /dev/sda, size=5120m)>) on secondary node node1.example.com!
    Failure: command execution error:
    Device creation failed, reverting...
    
    I'm totally stuck, 3 time i try to make this cluster and everytime i'm stuck at the creation of the instance


    Oki Nevermind just found the problems

    Just need to install linux-image- 2.6.26-2-xen-686
     
    Last edited: Jun 9, 2010
  14. emotioneu

    emotioneu HowtoForge Supporter

    totally awkward ...

    i'm having quite the some error msg - but i do already run on linux-image- 2.6.26-2-xen-686 ... :(


    instances created on node1 "can be created" but not started - instances with a mirror just break on creation ...


    greets
     

Share This Page