Join us at engage.eucalyptus.com
Hi,
We have a really strange thing when installing eucalyptus.
We are trying to install it from the Ubuntu 9.10 CD installer.
The eucalyptus version is 1.6-develop
The hardware is 2 brand new HP Proliant server ML120 G6 X3430
Architecture is 64 bits
One server is installed as Cluster, Walrus, Storage
Second as node with KVM
Network : Managed-NOVLAN
I can start an instance without any problem, I receive an IP from my elastic range.
The instance stay running BUT I can t SSH or ping this instance with the public IP.
Also something strage, when I install the node there is no br0 interface created;
Also we have on the node an interface virbr0 with an IP out my range (192.168.122.1) ?
I use a small script who create it manually. everything is looking fine; I can ping the cluster from the node and the node from the cluster.
My interface file looks like this :
iface br0 inet static
bridge_ports eth0
bridge_maxwait 0
address 10.0.0.21
netmask 255.255.255.0
network 10.0.0.0
broadcast 10.0.0.255
gateway 10.0.0.1
Please help ... We cannot understand why we cannot join an instance and all networking seems working.
Thanks,
Frederic
Hello,
the virbr0 is an interface created by libvirt and you can safely ignore it. Can you post your ifconfig -a, ip addr show and brctrl show (on the NC and the CC/CLC)?
cheers
graziano
Here is the result for both server
Thanks,
guru@CloudCluster1:/sbin$ ifconfig
eth0 Link encap:Ethernet HWaddr f4:ce:46:0f:3c:7b
inet addr:10.0.0.20 Bcast:10.0.0.255 Mask:255.255.255.0
inet6 addr: fe80::f6ce:46ff:fe0f:3c7b/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:220287 errors:0 dropped:0 overruns:0 frame:0
TX packets:243365 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:114565360 (114.5 MB) TX bytes:96094569 (96.0 MB)
Interrupt:16
eth0:metadata Link encap:Ethernet HWaddr f4:ce:46:0f:3c:7b
inet addr:169.254.169.254 Bcast:0.0.0.0 Mask:255.255.255.255
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:16
eth0:priv Link encap:Ethernet HWaddr f4:ce:46:0f:3c:7b
inet addr:172.19.1.1 Bcast:172.19.1.31 Mask:255.255.255.224
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:16
eth0:pub Link encap:Ethernet HWaddr f4:ce:46:0f:3c:7b
inet addr:10.0.0.30 Bcast:0.0.0.0 Mask:255.255.255.255
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:16
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:1968685 errors:0 dropped:0 overruns:0 frame:0
TX packets:1968685 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:702229273 (702.2 MB) TX bytes:702229273 (702.2 MB)
virbr0 Link encap:Ethernet HWaddr c2:3a:51:30:7c:0e
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:823 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:30973 (30.9 KB)
guru@CloudCluster1:/sbin$ ip addr show
1: lo: mtu 16436 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether f4:ce:46:0f:3c:7b brd ff:ff:ff:ff:ff:ff
inet 169.254.169.254/32 scope link eth0:metadata
inet 10.0.0.20/24 brd 10.0.0.255 scope global eth0
inet 172.19.1.1/27 brd 172.19.1.31 scope global eth0:priv
inet 10.0.0.30/32 scope global eth0:pub
inet6 fe80::f6ce:46ff:fe0f:3c7b/64 scope link
valid_lft forever preferred_lft forever
3: eth1: mtu 1500 qdisc noop state DOWN qlen 1000
link/ether f4:ce:46:0f:3c:7c brd ff:ff:ff:ff:ff:ff
4: virbr0: mtu 1500 qdisc noqueue state UNKNOWN
link/ether c2:3a:51:30:7c:0e brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
guru@CloudCluster1:/sbin$ brctrl show
No command 'brctrl' found, did you mean:
Command 'brctl' from package 'bridge-utils' (main)
brctrl: command not found
guru@CloudCluster1:/sbin$ brctl show
bridge name bridge id STP enabled interfaces
virbr0 8000.000000000000 yes
guru@CloudCluster1:/sbin$
Pour le 10.0.0.22 :
guru@CloudNode2:~$ ifconfig -a
br0 Link encap:Ethernet HWaddr 1a:71:13:68:81:23
inet addr:10.0.0.22 Bcast:10.0.0.255 Mask:255.255.255.0
inet6 addr: fe80::f6ce:46ff:fe0f:1cff/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:374994 errors:0 dropped:0 overruns:0 frame:0
TX packets:256909 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:187948860 (187.9 MB) TX bytes:133670428 (133.6 MB)
eth0 Link encap:Ethernet HWaddr f4:ce:46:0f:1c:ff
inet6 addr: fe80::f6ce:46ff:fe0f:1cff/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:380194 errors:0 dropped:0 overruns:0 frame:0
TX packets:279724 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:202314044 (202.3 MB) TX bytes:136377271 (136.3 MB)
Interrupt:16
eth1 Link encap:Ethernet HWaddr f4:ce:46:0f:1d:00
BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
Interrupt:17
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:968 errors:0 dropped:0 overruns:0 frame:0
TX packets:968 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:18374 (18.3 KB) TX bytes:18374 (18.3 KB)
virbr0 Link encap:Ethernet HWaddr 4e:c3:f9:7c:dd:d5
inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:983 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:35836 (35.8 KB)
vnet0 Link encap:Ethernet HWaddr 1a:71:13:68:81:23
inet6 addr: fe80::1871:13ff:fe68:8123/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2900 errors:0 dropped:0 overruns:0 frame:0
TX packets:26220 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:500
RX bytes:198831 (198.8 KB) TX bytes:10850547 (10.8 MB)
guru@CloudNode2:~$
guru@CloudNode2:~$ ip addr show
1: lo: mtu 16436 qdisc noqueue state UNKNOWN
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: mtu 1500 qdisc pfifo_fast state UP qlen 1000
link/ether f4:ce:46:0f:1c:ff brd ff:ff:ff:ff:ff:ff
inet6 fe80::f6ce:46ff:fe0f:1cff/64 scope link
valid_lft forever preferred_lft forever
3: eth1: mtu 1500 qdisc noop state DOWN qlen 1000
link/ether f4:ce:46:0f:1d:00 brd ff:ff:ff:ff:ff:ff
4: br0: mtu 1500 qdisc noqueue state UNKNOWN
link/ether 1a:71:13:68:81:23 brd ff:ff:ff:ff:ff:ff
inet 10.0.0.22/24 brd 10.0.0.255 scope global br0
inet6 fe80::f6ce:46ff:fe0f:1cff/64 scope link
valid_lft forever preferred_lft forever
5: virbr0: mtu 1500 qdisc noqueue state UNKNOWN
link/ether 4e:c3:f9:7c:dd:d5 brd ff:ff:ff:ff:ff:ff
inet 192.168.122.1/24 brd 192.168.122.255 scope global virbr0
8: vnet0: mtu 1500 qdisc pfifo_fast state UNKNOWN qlen 500
link/ether 1a:71:13:68:81:23 brd ff:ff:ff:ff:ff:ff
inet6 fe80::1871:13ff:fe68:8123/64 scope link
valid_lft forever preferred_lft forever
guru@CloudNode2:~$
guru@CloudNode2:~$ brctl show
bridge name bridge id STP enabled interfaces
br0 8000.1a7113688123 no eth0
vnet0
virbr0 8000.000000000000 yes
Hello,
can you report the output of sed -e 's/#.*//' -e '/^$/ d' /etc/eucalyptus.conf on both the node and the cc machine? I suspect you are overlapping the private network for instances with the network you are using.
cheers
graziano
Here is
From the node :
EUCALYPTUS="/"
EUCA_USER="eucalyptus"
DISABLE_DNS="Y"
ENABLE_WS_SECURITY="Y"
LOGLEVEL="DEBUG"
CC_PORT="8774"
SCHEDPOLICY="ROUNDROBIN"
POWER_IDLETHRESH="300"
POWER_WAKETHRESH="300"
NODES=""
NC_SERVICE="axis2/services/EucalyptusNC"
NC_PORT="8775"
HYPERVISOR="kvm"
INSTANCE_PATH="/var/lib/eucalyptus/instances"
VNET_PUBINTERFACE="eth0"
VNET_PRIVINTERFACE="eth0"
VNET_BRIDGE="br0"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="dhcpd"
VNET_MODE="MANAGED-NOVLAN"
From the cluster
EUCALYPTUS="/"
EUCA_USER="eucalyptus"
DISABLE_DNS="Y"
ENABLE_WS_SECURITY="Y"
LOGLEVEL="DEBUG"
CC_PORT="8774"
SCHEDPOLICY="ROUNDROBIN"
POWER_IDLETHRESH="300"
POWER_WAKETHRESH="300"
NODES=" 10.0.0.22"
NC_SERVICE="axis2/services/EucalyptusNC"
NC_PORT="8775"
HYPERVISOR="not_configured"
INSTANCE_PATH="not_configured"
VNET_PUBINTERFACE="eth0"
VNET_PRIVINTERFACE="eth0"
VNET_BRIDGE="br0"
VNET_DHCPDAEMON="/usr/sbin/dhcpd3"
VNET_DHCPUSER="dhcpd"
VNET_MODE="MANAGED-NOVLAN"
VNET_SUBNET="10.0.0.0"
VNET_NETMASK="255.255.255.0"
VNET_DNS="10.0.0.1"
VNET_ADDRSPERNET="32"
VNET_PUBLICIPS="10.0.0.30-10.0.0.50"
Thanks,
I also had the same problem for ping and ssh but it was a very terrible mistake....
"The security group was not set for ssh and icmp traffic !!!"
Did you check your security group settings?
I did it.
I had a rule on port 22 for IP 0.0.0.0/32.
I follow the documentation from the ubuntu website.
euca-authorize default -P tcp -p 22 -s 0.0.0.0/0
I also have only one group called "admin".
Thanks,
Hello,
your configuration is not going to work on your network. You have your machine configured to be on the 10.0.0.x network, and you are instructing eucalyptus to use 10.0.0.x for private networks. You may want to check again our documentation on the MANAGED* network mode, but in short you need to give eucalyptus a non-used private network, for example 172.16.0.0, with a subnet of 255.255.0.0 would work nicely.
Remember to restart the cc using cleanstop and cleanstart when you change network configuration.
Keep us posted on your progress.
cheers
graziano
Hi,
Thank you for your reply, I will try it in the next days ...
Could you give a good template for the node and the cluster who should working for my configuration.
Regards,
Hello,
as I mentioned before, use 172.16.0.0 as SUBNET, 255.255.0.0 as NETMASK. Also, check what your machines uses for nameserver (usually in /etc/resolv.conf) and add it as DNS. The public IPs should work in your subnet.
Let us know how it goes.
cheers
graziano