On Jan 30, 2012, at 3:39 PM, Orion Poplawski wrote:

> You're sure your switch supports 802.3ad dynamic link aggregation?  I had some switches that I thought did, but don't.

> 
> what does "dmesg | grep -Fi bond" show?
[root@tape ~]# dmesg | grep -Fi bond
Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)
bonding: bond0 is being created...
bonding: cannot add bond bond0; already exists
bonding: Bond creation failed.
bonding: bond0: setting mode to 802.3ad (4).
ADDRCONF(NETDEV_UP): bond0: link is not ready
bonding: bond0: Adding slave eth2.
bonding: bond0: Warning: failed to get speed and duplex from eth2, assumed to be 100Mb/sec and Full.
bonding: bond0: Warning: Operation of 802.3ad mode requires ETHTOOL support in base driver for proper aggregator selection.
bonding: bond0: enslaving eth2 as a backup interface with an up link.
bonding: bond0: Adding slave eth3.
bonding: bond0: Warning: failed to get speed and duplex from eth3, assumed to be 100Mb/sec and Full.
bonding: bond0: Warning: Operation of 802.3ad mode requires ETHTOOL support in base driver for proper aggregator selection.
bonding: bond0: enslaving eth3 as a backup interface with an up link.
bonding: bond0: Adding slave eth4.
bonding: bond0: Warning: failed to get speed and duplex from eth4, assumed to be 100Mb/sec and Full.
bonding: bond0: Warning: Operation of 802.3ad mode requires ETHTOOL support in base driver for proper aggregator selection.
bonding: bond0: enslaving eth4 as a backup interface with an up link.
bonding: bond0: Adding slave eth5.
bonding: bond0: Warning: failed to get speed and duplex from eth5, assumed to be 100Mb/sec and Full.
bonding: bond0: Warning: Operation of 802.3ad mode requires ETHTOOL support in base driver for proper aggregator selection.
bonding: bond0: enslaving eth5 as a backup interface with an up link.
ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
bond0: no IPv6 routers present

> Also cat /proc/net/bonding/bond0
[root@tape ~]# cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v3.6.0 (September 26, 2009)

Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 0
Up Delay (ms): 0
Down Delay (ms): 0

802.3ad info
LACP rate: slow
Aggregator selection policy (ad_select): stable
Active Aggregator Info:
	Aggregator ID: 1
	Number of ports: 4
	Actor Key: 17
	Partner Key: 63257
	Partner Mac Address: 00:15:77:e7:84:a2

Slave Interface: eth2
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:1b:21:21:2f:a8
Aggregator ID: 1
Slave queue ID: 0

Slave Interface: eth3
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:1b:21:21:2f:a9
Aggregator ID: 1
Slave queue ID: 0

Slave Interface: eth4
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:1b:21:21:2f:ac
Aggregator ID: 1
Slave queue ID: 0

Slave Interface: eth5
MII Status: up
Speed: 1000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: 00:1b:21:21:2f:ad
Aggregator ID: 1
Slave queue ID: 0

[root@tape ~]# ping 10.1.16.2
PING 10.1.16.2 (10.1.16.2) 56(84) bytes of data.
From 10.1.16.20 icmp_seq=2 Destination Host Unreachable
From 10.1.16.20 icmp_seq=3 Destination Host Unreachable
From 10.1.16.20 icmp_seq=4 Destination Host Unreachable
From 10.1.16.20 icmp_seq=6 Destination Host Unreachable
From 10.1.16.20 icmp_seq=7 Destination Host Unreachable
From 10.1.16.20 icmp_seq=8 Destination Host Unreachable
^C
--- 10.1.16.2 ping statistics ---
9 packets transmitted, 0 received, +6 errors, 100% packet loss, time 8902ms
pipe 3

[root@tape ~]# ethtool eth5
Settings for eth5:
	Supported ports: [ TP ]
	Supported link modes:   10baseT/Half 10baseT/Full 
	                        100baseT/Half 100baseT/Full 
	                        1000baseT/Full 
	Supports auto-negotiation: Yes
	Advertised link modes:  10baseT/Half 10baseT/Full 
	                        100baseT/Half 100baseT/Full 
	                        1000baseT/Full 
	Advertised pause frame use: No
	Advertised auto-negotiation: Yes
	Speed: 1000Mb/s
	Duplex: Full
	Port: Twisted Pair
	PHYAD: 1
	Transceiver: internal
	Auto-negotiation: on
	MDI-X: Unknown
	Supports Wake-on: d
	Wake-on: d
	Current message level: 0x00000003 (3)
	Link detected: yes

> See http://www.linuxfoundation.org/collaborate/workgroups/networking/bonding

Oddly enough if I move it to mode=0 I get a ping like this, but it's having a problem setting the ports speed and duplex.

PING 10.1.16.2 (10.1.16.2) 56(84) bytes of data.
64 bytes from 10.1.16.2: icmp_seq=4 ttl=64 time=0.150 ms
64 bytes from 10.1.16.2: icmp_seq=8 ttl=64 time=0.191 ms
64 bytes from 10.1.16.2: icmp_seq=11 ttl=64 time=0.225 ms
64 bytes from 10.1.16.2: icmp_seq=15 ttl=64 time=0.278 ms
64 bytes from 10.1.16.2: icmp_seq=19 ttl=64 time=0.119 ms


> -- 
> Orion Poplawski
> Technical Manager                     303-415-9701 x222
> NWRA, Boulder Office                  FAX: 303-415-9702
> 3380 Mitchell Lane                  [log in to unmask]
> Boulder, CO 80301              http://www.cora.nwra.com