EtherChannel question: 6509's

Hi, everyone --

I've set up a 4-port etherchannel between 2 6509's, tomax and xamot (no, I didn't name them. *grin*), and then I configured the etherchannel as a trunk. Traffic seems to be going over the trunk link (boxes can connect to each other when they're on different switches), but there's something that strikes me as weird: the output of "show channel traffic" doesn't show any unicast packets going through -- it's all multicast with a smattering of broadcast. Why is that? That seems broken-ish to me, but things are working.

Here's the configuration (we're running CatOS 8.5.5 on both). Tomax:

#module 3 : 48-port 10/100/1000BaseT Ethernet set vlan 51 3/9-48 set trunk 3/5 desirable negotiate 1-4094 set trunk 3/6 desirable negotiate 1-4094 set trunk 3/7 desirable negotiate 1-4094 set trunk 3/8 desirable negotiate 1-4094 set spantree portfast 3/5-8 disable set spantree portfast 3/9-48 enable set spantree guard none 3/5-8 set port channel 3/5-8 mode desirable silent

show trunk:

Port Mode Encapsulation Status Native vlan

-------- ----------- ------------- ------------ ----------- 3/5 desirable n-isl trunking 1 3/6 desirable n-isl trunking 1 3/7 desirable n-isl trunking 1 3/8 desirable n-isl trunking 1

show channel traffic:

6509-tomax (enable) show channel traffic ChanId Port Rx-Ucst Tx-Ucst Rx-Mcst Tx-Mcst Rx-Bcst Tx-Bcst

------ ----- ------- ------- ------- ------- ------- ------- 1732 3/5 0.00% 0.00% 20.87% 13.79% 0.00% 5.88% 1732 3/6 0.00% 0.00% 21.13% 14.42% 0.00% 0.00% 1732 3/7 0.00% 0.00% 23.36% 15.38% 0.00% 47.05% 1732 3/8 0.00% 0.00% 34.62% 56.38% 0.00% 47.07%

6509-tomax (enable)

On Xamot:

#module 3 : 48-port 10/100/1000BaseT Ethernet set vlan 50 3/9-48 set vlan 800 3/1-4 set port speed 3/1,3/4 1000 set spantree portfast 3/5-8 disable set spantree portfast 3/3-4,3/9-48 enable set spantree guard none 3/5-8 set port channel 3/5-8 mode desirable silent

Show trunk:

Port Mode Encapsulation Status Native vlan

-------- ----------- ------------- ------------ ----------- 3/5 auto n-isl trunking 1 3/6 auto n-isl trunking 1 3/7 auto n-isl trunking 1 3/8 auto n-isl trunking 1

show channel traffic:

6509-xamot (enable) show channel traffic ChanId Port Rx-Ucst Tx-Ucst Rx-Mcst Tx-Mcst Rx-Bcst Tx-Bcst

------ ----- ------- ------- ------- ------- ------- ------- 1732 3/5 0.00% 0.00% 13.79% 20.87% 5.88% 0.00% 1732 3/6 0.00% 0.00% 14.42% 21.12% 0.00% 0.00% 1732 3/7 0.00% 0.00% 15.38% 23.36% 47.05% 0.00% 1732 3/8 0.00% 0.00% 56.38% 34.62% 47.07% 0.00%

6509-xamot (enable)

Any hints/explanations would be great. And if this seems broken to you, please let me know. Thanks!

Elizabeth

Reply to
spidersister
Loading thread data ...

Hi,

Ah CatOS, many fond memories. [ Well just about memories anyway].

This could be due to the level of unicast traffic being < 0.01% of the total. Remember that broadcast is 24x7.

Otherwise it might be a software bug in the reporting.

Please post sh int (or CatOS equivalent) for the relevant interfaces.

Are the Channel ports spanning tree forwarding? Please post whatever shows that in CatOS.

e.g. IOS#sh spanning-tree Interface Role Sts Cost Prio.Nbr Type

---------------- ---- --- --------- --------

--------------------------------

Gi9/19 Desg FWD 19 128.531 Edge P2p Po1 Desg FWD 3 128.641 P2p

Reply to
anybody43

Okay, here's more weirdness. I just checked the channel stats:

6509-xamot (enable) show channel traffic ChanId Port Rx-Ucst Tx-Ucst Rx-Mcst Tx-Mcst Rx-Bcst Tx-Bcst

------ ----- ------- ------- ------- ------- ------- ------- 1732 3/5 0.00% 0.00% 7.42% 7.19% 0.00% 0.00% 1732 3/6 0.00% 0.00% 0.19% 0.21% 0.00% 0.00% 1732 3/7 0.00% 0.00% 92.04% 92.04% 0.00% 0.00% 1732 3/8 0.00% 0.00% 0.35% 0.56% 0.00% 0.00%

6509-xamot (enable)

What's up with that? All the ports are configured the same, it seems to me. Maybe it distributes the load better when there's no traffic?

I'm c>

"show port" it is. It's pretty extensive output for each one. I'll add it at the bottom.

6509-tomax (enable) show spantree 3/7 Port Vlan Port-State Cost Prio Portfast Channel_id

------------------------ ---- ------------- --------- ---- --------

----------

3/5-8 1 forwarding 2 32 disabled 1732 3/5-8 10 forwarding 2 32 disabled 1732 3/5-8 20 forwarding 2 32 disabled 1732 3/5-8 50 forwarding 2 32 disabled 1732 3/5-8 51 forwarding 2 32 disabled 1732 3/5-8 800 forwarding 2 32 disabled 1732 6509-tomax (enable)

Here's a "show port" on each of the interfaces on one half of the switch pair:

6509-tomax (enable) show port 3/5
  • = Configured MAC Address

# = 802.1X Authenticated Port Name.

Port Name Status Vlan Duplex Speed Type

----- -------------------- ---------- ---------- ------ -----------

------------ 3/5 connected trunk a-full a-1Gb

10/100/1000

Port AuxiliaryVlan AuxVlan-Status

----- ------------- -------------- 3/5 none none

Port Security Violation Shutdown-Time Age-Time Max-Addr Trap IfIndex

----- -------- --------- ------------- -------- -------- --------

------- 3/5 disabled shutdown 0 0 1 disabled

373

Port Flooding on Address Limit Last-Src-Addr Vlan

----- ------------------------- ----------------- ---- 3/5 Enabled - -

Port Num-Addr Secure-Src-Addr Vlan Age-Left Shutdown/Time-Left

----- -------- ----------------- ---- -------- ------------------ 3/5 0 - - - - -

Port 802.1X Auth-State 802.1X Port-Status

----- ------------------ ------------------ 3/5 force-authorized authorized

Port Mac-Auth-Bypass State Mac-Auth-Bypass Port-Status

----- --------------------- --------------------------- 3/5 Disabled (null)

Port Send FlowControl Receive FlowControl RxPause TxPause admin oper admin oper

----- -------- -------- --------- --------- ---------- ---------- 3/5 desired on off off 0 0

Port Status Channel Admin Ch Mode Group Id

----- ---------- -------------------- ----- ----- 3/5 connected desirable silent 307 1732 3/6 connected desirable silent 307 1732 3/7 connected desirable silent 307 1732 3/8 connected desirable silent 307 1732

----- ---------- -------------------- ----- -----

Port Status ErrDisable Reason Port ErrDisableTimeout Action on Timeout

---- ---------- ------------------- ----------------------

----------------- 3/5 connected - Enable No Change

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize

----- ---------- ---------- ---------- ---------- --------- 3/5 0 0 0 0 0

Port Single-Col Multi-Coll Late-Coll Excess-Col Carri-Sen Runts Giants

----- ---------- ---------- ---------- ---------- --------- ---------

--------- 3/5 0 0 0 0 0 0 -

Port Last-Time-Cleared

----- -------------------------- 3/5 Tue Jul 18 2006, 14:44:57

Idle Detection

-------------- --

6509-tomax (enable) show port 3/6
  • = Configured MAC Address

# = 802.1X Authenticated Port Name.

Port Name Status Vlan Duplex Speed Type

----- -------------------- ---------- ---------- ------ -----------

------------ 3/6 connected trunk a-full a-1Gb

10/100/1000

Port AuxiliaryVlan AuxVlan-Status

----- ------------- -------------- 3/6 none none

Port Security Violation Shutdown-Time Age-Time Max-Addr Trap IfIndex

----- -------- --------- ------------- -------- -------- --------

------- 3/6 disabled shutdown 0 0 1 disabled

374

Port Flooding on Address Limit Last-Src-Addr Vlan

----- ------------------------- ----------------- ---- 3/6 Enabled - -

Port Num-Addr Secure-Src-Addr Vlan Age-Left Shutdown/Time-Left

----- -------- ----------------- ---- -------- ------------------ 3/6 0 - - - - -

Port 802.1X Auth-State 802.1X Port-Status

----- ------------------ ------------------ 3/6 force-authorized authorized

Port Mac-Auth-Bypass State Mac-Auth-Bypass Port-Status

----- --------------------- --------------------------- 3/6 Disabled (null)

Port Send FlowControl Receive FlowControl RxPause TxPause admin oper admin oper

----- -------- -------- --------- --------- ---------- ---------- 3/6 desired on off off 0 0

Port Status Channel Admin Ch Mode Group Id

----- ---------- -------------------- ----- ----- 3/5 connected desirable silent 307 1732 3/6 connected desirable silent 307 1732 3/7 connected desirable silent 307 1732 3/8 connected desirable silent 307 1732

----- ---------- -------------------- ----- -----

Port Status ErrDisable Reason Port ErrDisableTimeout Action on Timeout

---- ---------- ------------------- ----------------------

----------------- 3/6 connected - Enable No Change

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize

----- ---------- ---------- ---------- ---------- --------- 3/6 0 0 0 0 0

Port Single-Col Multi-Coll Late-Coll Excess-Col Carri-Sen Runts Giants

----- ---------- ---------- ---------- ---------- --------- ---------

--------- 3/6 0 0 0 0 0 0 -

Port Last-Time-Cleared

----- -------------------------- 3/6 Tue Jul 18 2006, 14:44:57

Idle Detection

-------------- --

6509-tomax (enable)

6509-tomax (enable) show port 3/7

  • = Configured MAC Address

# = 802.1X Authenticated Port Name.

Port Name Status Vlan Duplex Speed Type

----- -------------------- ---------- ---------- ------ -----------

------------ 3/7 connected trunk a-full a-1Gb

10/100/1000

Port AuxiliaryVlan AuxVlan-Status

----- ------------- -------------- 3/7 none none

Port Security Violation Shutdown-Time Age-Time Max-Addr Trap IfIndex

----- -------- --------- ------------- -------- -------- --------

------- 3/7 disabled shutdown 0 0 1 disabled

375

Port Flooding on Address Limit Last-Src-Addr Vlan

----- ------------------------- ----------------- ---- 3/7 Enabled - -

Port Num-Addr Secure-Src-Addr Vlan Age-Left Shutdown/Time-Left

----- -------- ----------------- ---- -------- ------------------ 3/7 0 - - - - -

Port 802.1X Auth-State 802.1X Port-Status

----- ------------------ ------------------ 3/7 force-authorized authorized

Port Mac-Auth-Bypass State Mac-Auth-Bypass Port-Status

----- --------------------- --------------------------- 3/7 Disabled (null)

Port Send FlowControl Receive FlowControl RxPause TxPause admin oper admin oper

----- -------- -------- --------- --------- ---------- ---------- 3/7 desired on off off 0 0

Port Status Channel Admin Ch Mode Group Id

----- ---------- -------------------- ----- ----- 3/5 connected desirable silent 307 1732 3/6 connected desirable silent 307 1732 3/7 connected desirable silent 307 1732 3/8 connected desirable silent 307 1732

----- ---------- -------------------- ----- -----

Port Status ErrDisable Reason Port ErrDisableTimeout Action on Timeout

---- ---------- ------------------- ----------------------

----------------- 3/7 connected - Enable No Change

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize

----- ---------- ---------- ---------- ---------- --------- 3/7 0 0 0 0 0

Port Single-Col Multi-Coll Late-Coll Excess-Col Carri-Sen Runts Giants

----- ---------- ---------- ---------- ---------- --------- ---------

--------- 3/7 0 0 0 0 0 0 -

Port Last-Time-Cleared

----- -------------------------- 3/7 Tue Jul 18 2006, 14:44:57

Idle Detection

-------------- --

6509-tomax (enable)

6509-tomax (enable) show port 3/8

  • = Configured MAC Address

# = 802.1X Authenticated Port Name.

Port Name Status Vlan Duplex Speed Type

----- -------------------- ---------- ---------- ------ -----------

------------ 3/8 connected trunk a-full a-1Gb

10/100/1000

Port AuxiliaryVlan AuxVlan-Status

----- ------------- -------------- 3/8 none none

Port Security Violation Shutdown-Time Age-Time Max-Addr Trap IfIndex

----- -------- --------- ------------- -------- -------- --------

------- 3/8 disabled shutdown 0 0 1 disabled

376

Port Flooding on Address Limit Last-Src-Addr Vlan

----- ------------------------- ----------------- ---- 3/8 Enabled - -

Port Num-Addr Secure-Src-Addr Vlan Age-Left Shutdown/Time-Left

----- -------- ----------------- ---- -------- ------------------ 3/8 0 - - - - -

Port 802.1X Auth-State 802.1X Port-Status

----- ------------------ ------------------ 3/8 force-authorized authorized

Port Mac-Auth-Bypass State Mac-Auth-Bypass Port-Status

----- --------------------- --------------------------- 3/8 Disabled (null)

Port Send FlowControl Receive FlowControl RxPause TxPause admin oper admin oper

----- -------- -------- --------- --------- ---------- ---------- 3/8 desired on off off 0 0

Port Status Channel Admin Ch Mode Group Id

----- ---------- -------------------- ----- ----- 3/5 connected desirable silent 307 1732 3/6 connected desirable silent 307 1732 3/7 connected desirable silent 307 1732 3/8 connected desirable silent 307 1732

----- ---------- -------------------- ----- -----

Port Status ErrDisable Reason Port ErrDisableTimeout Action on Timeout

---- ---------- ------------------- ----------------------

----------------- 3/8 connected - Enable No Change

Port Align-Err FCS-Err Xmit-Err Rcv-Err UnderSize

----- ---------- ---------- ---------- ---------- --------- 3/8 0 0 0 0 0

Port Single-Col Multi-Coll Late-Coll Excess-Col Carri-Sen Runts Giants

----- ---------- ---------- ---------- ---------- --------- ---------

--------- 3/8 0 0 0 0 0 0 -

Port Last-Time-Cleared

----- -------------------------- 3/8 Tue Jul 18 2006, 14:44:57

Idle Detection

-------------- --

6509-tomax (enable)
Reply to
E. Bess

What do you see there as actually being wrong, load balancing not more evenly spread? What balancing algorithm has been configured? If the default is still set that's "dest-mac" ... all traffic to the same destination mac will always be sent over the same channel.

BernieM

Reply to
BernieM

And notice it's all multicast traffic, so it's most likely routing protocol etc traffic, all being sent to the same multicast L3 and L2 address.

/Jesper

Reply to
Jesper Skriver

Yep, that's exactly what I'm worried about. I don't know why that would be.

I'm also concerned about it being all multicast. This makes it look like there's no "regular" traffic going across these trunk links. But all machines on my network can see all other machines -- ie, I know that traffic is being passed over these trunks. If I plug 10.10.1.1 into tomax, and 10.10.1.2 into xamot, they can talk to each other just fine. Isn't that plain 'ol unicast traffic? Why are my unicast percentages at 0, then?

Maybe I'm misunderstanding unicast? It implies one-to-one; as in, a packet destined for a single machine.

Ah, good to know. I didn't know there was such a thing.

Reply to
E. Bess

Thanks. Again, this points to my confusion: if it's all multicast traffic, then where 's traffic between, say, two machines (Like

10.10.1.1 in tomax and 10.10.1.2 in xamot) being registered in the stats?

Feels like I'm missing something here. Boxes on either switch can talk to each other, but I don't see any traffic indicated in that output. I want to *see* them talking to each other so I can confirm that it's working.

Thank you all for your help!

Reply to
E. Bess

I explained why that would be ... the port-channel balancing algorithm being used ... 'dest-mac' . All 'like' multicast traffic will be sent across the same link every time. In IOS there's a 'test etherchannel' command that will show you for any given value ie. src/dst, mac/ip etc. what link of the port-channel a specific packet will be assigned. This never changes unless the normally assigned link is down.

I'd put that down to either a bug in the reporting software or that the amount of unicast traffic just doesn't have the numbers to register above 0% (seems less likely). Can you initiate a large file transfer to increase the amount of unicast traffic.

These are L2 Etherchannels by the way so you're not going to be able to configure any L3 balancing algorithms.

BernieM

Reply to
BernieM

As discussed these counters (i.e. no Unicast) may or may not indicate a problem since there may simply be not enough unicast traffic to show up.

For traffic creation I like iperf.

To computers, one on each side of link.

on one start the server

iperf -s

on the other

iperf -c your-server-address -t however-long-you-want

formatting link

Use the port counters to see the traffic. It may take some time for enough traffic to cross the link to overcome the weeks of 24x7 multicasts that have been counted by the show channel traffic counters.

After some searching I found:-

show mac mod/port

This should the current counters and could be used to verify where your traffic is going.

Reply to
anybody43

Back to basics folks, seems you're running ISL as trunk encapsulation. Now the ISL header is multicast, so all these ISL frames on the trunk are counted multicast. Configure dot1q to get "normal" counters.

Reply to
brink

Brink,

Thanks for that - back to earth with a bump:-)

Of course I may /never/ see another ISL trunk again (and I haven't seen one for at least 5 years I would think) but it is all good stuff.

Reply to
anybody43

Good observation brink. I'd not noticed but, truth be known, wouldn't have known to look for that.

Reply to
BernieM

Cabling-Design.com Forums website is not affiliated with any of the manufacturers or service providers discussed here. All logos and trade names are the property of their respective owners.