We have an 6513 Cisco router and we have some HP Proliant servers running Windows 2003 with gigabit adapters. Ports are set to 1000 on the router and the server are set to 1000/Full with flow control at auto. But when we do a windows copy from server to server we are only getting 230 MBps at the highest throughput rate. Should we be getting more throughput than this?
All depends on the server, backplane, protocol, etc. Are the source and destination on different switches? Are they in the same network? How much b/w do you have across your backbone if it is being routed or pushed across switches? How much utilization do you have across those links? If all of that checks out, how fast are your drives, what is the utilization of the server itself during that transfer? Additionally, windows copy is terrible from my experience, have you tried ftp? How does that work for you?
What do you get with those two servers on a different gigabit switch?
It's a pretty difficult question to answer, given how many variables there are. If you're just interested in the raw throughput of the switch from the servers, disregarding disk speed etc, try testing it with iperf:
I suggest you avoid the Java version, as it tends to max out your CPU before your network. Getting 93Mbps on a switched 100Mbit network here, btw.
A SNMP monitoring tool will work. Not sure of any free ones right offhand, but I'm sure some others can recommend some. However, 200+ mbps is not bad in my opinion for windows copy, so I would try ftp first and see how you fare. I have seen etherchannel gig to servers run at 2-3 gigs per second, but for most windows based single-gig boxes, several hundred meg is probably par for the course. Not to say a well tuned box can't get to 8-900 mbps, but does take a powerful, well-tuned box. And to answer your question, a proper server should push over 90% utilization of its link, but when you get to gig or multi-gig, there are a lot more thresholds you start to hit, many of which are hardware.
Are you sure it's big "B"? Thats MegaBYTES per second. Switches are rated in bits (little b) per second. If it truely is bytes per second, you've exceeded gigabit speed (bytes X 8 = bits) 2.2mbps. Where are you getting your numbers from?
Unless there is some architectural component I am not aware of, this must be a source/destination server issue. I have 6500 series switches that consistently push between 2 and 8 gigs per second without batting an eye. As for single server bandwidth, I have seen
2-3 gigs per second for tivoli backup boxes (4 gig etherchannel to the server itself), and for single-gig connections, I have seen 8-900 megs fairly regularly. Granted these are almost all non-wintel boxes, and are usually very large IBM nodes/system complexes or another flavor of unix. As for a windows server that is tuned and has some good hardware, i have seen 3-400 meg, but have never really watched them too closely. All in all, I am guessing you have hit a threshold on your server or with whatever copy program you are using, but your performance seems within my expectations.