Frustrated that I don't UNDERSTAND why my network times out
Oct 08, 2013 70 Replies
M
Mike Easter
Personally when I'm troubleshooting something I take into account the fact that some hops handle ICMP, UDP, and TCP differently. One of my preferred tools for testing access to a server is Steve Gibson's IDServe which runs under windows or WINE in linux and doesn't require installation in either.
For this target I would be using TCP port 80 on/at the webserver at centos. The tool shows my system resolving the IP and connecting to the webserver there.
Initiating server query ... Looking up IP address for domain:
formatting link
The IP address for the domain is: 72.232.194.162 Connecting to the server on standard HTTP port: 80 [Connected] Requesting the server's default page. The server returned the following response headers: [redact html from the centos Apache server] Query complete.
From the other info you've posted here, your system when not reaching centos on port 80 TCP IDServe would show you resolving the name but not connecting, which IDServe interprets as the server being stealthed or not online, so its use wouldn't add anything to this particular problem's solution; but I mention it as an indication that 'typically' I don't use an ICMP tool to test some TCP-related server issues.
Didn't find your answer? Ask the community — no account required.
M
Mike Easter
Login? Are you talking about login here?
formatting link
The difference between http and https protocols is the layering of http over the SSL/TLS protocol and the other difference is the use of port
443 instead of 80.
Or perhaps you are talking about logging in to some other server - the centos forums are at https centos as well.
The bugs.centos server login is at a different IP 83.149.86.133
U
unruh
Which was why I suggested telnet centos.org 80 but that did not return anything for him. Everyone else in the world has no trouble connecting but he does and he wants to know why.
B
billy
That's a perfect summary! I can't imagine that I'm singled out in this world for not connecting, for months at a time, to centos.org (it happened with one other web site - but it was so long ago that I've forgotten which it was).
One question I have is WHICH site is dropping my packets?
Is it the last site that returns traceroute values? Os is it the first site that has all asterisks?
# traceroute -M icmp
formatting link
traceroute to
formatting link
(72.232.194.162), 30 hops max, 60 byte packets 1 192.168.1.1 (192.168.1.1) 2.840 ms 2.832 ms 2.829 ms 2 MYIPADDRESS (xxx.xxx.xxx.xxx) 2.827 ms 5.830 ms 5.834 ms 3 10.50.0.1 (10.50.0.1) 9.369 ms 14.568 ms 14.566 ms 4 10.25.0.1 (10.25.0.1) 14.562 ms 18.614 ms 18.610 ms 5 10.20.0.1 (10.20.0.1) 79.603 ms 83.180 ms 83.177 ms 6 10.0.0.1 (10.0.0.1) 454.682 ms 251.479 ms 251.450 ms 7 69.36.226.193 (69.36.226.193) 251.420 ms 402.683 ms 402.652 ms 8 vl2.core1.scl.layer42.net (69.36.225.129) 402.624 ms 397.148 ms
397.127 ms 9 216.156.84.141.ptr.us.xo.net (216.156.84.141) 397.107 ms 284.336 ms 284.314 ms
10 207.88.14.233.ptr.us.xo.net (207.88.14.233) 287.164 ms 153.090 ms
162.910 ms
11 vb15.rar3.dallas-tx.us.xo.net (207.88.12.45) 162.878 ms 156.560 ms 156.544 ms
12 207.88.14.34.ptr.us.xo.net (207.88.14.34) 156.516 ms 2751.856 ms
2751.839 ms
13 207.88.185.74.ptr.us.xo.net (207.88.185.74) 2586.242 ms 97.179 ms
97.152 ms
14 border1.pc1-bbnet1.dal004.pnap.net (216.52.191.19) 97.123 ms border1.pc2-bbnet2.dal004.pnap.net (216.52.191.81) 74.418 ms border1.pc1-bbnet1.dal004.pnap.net (216.52.191.19) 87.348 ms
15 layered-11.border1.dal004.pnap.net (63.251.44.74) 87.329 ms
65.781 ms 120.012 ms
16 * **
17 ** *
18 * **
19 ** *
20 * **
21 ** *
22 * **
23 ** *
24 * **
25 ** *
26 * **
27 ** *
28 * **
29 ** *
30 * * * #
Is it hop 15 or 16 above which is dropping my packets?
B
billy
All I do, on TOR, is type '
formatting link
' or "centos.org", and it gives me a screen where I can enter in my login and password and it logs me in. On Firefox, I do the same, when everything is working.
Then, for months at a time, I can't even connect to
formatting link
or to 'centos.org' - getting the standard "connection timed out" message.
When I run a traceroute (any type of traceroute), the result is that the last hop before centos.org is the last hop that returns anything. The centos.org hop is asterisked out.
There's absolutely nothing wrong with my login (I easily log in with TOR, and I have an old thread asking THEM what's going on, and they don't know either).
So, I 'think' it's the ISP that they use.
I remember having a similar problem with telephones not being able to call certain numbers, and, we found out it was a routing thing at the Ooma headquarters. Nobody on the planet could call these specific numbers, one of whom was a relative of mine so I knew that the number existed. Yet, nobody could call the number from VOIP.
Same kind of idea seems to be here. Some router somewhere is very badly set up.
The funny thing, is that I'm the only one with the problem. Worse yet, there are no debugging tools for when a router is dropping packets. That's the saddest part.
I've been trying to solve this for two years running. Or, at least understand how it could possibly happen.
When I point my browser to http://83.149.86.133 I get the message: Forbidden You don't have permission to access / on this server. Apache/2.2.3 (CentOS) Server at 83.149.86.133 Port 80
# telnet 83.149.86.133 80 Trying 83.149.86.133... Connected to 83.149.86.133. Escape character is '^]'. HEAD HTTP/1.0
400 Bad Request Bad Request Your browser sent a request that this server could not understand. Apache/2.2.3 (CentOS) Server at mirror.centos.org Port
80 Connection closed by foreign host.
# traceroute -M icmp 83.149.86.133 # traceroute -M icmp 83.149.86.133 traceroute to 83.149.86.133 (83.149.86.133), 30 hops max, 60 byte packets 1 192.168.1.1 (192.168.1.1) 3.423 ms 3.405 ms 6.261 ms 2 MY_WISP_ADDRESS (xx.xx.xx.xx) 9.844 ms 9.842 ms 9.839 ms 3 10.50.0.1 (10.50.0.1) 15.284 ms 139.930 ms 139.937 ms 4 10.25.0.1 (10.25.0.1) 148.735 ms 148.734 ms 148.729 ms 5 10.20.0.1 (10.20.0.1) 164.306 ms 169.567 ms 169.564 ms 6 10.0.0.1 (10.0.0.1) 344.049 ms 70.997 ms 189.575 ms 7 69.36.226.193 (69.36.226.193) 189.531 ms 34.070 ms 136.902 ms 8 vl2.core2.scl.layer42.net (69.36.225.130) 139.000 ms 47.370 ms
133.156 ms 9 xe3-4.core1.mpt.layer42.net (69.36.239.110) 133.125 ms 35.300 ms
61.929 ms
10 any2ix.coresite.com (206.223.143.213) 73.838 ms 32.061 ms 94.368 ms
11 te5-2.msc2.wdc.leaseweb.net (217.20.125.40) 155.304 ms 99.444 ms
109.215 ms
12 * * *
13 31.31.32.5 (31.31.32.5) 260.392 ms 220.540 ms 229.781 ms
14 ten5-4.sbp-sr2.leaseweb.net (85.17.100.202) 229.737 ms 166.166 ms
243.165 ms
15 centos.yourname.nl (83.149.86.133) 239.189 ms 176.139 ms 194.943 ms
So, I have absolutely no problem getting to this site. But, why would I have a problem getting to centos.org?
Could it be that anything after 15 hops fails no matter what? To test, do you know of a site that would be more than 15 hops away from San Francisco, CA?
B
billy
I'm beginning to wonder if anything after about 15 hops is dropping the connection for me?
Could it be that the path to centos.org just happens to be longer than any other path I've tried?
The path to the centos bug server you gave me worked fine, but it only took 15 hops.
Do you have a way for me to pick somewhere far far away from San Francisco CA to see if it's simply the long path that is causing the problem (i.e., more than 16 hops)?
B
billy
I will contact them at the email addresses already posted and ask them if they're periodically doing something nasty to my IP address for months at a time (like putting me on a blacklist or something).
I'll report back if/when they respond.
B
billy
Everything you said is right on the money. It's frustratingly hard to figure out.
The only two ideas "I" can come up with are:
Someone is blocking me (but I can't imagine why)
The path is too long for something (but I don't know what).
In the first case, I'm not sure if the blocker would be the
15th hop (which returns packets) not forwarding them on to the Centos server or if it's the 16th hop (the Centos server) not responding back. Is there a way to tell?
In the second case, it would be useful to test a similarly long (at least 16 hops) path. Or, maybe there's a way to slow down my pings so that I can reproduce the problem in fewer hops?
B
billy
I understand and agree with your use of "claims", as you don't know what I've been told.
I can google for the public thread where I asked them (and they responded in email privately also) and point you to that. It was about six months to a year ago.
Gimme a minute to find it (Google will find it but I won't be able to open it up - but you should be able to).
OK. Found it with Google on CentOS.org Title: What can I do to UNDERSTAND why
formatting link
fails for me Date: MaMar 1, 2013 - 12 posts - ?4 authors
Of course, I can't "go" to that URL (since it's on CentOS.org) but it looks like it's mirrored here: linuxreference.com/modules/newbb/viewtopic.php?topic_id=41677&forum=55
Hey! Guess what? I can't get to "linuxreference.com" either! Just like centos.org, it goes to asterisks on the 16th hop!
I'm getting tired of redacting my IP address, so I'm letting it show here. I hope I don't regret that! :)
# traceroute -M icmp linuxreference.com traceroute to linuxreference.com (72.232.194.162), 30 hops max, 60 byte packets 1 192.168.1.1 (192.168.1.1) 2.851 ms 2.836 ms 2.839 ms 2 67-218-118-85.ridgewireless.net (67.218.118.85) 5.849 ms 5.849 ms
5.846 ms 3 10.50.0.1 (10.50.0.1) 5.845 ms 19.117 ms 19.115 ms 4 10.25.0.1 (10.25.0.1) 19.111 ms 19.108 ms 26.045 ms 5 10.20.0.1 (10.20.0.1) 58.291 ms 60.735 ms 60.733 ms 6 10.0.0.1 (10.0.0.1) 70.816 ms 10.336 ms 15.323 ms 7 69.36.226.193 (69.36.226.193) 15.291 ms 77.227 ms 140.765 ms 8 vl2.core1.scl.layer42.net (69.36.225.129) 148.204 ms 32.072 ms
32.025 ms 9 216.156.84.141.ptr.us.xo.net (216.156.84.141) 35.854 ms 82.604 ms
137.427 ms
10 207.88.14.233.ptr.us.xo.net (207.88.14.233) 137.395 ms 77.731 ms
86.088 ms
11 vb15.rar3.dallas-tx.us.xo.net (207.88.12.45) 92.609 ms 105.335 ms
105.305 ms
12 207.88.14.34.ptr.us.xo.net (207.88.14.34) 105.262 ms 130.219 ms
145.768 ms
13 207.88.185.74.ptr.us.xo.net (207.88.185.74) 145.746 ms 66.089 ms
83.514 ms
14 border1.pc1-bbnet1.dal004.pnap.net (216.52.191.19) 83.485 ms border1.pc2-bbnet2.dal004.pnap.net (216.52.191.81) 75.311 ms 75.275 ms
15 layered-11.border1.dal004.pnap.net (63.251.44.74) 75.241 ms
68.198 ms 85.547 ms
16 * **
17 ** *
18 * **
19 ** *
20 * **
21 ** *
22 * **
23 ** *
24 * **
25 ** *
26 * **
27 ** *
28 * **
29 ** *
30 * * *
B
billy
I can google just fine, so I found the original request way back in March on the Centos site (I subsequently got an email from the admins saying there's nothing wrong with my IP address).
Here's what Google says the Centos article URL is:
formatting link
It's looking more and more like anything longer than about 15 hops is dying for me. At least that's a preliminary guess.
Notice I can get to this Centos mirror just fine:
formatting link
When I traceroute to it, I see a MUCH SHORTER route!
# traceroute -M icmp
formatting link
traceroute to
formatting link
(66.135.57.166), 30 hops max, 60 byte packets 1 192.168.1.1 (192.168.1.1) 2.849 ms 2.835 ms 2.831 ms 2 67-218-118-85.ridgewireless.net (67.218.118.85) 2.855 ms 5.644 ms
5.642 ms 3 10.50.0.1 (10.50.0.1) 10.434 ms 10.432 ms 10.428 ms 4 10.25.0.1 (10.25.0.1) 11.707 ms 15.285 ms 15.284 ms 5 10.20.0.1 (10.20.0.1) 15.280 ms 19.197 ms 19.193 ms 6 10.0.0.1 (10.0.0.1) 66.277 ms 60.195 ms 113.259 ms 7 69.36.226.193 (69.36.226.193) 103.422 ms 213.710 ms 235.362 ms 8 vl2.core2.scl.layer42.net (69.36.225.130) 235.334 ms 251.949 ms
251.924 ms 9 xe3-4.core1.mpt.layer42.net (69.36.239.110) 255.382 ms 134.485 ms
134.458 ms
10 peer1.com.any2ix.coresite.com (206.223.143.79) 149.430 ms *
180.892 ms
11 10ge.xe-2-3-0.lax-600w-sbcor-2.peer1.net (216.187.124.121) 180.882 ms 226.325 ms 226.300 ms
12 10ge-ten1-2.dal-eqx-cor-1.peer1.net (216.187.88.131) 240.823 ms
156.853 ms *
13 * 10ge-xe-2-3-0.sat-8500v-sbcor-1.peer1.net (216.187.124.39)
106.930 ms 106.903 ms
14 10ge.xe-0-0-1.sat-8500v-sbdis-1.peer1.net (216.187.124.66) 106.884 ms 141.148 ms 190.401 ms
15
formatting link
(66.135.57.166) 131.264 ms 74.009 ms 83.791 ms
B
billy
IIRC, when I had asked my neighbors, they had fewer hops to the same destination - so - I'm beginning to wonder if it's the sheer number of hops (or the time involved); but that's just a guess.
I'd be glad to post traceroute or ping results to ANY server you suggest, so we can compare with you.
I'll also ask a neighbor to send me his traceroutes and post them when/if I get them.
B
billy
I have sent all the email addresses on that list an email. I will write back if/when they respond. I don't have high hopes that they will - but - they might.
I gave them the unedited traceroute results just like I gave you.
B
billy
The ping is useless. Either that or I'm using it wrong.
Here's the cut and paste for the pings on Knoppix: # ping -M icmp centos.org ping: wrong value for -M: do, dont, want are valid ones.
(strangely it took minutes to time out on Knoppix so I killed it).
R
Rick Jones
I was, perhaps, being overly simplistic in my use of terms. I was lumping-in "classic" routing issues like loops and what not in with things like deliberate blacklisting.
Anywhere between that 15th hop in the traceroute and centos.org I would think.
That it comes and goes for months at a time has me wondering about the rate at which his ISP might be changing his assigned IP address (the one his gateway gets), and whether or not the "blackouts" correlated with that. That would require having kept a log of the noticed start and end of the blackouts and a log of the IP assigned by the ISP.
rick jones
P
ps56k
Your basic problem in this entire discussion is that you have no concept of the very basics in networking - called - a protocol stack -
Here is the TCP/IP version -
Application (like email, browser, etc) Transport (specify ports on computers) Internet (addressing & routing) Link (physical)
The browser lives at the very top - as an Application and has NO knowledge of ANY protocol issues at the lower layers. So, to keep asking about how the fix the browser is meaningless.
The lower layers are where TCP (Transport Control Protocol) and the IP (Internet Protocol) address live.
Next - is the physical and link.... this is the magic of "transmit" and "receive" -
SO - some routers and website might turn of their responses to ICMP messages (ping/echo etc) and it might appear they are not responding to those tools - but in fact - they are "ignoring" them.
On the topic of MTU (the size of the packets transmitted) I have never had a website not respond, but have had probs with a school system called Blackboard that would not function properly on a DSL line due to a MTU being less than the Blackboard required value of 1500.
WEIRD - I can ping and traceroute to --> centos.org but it does NOT reply to my browser request ??
This page cannot be displayed due to an internal error.
If you are the administrator of this site, please visit the Xoops Troubleshooting Page for assistance.
Error [Xoops]: Unable to connect to database in file class/database/databasefactory.php line 34
P
ps56k
it times out - done -
formatting link
M
Mike Easter
Presently centos.org is down for everyone
formatting link
It's not just you!
formatting link
looks down from here.
formatting link
It's not just you!
formatting link
looks down from here.
That has not been the case for the duration of this thread.
M
Mike Easter
Initiating server query ... Looking up IP address for domain:
formatting link
The IP address for the domain is: 85.12.30.227 Connecting to the server on standard HTTP port: 80 The port is closed, so our connection attempt was refused. Query complete.
U
unruh
He may not have, but it is irrelevant. He is not able to connect. Can you give him the cause? Can you suggest how he fix it? It is like if you brought me your car to fix and I told you that you had no concept of the basics of the Standard Model of particle phyics as if such knowledge would help you fix your car.
And you now call this weird. I thought you had an intimate knowledge of the protocol layers. Why is this weird?
Note that I have absolutely no trouble connecting to centos.org.
C
Chris Davies
I have.
Chris
Join the Discussion
Have something to add? Share your thoughts — no account required.
Didn't find your answer?
Ask the community — no account required
Report Content
You are reporting this content to the moderators. They will look at it
ASAP.