It's interesting to look at a graphic plot of a traceroute to see there the actual delays are. I use a program called pingplotter for this, but there are many such programs. Be warned though, that seeing a potential problem only leaves you feeling helpless, since there is typically nothing you can do about it.