Although I have got a VERY slow internet connection I do not have the same experiences as you are making. Probably some add-ons or your av-software is delaying your browser.
have you try traceroute to check if one long detail within the path.
Its been this way for me for 5 years. Long latency. The stats look OK however.
Does not matter what browser, or wiried vs wireless.