Home Network Performance Question

I currently have a cable connection split to 4 computers at home with a router. I am experiencing some bad ping times (on all comps). download speeds are good, but latency is bad. i'm wondering if this necessarily means that it's my isp's fault or is it possible that the router needs some type of tweeking. Do i have hope or not? Networking Pros please help.