Hey Jeyge,
At this point - the best course of action is to continue to isolate, isolate, isolate. Anything you think you can do to narrow things down (or eliminate any variables) - do it.
Personally, my next step would be to pretty much disconnect *everything* from the network (except for the machine that you're testing from), and run a test to see if the problem persists. If it does - odds are the router (or the machine you're testing from) is your culprit. If the issue isn't present when everything is disconnected - then start re-connecting things (one at a time - and testing each time) to see if you can pinpoint the culprit from there.
In the Roadmap to Network Nirvana guide - there's a printable worksheet that comes in very handy for these exact kind of situations. If you haven't checked that out yet - I would recommend it!
Please let us know what you find!
-Gary