Getting a little off topic here. Done more testing from the other "end" and as Peter suspected it is CLEARLY an issue with the default gateway on this end! Good thing I had already told the ISP about this before I even checked here.

Anyone yes I am mistaken about IPSEC.... running VOIP over an SSL VPN might have problems due to packet retransmission but not the typical IPSEC implimentation.

a) rekeying occurs at night when no one is using the phones

b) I use my own BSD based routers

c) I have 4 tunnels. Some are teleworkers and another is a branch office

d) G.729 codecs supporting about 15 users (probably max 8 concurrent voip channels.) The remotes use standard phones > FXS multiport adapters > VPN > FXO > PBX analog station ports.