I seem to be having some luck after rebooting my server. I also set the client to connect by the server's name as opposed to the ip. I'll see how long it lasts and reply if it times out again.
