Last night I turned on QoS on my router and gave FFXIV the highest priority. For me there was a noticeable difference in load times around camps and around town. My roommate even commented on how much faster things were loading, I didn't tell him I was using QoS to curb his internet usage from messing with the game.
Just thought I'd suggest this, especially to anyone who shares their internet access.
UDP - 55296 - 55551
TCP - 54992 - 55551