have (someone) down
To invite someone who lives north of one's home to visit. They keep saying that they want to have us down, but I have no interest in traveling all the way from Vermont to Texas just for a weekend.
have someone down
to have someone for a visit to a place that is on a lower level or in the south. (Fixed order.) Why don't we have Roger down for the weekend? They had us down to their place in Florida.