As we pulled up to the ornate gates of The Elms in Newport, I felt as though I was leaving New England for the French countryside.