A Foregone Luxury - Domestic Lilly Pad In The Middle Of An Ocean

The protagonist is a young United States Army lieutenant, Philip Nolan, who develops a friendship with the visiting Aaron Burr. When Burr is tried for treason (historically this occurred in 1807), Nolan is tried as an accomplice. During his testimony, he bitterly renounces his nation, angrily shouting, "Damn the United States! I wish I may never hear of the United States again!" The judge, on convicting him, icily grants him his wish: he is to spend the rest of his life aboard United States Navy warships, in exile, with no right ever again to set foot on U.S. soil, and with explicit orders that no one shall ever mention his country to him again. - Wikipedia