U.S. government debt rallied slightly Tuesday morning, but long-dated yields remained near their highest levels since late July as deficit concerns weighed on investors and traders.