So the full quote is:
“Into exile, I must go. Failed, I have.”
Yes?
I don’t think that line is necessarily a confession of failure over hundreds of years, but it’s MORE than “I lost a lightsaber fight.” If Yoda had beaten Palpatine in that duel, I’m guessing Yoda and Kenobi would stick around and try to restore the Republic instead of going into exile.