He wasn't joking about marrying into money he was poking fun at himself for not being the world's best catch. Have you seen the guy? He knows what he looks like.
He's longfaced, drab-looking and not the world's most scintillating conversationalist (although he does have a grasp on the English language which even Bush admits he does not.)