Yes but he's not saying "it doesn't matter." That's an entirely different sentence than "It no longer has any meaning for me." Now read these examples out loud and tell me which sounds better:
"It no longer has any meaning for me. Now I know the power of the dark side."
"That no longer has any meaning for me. Now I know the power of the dark side."