I never really thought about the fact that Tarkin knows who Darth Vader actually is and he probably knows that the entire galaxy is run by a Sith Lord.
“You, my friend, are all that’s left of their religion.”
He didn’t know about the Emperor in that respect.