It's the only connection Palpatine mentions with the Sith, even vague as it was. So one must asume he was talking about his former master. Yet, I feel details such as who was Palpie's master and the whole Qui-Gon thing were not fully answered so that fans could argue about it for the following 20 years...