Vader did call him that in the Holiday Special. ;)
It's not luck, it's skill. Fett knew the Falcon was hiding somewhere close by. You didn't see the other bounty hunters hanging around in the garbage field.
Fett unfortunately was drunk off his ass on Jabba's barge. That's my theory, and I'm sticking to it. :P