Ted Nugent is also bonkers but I love his music. But no I never thought of Speaker for the Dead as sexist. One of the protagonists is a brilliant female scientists who makes many independent contributions without help from a man.
Ted Nugent is an awesome guitarist and rocker. Just because someone is nutty (or even downright despicable) does not mean their work should not be appreciated.