I don't really think that argument holds water; do you have to be an actor to know when acting isn't any good? Or do you have to be an artist to know you hate Jackson Pollock's work?
On the other hand, if you turn out a shoddy product yourself, you probably have no grounds to criticize others.