Spielberg didn't really want to do Indy 4. Georgie convinced him. That's why Indy 4 was "missing something." Spielberg did it but wasn't really invested in it.
Plus, him and the actors are all saying, "We'll do it if George writes it." That doesn't sound reassuring, unless people think there isn't enough evidence of Lucas not being a very competent writer.