Harry Potter director says he was fired from the original Fantastic Four for having “too much of an opinion”