I think it's because the antivax movement originated with mothers, who are usually much more concerned with their children's health than fathers. So antivax sentiment trickles through female social circles faster than male circles. I bet if you looked at health theories promoted by Joe Rogan they wouldn't be as common in women than in men.