I've been very shy about that label for this exact reason myself. Not only that, but even among a majority of mainstream liberal feminists that aren't explicitly TERFy, I feel like there is underlying bioessentialism in their form of feminism. As a black person in particular, womanist is usually what I'd call myself if I must.