In Japan Lolita is also the name of a fashion style ( very frilly dresses) so I think loli came from that and not the book. In English though it's probably referring to different things

Like in the anime Oshi No Ko there is one girl who is a bit taller than her senior at school, who she teasingly refers to as Loli-senpai