It’s also confusing, like “if walking costs me $1” who am I paying this dollar to?

You could look at it from the perspective of personal expenditure (shoes / calories / etc). But biking is vastly more efficient than walking, so it seems like you're almost being penalized getting in more mph.