I think it all depends on how much air is flowing through the cave or tunnel (either naturally or with fans) and how many people are in a confined space breathing at any moment. With mining or tunneling you can also hit pockets of methane or other gasses that can be explosive or displace oxygen, but I think that's mostly a hazard in coal mines.