We know that gravity causes things to fall with increasing speed, but as they speed up air resistance increases. Eventually the force of the air resistance is enough to balance the force of gravity, so the acceleration stops and the raindrop reaches a constant terminal velocity. Apparently the terminal velocity of rain isn't high enough to cause damage.