Eventhough the everyday use has shifted more to connection with prison. Originally the paying part is an integral part of the word. With something materialistic, not by doing time or getting hit (as punishment can imply. Though we still use the figurative "you will (have to) pay for that !!" it usually does not mean they want money, but you ll more likely get beat up..
Interestingly pain and fine have the same origins/root. (and both are/have been the consequences of doing something wrong, retribution)