You borrow a friend's drill for a week and buy them a bubble tea as thanks when you return it. Borrowing something costs a little something—that feels natural.
Flip it around: putting money in the bank is like "renting" your money to the bank to use, and the bank pays you interest. So an interest rate is both the cost of borrowing and the reward for saving.