to make sb suffer a lot
cost sb dear
That one mistake has cost him dear over the years.
Definitions from the Oxford Advanced Learner's Dictionary, 9th edition