to put sb at a disadvantage
load the dice (against sb)
He has always felt that the dice were loaded against him in life.
Definitions from the Oxford Advanced Learner's Dictionary, 9th edition