to hurt sb by hitting or kicking them
rough sb up
He claimed that guards had roughed him up in prison.
Definitions from the Oxford Advanced Learner's Dictionary, 9th edition