to keep breaking small pieces off sth
chip away at sth
He was chipping away at the stone.
Definitions from the Oxford Advanced Learner's Dictionary, 9th edition