from or living in a poor area or part of town
from / on the wrong side of the tracks
Definitions from the Oxford Advanced Learner's Dictionary, 9th edition