Depends on how small or hard/easy life is there. I would argue that there is a sweet spot where if life is just hard enough to keep you busy but comfortable enough to keep you satisfied, most would never care. Too hard and there will be those who would take the risk, too comfortable and there would be those who would seek it out.

Personally if I lived my exact same life but in that city, I would go out at least once.