So he had some family issues, and then told you to concentrate on his family? He is probably stressed, and feels that he wouldn't have time to have a proper relationship with you - he doesn't believe he'd be able to hold up his end of things. Without specific details, I can't say how correct he is to say that. It's possible that if you try, you could help relieve some of his stress and thus help him with his issues. Conversely, if his assumption was correct, you would feel upset or abandoned by him, and the relationship would end. A relationship shouldn't feel like a career.
_________________
When I allow it to be
There's no control over me
I have my fears
But they do not have me