Standing still

I am so lost, that I don't know if I will ever find my way back. I am a divorced mother of 3 beautiful children. When I got married, I thought I loved him, but I really didn't know what love was. So when we divorced after 18 yrs, I figured that I would never feel that special love that you can feel when you meet your soul mate. That you read about and people talk about, I figured it's not for me.. I was wrong, 2 yrs ago I did meet him.. It is the most amazing feeling, the feeling wanting to share everything with him to be with him, to help, to just sit and do nothing, to touch him to kiss him. The problem I have he is divorced father of 3, two are older on their own one lives with his ex who he sees as often as possible, my children and I have never met him, as in introducing him to us. He does have some issues and it is understandable to a point. The next issue is the man that I love tries to make everyone else happy except himself. It's like he is trying to make up for something. His oldest daughter who is married lives with her husband and two beautiful babies. Recently he found out that the son in law wasn't paying the mortgage and now is losing the house. Now for the solution he is moving them into the house that him and is ex build and because he can't pay for his townhouse and the mortgage he will be leaving the townhouse and moving into the house (that he rented out the last 3 yrs) also. I have never met the ex. Seen her never met. I own a house, and he made the statement that he want to live together, but now because of his daughter losing her house, the "us" has fallen to the waste side. My children adore him to the ends of the earth, and have asked him to live with us. I have to add that I have shared custody with my ex with my kids, 2 weeks with them 2 weeks without. I pack a suitcase every 2 weeks and live with my boyfriend at his condo, when my kids come home I go home and he may stay one or two night, but always finds a reason why he can't. Then when every other Thursday comes he has his son and I don't see him until maybe Sunday or Monday when he bring his son back to his ex. I sometimes feel that he only wants to be with me when I don't have my kids. We also end up in some kind of argument when I have my kids. (I think it is his excuse not to come over). I love this man with everything I have. But I feel like it's not enough...

just have a discussion with him about the last part,coun can help.you need to accept him and he needs to understand your needs