Should I go for a man with 4 kids!?

Complicated story so sit down while reading! I was in a relationship and met a man who was in a relationship which was more like co parenting than love. THey had two kids. I didn't have any. He had one other from a one night stand in his twenties. Over the course of two years, we fell in love but were treading carefully b/c he didn't know if he felt comfortable leaving his relationship for me, even though i was in love with him, I attract a lot of men, and had he left his kids of me, and then i left, he was too worried. I also, was too afraid to hurt my boyfriend. Fast forward after one night of bliss 2 1/2 years into this, and we're having a baby. He said on his own accord, he wants to leave his house, and we just put a deposit on a house. We're excited but it hasn't come without cost to the people who loved us dearly and we left. THEN, i was blindsided by the fact that this man didn't have two kids with this woman, there was actually a 3rd somewhere in between my meeting him and falling in love. He said he regrets getting her pregnant so much but loves his kids so much, and feels if he told me, i would walk out. I feel betrayed. So , net net, I now have 4 step children, and one natural on the way. I'm 35 and he's 47, am i crazy? The good thing is we're very in love, and we make a good team. ADVICE WELCOME