He told me he's not happy

We spent New Year's Eve separately with our own friends, I drank more than I should have and got in a state. I got a taxi to my boyfriend and he was really angry with me being so drunk. He didn't speak to me for 2 days and the I text him when he was at work asking if we are ok and he replied saying he would be lying if he said yes and he feels fed up. We had a son when we were young and broke up when our son turned 2, we were on and off with each other for years and made a go of it again when we fell pregnant with our daughter 2 years ago. It was unexpected and our families didn't know we had been back together. He gave me a list of reasons why he isn't happy, says its because we don't do things together, I give him hassle when he travels to watch the football, he feels I'm not interested in moving to Australia with him. I broke down and cried my eyes out and he did little to comfort me, told me he still loves me and is sure things will get better in time. I cannot get any of it out of my mind though, I try to spend time with him, cook dinner for him and say nothing when he goes out but I feel a bit lost and it's made me realise its maybe me who should feel fed up as its me who cooks, cleans, does everything with the kids, I work and I show him every day that I love him, I tell him how much he means to me, how attractive I find him and I get very little back. I don't know what to do??