I love you I think

I have been dating my boyfriend for almost two years. During these two years I have been going to school 4 hours away from him. We have had two summer breaks together and a winter break together. We have also known each other for about ten years before actually starting to date. Our relationship has had some ups and downs just like most relationships and not long into our relationship I knew I had really strong feeling for him or possibly even loved him. I knew it was too soon to say anything so I kept it to myself but then some serious events occurred in our relationship which confirmed my feelings I was/am completely and totally in love with this man. About a year into the relationship I couldn't hold back from telling him so I confessed my love for him only to get nothing back in return so I stopped saying it after that. About 3 or 4 months went by when he decided to say I love you. It felt like the happiest moment in my life and I was again comfortable to say it back to him knowing now that he felt the same way. The I love yous continued for about a month but then they stopped I asked him if he loved me and he said I do not know so we got into a fight about him saying it when he was not sure if it was how he felt. Time past again without him or I saying it to each other and it was destroying me because I knew and know my feelings for him. About a week ago I went back home to sending our once a month weekend together and he woke me up in the middle of the night to tell me he loved me but instead of saying it back to him all I could say is you can not take it back this time he promised he would not take it back. I love him so much but I am afraid he will take it back again. So this is my problem.