We're just friends but he's suddenly started to touch me... please help

i am really good friends with a guy at my school. i really really like him and i wish we could be an awful lot more than friends but thats all he wants to be. But a week ago we were sitting on a bench on the yard with the rest of our gang and he suddenly put his hand on my boob and moaned. i was so surprised i just didn't know what to do but i do really love him so i didnt take it away. a few days ago it happened again, we were waiting for the teacher at the start of a lesson and he put his hand down my shirt and moaned again. then he put his hand up my skirt and touched me there. i have had sex before so im not worried but i just dont know what to do. ive asked him about it and hes just the same as always and says we're just good friends. When i mention the touching thing he just looks kind of confused and raises his eyebrows and just carries on as normal. pleeeaaase advise on this!!! i REAAAALLy like him.