Hold on or let go??

i used to be have a bf who have a good job, nice family background, and honest man, and he wants to marry me, but i left him because he ignores all my drama, jealousy, no fun type of guy. and now i have a boyfriend who is very caring, very sweet, and i really enjoy hanging up with him, he always make me feel that i'm especial and i can totally feel that he loves me so much, and every argument we have even though i'm out of line he will be the one to say sorry, and he always try to be calm and understanding if i'm having drama issues, but his a liar! i accidentally met this guy went i visited a friend, we dating once and i find him interesting, but since i work far way from him we communicate through chat, and even though we are not seeing each other for long time i feel that we are connected so we make our relationship official to boyfriend/girl friend relation. and when i went on vacation to be with him a friend of mine and a friend of his told me things about him. During our courtship there are lots of things i didn't know about him, like his sexually involved in another persons, and when i say persons, a female and a couple of gays.he said that the girl just broke up with his bf and wants company plus sex of course, and the gays his doing it for money. and when he become my boyfriend he dumps the girl his sleeping with, because he loves me he said. but he still continue flirting with other girls and having sexual relationship with gays, but all this stop a week before my vacation. i tried to break up with him but his sweet talk and teared eyes caught me it make me feel that his totally sorry on what he did, and promise not to do it again so i stayed in our relationship. my vacation is over and i'm far away to him again. when i found out the truth i know i was in so much pain at that time. and the worst part was he didn't have the courage to tell me everything about him, he said he was afraid to lost me so he hides it from me. a few days after my vacation he told me he will go to her ex girlfriend, but i found out it was a party of one of his gay friend. he told me that nothing happened. and felt sorry again for lying he feels that i'm more comfortable knowing it's his ex gf party rather that his gay friend party. and he told me told me that he changed and i can trust him. and everytime we have argument he begs me not to look only his mistakes but also look to our good memories up to now were still in relationship. part of me knows that right now he can make me my life more enjoyable, but i know it will not last part of me loves him, but part of me hates him so much for all the lies he did… part of me want to trust him, but part of me knows liars can never be trusted… part of me want to see the changes he made, but part of me wants to get even for all the pain he cause me… he lies and lied about his lies... after all that happened i realized my old bf is much better that him so i tried to work things with him, but i'm still in relationship with my liar boyfriend. but i feel so bad getting back with my old bf while still on relationship with the other, his a honest guy and i can't hurt him so i avoid him, and i let him go so that he can find a girl who will also be honest to him. i know i'm better off without him. and if i broke up with him i know i can deal and manage my self being single. but i'm still with him and i really feel stupid on decisions i made. can anyone please tell me want to do....

hi....personally i feel you should not stay anymore with your recent boyfrind.because he is being dishonest to you...where dishonesty exists there never exists love..