Someone please help, i need an opinion?

there's this guy.. first off, we're not dating. we hang out as much as we can (we live 4 hours apart) and we always have a great time together. he came to visit me once, and then hitchhiked home. a couple days after that he told me he didn't wanna hurt me and so he needed to stop things before we got in over our heads. he told me that he was in love with me, and i told him i loved him too. then a couple days after that, we were talking and i said i was gonna visit so we could talk things over, and he informed me that he'd hooked up with someone else. obviously, i was upset. well i ended up visiting, he assured me that it meant nothing and he had gotten cold feet and sabotaging things with us was his way of dealing with it. he was super bummed out (normally he's super upbeat and a chatty fella). he told me how kissing is a very intimate thing to him, but he never kissed the other girl. so i forgave him.. we're obviously still working through some things, we're gonna take things slow and not just jump into anything at this point. but i'm moving there soon for summer. is it worth it to pursue things with him or is this gonna end up being an incredibly painful and poor decision?