Did i leave for no reason?

no, you didnt break up with him for no reason. if he was doing all of that, he is not worth yourtime.