If you were me would you be confused to? ?

i see why you're confused. just try to plan a time for just you 2 to hang out and tell him if he can't do that it's not going to work. if he makes time, he really likes you. if he doesn't he isn't worth it!