Why do I care if we weren't even ever together?

Ok so there is this guy, Kyle, and I really like him. I asked him for his number after we talked and he asked why I wanted it. I got reallya annoyed and we argued and then we walked away from eachother. Now, whenever I even driv eby his house and see him and his brother(or friends) out in the yard, I start to get really sad. I can't talks bout boys or hear any songs that sound like they are about what happened. Please tell me why I care!!! We were never together!!! I just had/have the biggest crush on him!!! Please help!!!