I have, as an INFJ, very hard with being around people who seem to love me. I'm like -very- introverted, even if I think I like them too.
And as so many people already said, feelings aren't set in stone, but ours (or at last mine?) change very slowly.