tense - What is the meaning of using the past simple for actions that continue to the present?

Are these sentences correct

I have loved you since I knew you [since (a point of time)]

means I'm still in love or very recently broke up. But what does

I loved you since I knew you [since (a point of time)]

mean? The use of the past simple indicates a "finished" action so I don't understand this sentence.