Another PVP postFollow

I haven't seen this discussed, but here goes:

Let me start by saying I am not into PVP and not an expert...

The other day I was questing in Winterspring. I notice a druid talking to the same NPC as me. He quickly leaves and goes stealth. I figure I'm about to get attacked. Fire off a Bliz lvl 1 - Nothing.

Oh well he left.

I go to leave, he jumps me. This is where it got wierd.

I nova, blink, turn and begin walking backwards on a road. Get off 1 Frost Bolt (FB) - Nova Breaks. Now I hadn't fired off my Reset Frost timer - so maybe he was worried about that - But the guy just stalked me. He never made up any ground, he never charged.

Question:
Was the guy waiting for me to reset, re-nova, then charge -- Or did I just actually kite someone to death?

I just backed up, Fire Blast, CoC, walk walk walk - FB, CoC.

The reason I ask is that this has occured 2 times to me. Both times the offender seemed more worried about Nova - than actually attacking me.