I've had this specific situation happen to me so many times, and in all in the research I've done I still can't fully comprehend why. I believe it is buyers remorse, but all the threads I've seen about coming back from it are from when you fully sleep with her.
Basically:
1. Have a first date...