In the song "Fire and Rain" by James Taylor, when did the woman leave?

I enjoyed his songs very much. I really can't just choose only one to be my favorite.

BlueEyedAlien, Absolutely tre!

Actually the lyric says yesterday morning they told me you were gone. It doesn’t say when she left.

This has always been in my top 5 songs I could listen to over and over.