This morning I also listened to Ray LaMontagne's
Gossip in the Grain. This is just a minor point (and I'm surprised I never noticed it earlier), but the "down"s in the recurring line "And watch the sun goin' down" is sung to two notes (F# to E), so - musically - it's descending just like the sun in the line.