The most painful goodbyes are the ones never said