Do You Have to Leave Family & Society to be Spiritual?

Gautama the Buddha left his wife and young son, in order to pursue the spiritual path. A questioner quotes this example when he asks about balancing the spiritual urge with social and family life.