Boxing gym's owner said building is falling apart