How Many Stars & Galaxies Could We Colonize?