Thousands to not participate in census