Crews began hauling away illegal benches amid concerns from community leaders about safety and trash