West End affordable housing project has some worried about displacement