The Paradox of an Infinite Universe

What is outside of the universe? We know that the universe had a beginning 14 billion years ago and that it has been expanding ever since.
But something that is expanding should also have an edge, right?
What would you see if you went there?