What you're describing sounds like the curvature or topology of space would be non-flat. AFAIK this hasn't been completely ruled out, but so far every piece of evidence suggests the universe is flat over vast distances.

Intuitively I'd say if there was curvature or topological irregularities at the furthest distances we can observe, there wouldn't be a consistent redshift observed on far objects because some of them would be coming towards us instead of pulling away.