I’m just thinking of space as part of the quartet that normally defines our universe: Matter Energy Space and Time, all considered physical. Now Distance needs something physical to be distant in, no? I agree that it, as a concept and even a reality is not in itself physical.
When I conceive of Dzogchen, the absolute Emptiness, I conceive of the distance-less, the into which the universe banged, as it were. A reality apparently beyond the human analytical ken.
As a practicing Buddhist I aim to experience all this first-hand one day.