Maybe we are moving backwards through time and that’s why we can only see clearly into the past. As GP comment hinted at, it’s a matter of cultural perspective.
I don't think cultural perspective as much as pure philosophy. As a coder, I once realized that the entire universe's events could be an existing stack, and in that stack exists the events that create the universe, because of the requirement of consistency. Us experiencing time would just be those events being popped off that stack.
This stack view is equivalent to what you are saying, and there is no reason to believe it can't be the case since it does make consistency easily satiable.
