Perhaps that is the problem; no past exists but our memories, and no future but a speculative gaze, lost in thought. All that rests is presence. This is not obvious, but inherent. If we want to understand ourselves, we can't do it through theorizing (Beating the bush, for certain!) It can only be done directly, now, here. Then we see there is no "we" nor "you," and so you are all things. You are other. You are sunsets, papers, peoples and the like.
Even so, let us carry on and continue the rabble another day longer.