The arrow of time is established by probability, if you leave the overview, you can observe the individual interactions isolated from the context, there is no arrow of time there.