One must judiciously retrospect not just his actions but also reactions of the other in order to arrive at a sensible conclusion. The primary fallacy is that you're assuming that the other is functioning out of awareness - which is falsity and this further aggrevates the mental agony, driving you farther from reality. Watch on!