Visual perception is influenced by what we've seen before, a phenomenon known as 'serial dependence' in visual perception. This helps maintain stability in our perception and also supports accurate perception of the world due to the temporal regularities in our environment. We investigated whether serial dependence is stronger when consecutive elements share the same identity across changing views. Specifically, we hypothesized that this dependence is more affected by spatial correspondence in relative rather than absolute space, as relative spatial correspondence supports object identity across time more consistently than absolute correspondence. Previous studies have shown strong spatial specificity in serial dependence, but the exact spatial coding remains elusive. To test our hypothesis, we designed a task where two targets changed positions together between views, allowing us to distinguish between relative and absolute spatial correspondence. Our findings reveal that serial dependence was significantly influenced by relative spatial correspondence but not by absolute spatial alignment. This modulation also extended to non-target elements. These results suggest that serial dependence plays a crucial role in maintaining the perceptual continuity of objects over time amidst dynamic changes in our environment.