If I use your example and refresh the page, both dates stay the same. I tried it too on a fresh 3.1.13 install.
The only way I can reproduce your issue is, if I invalidate caching in the config.
SS_Cache::set_cache_lifetime('any', -1);
edit: ... or if I append a ?flush to the url