This is a default Internet Explorer behavior I've hated for a long time. (I moved on to Opera quite some years ago, however, so I don't know if IE "fixed" the problem previously and it came back in IE in Win8 or something.)
ie10 Metro automatically reloads the page when I go back. - Microsoft Community
Summary: Maybe sort of, but not really. At least not yet? (Log in and "me too" the question, if that helps MS see traffic, no idea.)
The "Check for newer versions of stored pages" option might work for only the desktop version, according to one comment, and the Metro IE10 (at least in WinRT) doesn't give additional options pertaining to refresh. I found a couple comments here and there saying that using the back button in Metro IE10 is better than swiping (what's the point, then). I can't test this extensively, right now, though...
Edit: May or may not be fixed with 8.1 RTM--someone said yes and another said no, but the latter was on preview, so who knows. I don't suppose someone with RT 8.1 final could check.