Windows uses the special recents folder to remember which files you have opened. You can have a look to check what Windows has stored:
Dir ([Environment]::GetFolderPath("Recent"))
To get rid of that information, delete the folder content:
Del "$([Environment]::GetFolderPath("Recent"))\*.*" -whatif