Delete temporary internet files on exit using Group Policy

Click Start - Run and type gpedit.msc

Browse to:
User Configuration\Administrative Templates\Windows Components\Internet Explorer\Internet Control Panel\Advanced Page\Empty Temporary Internet Files Folder when browser is closed
Set it to enabled and either gpupdate or reboot.