My guess is that your anti-virus Real Time Scan is doing this. While you browse your folders, your real time scan will check every files you open under Windows Explorer and check for viruses before displaying them to you. If you have a 1.2g folder with 4k files in them, it will take a long time to scan everything before showing you the folder.
Go into your anti-virus, and check for a feature that you can exclude folders from the Real Time scan (NOT the schedule scan). Put the folder that is causing the problem, and see how it goes...
Good luck.