Clicking and dragging icons from collapsed fences

I've noticed that when I click an area below a collapsed fence that it will sometimes click on a file that is in the fence above it. I expand the fence and find that the file was is in the exact same spot I clicked. I have also been accidentally moving them out of fences because of the same reason. I tried moving the fences to another desktop page. It still did the same thing almost as if the pages and fences are all on top of each other. Over all not a huge issue, but have had to restore layout snapshots multiple times because of this. Is there anything in the settings that could be causing this?