I had problems with some cards because it has current consumption more than 250 - 300mA in peak at insertion moment!!!
Maybe a short when inserting the sdcard into the socket?
Probably this is why I have seen inductors in some designs.
A ferrite bead might help.. I would be careful of adding larger values (ie 4.7uH) as with high ESR capacitors and a suboptimal pcb design it may make the situation even worse..