Sure, that was designed to create a delaying action, but eventually heavier force would be applied to dislodge the defenders. And the pebbles, while not being entirely fatal to the occupants, could cause serious injuries when sent flying about.
A friend of my step-dad was part of an armored unit, first seeing action in North Africa with the early M4 (they had M3s on hand as well) and he had mentioned that while some Axis anti-tank guns wouldn't knock out their Sherman, the dislodged rivets would ricochet about the interior, causing serious injuries.
So in essence, the defenses have refused penetration by the enemy's offensive fire, but the crew attrition by way of injuries reduces their performance.