Yep, I did the same and left it off almost all the steps I've made. I was consoled by the fact that, in 'real life', this handle often got quite bent, and was not always visible, being crushed up against the step itself.
Apart from that, having made a few, they are very easily dislodged, there being little area to glue.