Headliner

I am changing the headliner of my vw 98 beetle. It's a first generation. I am trying to remove the clock. It is independent, no rear view mirror or light connected to it. I see that in the back there ate two latches, but if I squeeze to remove, their are sponges, small square attached sponge like squares, that don't allow me to squeeze the clock out. Any ideas what to do? Do I take those sponges off? If I do, it will not be tight enough to place back, once I'eve added the headliner material. So what can I do?
Thanks for any help.