If it is small palm, probably best to cut them off as a lot of the nutrients diverts into the flowering/seed production , so cutting them off reduces the stress on the palm, and puts the goodness back into the plant. well, this is what my dad told me and I always listen to him (these days!)

Also a good way of preventing a lot of messy fruit on the big ones!