I'd observe for a few days to see how the ladybirds do at decimating them. If they are still around you can either remove with your fingers (marigold gloves if squeamish!) or spray with soapy water.

the next best thing is to nip the tops out of the plant

Do make sure the soap is vegetable based (Ecover washing up liquid for instance) or the surfactants will be potentially toxic to Ladybirds and the environment in general.

Absolutely Ilex! I forget that most folk don't use vegetable based washing up liquid...