Daphne comes to mind and have fragrance.

The only evergreen comes to mind is Magnolia grandifloria. Some are dwarf.

Camellia takes an age to grow tall.

How about Viburnum tinus or would it be too shady?

Choysia is good, always green mass of white flowers just coming out and a nice compact shape.

Drimys lanceolata is a shrub with presence, although the flowers are not scented. I recently posted photos of it.

Mahonia aquifolium - gets about 7 feet by 5 feet, fragrant yellow mimosa like flowers in early spring (just when the bees need 'em cos there's not much else in flower), followed by edible, blue black berries (bit tart for human taste). Can be pruned back after flowering if you need to, even grows in full shade.

Interesting that aquifolium berries are tart. I tried Charity ones and they were rather insipid.

Well I've not tasted them myself, that's what I've read about them - but everyone's taste buds are different, aren't they.... sometimes people say 'tart' when they actually mean 'bitter', well, to my tongue anyway.