I leave mine on until the spring - just as a feature, really, but you can cut them back when you want to.

I'd cut down the flowering stem as close to ground level as possible, when the flowers have faded, to get the plant to concentrate any remaining energy into root and foliage development, rather than natural reproduction, and give the poor thing a rest!

David - you've seen my HUGE Phormium! LOL.