Certain perennials that have finished flowering, such as Campanulas, Lysimachias or Achilleas, you can cut them back. There are a few like Penstemons which need the top growth as protection in the winter though. Some plants also have attractive seeedheads that you may wish to leave. Don't be too tidy - insects like hiding places, and birds like seeds.