I don't see why not, so long as the ground is not too soggy or frozen. I noticed on weekend that my peonies are already sending up shoots above soil-level. They take an age to establish, so don't expect any flowers this year.

I'd agree and make sure they go in at the same depth that they at now. They tend to 'sulk' but i have had them flower when i have moved them at this time of year.

They need to go in as soon as possible as long as the ground is not frozen. They start into growth very early