You have not said what type of plant you have. The risk of frost is gone now, so if the soil is prepared then you can plant out now.

Personally, I have started to put plug plants into a larger plant pot and put them in a suitable spot in the garden. After a few weeks you have a stronger plant with more growth and roots to put out. That helps to stop any slugs and snails from killing off a small plug plant.