Can I plant a Cerinthe in a pot?

Yes. I hope it grows well for you.

They dislike transplanting, so don't be surprised if it dies afterwards!

I grew them one year and was very disappointed in them, perhaps I didn't feed enough - don't remember if they were transplanted or sown in situ.

I think they are better in pots and it is far easier to gather the seed then for next years plants.

They always perform poorly in pots, and as stated they really dislike root disturbance.
Being blessed with 20/20 vision, I find collecting the large seeds easy enough, but if I had to listen for them I'd be stuffed!!
My tip is to hold onto the seeds until mid to late August and them toss them down where you would like them to grow. As long as it's reasonably sheltered, they'll survive the winter and reward you really well next year.