Check out bagworm - not the right shape but similar.

Somewhat similar but not consistent with bag worm.

could be a spider cocoon either about to have hatchlings or just emptied of hatchlings.

It's way too cold outside for anything to hatch out now or recently. We've just had a week below freezing (I think it's heading your way). Everything is dead now. Whatever is in here, will most likely hatch out in the Spring. This is still very much alive.

It looks like a praying mantis egg case, to me. But, if that were true, it should be stiff like foam insulation, once dried.

That could be it Tugbrethii. It's kinda spongy, like styrofoam, so maybe not completely dried off yet. Looks just like the pictures on Google. I hope that's what it is! They are cool to have around. Thanks for your input.