Hi Bee,
What do you have growing at the moment that needs taming?
It's often a good place to start with what's already there - deciding what you want to keep or get rid of.

Does the stone go over the whole site? That will limit you growing most trees but you might be able to grow some reasonable shrubs even in a foot of soil, or you could build raised beds to give extra depth.

Check out the RHS site for lists of plants for chalky or limestone soils - you won't be growing rhodedendron (no bad thing, in my view), but you could have lavender, honeysuckle and jasmine (for starters).

ps to the above - well worth checking the pH of your soil before buying any plants.

Many thanks for your help, Urbanite :o)
Since I'm an absolute beginner, your addition about checking the soil pH was extra helpful. Just the kind of advice I need. Real basic stuff 'for Dummies'.
Thanks again. :o)

A lot of native flowers like chalk - think of the South Downs. Try an Internet search for 'plants for chalk' or 'plants for limestone' (limestone will probably give more plants suited to rockery setting).
Good luck with it.