Can I ask if you have a true chalky soil which can be alkaline? Have you tested the soil?
Adding soil improvers,and organic matter will help. Organic matter tends to decompose quickly in alkaline soils and so needs replacing at least annually. Without regular additions of organic matter, chalky soils may turn to mud in winter and rock-hard in summer. Having said that Thyme, Rosemary, Bay (not too wet and sheltered) Sage, and Oregano will do well in chalky soil

i have hebes and my soil is chalky so yes they will grow ok.