I have a few of them, Lovetta, and i did that last year because like yours, it was looking tatty.
It grew back normally and when i looked at mine yesterday i saw that it's come through this cold winter okay and i probably won't need to cut it back this year.
However, seeing as it looks so healthy now though i might do it regularly - just to keep it strong !

Whilst I do trim back Lithodora, every few years I will throw out the plant and replace it with a new one.