I'd buy a new PH meter.
Then after testing again you may be OK.

I've never heard of such a low PH so unless your garden is being watered with conc Sulphuric Acid or you are on top of a volcano emiting sulphur gas it has to be how you are testing the soil.

Garden centre pH meters are notoriously unreliable. A pH of 2 in a garden is impossible and 5 highly unlikely unless you are on a peat bog.

Get yourself a pH soil testing kit, the ones that use chemicals. They are quite accurate, very cheap, easy to use and cost under £10 and will do up to 60 or 70 soil tests.

I agree with all of these members, I have a PH meter and I find it is not any use at all as it gives off different readings everytime you put it in the same place in the garden, the best is as Myron says get a Ph soil testing kit