I would not remove the apples, unless rotten. It's supposed to be small, so i assume every thing about it is small. Wouldn't it be great in a pot? Wells

apples go through what is called 'june drop' the tree will naturally start to loose some of the apples. So that the others can ripen and get bigger. Do you know what root stock it is on? Mine are M27 I do thin out my apples as the branches get too heavy and I don't want the branches to break. A picture would be helpful

I know it might seem harsh, but I would recommend taking any emerging fruit off of your young tree. It needs to devote all its energy into strong roots and a good stem and branch structure.