When there are too many young fruits the tree will shed some, this is called the June drop,bit early this year.

Most likely June drop as Mick says...could also be lack of water, or just an immature tree. Hope some stay on and grow for you! :)

I would give it a good soaking ... but nothing unusual for them to drop some but have to agree it is early..