The side facing you .....? Could you please supply more information so that the gist of your question is better understood. :o)

The fence is either your or it is your neighbour's. If the fence posts are in your garden the it is your fence, if they are in your neighbour's garden it isn't.

Moongrower's right, if the posts are on your side then it's technically your fence.
What you'll tend to find, if builders have erected the fences, is that half the posts will be on your side. In my case, my LHS and the bottom fence is mine. The RHS is my neighbours.

It usually shows on your deed which side of the fence is yours. A neighbour once asked us when we were going to repair 'our' fence. They said it was ours because the posts were on our side. I took our deeds into them which clearly showed the fence the other side was ousr. They looked at their deeds and that clearly showed that what they thought was our fence was in fact theirs. Problem solved.

With closeboard fencing the straight part is usually facing the neighbour and you have the struts facing you - if its yours. On modern houses the fence post tend to be on the boundary so its hard to tell? Modern housing estate builders do tend also to make it easier by designating all the right or left fences (as yours) when looking at your property?But it says clearly on my deeds which fences are mine.

I suppose the builders decide how to put the fences up that's why what is shown on the deeds is correct.