If water gets into the skimmer and freezes, damage is almost inevitable.

Another thing better about fencing is that it doesn't cover the beautiful landscaping that the pool water provides. If it is due to the budget, look to buy one with mildew inhibitors, reinforced seams and even UV stabilizers.