That fence would be costly for him to replace or repair. Leo must follow up on those charges.
I think the husband was thinking how fun it would be to build a privacy fence so they have all the privacy they want to hunt the deer on their own property for a change and any holes in the newly erected "fence" would be additional proof that it is still an ongoing issue.