If the fence is cutting off his view, check the laws on "spite fences" first. Property disputes can get messy, especially when it gets to the courts. Don't do anything that they would see as "bad faith" and document all the extra measures you're taking to alleviate the situation (like building the berm, etc).