I found out how to swap the tree out; however, it does it slow time - ie you have to move through the terrain to filter the swap in.
Still, it makes it more exciting.
EDIT:
Cancel that, after driving for miles through the terrain, I turned around and the original tree was re-filling in behind me. The cheeky little scamp.