Let's plant a tree by Mr. Olsons fence.

is that a sentence

Yes, it is.

One correction -- Mr. Olson's fence.
You need the apostrophe there because Mr. Olson owns the fence.