The Olive Tree analogy is in regard to "bearing fruit", or "service" under the Abrahamic Covenant. At the time when the nation of Israel was bearing fruit the Lord called them an Olive Tree:
"The LORD called thy name, A green olive tree, fair, [and] of goodly fruit: with the noise of a great...