In the picture below. The person going back is giving up because he doesn't think he will find what he wants. The other person still going will most likely find what he wants unlike the other guy. In the picture below. In the poem it says you will never know how close you are just like in the picture.
In this picture the person is not quitting riding the Ferris wheel well he do not have a choice to go off now.