Yeah, I think we're meant to think that he's already accomplished everything he needed to accomplish, and now Camelot can carry on without him, even though we never saw much of that on screen. The whole premise of the early years was that Merlin needed to protect Arthur because Arthur would bring magic back to the land, but... he didn't. Not even a little.