Well we used to need a way for work to be done centrally because powerful matches were expensive. So X11s idea was just do everything remotely and draw the results locally. Then machines go cheaper so X11 was modified to render more locally processed stuff.

Now, we have thin clients, Citrix, and Remote Desktop what are much less efficient than the old X11 approach.