That way you're not using it as a monitor, you're using it as a terminal - the difference is that the machine running the programs isn't drawing the image itself. The "X Window" system used by Linux has been allowing that for ages.
Performance problems lie in bitmap graphics, video replay, and everything 3D or otherwise realtime.