In MP games,  what is that annoying yellow or red blinking box I sometimes see in the lower right-hand corner of the screen?

The blinking yellow or red box is a connection warning indicator. Yellow indicates that your connection is not good. Red indicates that it is very bad.