I don't recall that to be normal.

I had to check because that sounded crazy. So maybe your scroll lock key is on? If so Excel does the same thing.