'Yes but this planet is on a much longer orbit and its [time it takes to orbit] is the same, so it must be moving much faster then the one you're teleporting to, where...'

I wholeheartedly disagree. The passage of time within a given frame of reference is an objective fact. Relativity existing doesn't negate objectivity. If anything, it makes the gathering of objective evidence and reference points more necessary.