If all the poor people drop dead tomorrow, the emissions will change. And the number of animals will decrease.
You do have an impact. It is no negligible.
It is not sufficient to cut the emissions of rich people to zero. It is necessary and the majority, but all of us need to stop putting GHG into the atmosphere