It's a big matrix multiplier that is tailored for machine learning model evaluation (not training). Often they are low precision as that's all you need for model evaluation (or "inference").

Think of it as a much less useful GPU because it won't do graphics.