Yes, language -- a LLM trained only on English writing will have zero ability to respond to a question in Spanish. These LLM are trained in the language of genetics (e.g. ACTG).

It's like putting an internal combustion engine in a car or a boat. One navigates land and the other water, but the engine can actually just be the same one.