Funny thing is you can actually conduct pretty well with just your hand.

Also a good conductor is usually an astoundingly good player of multiple instruments themselves.

It's kind of like how football (soccer) team managers are retired players that can still play better than the entire stadium wearing loafers and a suit.