"Dark Ages" comes from Renaissance and Enlightenment scholars saying, "Thank God we're so smart. Those people were morons."

Also, it was after Rome really fell apart, darker times then the Empire certainly.