The ancient Greeks thought that the Muses were the source of ideas. Many contemporary artists believe they reveal, rather than generate, ideas through “channeling.” My personal view is that ideas are typically produced when people divorce themselves from their senses, as in dreams. It’s clearly a debatable point, and one that may never be resolved.
AI is hyperrational. It doesn’t have a subconscious. It isn’t capable of divorcing itself from reality and receiving revelations. As a result, it cannot replace natural intelligence; in fact, the classical definition of man as “rational animal” may have to be replaced by referencing emotions and the subconscious.