Sketchy work-in-progress:

☆☆☆

LLMs, to become human-level problem-solvers, need the same architecture of mind which the humans have. Most of all, I think LLMs need imagination. Imagination is the inner sense of sight. With imagination, and some operating principles of imagination, LLMs could become, for some more areas, human-level problem-solvers and more. Deep Learning Networks are capable of producing, with words, all the required intellectual operations of a problem-solving imagination: future steps should include giving them the imagination required to solve more tasks.

This architecture I imagine, in its simplest formulation, as follows: