Abstract
Human thinking requires the brain to understand the meaning of languageexpression and to properly organize the thoughts flow using the language.However, current natural language processing models are primarily limited inthe word probability estimation. Here, we proposed a Language guidedimagination (LGI) network to incrementally learn the meaning and usage ofnumerous words and syntaxes, aiming to form a human-like machine thinkingprocess. LGI contains three subsystems: (1) vision system that contains anencoder to disentangle the input or imagined scenarios into abstract populationrepresentations, and an imagination decoder to reconstruct imagined scenariofrom higher level representations; (2) Language system, that contains abinarizer to transfer symbol texts into binary vectors, an IPS (mimicking thehuman IntraParietal Sulcus, implemented by an LSTM) to extract the quantityinformation from the input texts, and a textizer to convert binary vectors intotext symbols; (3) a PFC (mimicking the human PreFrontal Cortex, implemented byan LSTM) to combine inputs of both language and vision representations, andpredict text symbols and manipulated images accordingly. LGI has incrementallylearned eight different syntaxes (or tasks), with which a machine thinking loophas been formed and validated by the proper interaction between language andvision system. The paper provides a new architecture to let the machine learn,understand and use language in a human-like way that could ultimately enable amachine to construct fictitious 'mental' scenario and possess intelligence.