Dr. Etzioni asked the new bot for “a novel joke about the singer Madonna.”

“It is not good at discussing the future. Though the new bot seemed to reason about things that have already happened, it was less adept when asked to form hypotheses about the future. It seemed to draw on what others have said instead of creating new guesses. When Dr. Etzioni asked the new bot, “What are the important problems to solve in N.L.P. research over the next decade?” — referring to the kind of “natural language processing” research that drives the development of systems like ChatGPT — it could not formulate entirely new ideas.”

Source : 10 Ways GPT-4 Is Impressive but Still Flawed – The New York Times