«The most basic problem is that researchers often don’t share their source code. At the AAAI meeting, Odd Erik Gundersen, a computer scientist at the Norwegian University of Science and Technology in Trondheim, reported the results of a survey of 400 algorithms presented in papers at two top AI conferences in the past few years. He found that only 6% of the presenters shared the algorithm’s code. Only a third shared the data they tested their algorithms on, and just half shared « pseudocode »—a limited summary of an algorithm. (In many cases, code is also absent from AI papers published in journals, including Science and Nature.)».

Source : Missing data hinder replication of artificial intelligence studies | Science | AAAS