Need an Expert? Try the Crowd

[zenmaster]

Indeed, would you say it is getting rid of the bias out of the bias detection methods ?

The point is with this approach, the ultimate result, even if it was the result of heavily biased input, is still going to be practical and potentially superior to conventional wisdom or years of work from a specialized researcher. There is a crowd-sourced check with the responses which automatically filters out "bad" questions. So this approach makes the question of 'bias' irrelevant. However, one might gain new insight into how some process works which may uncover some long-standing conceptual bias.

Still.. garbage in, garbage out - you need people experienced with the subject matter to offer the most relevant questions. Would be interesting to see if an instruction manual could be created using a similar method. For example, if the person follows a set of "questions" they would be led to an "answer".