The importance of expert knowledge in big data and machine learning

• DOI: 10.1007/s11229-023-04041-5
• Publication Date: 2023-01-20T22:06:26Z
• Authors: Jens Ulrik Hansen; Paula Quinon
• Keywords: 06 humanities and the arts; 0603 philosophy, ethics and religion

Abstract According to popular belief, big data and machine learning provide a wholly novel approach science that has the potential revolutionise scientific progress will ultimately lead ‘end of theory’. Proponents this view argue advanced algorithms are able mine vast amounts relating given problem without any prior knowledge we do not need concern ourselves with causality, as correlation is sufficient for handling complex issues. Consequently, human contribution deemed be non-essential replaceable. We, however, following position most commonly represented in philosophy science, expertise remains. Based on an analysis methods two case studies—skin cancer detection protein folding—we show expert essential inherent application these methods. Drawing analysis, establish classification different kinds involved contexts. We address ramifications human-driven practice discussion about role theory. Finally, ways which both influence influenced by methodology involve continuous conceptual shifts rather than rigid paradigm change.