The generation of large-scale biomedical data is creating unprecedented opportunities for applications of AI solutions. Typically, the data producers develop initial predictions using AI, but it is very likely that the higher performing AI methods may reside with other groups. Crowdsourcing the analysis of complex and massive data has emerged as a framework to find robust methodologies in healthcare and drug discovery. When the crowdsourcing is done in the form of collaborative scientific competitions, known as Challenges, the validation of the AI methods is inherently addressed. Challenges also encourage open innovation, create collaborative communities to solve diverse and important biomedical problems, and foster the creation and dissemination of well-curated data repositories.