The benefits of DERM AI
The machine learning algorithm built by Skin Analytics, Deep Ensemble for the Recognition of Malignancy (DERM), recognises the most common malignant, pre-malignant, and benign skin lesions. This includes melanoma, the most dangerous of the common skin cancers.
Almost all existing solutions for the recognition of skin cancer in images take a similar approach: using an existing ‘pre-trained’ neural network, and retraining it using skin lesion data. These ‘pre-trained’ neural networks (such as Google’s Inception network and Microsoft Research’s ResNet) are designed to perform very different tasks, such as large-scale image recognition (classification of 1000s of image categories, such as cats, dogs, and lamp-posts). While use of this approach gives a reasonable performance for an initial proof-of-concept, a solution of this type is inadequate for deployment in a medical device.
At Skin Analytics we’ve taken a different approach, designing all aspects of our machine learning architecture from the ground up for the specific problem we are trying to solve. This includes specifically tailored machine learning architectures, training methodology, and data augmentation for detection of skin cancer. Award
What is Artificial Intelligence? What is Machine Learning?
Artificial intelligence (AI) is the field of computer science which involves intelligence possessed by machines. Machine learning is a subset of AI that involves algorithms which are able to learn directly from data, without being explicitly programmed by a human. This technology is characterised by algorithms which are capable of learning complex representations directly from data itself.
While in theory this gives machine learning algorithms the ability to learn concepts beyond the comprehension of the programmer that built them, until recently machine learning was far more limited. ‘Classical’ approaches depended on the programmer creating code to extract useful ‘features’ from the data, so that they could be used by a machine learning algorithm. These ‘feature descriptors’ were limited by the perception and understanding of the programmer who built them, limiting the ability of the machine learning algorithm to learn from the data.
The implementation of ‘Deep Learning’ changed AI forever. Deep learning allows ‘features’ which describe the data to be learned directly from the data, without being explicitly coded by a programmer. In this way algorithms can be trained on data in an end-to-end manner, and highly complex features, beyond the understanding of the programmer, can be learned.
One of the biggest areas in which ‘Deep learning’ was first successfully applied was ‘computer vision’. This area of computer science involves using computers to understand high level concepts from images; essentially building software which can ‘see’. Given the highly visual nature of many aspects of medicine, deep learning is the perfect technology for application to assist in many medical fields.
Validated Dermatologist Quality Performance
While machine learning and deep learning are incredibly powerful tools, they also come with risks. A key problem area in machine learning is ‘overfitting’, this occurs when a machine learning algorithm finds patterns in arbitrary noise in the data set, which negatively affects the algorithm’s ability to be useful in the real world or; generalise.. An example of this can be found in detection of malignant skin lesions in dermoscopic images. Often lesions selected for biopsy are marked with a blue circle drawn in marker around the lesion. If images of this type are used to train a machine learning algorithm to recognise malignant lesions, this feature could be incorrectly learned as an indicator of malignancy.
In practice, examples of overfitting can be far more abstract. This is especially apparent in medical applications where trends in data gathered from a particular site, demographic, or using particular equipment, can contain biases which negatively affect the ability of the algorithm to generalise when applied to new, unseen data.
Observational research is extremely valuable to help prove the concept of your technology works. We have published an observational paper demonstrating DERM’s ability to identify melanoma within a dataset. Shortly we will publish an observational paper which further demonstrates DERM’s ability to find 11 different malignant, pre-malignant and benign conditions within a dataset. However, it is essential to validate any machine learning based medical device using a statistically powered prospective clinical study. This approach allows for an algorithm to be validated on a new, entirely unseen and representative data set.
Skin Analytics conducted the world’s first ever statistically powered prospective clinical study assessing the ability of a machine learning based algorithm to predict the presence of melanoma in images of skin lesions. A paper containing the results of this study was published in JAMA Open in 2019, and showed that Skin Analytics’ computer vision technology was capable of detecting melanoma at the same level as that of a skin cancer specialist.
Access to huge amounts of training data, processing power, and powerful algorithms does not equate to better outcomes. Without fully understanding the problem you’re trying to solve your returns will be diminished. Machine learning applied to healthcare is a complex multi-disciplinary area which requires expert knowledge in a number of fields. At Skin Analytics we have used this approach to build a powerful AI solution which is able to truly make a difference.