The scientific article considers the issues of practical quality assessment of modern machine learning models implemented on the basis of deep neural networks and visual transformers. The parameters of the conducted experiment on the ISIC 2018 dataset are described. The statistics on the categories of the considered skin lesions is given. The statistical analysis of the obtained results allowed the author’s team to form a new binary category: melanocytic and non-melanocytic skin lesions. Experiments on training neural network models were performed at the facilities of the NCMU Digital Ecosystem.