Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.

Techniques are provided for increasing the accuracy of automated classifications produced by a machine learning engine. Specifically, the classification produced by a machine learning engine for one photo-realistic image is adjusted based on the classifications produced by the machine learning engine for other photo-realistic images that correspond to the same portion of a 3D model that has been generated based on the photo-realistic images. Techniques are also provided for using the classifications of the photo-realistic images that were used to create a 3D model to automatically classify portions of the 3D model. The classifications assigned to the various portions of the 3D model in this manner may also be used as a factor for automatically segmenting the 3D model.

A computer implemented method of generating at least one shape of a region of interest in a digital image is provided. The method includes obtaining, by an image processing engine, access to a digital tissue image of a biological sample; tiling, by the image processing engine, the digital tissue image into a collection of image patches; identifying, by the image processing engine, a set of target tissue patches from the collection of image patches as a function of pixel content within the collection of image patches; assigning, by the image processing engine, each target tissue patch of the set of target tissue patches an initial class probability score indicating a probability that the target tissue patch falls within a class of interest, the initial class probability score generated by a trained classifier executed on each target tissue patch; generating, by the image processing engine, a first set of tissue region seed patches by identifying target tissue patches having initial class probability scores that satisfy a first seed region criteria, the first set of tissue region seed patches comprising a subset of the set of target tissue patches; generating, by the image processing engine, a second set of tissue region seed patches by identifying target tissue patches having initial class probability scores that satisfy a second seed region criteria, the second set of tissue region seed patches comprising a subset of the set of target tissue patches; calculating, by the image processing engine, a region of interest score for each patch in the second set of tissue region seed patches as a function of initial class probability scores of neighboring patches of the second set of tissue region seed patches and a distance to patches within the first set of issue region seed patches; and generating, by the image processing engine, one or more region of interest shapes by grouping neighboring patches based on their region of interest scores.

Methods and apparatus, including computer program products, implementing and using techniques for classifying an object occurring in a sequence of images. The object is tracked through the sequence of images. A set of temporally distributed image crops including the object is generated from the sequence of images. The set of image crops is fed to an artificial neural network trained for classifying an object. The artificial network determines a classification result for each image crop. A quality measure of each classification result is determined based on one or more of: a confidence measure of a classification vector output from the artificial neural network, and a resolution of the image crop. The classification result for each image crop is weighed by its quality measure, and an object class for the object is determined by combining the weighted output from the artificial neural network for the set of images.

Methods and apparatus, including computer program products, implementing and using techniques for classifying an object occurring in a sequence of images. The object is tracked through the sequence of images. A set of temporally distributed image crops including the object is generated from the sequence of images. The set of image crops is fed to an artificial neural network trained for classifying an object. The artificial network determines a classification result for each image crop. A quality measure of each classification result is determined based on one or more of: a confidence measure of a classification vector output from the artificial neural network, and a resolution of the image crop. The classification result for each image crop is weighed by its quality measure, and an object class for the object is determined by combining the weighted output from the artificial neural network for the set of images.

In some aspects, systems and methods for rapidly building, managing, and sharing machine learning models are provided. Managing the lifecycle of machine learning models can include: receiving a set of unannotated data; requesting annotations of samples of the unannotated data to produce an annotated set of data; building a machine learning model based on the annotated set of data; deploying the machine learning model to a client system, wherein production annotations are generated; collecting the generated production annotations and generating a new machine learning model incorporating the production annotations; and selecting one of the machine learning model built based on the annotated set of data or the new machine learning model.

In a method for defecting surface defects, a trained weighting generated when defect-free training samples are used to train an autoencoder and pixel convolutional neural network is obtained. A test encoding feature is obtained by inputting the trained weighting into the autoencoder and pixel convolutional neural network and a weighted autoencoder of the weighted autoencoder and pixel convolutional neural network encoding a test sample. The test encoding feature is input into a weighted pixel convolution neural network of the weighted autoencoder and pixel convolutional neural network to output a result of test. The test result is either no defect in the test sample or at least one defect in the test sample. Inaccurate determinations as to defects are thereby avoided. An electronic device and a non-transitory storage medium are also disclosed.

A method of processing x-ray images comprises training an artificial neural network to process multi-spectral x-ray projections to determine composition information about an object in terms of equivalent thickness of at least one basis material. The method further comprises providing a multi-spectral x-ray projection of an object, wherein the multi-spectral x-ray projection of the object contains energy content information describing the energy content of the multi-spectral x-ray projection, The multi-spectral x-ray projection is then processed with the artificial neural network to determine composition information about the object, and then the composition information about the object is provided

Methods, apparatus, systems and articles of manufacture to improve deepfake detection with explainability are disclosed. An example apparatus includes a deepfake classification model trainer to train a classification model based on a first portion of a dataset of media with known classification information, the classification model to output a classification for input media from a second portion of the dataset of media with known classification information; an explainability map generator to generate an explainability map based on the output of the classification model; a classification analyzer to compare the classification of the input media from the classification model with a known classification of the input media to determine if a misclassification occurred; and a model modifier to, when the misclassification occurred, modify the classification model based on the explainability map.

Embodiments of the present invention are directed to learning of an appropriate dictionary which has a high expression ability of minority data while preventing reduction of an expression ability of majority data. A dictionary generation apparatus which generates a dictionary used for discriminating whether data to be discriminated belongs to a specific category includes a generation unit configured to generate a first dictionary based on learning data belonging to the specific category and a selection unit configured to estimate a degree of matching of the learning data at each portion with the first dictionary using the generated first dictionary and select a portion of the learning data based on the estimated degree of matching, wherein the generation unit generates a second dictionary based on the selected portion of the learning data.