Style transfer based data augmentation in material microscopic image processing

by   Boyuan Ma, et al.

Recently progress in material microscopic image semantic segmentation has been driven by high-capacity models trained on large datasets. However, collecting microscopic images with pixel-level labels has been extremely costly due to the amount of human effort required. In this paper, we present an approach to rapidly creating microscopic images with pixel-level labels from material 3d simulated models. Usually images extracted directly from those 3d simulated models are not realistic enough. It is easy to get semantic labels, though. We introduce style transfer technique to make simulated image data more similar to real microscopic data. We validate the presented approach by using real image data from experiment and simulated image data from Monte Carlo Potts Models, which simulate the growth of polycrystal. Experiments show that using the acquired simulated image data and style transfer technique to supplement real images of polycrystalline iron significantly improves the mean precision of image processing. Besides, models trained with simulated image data and just 1/3 of the real data outperform models trained on the complete real image data. In the study of such polycrystalline materials, this approach can reduce pressure of getting and labeling images from microscopes. Also, it can be applied to numbers of other material images.


Playing for Data: Ground Truth from Computer Games

Recent progress in computer vision has been driven by high-capacity mode...

Data privacy protection in microscopic image analysis for material data mining

Recent progress in material data mining has been driven by high-capacity...

Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Images

Most recent style-transfer techniques based on generative architectures ...

Mimicking non-ideal instrument behavior for hologram processing using neural style translation

Holographic cloud probes provide unprecedented information on cloud part...

Transferring and Regularizing Prediction for Semantic Segmentation

Semantic segmentation often requires a large set of images with pixel-le...

Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artworks

Convolutional neural networks (CNNs) have proven highly effective at ima...

Universal Material Translator: Towards Spoof Fingerprint Generalization

Spoof detectors are classifiers that are trained to distinguish spoof fi...

Please sign up or login with your details

Forgot password? Click here to reset