Hostname: page-component-848d4c4894-75dct Total loading time: 0 Render date: 2024-06-01T14:44:22.724Z Has data issue: false hasContentIssue false
  • English
  • Français

Extracting Grain Orientations from EBSD Patterns of Polycrystalline Materials Using Convolutional Neural Networks

Published online by Cambridge University Press:  18 October 2018

Dipendra Jha ,
Saransh Singh ,
Reda Al-Bahrani ,
Wei-keng Liao ,
Alok Choudhary ,
Marc De Graef  and
Ankit Agrawal
Dipendra Jha
Affiliation:
Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
Saransh Singh
Affiliation:
Department of Materials Science and Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA
Reda Al-Bahrani
Affiliation:
Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
Wei-keng Liao
Affiliation:
Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
Alok Choudhary
Affiliation:
Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
Marc De Graef
Affiliation:
Department of Materials Science and Engineering, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213, USA
Ankit Agrawal*
Affiliation:
Department of Electrical Engineering and Computer Science, Northwestern University, 2145 Sheridan Road, Evanston, IL 60208, USA
*
*Author for correspondence: Ankit Agrawal, E-mail: ankitag@eecs.northwestern.edu
Get access

Abstract

We present a deep learning approach to the indexing of electron backscatter diffraction (EBSD) patterns. We design and implement a deep convolutional neural network architecture to predict crystal orientation from the EBSD patterns. We design a differentiable approximation to the disorientation function between the predicted crystal orientation and the ground truth; the deep learning model optimizes for the mean disorientation error between the predicted crystal orientation and the ground truth using stochastic gradient descent. The deep learning model is trained using 374,852 EBSD patterns of polycrystalline nickel from simulation and evaluated using 1,000 experimental EBSD patterns of polycrystalline nickel. The deep learning model results in a mean disorientation error of 0.548° compared to 0.652° using dictionary based indexing.

Keywords

electron backscatter diffractionEBSDdeep learningconvolutional neural networks
Type
Software and Instrumentation
Information
Microscopy and Microanalysis , Volume 24 , Issue 5 , October 2018 , pp. 497 - 502
Copyright
© Microscopy Society of America 2018 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abadi, M, Agarwal, A, Barham, P, Brevdo, E, Chen, Z, Citro, C, Cor-rado, GS, Davis, A, Dean, J, Devin, M, Ghemawat, S, Goodfellow, I, Harp, A, Irving, G, Isard, M, Jia, Y, Jozefowicz, R, Kaiser, L, Kudlur, M, Levenberg, J, Mane, D, Monga, R, Moore, S, Murray, D, Olah, C, Schuster, M, Shlens, J, Steiner, B, Sutskever, I, Talwar, K, Tucker, P, Vanhoucke, V, Vasudevan, V, Viegas, F, Vinyals, O, Warden, P, Wattenberg, M, Wicke, M, Yu, Y Zheng, X (2016) Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint:160304467.Google Scholar
Adams, BL, Wright, SI Kunze, K (1993) Orientation imaging: The emergence of a new microscopy. Metall Trans A Phys Metall Mater Sci 24, 819–831.Google Scholar
Agrawal, A Choudhary, A (2016) Perspective: Materials informatics and big data: Realization of the fourth paradigm of science in materials science. APL Mater 4, 053208.Google Scholar
An, N, Zhao, W, Wang, J, Shang, D Zhao, E (2013) Using multi-output feedforward neural network with empirical mode decomposition based signal filtering for electricity demand forecasting. Energy 49, 279–288.Google Scholar
Bezijglov, A, Blanton, B Santiago, R (2016) Multi-output artificial neural network for storm surge prediction in north carolina. arXiv preprint: 160907378.Google Scholar
Bottou, L (1991) Stochastic gradient learning in neural networks. In Proceedings of Neuro-Nimes 91, 4th International Conference on Neural Networks and their Applications. Nanterre, France: EC2.Google Scholar
Briggs, F, Fern, XZ Raich, R (2013) Context-aware miml instance annotation. In 2013 IEEE 13th International Conference on Data Mining (ICDM), pp. 41–50. Piscataway, NJ: IEEE.Google Scholar
Callahan, PG De Graef, M (2013) Dynamical electron backscatter diffraction patterns. part I: Pattern simulations. Microsc Microanal 19, 1255–1265.Google Scholar
Cecen, A, Dai, H, Yabansu, YC, Kalidindi, SR Song, L (2018) Material structure–property linkages using three-dimensional convolutional neural networks. Acta Mater 146, 76–84.Google Scholar
Chen, YH, Park, SU, Wei, D, Newstadt, G, Jackson, MA, Simmons, JP, De Graef, M Hero, AO (2015) A dictionary approach to electron backscatter diffraction indexing. Microsc Microanal 21, 739–752.Google Scholar
Collobert, R Weston, J (2008) A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th International Conference on Machine Learning, Lawrence N and Reid M (eds.), pp. 160–167. Helsinki, Finland: PMLR.Google Scholar
Deng, L, Li, J, Huang, JT, Yao, K, Yu, D, Seide, F, Seltzer, M, Zweig, G, He, X, Williams, J, Gong, Y Acero, A (2013) Recent advances in deep learning for speech research at Microsoft. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 8604–8608. Piscataway, NJ: IEEE.Google Scholar
Gopalakrishnan, K, Khaitan, SK, Choudhary, A Agrawal, A (2017) Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Constr Build Mater 157, 322–330.Google Scholar
He, K, Zhang, X, Ren, S Sun, J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778. Piscataway, NJ: IEEE.Google Scholar
Kang, K, Oh, JH, Kwon, C Park, Y (1996) Generalization in a two-layer neural network with multiple outputs. Phys Rev E 54, 1811–1815.Google Scholar
Kingma, D Ba, J (2014) Adam: A method for stochastic optimization. arXiv preprint:14126980.Google Scholar
Kondo, R, Yamakawa, S, Masuoka, Y, Tajima, S Asahi, R (2017) Microstructure recognition using convolutional neural networks for prediction of ionic conductivity in ceramics. Acta Mater 141, 29–38.Google Scholar
Krieger Lassen, N (1992) Automatic crystal orientation determination from ebsps. Micron Microsc Acta 6, 191–192.Google Scholar
Krizhevsky, A, Sutskever, I Hinton, GE (2012) Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems 25, pp. 1097–1105. San Francisco, CA: Morgan Kaufmann Publishers Inc.Google Scholar
LeCun, Y (2015) Lenet-5, convolutional neural networks. http://yannlecuncom/exdb/lenet (retrieved March 15, 2018).Google Scholar
LeCun, Y, Bengio, Y Hinton, G (2015) Deep learning. Nature 521, 436–444.Google Scholar
Ling, J, Hutchinson, M, Antono, E Decost, B (2017) Building data-driven models with microstructural images: Generalization and interpretability. Mater Dis 10, 19–28.Google Scholar
Liu, R, Agrawal, A, Liao, WK, Choudhary, A De Graef, M (2016) Materials discovery: Understanding polycrystals from large-scale electron patterns. In 2016 IEEE International Conference on Big Data (Big Data), December 5–8, Washington DC, pp. 2261–2269. Piscataway, NJ: IEEE.Google Scholar
Marquardt, K, De Graef, M, Singh, S, Marquardt, H, Rosenthal, A Koizuimi, S (2017) Quantitative electron backscatter diffraction (EBSD) data analyses using the dictionary indexing (DI) approach: Overcoming indexing difficulties on geological materials. Am Mineral 102, 1843–1855.Google Scholar
Mikolov, T, Deoras, A, Povey, D, Burget, L Černockỳ, J (2011) Strategies for training large scale neural network language models. In 2011 IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), December 11–15, Waikoloa, HI, pp. 196–201. Piscataway, NJ: IEEE.Google Scholar
Park, WB, Chung, J, Jung, J, Sohn, K, Singh, SP, Pyo, M, Shin, N Sohn, KS (2017) Classification of crystal structure using a convolutional neural network. IUCrJ 4, 486–494.Google Scholar
Pham, A, Raich, R, Fern, X Arriaga, JP (2015) Multi-instance multi-label learning in the presence of novel class instances. In International Conference on Machine Learning, Vol. 37, Lawrence N and Reid M (eds.), pp. 2427–2435. Lille, France: PMLR.Google Scholar
Ram, F, Wright, S, Singh, S Graef, MD (2017) Error analysis of the crystal orientations obtained by the dictionary approach to EBSD indexing. Ultramicroscopy 181, 17–26.Google Scholar
Schütt, KT, Sauceda, HE, Kindermans, PJ, Tkatchenko, A Müller, KR (2018) Schnet – A deep learning architecture for molecules and materials. J Chem Phys 148, 241722.Google Scholar
Schwartz, A, Kumar, M, Adams, B Field, D (eds.) (2000) Electron Backscatter Diffraction in Materials Science, 2nd ed. New York, NY: Springer.Google Scholar
Singh, S De Graef, M (2016) Orientation sampling for dictionary-based diffraction pattern indexing methods. Model Simul Mater Sci Eng 24, 085024.Google Scholar
Singh, S De Graef, M (2017) Dictionary indexing of electron channeling patterns. Microsc Microanal 23, 1–10.Google Scholar
Sutskever, I, Vinyals, O Le, QV (2014) Sequence to sequence learning with neural networks. In Advances in neural information processing systems 27, pp. 3104–3112. San Francisco, CA: Morgan Kaufmann Publishers Inc.Google Scholar
Szegedy, C, Ioffe, S, Vanhoucke, V Alemi, AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. AAAI 4, 12.Google Scholar
Szegedy, C, Vanhoucke, V, Ioffe, S, Shlens, J Wojna, Z (2016) Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2818–2826. Piscataway, NJ: IEEE.Google Scholar
Van den Oord, A, Dieleman, S Schrauwen, B (2013) Deep content-based music recommendation. In Advances in neural information processing systems 26, pp. 2643–2651. San Francisco, CA: Morgan Kaufmann Publishers Inc.Google Scholar
Wright, SI, Nowell, MM, Lindeman, SP, Camus, PP, Graef, MD Jackson, MA (2015) Introduction and comparison of new EBSD post-processing methodologies. Ultramicroscopy 159, 81–94.Google Scholar
Wu, Z, Ramsundar, B, Feinberg, EN, Gomes, J, Geniesse, C, Pappu, AS, Leswing, K Pande, V (2018) MoleculeNet: A benchmark for molecular machine learning. Chem Sci 9, 513–530.Google Scholar
Xu, W LeBeau, JM (2018) A deep convolutional neural network to analyze position averaged convergent beam electron diffraction patterns. Ultramicroscopy 188, 59–69.Google Scholar
Zhou, ZH, Zhang, ML, Huang, SJ Li, YF (2008) MIML: A framework for learning with ambiguous objects. CORR abs/0808.3231, 112.Google Scholar