JAIST prof develops software that can find all non-redundant substitution patterns in disordered systems, making computation in materials informatics faster

Symmetry is a prevalent feature of nature at all scales. For example, our naked eyes can easily identify symmetries in the bodily shape of countless organisms. Symmetry is also very important in the fields of physics and chemistry, especially in the microscopic realm of atoms and molecules. Crystals, which are highly ordered materials, can even have multiple types of symmetry at the same time, such as rotational symmetry, inversion symmetry, and translational symmetry.

Lately, alongside rapid progress in computer science, researchers have developed computational methods that seek to predict the physical properties of crystals based on their electronic structure. In practice, however, pure and perfectly symmetric crystals are seldom used. This is because a crystal’s properties can be tuned as desired by alloying them with other materials or randomly substituting certain atoms with other elements, i.e., doping.
Figure 1. Example of an atomic substitution in a crystal  CAPTION: Atomic substitution with La atoms: Ce8Pd24Sb → (Ce5,La3)Pd24Sb. The crystal structure was obtained from the ICSD database (CollCode: 83378). The space group is 221-Pm3m, and the crystal structures are depicted using VESTA.  Image credit: Kousuke Nakano from JAIST.
Accordingly, materials scientists are seeking computationally efficient approaches to analyze such alloys and substituted crystals, also known as solid solutions. The ‘supercell method’ is one such approach and is widely used to model crystal structures with random substitutions of different atoms. The symmetry of crystals, however, is actually a problem when using this technique. In crystals, there can be many substitution patterns that are physically equivalent to other substitutions if we simply translate or rotate them. Findings of these symmetric substitution patterns are not very meaningful, and thus their calculation when using the supercell method is a waste of time.

In a recent study, a team of researchers led by Assistant Professor Kousuke Nakano from the Japan Advanced Institute of Science and Technology (JAIST) found a solution to this problem. They developed an open-source software called “Suite for High-throughput generation of models with atomic substitutions implemented by Python,” or SHRY that can, in terms of symmetry, generate distinct substitution patterns in solid solutions and alloys [https://github.com/giprayogo/SHRY]. This work, which was published in the ACS Journal of Chemical Information and Modeling, was co-authored by doctoral student Genki I. Prayogo, Dr. Andrea Tirelli, Professor Ryo Maezono, and Associate Professor Kenta Hongo.

The team approached the problem from the angle of group theory. It turns out that searching for atomic substitution patterns in crystals is analogous to the problem of finding coloring patterns on the vertices of graphs under certain restrictions. This allows one to reformulate the original problem of finding non-symmetric atomic substitutions in crystals as exploring search trees depicting the coloring of vertices in graphs.
Figure 2. Example of a search tree representing an atomic substitution  CAPTION: In this search tree, three vertices out of eight are colored red in a cubic arrangement, representing the substitution of Figure 1. p(X) denotes the parent node of X, whereas C(X) denotes the set of children of X. Because of the symmetry of the cube, [p(X) and p(Y)], [X and Y] and [Z and W] are identical.  Image credit: Kousuke Nakano from JAIST.However, the way in which the search tree is explored is crucial. A simple, naïve approach in which all possible branches are searched and directly compared is impossible; the time and calculations required to grow uncontrollably for large systems. This happens because deciding whether to explore further down a branch requires information about all other branches besides the one being explored, which is technically referred to as ‘non-local information’.

To avoid this issue, the researchers implemented in SHRY a technique called canonical augmentation. “This method can decide whether a tree branch should be explored more deeply or not based solely on local information,” explains Dr. Nakano, “Most importantlytheorems from group theory guarantee that only distinct substitution patterns will be extracted, without over-or under-exploring the tree structure in the terms of symmetry.” The team verified that their algorithm was error-free by testing it thoroughly with data from a database of crystal structures.

It is worth noting that SHRY was written in Python 3, one of the most popular cross-platform programming languages, and uploaded to GitHub, a leading project-sharing online platform. “SHRY can be used as a stand-alone program or imported into another Python program as a module,” highlights Dr. Nakano, “Our software also uses the widely supported Crystallographic Information File (CIF) format for both the input and output of the sets of substituted crystal structures.” The team plans to keep improving SHRY’s code based on feedback from other users, boosting its speed and capabilities.

Overall, the software developed in this study could help scientists identify potential atomic substitutions in solids, which is the most common strategy used to tune the properties of materials for practical applications. SHRY will help speed up research and develop substituted crystals with unprecedented functionalities and superior characteristics.

Missouri S&T names AI expert Donald Wunsch founding director of Kummer Institute Center for Artificial Intelligence and Autonomous Systems

Dr. Donald C. Wunsch II, the Mary K. Finley Missouri Distinguished Professor of Electrical and Computer Engineering at Missouri University of Science and Technology, has been appointed founding director of the university’s Kummer Institute Center for Artificial Intelligence and Autonomous Systems. Wunsch will begin his duties on Dec. 1, when he completes his appointment as a program director in the National Science Foundation’s Energy, Power, Control and Networks program. AI expert Donald Wunsch, who joined the S&T faculty in 1999, has been appointed founding director of the Kummer Institute Center for Artificial Intelligence and Autonomous Systems. Photo by Michael Pierce, Missouri S&T.

As founding director, Wunsch will lead the development of the new center’s mission, vision, and strategic plan to develop a nationally recognized research center focused on the rapidly evolving fields of artificial intelligence and autonomous systems. Ultimately, the center will deploy the latest machine learning and artificial intelligence techniques to advance the performance and intelligence of a range of robotic and autonomous solutions. Wunsch will also be responsible for leveraging the breadth of capabilities and expertise among S&T’s faculty to strengthen collaboration with and among several university-based research centers.

The center was founded to spur regional, national and global development in artificial intelligence and autonomous systems, in alignment with the vision of the Kummer Institute for Student Success, Research and Economic Development at Missouri S&T. Late St. Louis entrepreneur Fred Kummer, a Missouri S&T graduate, and his wife June donated $300 million to Missouri S&T in October 2020 to establish the Kummer Institute. Their donation is the largest single gift ever to any public or private university in Missouri and one of the largest to any university.

“Mr. Kummer recognized the potential artificial intelligence and autonomous systems have to truly change the world,” says Dr. Kamal Khayat, interim vice chancellor for research and innovation at S&T. “I am pleased to welcome someone as accomplished and capable as Dr. Wunsch to lead our institute’s innovative efforts in these two truly transformative disciplines. The insights and expertise he has acquired throughout his career will be an asset to the entire S&T community as he steps into this new role.”

Before joining S&T in 1999, from 1984 to 1993, Wunsch worked for Boeing, culminating in his role as a senior principal scientist. In 1993 he joined Texas Tech University as an assistant professor with a joint appointment to the departments of electrical and computer engineering and computer science; he was promoted to associate professor at Texas Tech in 1998. He joined the electrical and computer engineering department at S&T in 1999 and has courtesy appointments in system engineering, computer science, business administration and mathematics, and statistics. In 2005, Wunsch served as president of the International Neural Networks Society (INNS), which bestowed upon him its Gabor Award in 2015 and its Ada Lovelace Award in 2019. He is a Fellow of the INNS and the Institute of Electrical and Electronics Engineers (IEEE) and was twice the Charles Hedlund Distinguished Visiting Professor at the American University in Cairo. Wunsch has mentored 23 Ph.D. recipients in computer engineering, electrical engineering, systems engineering, and computer science.

Wunsch’s research has focused on unsupervised learning, also known as clustering, particularly hierarchical and real-time versions; adaptive resonance and reinforcement learning architectures; hardware and applications; and various multidisciplinary collaborations. He has more than 500 publications to his credit, including 12 books.

“I feel honored and grateful for the phenomenal opportunity to help develop the Kummer Institute Center for Artificial Intelligence and Autonomous Systems,” Wunsch says. “For over two decades, I’ve been amazed at the novelty, diversity, and impact of S&T research. I look forward to supporting collaborations across campus, across our region, and around the world as we grow and intensify our competitiveness in these incredibly transformational fields. I would like to hear from internal and external stakeholders about how AI and Autonomous Systems can help them achieve their goals.”  

Wunsch earned a doctorate in electrical engineering and a master’s degree in applied mathematics from the University of Washington in 1991 and 1987, respectively. He also earned an executive M.B.A. from Washington University in 2006 and a bachelor’s degree in applied mathematics from the University of New Mexico in 1984 and completed the Jesuit Core Honors Program at Seattle University in 1981.

The Center for Artificial Intelligence and Autonomous Systems is one of four new research centers established through the Kummer Institute. The Center for Advanced Manufacturing is led by Dr. Richard Billo, who joined S&T in January. National searches for founding directors continue for the Center for Advanced and Resilient Infrastructure and the Center for Resource Sustainability.

DFG's Priority Program funds project on ML for molecular systems

Machine learning, meaning the ability to recognize important patterns in data sets and to generate solutions with the help of algorithms, is a research field of rapidly growing importance. In physics, chemistry, and biology with complex molecular structures, classical machine learning is reaching its limits. To better understand and use molecular data, new models must be developed. This is what the DFG's Priority Program "Use and Development of Machine Learning for Molecular Applications – Molecular Machine Learning" aims to achieve. At the end of the six-year funding period, software should be available that can be used by scientists in everyday life and enable new applications – for example in pharmacy. The energy transfer between light-absorbing molecules attached to a clay surface is at the focus of the project.

"Representing and calculating the properties of molecules in a computer is anything but trivial," said Professor Zaspel. "One of the main challenges is that we first have to generate new data instead of working with existing data as we normally do. Conceptually, that makes a big difference." The research group applies the so-called "multi-fidelity approach" of machine learning, which combines data of varying accuracy.

Complicated physical and quantum chemical calculations are required to produce the data. "This process is complex, expensive, and can take several days," explained Professor Kleinekathöfer. "We want to develop machine learning models based on the data that make large-scale calculations faster and more efficient. That would be extremely simplifying." This method can be used, for example, to improve special solar cells.

The tandem Kleinekathöfer and Zaspel jointly applied for the DFG project. For both of them, the attraction of the Priority Program lies not only in gaining new insights into their special fields but also in the interdisciplinary exchange with colleagues throughout Germany. More than a dozen universities and research institutions are brought together by the program, which is coordinated by Professor Frank Glorius of the University of Münster. "We hope for fruitful synergies," Kleinekathöfer said. At Jacobs University, the program is linked to the creation of two positions for Ph.D. candidates. The funding volume from the DFG for the two scientists amounts to almost 500,000 euros.