Rensselaer wins $250k grant to research ML algos, improve complex predictions

Dr. Yangyang Xu, assistant professor of mathematical sciences at Rensselaer Polytechnic Institute, has received a $250,000 grant from the National Science Foundation (NSF) to research challenges associated with distributed big data in machine learning. Artificial Intelligence digital concept illustrate of modern internet technology and innovative processes 3D rendering

Machine learning algorithms allow computers to make decisions, predictions, and recommendations based on input training data without being explicitly told what information to look for in the data. This technique has been broadly used ever since data mining was envisioned, but its potential has not been fully realized yet. For instance, marketers use machine learning to provide shoppers with product recommendations, photo apps use it for facial recognition, and mapping and traffic apps use it to estimate commute times, but identifying highly complex relationships requires much more data and computing power.

Deep learning is machine learning on a larger scale, involving the input of massive amounts of data and the formulation of increasingly complex predictions. With vast amounts of data, the use of multiple networked computers is necessary: a distributed system. However, computational and mathematical challenges arise. Xu and his team, which includes undergraduate and graduate students, will use the NSF grant to address some of these challenges. 

Simply put, Xu’s team will develop groundbreaking algorithms that allow multiple computers to work efficiently together as one. They will also focus on maintaining the security of distributed personal information, and on methods to improve the speed and accuracy of deep learning. Decentralized algorithms will also be developed for solving optimization problems containing conditions restricting the behavior of the intelligent agents involved.

“The main goal is to design optimization algorithms that have fast convergence and low communication cost for solving large-scale distributed machine learning problems,” said Xu. “A few stochastic gradient-type methods will be designed for solving a few classes of problems by exploiting their structures. These algorithms will incorporate several features including acceleration technique to have fast convergence, compression technique to have efficient communication, and asynchronous computing to have high parallelization speed up.”

“Dr. Xu’s research will not only advance the scope and applicability of large-scale machine learning technology, but it will offer exceptional opportunities for Rensselaer’s graduate and undergraduate students,” said Curt M. Breneman, Dean of the School of Science. “At Rensselaer, undergraduate students are offered hands-on, project-based research opportunities early on in collaboration with seasoned graduate students and faculty, and this experience makes all the difference in terms of their big-picture thinking and future employability. Through this grant, Dr. Xu’s students will be able to contribute to a widely used, cutting-edge technology.”

Brazilian researchers show superconductivity at higher temperature than usual

Certain materials at very low temperatures conduct electric current without resistance or losses. This property, known as superconductivity, was discovered in 1911 by Dutch physicist Heike Kamerlingh Onnes (1853-1926), who won the 1913 Nobel Prize in Physics for his research in the field. Discovery by Brazilian researchers featured on cover of the journal Nanoscale is noteworthy because of possible applications in next-generation electronic devices  CREDIT Daniel Rana Camarotto / Desayuno

Even though more than a century has passed since its discovery, research on superconductivity is still intense, owing both to the amount of information it provides about fundamental aspects of material reality and to its practical applications, in energy conversion, telecommunications, and medical diagnostic imaging, for example. 

One research line relates to the so-called “superconductive transition temperature” (Tc), below which a material becomes a superconductor. The importance of this topic is easy to understand, given the significance of obtaining superconductivity at ever-higher temperatures, I.e., as close as possible to room temperature.

A study with this focus by Brazilian researchers has recently been published as a cover feature in the journal Nanoscale. The article begins with a reference to the “great interest” in the topic owing to "possible applications in next-generation electronic devices”.

“In a previous study, our research group investigated the role played by pressure as a variable capable of modifying the transition temperature of a certain material. In the case of two-dimensional materials, an analogous process is obtained by the application of strains. That’s what our latest study is about,” said Edison Zacarias da Silva, a professor at the State University of Campinas’s Gleb Wataghin Institute of Physics (IFGW-UNICAMP) in São Paulo State, and principal investigator for the study.

Silva is a senior researcher for a Thematic Project supported by FAPESP. The study used a new supercomputer called Ada Lovelace at the National Center for High-Performance Processing (CENAPAD-SP), hosted by UNICAMP. The Center for Development of Functional Materials (CDMF) also collaborated. CDMF is one of FAPESP’s Research, Innovation, and Dissemination Centers (RIDCs).

In the study, the researchers used supercomputer simulations to investigate the superconducting behavior of a dimolybdenum nitride (Mo2N) monolayer at different temperatures and with the application of varying strains. The mathematical tool used to resolve the electronic structure of the material was density functional theory (DFT), a simplified model derived from quantum mechanics. 

In DFT, used in solid-state physics and theoretical chemistry to resolve many-body systems, the properties of systems with many electrons are determined using functionals (functions of functions) — in this case, the spatial distribution of electron density.

“Analysis of electron-phonon coupling enables us to detect the formation of Cooper pairs, which characterize a superconducting state,” Silva said. 

A phonon is a mechanical excitation that propagates through the crystal lattice of a solid. In classical physics, it can be described as an elastic wave, but considering that the phenomenon occurs on the atomic scale, it is necessary to use quantum physics, in which case a phonon should be thought of as a quantum of energy that travels through the lattice. 

Electron-phonon interaction generates an effective attraction between electrons, which leads to electron pairing, or the formation of Cooper pairs. Discovered by Leon Cooper, winner of the 1972 Nobel Prize in Physics, Cooper pairs flow together through the material without energy dissipation, resulting in superconductivity.

“We found that dimolybdenum nitride has a striking property, which is that it’s an electride and at the same time displays superconductivity at relatively high temperatures. Owing to their ionic nature, electrides have pockets of electrons confined in voids in the crystal, whereas superconductors, depending on the temperature, offer no resistance to the flow of electrons. Although these two properties appear to be opposites, they could coexist in the same material. That’s exactly what we showed in our study,” said Zenner Pereira, a professor at the Federal Rural University of the Semi-Arid (Ufersa) in Rio Grande do Norte State, and the first author of the Nanoscale article.

An important finding of the study was the strong correlation between the electronic properties of the material and the strain applied. “Our simulations also showed that the Mo2N monolayer became superconductive at the highest temperature of any material in its class at ambient pressure. The transition temperature ranged from 19.3 kelvin to 24.8 kelvin, depending on the strain,” Silva said.

Besides Silva and Pereira, Giovani Faccin, a professor at the Federal University of Greater Dourados (UFGD) in Mato Grosso do Sul, also participated in the study.

ICFO researchers use ultracold atoms dressed by light to simulate gauge theories

Our modern understanding of the physical world is based on gauge theories: mathematical models from theoretical physics that describe the interactions between elementary particles (such as electrons or quarks) and explain quantum mechanically three of the fundamental forces of nature: the electromagnetic, weak, and strong forces. The fourth fundamental force, gravity, is described by Einstein’s theory of general relativity, which, while not yet understood in the quantum regime, is also a gauge theory. Gauge theories can also be used to explain the exotic quantum behavior of electrons in certain materials or the error correction codes that future quantum supercomputers will need to work reliably, and are the workhorse of modern physics. Left pictures (from top to bottom): ICFO Alumni Anika Frölian, Cesar Cabrera, Elettra Neri. Right picture (from left to right): ICFO researchers Craig Chisholm, Ramón Ramos, Leticia Tarruell, together with UAB researcher Alessio Celi, in the lab at ICFO where the experiments were performed.

To better understand these theories, one possibility is to realize them using artificial and highly controllable quantum systems. This strategy is called quantum simulation and constitutes a special type of quantum supercomputing. It was first proposed by the physicist Richard Feynman in the 80s, more than fifteen years after being awarded the Nobel prize in physics for his pioneering theoretical work on gauge theories. Quantum simulation can be seen as a quantum LEGO game where experimental physicists give reality to abstract theoretical models. They build them in the laboratory “quantum brick by quantum brick”, using very well-controlled quantum systems such as ultracold atoms or ions. After assembling one quantum LEGO prototype for a specific model, the researchers can measure its properties very precisely in the lab, and use their results to understand better the theory that it mimics. During the last decade, quantum simulation has been intensively exploited to investigate quantum materials. However, playing the quantum LEGO game with gauge theories is fundamentally more challenging. Until now, only the electromagnetic force could be investigated in this way. 

{media id=285,layout=solo}

In a recent study at ICFO, in Barcelona, Spain, experimental researchers Anika Frölian, Craig Chisholm, Ramón Ramos, Elettra Neri, and Cesar Cabrera, led by ICREA Prof. at ICFO Leticia Tarruell, in collaboration with Alessio Celi, a theoretical researcher from the Talent program at the Autonomous University of Barcelona, was able to simulate a gauge theory other than electromagnetism for the first time, using ultracold atoms.

A gauge theory for very heavy photons

The team set out to realize in the laboratory a gauge theory belonging to the class of topological gauge theories, different from the class of dynamical gauge theories to which electromagnetism belongs.

In the gauge theory language, the electromagnetic force between two electrons arises when they exchange a photon: a particle of light that can propagate even when the matter is absent. However, in two-dimensional quantum materials subjected to very strong magnetic fields, the photons exchanged by the electrons behave as if they were extremely heavy and can only move as long as they are attached to matter. As a result, the electrons have very peculiar properties: they can only flow through the edges of the material, in a direction that is set by the orientation of the magnetic field, and their charge becomes apparently fractional. This behavior is known as the fractional quantum Hall effect and is described by the Chern-Simons gauge theory (named after the mathematicians that developed one of its key elements). The behavior of the electrons restricted to a single edge of the material should also be described by a gauge theory, in this case, called chiral BF, which was proposed in the 90s but not realized in a laboratory until the ICFO and UAB researchers pulled it out of the freezer.

An ultracold cloud that does not behave as its mirror image

To give reality to this topological gauge theory and simulate it in their experiment, the team used a cloud of atoms cooled down to temperatures about a billionth of a degree above absolute zero. As atomic species, they chose potassium, because one of its isotopes has two states that interact with different strengths and can be used as the quantum bricks to construct the chiral BF gauge theory. They then shone laser light to combine the two states into a single new one. This technique, called “dressing the atoms with light”, made them acquire peculiar interactions whose strength and sign depended on the velocity of the cloud. Finally, they created an optical waveguide that would restrict the motion of the atoms to a line and used additional lasers to kick the cloud and make it move at different velocities along it.

In normal conditions, letting the atoms evolve freely in the waveguide would have resulted in the cloud expanding. However, with the dressing light on, the images of the atoms taken in the laboratory showed completely different behavior. As Ramon Ramos explains, “in our system, when the atoms move to the right their interactions are attractive and cancel the behavior of the atoms trying to expand. So, what you actually see is that the shape of the cloud remains the same. In technical words, we realized a soliton. But, if the atoms move to the left, these atoms expand like normal gas”. The observation of atoms that behave differently when moving in opposite directions demonstrates that the system is chiral, that is, different from its mirror image. “When we observed for the first time the effect of chiral interactions in our atomic cloud, we were not trying to simulate a gauge theory. But the data was so beautiful and intriguing that we felt that we really needed to understand better its meaning. It made me change completely the research plans of the team”, says Leticia Tarruell.

The team quickly figured out that their observations were connected to a theoretical article published ten years earlier, which proposed to use an almost identical setup to study a modified type of electromagnetism. However, the results of the experiment never seemed to agree with their expectations. As Craig Chisholm recalls, initially “the results that we were obtaining did not seem at all aligned with any of the theory. The challenge was to understand which regime you had to be in to actually see the correct effect coming from the correct place and to eliminate the effect coming from the wrong place”.

For the experimental team, the meaning of the modified electromagnetism mentioned in the paper was also very unclear. It cited mathematical physics papers from the 90s, which established the connection with the gauge theories used to describe the fractional quantum Hall effect. However, as Tarruell says, “for experimental atomic physicists like us, the content of these works was very hard to grasp, because they were written in a mathematical physics language that was completely different from ours. It was really frustrating to know that the answer to our questions was there, but we were not being able to understand it! This is when we decided that we needed to bring a theorist into the picture.”

A very fruitful experiment-theory collaboration

For theoretical physicist Alessio Celi, who had worked for many years on high energy physics and gravity before switching to quantum simulation, reading the original gauge theory papers was easy. At the same time, he could understand the regime in which the experiments could be performed and their challenges. He sat down with the experimental team, and after several discussions came up with a model that could properly explain the experimental results. As he explains, “the main problem we had was to enter in the right framework. Once you knew where to look, it became an easy problem to solve”. Remarkably, there was a regime of parameters where this model was exactly the topological gauge theory proposed 30 years earlier to describe the behavior of electrons at the edges of fractional quantum Hall materials.

“I think that this project shows us the strength of interdisciplinary collaborations. Combining experimental tools of ultralow temperature physics and theoretical tools from high energy physics has made all of us better physicists, and resulted in the first quantum simulation of a topological gauge theory”, concludes Tarruell.

The team is already set to explore the new research directions opened by this project. Their goal now is to try to expand the experiments and the theory from a line to a plane, which would allow them to observe the fractional quantum Hall effect without the need for a quantum material. This would give access to exotic quasi-particles, called anyons, which in the future could be used for more robust forms of quantum supercomputing.