The biotech industry is constantly searching for the perfect mutation, where properties from different proteins are synthetically combined to achieve the desired effect. It may be necessary to develop new medicaments or enzymes that prolong the shelf-life of yogurt, break down plastics in the wild, or make washing powder effective at low water temperatures. 

New research from DTU Compute and the Department of Computer Science at the University of Copenhagen (DIKU) can in the long term help the industry to accelerate the process. The researchers show how a new way of using Machine Learning (ML) draws a map of proteins, that makes it possible to appoint a candidate list of the proteins that you need to examine more closely.

In recent years, we have started to use Machine Learning to form a picture of permitted mutations in proteins. The problem is, however, that you get different images depending on what method you use, and even if you train the same model several times, it can provide different answers about how the biology is related.

"In our work, we are looking at how to make this process more robust, and we are showing that you can extract significantly more biological information than you have previously been able to. This is an important step forward to be able to explore the mutation landscape in the hunt for proteins with special properties," says Postdoc Nicki Skafte Detlefsen from the Cognitive Systems Section at DTU Compute.

The map of the proteins
A protein is a chain of amino acids, and a mutation occurs when just one of these amino acids in the chain is replaced with another. As there are 20 natural amino acids, this means that the number of mutations increases so quickly that it is completely impossible to study them all. There are more possible mutations than there are atoms in the universe, even if you look at simple proteins. It is not possible to test everything experimentally, so you must be selective about which proteins you want to try to produce synthetically.

The researchers from DIKU and DTU Compute have used their ML model to generate a picture of how the proteins are linked. By presenting the model for many examples of protein sequences, it learns to draw a card with a dot for each protein so that closely related proteins are placed close to each other while distantly related proteins are placed far from each other.

The ML model is based on mathematics and geometry developed to draw maps. Imagine that you must make a map of the globe. If you zoom in on Denmark, you can easily draw a map on a piece of paper that preserves the geography. But if you must draw the earth, mistakes will occur because you stretch the globe, so that the Arctic becomes a long country instead of a pole. So, on the map, the earth is distorted. For this reason, research in map-making has developed a lot of mathematics that describe the distortions and compensate for the distortions on the map.

This is exactly the theory that DIKU and DTU Compute have been able to expand to cover their Machine Learning model (deep learning) for proteins. Because they have mastered the distortion on the map, they can also compensate for it.

"It enables us to talk about what a sensible distance target is between proteins that are closely related, and then we can suddenly measure it. In this way, we can draw a path through the map of the proteins that tell us which way we expect a protein to develop from to another – i.e. mutated, since they are all related to evolution. In this way, the ML model can measure a distance between the proteins and draw optimal paths between promising proteins," says Wouter Boomsma, Associate Professor in the section for Machine Learning at DIKU.

The researchers have tested the model on data from numerous proteins that are found in nature, where their structure is known, and they can see that the distance between proteins starts to correspond to the evolutionary development of the proteins so that proteins that are close to each other evolutionally are placed close to each other.

"We are now able to put two proteins on the map and draw the curve between them. On the path between the two proteins are possible proteins, which have closely related properties. This is no guarantee, but it provides an opportunity to have a hypothesis about which proteins it could be that the biotech industry ought to test when new proteins are designed," says Søren Hauberg, professor in the Cognitive Systems Section at DTU Compute.

The unique collaboration between DTU Compute and DIKU was established through a new center for Machine Learning in Life Sciences (MLLS), which started last year with the support of the Novo Nordisk Foundation. In the center, researchers in artificial intelligence from both universities are working together to solve the fundamental problems in Machine Learning driven by important issues within the field of biology.

The developed protein maps are part of a large-scale project that spans from basic research to industrial applications, e.g. in collaboration with Novozymes and Novo Nordisk.

FACT BOX: Artificial intelligence, machine learning, and deep learning

When computer programs can do something 'smart', it is called artificial intelligence – or just AI. Artificial intelligence is thus a unified concept that covers several methods. One of the methods is Machine Learning, and the latest and most advanced use of Machine Learning is called Deep Learning.

Deep Learning is based on neural networks, which is a mathematical model, where the model itself from a given dataset and without direct programming can learn to find patterns in data. Because you use data, it is called a data-driven model.

In unsupervised learning, the goal is to train a neural network to discover the underlying patterns in the data. This is typically done by attempting to compress data because it thereby rejects the trends in data that are least frequent, while the most important data takes up more information, so you can see the underlying patterns.

Utilizing many repetitions, the network learns which patterns in data can be used to compress data.

Once the model has been trained, it is tested on unknown data, which then also can be compressed into a compact representation that can be interpreted to form scientific hypotheses or form the foundation for other Machine Learning models.

Warming is making surface currents shallower and faster

An international team led by researchers at Scripps Institution of Oceanography at UC San Diego used supercomputer model simulations to find that climate change is altering the mechanics of surface ocean circulations, making them faster and thinner. 

These changes can have a ripple effect in the ocean, affecting the transport of the nutrients organisms need as well as that of microorganisms themselves. Swifter currents may also affect the processes by which the ocean removes carbon and heat from the atmosphere and protects the planet from excessive atmospheric warming.

“We were surprised to see that surface currents speed up in more than three-fourths of the world’s oceans when we heated the ocean surface,” said study lead author Qihua Peng, who recently joined Scripps Oceanography as a postdoctoral researcher.

The study, published April 20 in the journal Science Advances, sheds light on an underappreciated force behind the speed of global ocean currents. It helps resolve a debate on whether currents are accelerating as a result of global warming.

The wind has been the main factor scientists have studied to describe and predict the speed of currents, but the research team used a global ocean model to simulate what happens when sea surface temperatures are also increased. They found that warming makes the topmost layers of water lighter. The increased density difference of those warm surface layers from the cold water beneath limits the swift ocean currents to a thinner layer, causing the surface currents to speed up in more than three-fourths of the world’s oceans. The increased speed of rotating ocean currents known as gyres was associated with a slowdown of ocean circulation underneath. The team directly correlated the trend to the presence of ever-increasing levels of greenhouse gases in the atmosphere.

“Our study points to a way forward for investigating ocean circulation change and evaluating the uncertainty,” said Scripps Oceanography climate modeler Shang-Ping Xie, whose portion of the work is funded by the National Science Foundation.

Currents are organized into gyres in most oceans that are bounded by continents. The Southern Ocean that rings Antarctica is an exception. There, howling westerly winds make the Antarctic Circumpolar Current the largest in the world in terms of volume transport. Last year, Scripps scientists detected from ocean and space observations that the Antarctic Circumpolar Current is speeding up.

“The accelerating Antarctic Circumpolar Current is exactly what our model predicts as the climate warms,” said Xie.