With launch of new night sky survey, UW researchers ready for era of big data astronomy

The ZTF took this “first light” image on Nov. 1, 2017, after being installed at the 48-inch Samuel Oschin Telescope at Palomar Observatory. The Horsehead nebula is near center and the Orion nebula is at lower right. The full-resolution version is more than 24,000 pixels by 24,000 pixels. Each ZTF image covers a sky area equal to 247 full moons.Caltech Optical Observatories
The ZTF took this “first light” image on Nov. 1, 2017, after being installed at the 48-inch Samuel Oschin Telescope at Palomar Observatory. The Horsehead nebula is near center and the Orion nebula is at lower right. The full-resolution version is more than 24,000 pixels by 24,000 pixels. Each ZTF image covers a sky area equal to 247 full moons.Caltech Optical Observatories

The first astronomers had a limited toolkit: their eyes. They could only observe those stars, planets and celestial events bright enough to pick up unassisted. But today's astronomers use increasingly sensitive and sophisticated instruments to view and track a bevy of cosmic wonders, including objects and events that were too dim or distant for their sky-gazing forebears.

On Nov. 14, scientists with the California Institute of Technology, the University of Washington and eight additional partner institutions, announced that the Zwicky Transient Facility, the latest sensitive tool for astrophysical observations in the Northern Hemisphere, has seen "first light" and took its first detailed image of the night sky.

When fully operational in 2018, the ZTF will scan almost the entire northern sky every night. Based at the Palomar Observatory in southern California and operated by Caltech, the ZTF's goal is to use these nightly images to identify "transient" objects that vary between observations -- identifying events ranging from supernovae millions of light years away to near-Earth asteroids.

In 2016, the UW Department of Astronomy formally joined the ZTF team and will help develop new methods to identify the most "interesting" of the millions of changes in the sky -- including new objects -- that the ZTF will detect each night and alert scientists. That way, these high-priority transient objects can be followed up in detail by larger telescopes, including the UW's share of the Apache Point Observatory 3.5-meter telescope.

"UW is a world leader in survey astronomy, and joining the ZTF will deepen our ability to perform cutting-edge science on the ZTF's massive, real-time data stream," said Eric Bellm, a UW assistant professor of astronomy and the ZTF's survey scientist. "One of the strengths of the ZTF is its global collaboration, consisting of experts in the field of time-domain astronomy from institutions around the world."

Identifying, cataloguing and classifying these celestial objects will impact studies of stars, our solar system and the evolution of our universe. The ZTF could also help detect electromagnetic counterparts to gravitational wave sources discovered by Advanced LIGO and Virgo, as other observatories did in August when these detectors picked up gravitational waves from the merger of two neutron stars.

But to unlock this promise, the ZTF requires massive data collection and real-time analysis -- and UW astronomers have a history of meeting such "big data" challenges.

The roots of big data astronomy at the UW stretch back to the Sloan Digital Sky Survey, which used a telescope at the Apache Point Observatory in New Mexico to gather precise data on the "redshift" -- or increasing wavelength -- of galaxies as they move away from each other in the expanding universe. Once properly analyzed, the data helped astronomers create a more accurate 3-D "map" of the observable universe. The UW's survey astronomy group is gathered within the Data Intensive Research in Astrophysics and Cosmology (DIRAC) Institute, which includes scientists in the Department of Astronomy as well as the eScience Institute and the Paul G. Allen School of Computer Science & Engineering.

"It was natural for the UW astronomy department to join the ZTF team, because we have assembled a dedicated team and expertise for 'big data' astronomy, and we have much to learn from ZTF's partnerships and potential discoveries," said UW associate professor of astronomy Mario Juric.

From Earth, the sky is essentially a giant sphere surrounding our planet. That whole sphere has an area of more than 40,000 square degrees. The ZTF utilizes a new high-resolution camera mounted on the Palomar Observatory's existing Samuel Oschin 48-inch Schmidt Telescope. Together these instruments make up the duet that saw first light recently, and after months of fine-tuning they will be able to capture images of 3,750 square degrees each hour.

These images will be an order of magnitude more numerous than those produced by the ZTF's predecessor survey at Palomar. But since these transient objects might fade or change position in the sky, analysis tools must run in near real time as images come in.

"We'll be looking for anything subtle that changes over time," said Bellm. "And given how much of the sky ZTF will image each night, that could be tens of thousands of objects of potential interest identified every few days."

From a data analysis standpoint, these are no easy tasks. But, they're precisely the sorts of tasks that UW astronomers have been working on in preparation for the Large Synoptic Survey Telescope, which is expected to see first light in the next decade. The LSST, located in northern Chile, is another big data project in astrophysics, and is expected to capture images of almost the entire night sky every few days.

"Data from the ZTF surveys will impact nearly all fields of astrophysics, as well as prepare us for the LSST down the line," said Juric.