Machine-learning code sorts through telescope data

A new telescope will take a sequence of hi-res snapshots with the world's largest digital camera, covering the entire visible night sky every few days - and repeating the process for an entire decade. That presents a big data challenge: What's the best way to rapidly and automatically identify and categorize all of the stars, galaxies, and other objects captured in these images?

To help solve this problem, the scientific collaboration that is working on this Large Synoptic Survey Telescope project launched a competition among data scientists to train computers on how to best perform this task. The Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC), hosted on the Kaggle.com platform, provided a simulated data set for 3 million objects and tasked participants with identifying which of 15 classifications was the best fit for each object.

Kyle Boone, a UC Berkeley graduate student who has been working on computer algorithms in support of the Nearby Supernova Factory experiment and Supernova Cosmology Project efforts at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab), devoted some of his spare time to the international machine-learning challenge in late 2018 while also working toward his Ph.D.

"As I worked on job applications I started playing around with this competition to teach myself more about machine learning." Boone said. Participants could submit their codes up to five times per day to check their performance on a leaderboard for 1 million objects in the test set. The competition ran from Sept. 28, 2018, to Dec. 17, 2018, and Boone was up against 1,383 other competitors on 1,093 teams.

"During the last few weeks I worked really hard on it," he said, devoting all of his evenings and weekends to intense coding.

"My results started to become competitive, and I rushed to implement all of the different ideas that I was coming up with. It was fun, and several teams were neck and neck until the end. I learned a lot about how to tune machine-learning algorithms. There are a lot of little 'knobs' you can tweak to get that extra 1 percent performance."

While giving a science talk on the final day of the competition, he received a text from his fiancee. "She messaged me and said, 'Congratulations.' That was pretty exciting," Boone said. He won $12,000 for his first-place finish, and is now participating in a second phase of the competition that is more open-ended and is driving toward more applicable solutions in categorizing the objects that LSST will see - the deadline for this latest round is Jan. 15.

Renee Hlozek, as assistant professor of astrophysics at the University of Toronto in Canada who led the Kaggle challenge, said, "It is really refreshing to see how combinations of approaches lead to really innovative and novel solutions."

She added, "We have big plans for the next iterations of PLAsTiCC, since there are many ways in which the real LSST data will be even more challenging than our current simulations."

She noted that PLAsTiCC was created through a collaboration between two science groups working on LSST: the Transient and Variable Stars Collaboration (TVS) and the Dark Energy Science Collaboration (DESC).

Gautham Narayan, a Lasker Data Science Fellow at the Space Telescope Science Institute who is a member of TVS and DESC and served as a host for the LSST Kaggle competition, noted that the solutions submitted by PLAsTiCC competitors all had different strengths and weaknesses.

"We're looking at their submissions to see if we can do even better," he said. It may be possible to mix and match the different solutions to develop an improved code, he said. "We're really delighted with how it went."

He added, "Machine learning is advancing so fast. The numbers are staggering to behold."

Boone said, "The competition really motivated people to think outside the box and come up with new ideas. There were a lot of very interesting ideas that I don't think have ever been tried before. I think that combining all of the best models is going to give a huge boost and be very useful for LSST."

In his work at Berkeley Lab, Boone analyzes data taken from telescopes to understand all of the properties of Type Ia supernovae, and develops new models that can provide accurate distance measurements even for distant supernovae. Type Ia supernovae are used as so-called "standard candles" for measuring distances in the universe based on their luminosity, but these measurements can be affected by the size of the galaxy they reside in.

Boone said he hopes to apply his programming work for the LSST competition to his work at Berkeley Lab. "It's very relevant to my own research," he said, adding that he plans to prepare a scientific paper based on the machine-learning code he wrote for the competition.

In Boone's approach to the LSST Kaggle competition, he started out by developing a code that was specialized for identifying supernovae. And he applied a popular statistical technique called Gaussian processes.

"Gaussian processes are basically a way to turn a whole bunch of noisy data points, taken at random points in time, into a smooth curve," he explained, so the data points are represented by curved graphs that provide clues about the object types.

Real data, unlike the test data set used for the competition, can be messier, Boone noted, as it can be affected by noise from a variety of sources. "Machine-learning algorithms oftentimes don't take noise into account. That's a big challenge," he said.

New experiments such as LSST, which will regularly generate streams of data measured in terabytes and petabytes, will likely lean heavily on machine-learning algorithms just because researchers can't possibly keep up with the incredible volume of information.

"You can't have people at every step of the process and we need to automate everything that we can," he said.

Hlozek said she looks forward to sharing the results from the Kaggle competition more broadly with the scientific community, "and to keep testing them on the data going forward."

Research Report: "PLAsTiCC Astronomical Classification: Can You Help Make Sense of the Universe?"

Related Links
Lawrence Berkeley National Laboratory
Space Technology News - Applications and Research

Tweet

Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.

SpaceDaily Monthly Supporter
$5+ Billed Monthly

paypal only

SpaceDaily Contributor
$5 Billed Once

credit card or paypal

'The new oil': Dublin strikes it rich as Europe's data hub
Dublin (AFP) Jan 24, 2019
A new industrial revolution is under way on the outskirts of Dublin. Fortunes are being made in clusters of anonymous warehouses housing vast data centres. "Data is the new oil, definitely," said Brian Roe, commercial director of Servecentric, a data centre company. Roe is a new breed of prospector, presiding over one node in a network of 48 data centres in Ireland. Put simply, these powerhouse developments provide 24/7/365 access to the massive data, processing power and storage that di ... read more