. 24/7 Space News .
Machine-learning code sorts through telescope data
by Staff Writers
Berkeley CA (SPX) Jan 28, 2019

This graph shows a sample of the output from Kyle Boone's winning code. The graph, produced using a method known as Gaussian processes, shows object light curves over time, sampled at different optical bands. (Credit: Kyle Boone)

A new telescope will take a sequence of hi-res snapshots with the world's largest digital camera, covering the entire visible night sky every few days - and repeating the process for an entire decade. That presents a big data challenge: What's the best way to rapidly and automatically identify and categorize all of the stars, galaxies, and other objects captured in these images?

To help solve this problem, the scientific collaboration that is working on this Large Synoptic Survey Telescope project launched a competition among data scientists to train computers on how to best perform this task. The Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC), hosted on the Kaggle.com platform, provided a simulated data set for 3 million objects and tasked participants with identifying which of 15 classifications was the best fit for each object.

Kyle Boone, a UC Berkeley graduate student who has been working on computer algorithms in support of the Nearby Supernova Factory experiment and Supernova Cosmology Project efforts at the Department of Energy's Lawrence Berkeley National Laboratory (Berkeley Lab), devoted some of his spare time to the international machine-learning challenge in late 2018 while also working toward his Ph.D.

"As I worked on job applications I started playing around with this competition to teach myself more about machine learning." Boone said. Participants could submit their codes up to five times per day to check their performance on a leaderboard for 1 million objects in the test set. The competition ran from Sept. 28, 2018, to Dec. 17, 2018, and Boone was up against 1,383 other competitors on 1,093 teams.

"During the last few weeks I worked really hard on it," he said, devoting all of his evenings and weekends to intense coding.

"My results started to become competitive, and I rushed to implement all of the different ideas that I was coming up with. It was fun, and several teams were neck and neck until the end. I learned a lot about how to tune machine-learning algorithms. There are a lot of little 'knobs' you can tweak to get that extra 1 percent performance."

While giving a science talk on the final day of the competition, he received a text from his fiancee. "She messaged me and said, 'Congratulations.' That was pretty exciting," Boone said. He won $12,000 for his first-place finish, and is now participating in a second phase of the competition that is more open-ended and is driving toward more applicable solutions in categorizing the objects that LSST will see - the deadline for this latest round is Jan. 15.

Renee Hlozek, as assistant professor of astrophysics at the University of Toronto in Canada who led the Kaggle challenge, said, "It is really refreshing to see how combinations of approaches lead to really innovative and novel solutions."

She added, "We have big plans for the next iterations of PLAsTiCC, since there are many ways in which the real LSST data will be even more challenging than our current simulations."

She noted that PLAsTiCC was created through a collaboration between two science groups working on LSST: the Transient and Variable Stars Collaboration (TVS) and the Dark Energy Science Collaboration (DESC).

Gautham Narayan, a Lasker Data Science Fellow at the Space Telescope Science Institute who is a member of TVS and DESC and served as a host for the LSST Kaggle competition, noted that the solutions submitted by PLAsTiCC competitors all had different strengths and weaknesses.

"We're looking at their submissions to see if we can do even better," he said. It may be possible to mix and match the different solutions to develop an improved code, he said. "We're really delighted with how it went."

He added, "Machine learning is advancing so fast. The numbers are staggering to behold."

Boone said, "The competition really motivated people to think outside the box and come up with new ideas. There were a lot of very interesting ideas that I don't think have ever been tried before. I think that combining all of the best models is going to give a huge boost and be very useful for LSST."

In his work at Berkeley Lab, Boone analyzes data taken from telescopes to understand all of the properties of Type Ia supernovae, and develops new models that can provide accurate distance measurements even for distant supernovae. Type Ia supernovae are used as so-called "standard candles" for measuring distances in the universe based on their luminosity, but these measurements can be affected by the size of the galaxy they reside in.

Boone said he hopes to apply his programming work for the LSST competition to his work at Berkeley Lab. "It's very relevant to my own research," he said, adding that he plans to prepare a scientific paper based on the machine-learning code he wrote for the competition.

In Boone's approach to the LSST Kaggle competition, he started out by developing a code that was specialized for identifying supernovae. And he applied a popular statistical technique called Gaussian processes.

"Gaussian processes are basically a way to turn a whole bunch of noisy data points, taken at random points in time, into a smooth curve," he explained, so the data points are represented by curved graphs that provide clues about the object types.

Real data, unlike the test data set used for the competition, can be messier, Boone noted, as it can be affected by noise from a variety of sources. "Machine-learning algorithms oftentimes don't take noise into account. That's a big challenge," he said.

New experiments such as LSST, which will regularly generate streams of data measured in terabytes and petabytes, will likely lean heavily on machine-learning algorithms just because researchers can't possibly keep up with the incredible volume of information.

"You can't have people at every step of the process and we need to automate everything that we can," he said.

Hlozek said she looks forward to sharing the results from the Kaggle competition more broadly with the scientific community, "and to keep testing them on the data going forward."

Research Report: "PLAsTiCC Astronomical Classification: Can You Help Make Sense of the Universe?"

Related Links
Lawrence Berkeley National Laboratory
Space Technology News - Applications and Research

Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Monthly Supporter
$5+ Billed Monthly

paypal only
SpaceDaily Contributor
$5 Billed Once

credit card or paypal

'The new oil': Dublin strikes it rich as Europe's data hub
Dublin (AFP) Jan 24, 2019
A new industrial revolution is under way on the outskirts of Dublin. Fortunes are being made in clusters of anonymous warehouses housing vast data centres. "Data is the new oil, definitely," said Brian Roe, commercial director of Servecentric, a data centre company. Roe is a new breed of prospector, presiding over one node in a network of 48 data centres in Ireland. Put simply, these powerhouse developments provide 24/7/365 access to the massive data, processing power and storage that di ... read more

Comment using your Disqus, Facebook, Google or Twitter login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

Duration of UAE Astronaut's Mission on Board ISS Reduced to 8 Days

NASA Announces Updated Crew Assignment for Boeing Flight Test

Blue Origin to make 10th flight test of space tourist rocket

China is growing crops on the far side of the moon

Jeff Bezos's Blue Origin rocket makes 10th flight test

Countdown for launch of DRDO satellite starts

Japan launches Epsilon-4 Rocket with 7 satellites

United Launch Alliance Successfully Launches NROL-71 in Support of National Security

NASA's Opportunity Rover Logs 15 Years on Mars

Dust storm activity appears to pick up south of Opportunity

ExoMars software passes ESA Mars Yard driving test

Team selected by Canadian Space Agency to study Mars minerals

China to deepen lunar exploration: space expert

China launches Zhongxing-2D satellite

China welcomes world's scientists to collaborate in lunar exploration

In space, the US sees a rival in China

mu Space unveils plan to bid for space exploration projects

Airbus wins DARPA contract to develop smallsat bus for Blackjack program

Thales Alenia Space and Maxar Consortium Achieve Major Milestone in Design Phase of Telesat's LEO Satellite Constellation

OneWeb's first satellites arrive in Kourou, French Guiana in preparation for the first OneWeb launch on February 19, 2019

2D magnetism reaches a new milestone

New 3D nanoprinting strategy opens door to revolution in medicine, robotics

Winning ideas for 3D printing on the Moon

ESA says there are 'big beasts' among 20,000 pieces of space junk

Where Is Earth's Submoon?

Planetary collision that formed the Moon made life possible on Earth

Astronomers find star material could be building block of life

Double star system flips planet-forming disk into pole position

New Horizons' Newest and Best-Yet View of Ultima Thule

Juno's Latest Flyby of Jupiter Captures Two Massive Storms

Outer Solar System Orbits Not Likely Caused by "Planet Nine"

Scientist Anticipated "Snowman" Asteroid Appearance

The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.