Subscribe free to our newsletters via your
. 24/7 Space News .

Big data analytical advances to exploration of universe
by Staff Writers
Seattle WA (SPX) Aug 12, 2015

File image.

Statisticians have combined state-of-the-art analytical techniques from the academic and business worlds to tackle the Big Data challenges confronting astrophysicists and astronomers as they explore the mysteries of our universe, Lars K.S. Daldorff and Siavoush Mohammadi told an audience at the 2015 Joint Statistical Meetings (JSM 2015) in Seattle.

These technical advances--called automatic explorative analysis of data--have the potential of greatly aiding these scientists as they seek to understand our universe, as well as researchers who work with Big Data in other fields, said Daldorff and Mohammadi while presenting a topic-contributed session titled "Novel Application of Statistical Tools for Big Data Analyses of Solar Physics" at JSM 2015.

Daldorff is an atmospheric, oceanic and space sciences research fellow in the college of engineering at the University of Michigan and a consultant for NASA's Goddard Space Flight Center, and Mohammadi is a consultant with Infotrek, a Swedish business intelligence and data warehousing company.

The new analytical techniques Daldorff and Mohammadi described are being used in a study of giant magnetic loops generated by our solar system's sun. When physicists use large supercomputers to simulate the sun, their research produces massive amounts of data, but the phenomenon of interest is usually located at a specific point in time and space, essentially creating a proverbial needle-in-a-haystack situation for the researcher.

The large quantity of data has forced physicists to reduce data amounts, which they do by looking at small portions of the data at the time, making the process long and slow before true insight is found.

But what if you could scan the entire haystack at once to find the proverbial needle? That's the question Daldorff and Mohammadi sought to answer when they looked to the commercial data warehouse industry for solutions to search, categorize and filter the large amount of solar research data from plasma simulations Daldorff had conducted for NASA.

There are still many open questions surrounding solar magnetic loops associated with solar spots, which contribute to a considerable increase in X-ray and ultraviolent radiation from the outer solar atmosphere and into the upper atmosphere of the Earth. The phenomena can be seen in this video clip released by NASA's Heliophysics Science Division as part of the Solar Dynamics Observatory project.

The astrophysicist community speculates that a phenomenon called "magnetic reconnection" occurs when these powerful arches are created. It's this moment in the data that researchers like Daldorff and Mohammadi want to identify both spatially and in time--or both where and when.

The duo use statistical methods that frequently are used in data warehouses and by analysts at companies to study human behavior--for example, customers--or scientific data, in this case coronal loops. These are analytical methods that combine computational power and statistics to turn information into insight. These standardized methods, widely used in the business world, suddenly find use for a completely different type of data.

As for analytical tools, they have been using SAS' Visual Analytics platform--a Big Data reporting and explorative tool that works in-memory. Many of the statistical methods employed by SAS Visual Analytics also are standardized statistical methods used in numerous data warehouses.

These analytical tools and methods don't care what your data are. The methods for identifying points of interest, performing analysis and visualizations and creating reports are the same, regardless if it's used on business or scientific data, Daldorff and Mohammadi told session attendees.

This automatic exploration of large data sets using statistics and modern analytical methods can greatly reduce the time it takes to extract insight from Big Data--not just for heliophysics research, but all data-intensive research subjects. It removes a major manual repetitive step and automates it, allowing the subject expert to focus on the research topic instead of processing data manually.

"Our hope is these results can help with solar magnetic loops research at NASA and at the same time our work will show the effectiveness of explorative analysis of data in other data-intensive fields. There are numerous possibilities for this new application that could potentially help various types of researchers--in academia, business and science--obtain quicker insights and results from their research's Big Data," said Daldorff.

JSM 2015 is being held August 8-13 at the Washington State Convention Center in Seattle. More than 6,000 statisticians--representing academia, business and industry, as well as national, state and local governments--from numerous countries are attending North America's largest statistical science gathering.

Thanks for being here;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Contributor
$5 Billed Once

credit card or paypal
SpaceDaily Monthly Supporter
$5 Billed Monthly

paypal only


Related Links
American Statistical Association
Space Technology News - Applications and Research

Comment on this article via your Facebook, Yahoo, AOL, Hotmail login.

Share this article via these popular social media networks DiggDigg RedditReddit GoogleGoogle

Memory Foam Mattress Review
Newsletters :: SpaceDaily :: SpaceWar :: TerraDaily :: Energy Daily
XML Feeds :: Space News :: Earth News :: War News :: Solar Energy News

China's Alibaba to invest $1.0 bn in cloud computing
Shanghai (AFP) July 29, 2015
Chinese e-commerce giant Alibaba will invest $1.0 billion in its cloud computing arm to expand its international presence, the company said Wednesday, as it looks outside its core business and beyond traditional markets. The Aliyun unit will use the funds in part to set up cloud computing centres in Singapore and Japan, as well as in the Middle East and Europe, Alibaba said in a statement. ... read more

From a million miles away, NASA camera shows moon crossing face of Earth

Russia to conduct simulated flight program to Moon, Mars over 4 years

NASA Could Return Humans to the Moon by 2021

Smithsonian embraces crowdfunding to preserve lunar spacesuit

New Online Exploring Tools Bring NASA's Journey to Mars to New Generation

Six scientists to spend 365 days in HI-SEAS simulated Mars trip

Salt flat indicates some of the last vestiges of surface water on Mars

Mars Rovers and the Last Moonwalker to Invade Poland in September

First bite of space-grown lettuce is 'awesome'

Spaceflight may increase susceptibility to inflammatory bowel disease

US, Russia, China to Explore Benefits of Outer Space for ASEAN

Third spaceflight for astronaut Paolo Nespoli

China to deploy space-air-ground sensors for environment protection

China's space exploration potential has US chasing its own tail

Chinese earth station is for exclusively scientific and civilian purposes

Cooperation in satellite technology put Belgium, China to forefront

NASA signs $490 mn contract with Russia for ISS travel

NASA Completes Selection of Crew Members for 2017 ISS Missions

NASA renews $490M contract with Russian Space Agency

Russian cosmonauts wrap up spacewalk

Intelsat 34 fueled for heavy-lift mission with Ariane 5

ILS concludes Proton launch failure investigation

India to launch 9 US satellites in 2015, 2016

Payload checkout is advancing for Arianespace's September Soyuz flight

Scientists solve planetary ring riddle

Overselling NASA

Study: All planetary rings governed by particle distribution principle

Exoplanets 20/20: Looking Back to the Future

Disney Research produces 3D objects with variable elasticity using single material

Metal organic frameworks show unexpected flexibility

Yarn from slaughterhouse waste

A droplet's pancake bounce

The content herein, unless otherwise known to be public domain, are Copyright 1995-2014 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. Privacy Statement All images and articles appearing on Space Media Network have been edited or digitally altered in some way. Any requests to remove copyright material will be acted upon in a timely and appropriate manner. Any attempt to extort money from Space Media Network will be ignored and reported to Australian Law Enforcement Agencies as a potential case of financial fraud involving the use of a telephonic carriage device or postal service.