. 24/7 Space News .
Dutch software makes supercomputer from laptop
by Staff Writers
Groningen, Netherlands (SPX) Jun 20, 2018

This screenshot of an image is based on 1 billion get offs from travelers with a Yellow Cab in New York. (c) Breddels and Veljanoski (RUG)

Two astronomers from the University of Groningen (The Netherlands) developed a software library that can effortlessly generate visualisations based on hundreds of millions of data points. Maarten Breddels and Jovan Veljanoski initially developed their software to handle the enormous quantity of data from the Gaia mission.

However, the software can also show patterns in other large data files. The software is open source, and free to use. The researchers explain the ins and outs in an article that has been accepted for publication in the journal Astronomy and Astrophysics.

Breddels and Veljanoski call their software vaex, which stands for visualisation and exploration of big tabular datasets. The software can generate visualisations of billions of data points in only one second. This makes it interactive. It behaves similarly to Google Maps. When panning or zooming, one needs to wait shortly for an updated or more detailed map to appear. However, Google Maps run on fast, powerful servers, while vaex works on a laptop.

The power of vaex lies in the combination of several smart techniques. First, it utilises a smart algorithm that maximises all available computing power. Then, it read only the required data from the hard disk and sends it directly to the main memory of the computer. Finally, it is extremely memory efficient, and the working memory does not store unnecessary copies of the data.

Breddels has showcased vaex live at several conferences. As an example, he used a dataset consisting of 1 billion entries related to the Yellow Cab taxis in New York City. He shows which taxi rides are the most lucrative, and where the taxis should wait in any part of the day to maximise their profit. This example shows how vaex can be interesting and beneficial for general applications outside of astronomy.

The software, including the documentation and tutorials, is available for free via here

"Vaex: Big Data exploration in the era of Gaia." Maarten A. Breddels and Jovan Veljanoski, 2018. To appear in Astronomy and Astrophysics.

Related Links
Astronomie at NL
Space Technology News - Applications and Research

Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Monthly Supporter
$5+ Billed Monthly

paypal only
SpaceDaily Contributor
$5 Billed Once

credit card or paypal

Microsoft sinks data centre off Scottish island
London (AFP) June 6, 2018
US tech giant Microsoft has submerged a data centre off the Orkney archipelago in northern Scotland in a project to save on the energy used to cool the servers on land, the firm said Wednesday. The Northern Isles data centre consists of a 40-foot (12.2 metre) long white cylinder containing 864 servers - enough to store five million movies - and can lie on the seabed for up to five years. An undersea cable brings electricity, from Orkney's renewable energy network of wind turbines and tidal pow ... read more

Comment using your Disqus, Facebook, Google or Twitter login.

Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

NASA astronauts install high-def cameras during spacewalk

ECOSTRESS among science payloads on next ISS mission

Possible launch date of Russia's Nauka module to ISS

Second Space Station mission for Alexander Gerst begins

Sample Return Technology Successfully Tested on Xodiac Rocket

Japan successfully tests H-IIA launch vehicle with new research satellite

Girls' Rocketry Challenge team wins three awards at national model rocketry competition

US Senate introduces measure to upgrade defense against hypersonic threats

NASA spacecraft studying massive Martian dust storm

Opportunity rover sends transmission amid Martian dust storm

NASA encounters the perfect storm for science on Mars

Martian dust storm silences NASA's rover, Opportunity

China confirms reception of data from Gaofen-6 satellite

Experts Explain How China Is Opening International Space Cooperation

Beijing welcomes use of Chinese space station by all UN Nations

China upgrades spacecraft reentry and descent technology

US FCC expands market access for SES O3b MEO constellation

Liftoff as Alexander Gerst returns to space

Lockheed Martin Announces $100 Million Venture Fund Increase

Iridium Continues to Attract World Class Maritime Service Providers for Iridium CertusS

Dutch software makes supercomputer from laptop

Ground-breaking discoveries could create superior alloys with many applications

Scientists predict a new superhard material with unique properties

Modern alchemists are making chemistry greener

Chandra Scouts Nearest Star System for Possible Hazards

Researchers discover a system with three Earth-sized planets

Researchers discover multiple alkali metals in unique exoplanet

The Clarke exobelt, a method to search for possible extraterrestrial civilizations

NASA shares more Pluto images from New Horizons

Juno Solves 39-Year Old Mystery of Jupiter Lightning

NASA Re-plans Juno's Jupiter Mission

New Horizons Wakes for Historic Kuiper Belt Flyby

The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.