. 24/7 Space News .
CHIP TECH
Liquid machine-learning system adapts to changing conditions
by Daniel Ackerman for MIT News
Boston MA (SPX) Jan 29, 2021

MIT researchers have developed a neural "liquid" network that varies its equations' parameters, enhancing its ability to analyze time series data.

MIT researchers have developed a type of neural network that learns on the job, not just during its training phase. These flexible algorithms, dubbed "liquid" networks, change their underlying equations to continuously adapt to new data inputs. The advance could aid decision making based on data streams that change over time, including those involved in medical diagnosis and autonomous driving.

"This is a way forward for the future of robot control, natural language processing, video processing - any form of time series data processing," says Ramin Hasani, the study's lead author. "The potential is really significant."

The research will be presented at February's AAAI Conference on Artificial Intelligence. In addition to Hasani, a postdoc in the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL), MIT co-authors include Daniela Rus, CSAIL director and the Andrew and Erna Viterbi Professor of Electrical Engineering and Computer Science, and PhD student Alexander Amini. Other co-authors include Mathias Lechner of the Institute of Science and Technology Austria and Radu Grosu of the Vienna University of Technology.

Time series data are both ubiquitous and vital to our understanding the world, according to Hasani. "The real world is all about sequences. Even our perception - you're not perceiving images, you're perceiving sequences of images," he says. "So, time series data actually create our reality."

He points to video processing, financial data, and medical diagnostic applications as examples of time series that are central to society. The vicissitudes of these ever-changing data streams can be unpredictable. Yet analyzing these data in real time, and using them to anticipate future behavior, can boost the development of emerging technologies like self-driving cars. So Hasani built an algorithm fit for the task.

Hasani designed a neural network that can adapt to the variability of real-world systems. Neural networks are algorithms that recognize patterns by analyzing a set of "training" examples. They're often said to mimic the processing pathways of the brain - Hasani drew inspiration directly from the microscopic nematode, C. elegans. "It only has 302 neurons in its nervous system," he says, "yet it can generate unexpectedly complex dynamics."

Hasani coded his neural network with careful attention to how C. elegans neurons activate and communicate with each other via electrical impulses. In the equations he used to structure his neural network, he allowed the parameters to change over time based on the results of a nested set of differential equations.

This flexibility is key. Most neural networks' behavior is fixed after the training phase, which means they're bad at adjusting to changes in the incoming data stream. Hasani says the fluidity of his "liquid" network makes it more resilient to unexpected or noisy data, like if heavy rain obscures the view of a camera on a self-driving car. "So, it's more robust," he says.

There's another advantage of the network's flexibility, he adds: "It's more interpretable."

Hasani says his liquid network skirts the inscrutability common to other neural networks. "Just changing the representation of a neuron," which Hasani did with the differential equations, "you can really explore some degrees of complexity you couldn't explore otherwise." Thanks to Hasani's small number of highly expressive neurons, it's easier to peer into the "black box" of the network's decision making and diagnose why the network made a certain characterization.

"The model itself is richer in terms of expressivity," says Hasani. That could help engineers understand and improve the liquid network's performance.

Hasani's network excelled in a battery of tests. It edged out other state-of-the-art time series algorithms by a few percentage points in accurately predicting future values in datasets, ranging from atmospheric chemistry to traffic patterns. "In many applications, we see the performance is reliably high," he says. Plus, the network's small size meant it completed the tests without a steep computing cost. "Everyone talks about scaling up their network," says Hasani. "We want to scale down, to have fewer but richer nodes."

Hasani plans to keep improving the system and ready it for industrial application. "We have a provably more expressive neural network that is inspired by nature. But this is just the beginning of the process," he says. "The obvious question is how do you extend this? We think this kind of network could be a key element of future intelligence systems."

Research Report: "Liquid Time-constant networks"


Related Links
MIT News Office
Computer Chip Architecture, Technology and Manufacture
Nano Technology News From SpaceMart.com


Thanks for being there;
We need your help. The SpaceDaily news network continues to grow but revenues have never been harder to maintain.

With the rise of Ad Blockers, and Facebook - our traditional revenue sources via quality network advertising continues to decline. And unlike so many other news sites, we don't have a paywall - with those annoying usernames and passwords.

Our news coverage takes time and effort to publish 365 days a year.

If you find our news sites informative and useful then please consider becoming a regular supporter or for now make a one off contribution.
SpaceDaily Monthly Supporter
$5+ Billed Monthly


paypal only
SpaceDaily Contributor
$5 Billed Once


credit card or paypal


CHIP TECH
Embattled Intel says earnings better than expected
San Francisco (AFP) Jan 22, 2021
Intel said Thursday that earnings topped prior expectations, as the computer chip giant faces pressure to come up with bold ways to fend off fierce competition and an activist shareholder. Intel said it took in $20 billion in revenue during the final quarter of last year, little changed from a year earlier, amid robust sales of personal computers. The Silicon Valley company reported net income of $5.9 billion in the quarter, down a billion dollars from the same period a year earlier. Intel s ... read more

Comment using your Disqus, Facebook, Google or Twitter login.



Share this article via these popular social media networks
del.icio.usdel.icio.us DiggDigg RedditReddit GoogleGoogle

CHIP TECH
Bridenstine leaves NASA, calls for unity in space, science efforts

Tourism on track in the world's largest cave

Pandemic drags German admin out of the 1980s

Glenn's Power Systems Facility has supported Station research for decades

CHIP TECH
GEM 63XL rocket motors will help launch ULA's Vulcan Centaur rocket

Nanosatellite thruster emits pure ions

SpaceX launches first Starlink satellite mission of 2021

New Year, New Record for Australia's Gilmour Space

CHIP TECH
Six things to know about NASA's Mars helicopter on its way to Mars

Crater study offers window on temperatures 3.5 billion years ago

Mystery of Martian glaciers revealed

Analyzing different solid states of water on other planets and moons

CHIP TECH
China's space station core module, cargo craft pass factory review

China's space tracking ship completes satellite launch monitoring

Key modules for China's next space station ready for launch

Major space station components cleared for operations

CHIP TECH
China launches new mobile telecommunication satellite

Astronauts to boost European connectivity

Statement on Satellite Constellations by German Astronomical Society

OneWeb secures investment from Softbank and Hughes Network Systems

CHIP TECH
Ions in molten salts can go 'against the flow'

GameStop extends wild ride on Wall Street

Record-breaking laser may help test Einstein's theory of relativity

U.S. military uses 3D printing to make N95 respirators

CHIP TECH
Holding the system of HR 8799 together

The seven rocky planets of TRAPPIST-1 seem to have very similar compositions

Astronomers discover first cloudless, Jupiter-like planet

Solar system formation in two steps

CHIP TECH
A Hot Spot on Jupiter

The 15th Anniversary of New Horizons Leaving Earth

Juno mission expands into the future

Dark Storm on Neptune reverses direction, possibly shedding a fragment









The content herein, unless otherwise known to be public domain, are Copyright 1995-2024 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.