24/7 Space News
AI voice tool 'misused' as deepfakes flood web forum
AI voice tool 'misused' as deepfakes flood web forum
by AFP Staff Writers
Paris (AFP) Jan 31, 2023

A British AI firm said it was rethinking its "safeguards" after its audio tool was used to clone celebrity voices and have them say racist and homophobic slurs.

Eleven Labs tweeted on Monday that it had been a "crazy weekend" and admitted to finding "an increasing number of voice cloning misuse cases" just days after it released a demo version of the tool.

The firm did not give details of the cases but the internet forum 4chan was flooded with deepfakes of celebrity voices using racist, sexist and homophobic slurs.

Many of the posts mentioned Eleven Labs, with some users claiming to have been banned by the firm and others providing links to the demo version of the tool.

Celebrities who came in for treatment on the forum, which is notorious for its offensive humour, included the stars of the Harry Potter films, and film directors Quentin Tarantino and George Lucas.

Eleven labs has touted its voice cloning technology as having "the potential to revolutionise the way content is produced, delivered and interacted with across a range of industries".

In its publicity material, the firm produced a video of actor Leonardo DiCaprio being voiced by several other celebrities.

The firm tweeted that its technology had been "overwhelmingly applied to positive use" but said "additional safeguards" were needed.

Among the options it was considering were manually verifying each cloning request or tightening account verifications.

AI tools are trained on vast swathes of data -- pictures, audio, text or video -- that allow them to essentially predict what output the user would like.

Text tool ChatGPT has taken the world by storm with its ability to generate essays to a relatively high standard with just a few prompts.

Imaging tools like Dall-E 2 and Midjourney are threatening to upend the art and design world with their ability to generate complex images in the style of famous artists.

But critics have long expressed fear that cloning technology, particularly in audio and video, could lead to a flood of deepfakes and disinformation.

And several AI companies are facing lawsuits from people who allege the firms have breached copyright by using their material as a basis for the AI models.

Related Links
Space Technology News - Applications and Research

Subscribe Free To Our Daily Newsletters

The following news reports may link to other Space Media Network websites.
Seoul launches ambitious metaverse platform for city services, tourism
Seoul, South Korea (UPI) Jan 17, 2023
The Seoul Metropolitan Government officially opened the doors Monday to its own metaverse platform, a virtual world where users will be able to play games, chat, file official forms, get help with taxes and receive other city services. The South Korean capital is the first major city to set up a public metaverse platform, with a five-year roadmap for rolling out a full menu of government, business, tourism and culture offerings. The project, called Metaverse Seoul, launched in beta last year ... read more

UAE astronaut says not required to fast during Ramadan on ISS

20 Years Ago: Remembering Columbia and Her Crew

Astronauts conduct first ISS spacewalk of 2023

Zero-Covid left in dust as Chinese revellers fuel travel boom

NASA validates revolutionary propulsion design for deep space missions

MIT Gas Turbine Laboratory prepares to jet into the future

NASA safety system enables Rocket Lab launch from Wallops

Isar Aerospace and Spaceflight Inc sign launch agreement to service global market

Aiming for the Triple Junction: Sols 3723-3724

Perseverance marks 1 Martian Year at Jezero

Sol 3721: Wrapping up at the Encanto Drill Site

NASA launches Mars Sample Receiving Project Office at Johnson

Chinese astronauts send Spring Festival greetings from space station

China to launch 200-plus spacecraft in 2023

China's space industry hits new heights

China's first private sector 2023 rocket launch up, up and away

Iridium GO exec redefines personal off-the-grid connectivity

SpaceX launches 56 more Starlink satellites in heaviest payload yet

Hawkeye 360 launches Cluster 6 satellites aboard inaugural Rocket Lab Electron flight from Virginia

How ESA works with the EU to advance European space

AI voice tool 'misused' as deepfakes flood web forum

Ghostly mirrors for high-power lasers

Judge denies US bid to block Meta virtual reality deal: reports

Development of 100% biodegradable paper straws that do not become soggy

Webb Telescope identifies origins of icy building blocks of life

Rare opportunity to study short-lived volcanic island reveals sulfur-metabolizing microbes

New small laser device can help detect signs of life on other planets

How do rocky planets really form

Webb spies Chariklo ring system with high-precision technique

Europe's JUICE spacecraft ready to explore Jupiter's icy moons

Exotic water ice contributes to understanding of magnetic anomalies on Neptune and Uranus

From Europe to Jupiter via Kourou

Subscribe Free To Our Daily Newsletters


The content herein, unless otherwise known to be public domain, are Copyright 1995-2023 - Space Media Network. All websites are published in Australia and are solely subject to Australian law and governed by Fair Use principals for news reporting and research purposes. AFP, UPI and IANS news wire stories are copyright Agence France-Presse, United Press International and Indo-Asia News Service. ESA news reports are copyright European Space Agency. All NASA sourced material is public domain. Additional copyrights may apply in whole or part to other bona fide parties. All articles labeled "by Staff Writers" include reports supplied to Space Media Network by industry news wires, PR agencies, corporate press officers and the like. Such articles are individually curated and edited by Space Media Network staff on the basis of the report's information value to our industry and professional readership. Advertising does not imply endorsement, agreement or approval of any opinions, statements or information provided by Space Media Network on any Web page published or hosted by Space Media Network. General Data Protection Regulation (GDPR) Statement Our advertisers use various cookies and the like to deliver the best ad banner available at one time. All network advertising suppliers have GDPR policies (Legitimate Interest) that conform with EU regulations for data collection. By using our websites you consent to cookie based advertising. If you do not agree with this then you must stop using the websites from May 25, 2018. Privacy Statement. Additional information can be found here at About Us.