Advertisement
Sections
Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages
Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.
As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker's original tone of voice.Limitless possibilitiesThe creators expect that this would 'extend the possibilities' in a variety of industries such as publishing, gaming creation, and media. "Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish." “This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.Another user changed David Attenborough's voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It's also worth noting that fraudsters will undoubtedly exploit this one.”ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this. Who is this new tool meant to help?The US-based company believes its technology will be valuable in a variety of areas, including education and journalism. Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.Because of the model's capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.The conundrum of AI voice genertorsDespite its benefits, ElevenLabs' launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be 'fully committed' to respecting creators' rights in the midst of technological advancements.“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated. “As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.” Read all the Latest News, Trending News, Cricket News, Bollywood News,India News and Entertainment News here. Follow us on Facebook, Twitter and Instagram.
First Published:May 03, 2023, 13:42:20 IST
Advertisement
Advertisement
Nawaz Sharif wants to become prime minister of PoK — but laws framed by Pakistan disqualify him
Former Pakistani Prime Minister Nawaz Sharif has said that he would ask his brother, Prime Minister Shehbaz Sharif, to appoint him as the Prime Minister of Pakistan-occupied Jammu and Kashmir (POJK). But the Constitution bars him from making such a move.
2 min read
Fake jobs, tourist visas: Inside Russia’s vast network luring foreigners to fight Ukraine war
Russia is accused of using fake job offers, tourist visas and lucrative military contracts to recruit thousands of foreign nationals for the Ukraine war. Investigations reveal how poverty, deception and coercion have drawn people from Asia, Africa and Latin America into one of the world's deadliest conflicts
8 min read
As Pakistan eyes American dollar for Iran mediation, economists sound the alarm: ‘It can buy time, not growth’
Pakistan is reportedly seeking billions in US support after claiming a role in easing US-Iran tensions, but economists warn fresh funding would offer only temporary relief without deep structural economic reforms.
2 min read
Are Chinese UN peacekeepers spies? Trump’s UN envoy sends out a warning
US UN Envoy Mike Waltz has warned that China has been using United Nations' platforms, such as peacekeeping missions, for espionage. He accused Chinese peacekeepers of serving as the eyes and ears of the Communist Party of China.
2 min read
Why has Bangladesh’s choice of India spokespersons raised eyebrows?
Bangladesh’s appointment of journalists Md Saidur Rahman and Umme Marufa to media roles in New Delhi and Kolkata has triggered controversy over their past anti-India social media posts, many of which were later deleted, prompting diplomatic scrutiny as India and Bangladesh seek to improve bilateral ties
6 min read
Advertisement
Advertisement