Pocket FM partners with ElevenLabs to convert scripts into audio content quickly


Pocket FM and ElevenLabs logos
Image Credits: Pocket FM

Lightspeed Ventures-backed audio platform Pocket FM announced it has partnered with voice-cloning company ElevenLabs to quickly convert text content, such as script, into audio series using AI.

Pocket FM, which raised $103 million in Series D funding in March, told TechCrunch at the time that it was already experimenting with the ability to convert text content into audio using ElevenLabs‘ tech. Now, the India-based company has expanded the partnership to make the conversion tool available to all creators over the next few weeks.

In the test phase, Pocket FM already produced 30,000 hours of audio series using ElevenLab’s AI tech. With the new roll-out, the startup expects to triple its content library of over 100,000 hours of audio content this year. Pocket FM also said that during the experimental phase, the AI-powered tools helped it cut the cost of producing audio by 90%.

Pocket FM conversion of text to audio content
Image Credits: Pocket FM

Pocket FM’s co-founder and CTO Prateek Dixit told TechCrunch over a call that with this partnership, the company wants to make it easier for writers to convert their writings into audio series.

“We have over 250,000 writers (including the ones on the company’s Pocket Novel writing plaform) and this partnership decreases the cost of setting up and recording audio for them,” he said.

“Even with a good set up of recording tools and equipment, writers can produce roughly 30 minutes of high-quality audio content per day. With the AI tools, this output can be 10 times more,” he added.

Pocket FM has built a tool integrating ElevenLabs tech, through which it is offering 50 voices for writers who want to convert their content. ElevenLabs’ co-founder Mati Staniszewski said that his company’s tool understands the context of the writing and infers emotions through the voice automatically.

“Working with Pocket FM, we are deploying our newer models that understand the genre of writing and are emotionality better,” Staniszewski said.

Dixit noted that based on data from users’ engagement with this kind of content, the platform also plans to suggest voices that work well for writers in a particular genre.

Pocket FM is not the only audio series platform experimenting with AI-powered tools. Google-backed Kuku FM is using GPT-4, Claude, BandLab and even ElevenLabs to help its writers with different stages of creation, including refining script, generating thumbnails, adding sound effects and converting text into audio.

Kuku FM told TechCrunch that it is also experimenting with using visual generation tools such as Midjourney and Runway to create ads related to content.

Quality of content and impact on artists

The promise of AI-powered tools is to generate more content faster, but that doesn’t mean the content is good. Pocket FM’s answer to aiding discovery and surfacing quality content is making its discovery algorithm sophisticated and experimenting with user engagement.

“If a writer publishes an audio series, we surface that content to a select number of users and observe engagement metrics. If these metrics are positive, we further propagate that,” Dixit said.

Kuku FM said it is working with its quality control team to ensure only high-quality content is promoted on its app, even if creators have used AI in the process.

“We realized the importance of having a human Quality Control team at the center of our decision-making when it comes to audio content production. We have developed a core team of Content Producers who have high ownership & authority on the artistic standards,” the company’s co-foudner and CEO Lal Chand Bisu said.

Utilizing AI could lead to quicker results and a bigger content library for these platforms, but it will also reduce the roles of voiceover artists working with them. India’s Association of Voiceover Artists (AVA) has expressed its concerns about AI taking over.

“If AI takes over, we are finished. As voice artists, we need to get some regulation in place so that our livelihood is protected,” Amarinder Singh Sodhi, the association’s general secretary, told Indian publication Scroll.

Sodi also told Scroll about incidents where voiceover artists were called into the studio to record samples to train AI without obtaining their consent or informing them.

“On an emotional level, it scares me. By using AI, you are essentially diluting the human experience of storytelling. You lose out on an emotional connection,” Delhi-based voiceover artist Aditya Mattoo told TechCrunch.

He added that giving access to premium voices to people who don’t have the taste and skill to produce quality content will lead to the market getting flooded by bad content.

Voice artists in other parts of the world have also raised concerns about AI impacting their jobs. And despite working with some of the AI companies, they feel uncomfortable about their voices being altered.

When we asked about the impact of AI-powered voice generation on Pocket FM, the company didn’t directly answer the question. However, Dixit noted that engagement with AI-generated content in its experiments is “as good as human voiceover production.” Notably, the company is also working on technology to incorporate multiple voices in one audio output.

Both Pocket FM and Kuku FM don’t currently label their content to indicate if AI has been used in the creation process.

More TechCrunch

Fisker is just a few days into its Chapter 11 bankruptcy, and the fight over its assets is already charged, with one lawyer claiming the startup has been liquidating assets…

The fight over Fisker’s assets is already heating up

A hacker is advertising customer data allegedly stolen from the Australia-based live events and ticketing company TEG on a well-known hacking forum. On Thursday, a hacker put up for sale…

Hacker claims to have 30 million customer records from Australian ticket seller giant TEG

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Elon…

Tesla makes Musk best-paid CEO of all time and Fisker bites the dust

Dot is a new AI companion and chatbot that thrives on getting to know your innermost thoughts and feelings.

Dot’s AI really, really wants to get to know you

The e-fuels startup is working on producing fuel for aviation and maritime shipping using carbon dioxide and other waste carbon streams.

E-fuels startup Aether Fuels is raising $34.3 million, per filing

Fisker was facing “potential financial distress” as early as last August, according to a new filing in its Chapter 11 bankruptcy proceeding, which the EV startup initiated earlier this week.…

Fisker faced financial distress as early as last August

Cruise, the self-driving subsidiary of General Motors, has agreed to pay a $112,500 fine for failing to provide full information about an accident involving one of its robotaxis last year.…

Cruise clears key hurdle to getting robotaxis back on roads in California

Feel Therapeutics has a pretty original deck, with some twists we rarely see; the company did a great job telling the overall story.

Pitch Deck Teardown: Feel Therapeutics’ $3.5M seed deck

The Rockset buy fits into OpenAI’s broader recent strategy of investing heavily in its enterprise sales and tech orgs.

OpenAI buys Rockset to bolster its enterprise AI

The U.S. government announced sanctions against 12 executives and senior leaders of the Russia-based cybersecurity giant Kaspersky. In a press release, the Department of the Treasury’s Office of Foreign Assets…

US government sanctions Kaspersky executives

Style DNA, an AI-powered fashion stylist app, creates a personalized style profile from a single selfie. The app is particularly useful for people interested in seasonal color analysis, a process…

Style DNA gets a generative AI chatbot that suggests outfit ideas based on your color type

Rates of depression, anxiety and suicidal thoughts are surging among U.S. teens. A recent report from the Center of Disease Control found that nearly one in three girls have seriously…

Khosla-backed Marble, built by former Headway founders, offers affordable group therapy for teens

Cover says what sets it apart is the underlying technology it employs, which has been exclusively licensed from NASA’s Jet Propulsion Laboratory.

A new startup from Figure’s founder is licensing NASA tech in a bid to curb school shootings

Spotify is introducing a new “Basic” streaming plan in the United States, the company announced on Friday. The new plan costs $10.99 per month and includes all of the benefits…

Spotify launches a new Basic streaming plan in the US

Photographers say the social media giant is applying a ‘Made with AI’ label to photos they took, causing confusion for users.

Meta is tagging real photos as ‘Made with AI,’ say photographers

Website building platform Squarespace is selling Tock, its restaurant reservation service, to American Express in a deal worth $400 million — the exact figure that Squarespace paid for the service…

Squarespace sells restaurant reservation system Tock to American Express for $400M

Featured Article

Change Healthcare confirms ransomware hackers stole medical records on a ‘substantial proportion’ of Americans

The February ransomware attack on UHG-owned Change Healthcare stands as one of the largest-ever known digital thefts of U.S. medical records.

20 hours ago
Change Healthcare confirms ransomware hackers stole medical records on a ‘substantial proportion’ of Americans

Google said today that it globally paused its experiment that aimed to allow new kinds of real-money games on the Play Store, citing the challenges that come with the lack…

Google pauses its experiment to expand real-money games on the Play Store

Venture firms raised $9.3 billion in Q1 according to PitchBook data, which means this year likely won’t match or surpass 2023’s $81.8 billion total. While emerging managers are feeling the…

Kevin Hartz’s A* raises its second oversubscribed fund in three years

Google is making reviews of all your movies, TV shows, books, albums and games visible under one profile page starting June 24, according to an email sent to users last…

Google is making your movie and TV reviews visible under a new profile page

Zepto, an Indian quick commerce startup, has more than doubled its valuation to $3.6 billion in a new funding round of $665 million.

Zepto, a 10-minute delivery app, raises $665M at $3.6B valuation

Speak, the AI-powered language learning app, has raised new money from investors at double its previous valuation.

Language learning app Speak nets $20M, doubles valuation

SpaceX unveiled Starlink Mini, a more portable version of its satellite internet product that is small enough to fit inside a backpack.  Early Starlink customers were invited to purchase the…

SpaceX debuts portable Starlink Mini for $599

Ali Rathod-Papier has stepped down from her role as global head of compliance at corporate card expense management startup Brex to join venture firm Andreessen Horowitz (a16z) as a partner…

Brex’s compliance head has left the fintech startup to join Andreessen Horowitz as a partner

U.S. officials imposed the “first of its kind” ban arguing that Kaspersky threatens U.S. national security because of its links to Russia.

US bans sale of Kaspersky software citing security risk from Russia 

Apple has released Final Cut Pro for iPad 2 and Final Cut Camera, the company announced on Thursday. Both apps were previously announced during the company’s iPad event in May.…

Apple releases Final Cut Pro for iPad 2 and Final Cut Camera

Paris has quickly established itself as a major European center for AI startups, and now another big deal is in the works.

Poolside is raising $400M+ at a $2B valuation to build a supercharged coding co-pilot

The space industry is all abuzz about how SpaceX’s Starship, Blue Origin’s New Glenn, and other heavy-lift rockets will change just about everything. One likely consequence is that spacecraft will…

Gravitics prepares a testing gauntlet for a new generation of giant spacecraft

LTK (formerly and RewardStyle), the influencer shopping app with 40 million monthly users, announced on Thursday the launch of a free direct message tool for creators to instantly share…

Influencer shopping app LTK gets an automatic direct message tool

YouTube appears to be taking a firm stance against Premium subscribers who attempt to use a VPN (virtual private network) to access cheaper subscription prices in other countries. This week,…

YouTube confirms crackdown on VPN users accessing cheaper Premium plans