AI

This Week in AI: Apple won’t say how the sausage gets made

Comment

Apple Software Engineering SVP Craig Federighi, seen presenting Apple Intelligence at WWDC 2024
Image Credits: Apple

Hiya, folks, and welcome to TechCrunch’s regular AI newsletter.

This week in AI, Apple stole the spotlight.

At the company’s Worldwide Developers Conference (WWDC) in Cupertino, Apple unveiled Apple Intelligence, its long-awaited, ecosystem-wide push into generative AI. Apple Intelligence powers a whole host of features, from an upgraded Siri to AI-generated emoji to photo-editing tools that remove unwanted people and objects from photos.

The company promised Apple Intelligence is being built with safety at its core, along with highly personalized experiences.

“It has to understand you and be grounded in your personal context, like your routine, your relationships, your communications and more,” CEO Tim Cook noted during the keynote on Monday. “All of this goes beyond artificial intelligence. It’s personal intelligence, and it’s the next big step for Apple.”

Apple Intelligence is classically Apple: It conceals the nitty-gritty tech behind obviously, intuitively useful features. (Not once did Cook utter the phrase “large language model.”) But as someone who writes about the underbelly of AI for a living, I wish Apple were more transparent — just this once — about how the sausage was made.

Take, for example, Apple’s model training practices. Apple revealed in a blog post that it trains the AI models that power Apple Intelligence on a combination of licensed datasets and the public web. Publishers have the option of opting out of future training. But what if you’re an artist curious about whether your work was swept up in Apple’s initial training? Tough luck — mum’s the word.

The secrecy could be for competitive reasons. But I suspect it’s also to shield Apple from legal challenges — specifically challenges pertaining to copyright. The courts have yet to decide whether vendors like Apple have a right to train on public data without compensating or crediting the creators of that data — in other words, whether fair use doctrine applies to generative AI.

It’s a bit disappointing to see Apple, which often paints itself as a champion of commonsensical tech policy, implicitly embrace the fair use argument. Shrouded behind the veil of marketing, Apple can claim to be taking a responsible and measured approach to AI while it may very well have trained on creators’ works without permission.

A little explanation would go a long way. It’s a shame we haven’t gotten one — and I’m not hopeful we will anytime soon, barring a lawsuit (or two).

News

Apple’s top AI features: Yours truly rounded up the top AI features Apple announced during the WWDC keynote this week, from the upgraded Siri to deep integrations with OpenAI’s ChatGPT.

OpenAI hires execs: OpenAI this week hired Sarah Friar, the former CEO of hyperlocal social network Nextdoor, to serve as its chief financial officer, and Kevin Weil, who previously led product development at Instagram and Twitter, as its chief product officer.

Mail, now with more AI: This week, Yahoo (TechCrunch’s parent company) updated Yahoo Mail with new AI capabilities, including AI-generated summaries of emails. Google introduced a similar generative summarization feature recently — but it’s behind a paywall.

Controversial views: A recent study from Carnegie Mellon finds that not all generative AI models are created equal — particularly when it comes to how they treat polarizing subject matter.

Sound generator: Stability AI, the startup behind the AI-powered art generator Stable Diffusion, has released an open AI model for generating sounds and songs that it claims was trained exclusively on royalty-free recordings.

Research paper of the week

Google thinks it can build a generative AI model for personal health — or at least take preliminary steps in that direction.

In a new paper featured on the official Google AI blog, researchers at Google pull back the curtain on Personal Health Large Language Model, or PH-LLM for short — a fine-tuned version of one of Google’s Gemini models. PH-LLM is designed to give recommendations to improve sleep and fitness, in part by reading heart and breathing rate data from wearables like smartwatches.

To test PH-LLM’s ability to give useful health suggestions, the researchers created close to 900 case studies of sleep and fitness involving U.S.-based subjects. They found that PH-LLM gave sleep recommendations that were close to — but not quite as good as — recommendations given by human sleep experts.

The researchers say that PH-LLM could help to contextualize physiological data for “personal health applications.” Google Fit comes to mind; I wouldn’t be surprised to see PH-LLM eventually power some new feature in a fitness-focused Google app, Fit or otherwise.

Model of the week

Apple devoted quite a bit of blog copy detailing its new on-device and cloud-bound generative AI models that make up its Apple Intelligence suite. Yet despite how long this post is, it reveals precious little about the models’ capabilities. Here’s our best attempt at parsing it:

The nameless on-device model Apple highlights is small in size, no doubt so it can run offline on Apple devices like the iPhone 15 Pro and Pro Max. It contains 3 billion parameters — “parameters” being the parts of the model that essentially define its skill on a problem, like generating text — making it comparable to Google’s on-device Gemini model Gemini Nano, which comes in 1.8-billion-parameter and 3.25-billion-parameter sizes.

The server model, meanwhile, is larger (how much larger, Apple won’t say precisely). What we do know is that it’s more capable than the on-device model. While the on-device model performs on par with models like Microsoft’s Phi-3-mini, Mistral’s Mistral 7B and Google’s Gemma 7B on the benchmarks Apple lists, the server model “compares favorably” to OpenAI’s older flagship model GPT-3.5 Turbo, Apple claims.

Apple also says that both the on-device model and server model are less likely to go off the rails (i.e., spout toxicity) than models of similar sizes. That may be so — but this writer is reserving judgment until we get a chance to put Apple Intelligence to the test.

Grab bag

This week marked the sixth anniversary of the release of GPT-1, the progenitor of GPT-4o, OpenAI’s latest flagship generative AI model. And while deep learning might be hitting a wall, it’s incredible how far the field’s come.

Consider that it took a month to train GPT-1 on a dataset of 4.5 gigabytes of text (the BookCorpus, containing ~7,000 unpublished fiction books). GPT-3, which is nearly 1,500x the size of GPT-1 by parameter count and significantly more sophisticated in the prose that it can generate and analyze, took 34 days to train. How’s that for scaling?

What made GPT-1 groundbreaking was its approach to training. Previous techniques relied on vast amounts of manually labeled data, limiting their usefulness. (Manually labeling data is time-consuming — and laborious.) But GPT-1 didn’t; it trained primarily on unlabeled data to “learn” how to perform a range of tasks (e.g., writing essays).

Many experts believe that we won’t see a paradigm shift as meaningful as GPT-1’s anytime soon. But then again, the world didn’t see GPT-1’s coming, either.

More TechCrunch

Fisker is just a few days into its Chapter 11 bankruptcy, and the fight over its assets is already charged, with one lawyer claiming the startup has been liquidating assets…

The fight over Fisker’s assets is already heating up

A hacker is advertising customer data allegedly stolen from the Australia-based live events and ticketing company TEG on a well-known hacking forum. On Thursday, a hacker put up for sale…

Hacker claims to have 30 million customer records from Australian ticket seller giant TEG

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Elon…

Tesla makes Musk best-paid CEO of all time and Fisker bites the dust

Dot is a new AI companion and chatbot that thrives on getting to know your innermost thoughts and feelings.

Dot’s AI really, really wants to get to know you

The e-fuels startup is working on producing fuel for aviation and maritime shipping using carbon dioxide and other waste carbon streams.

E-fuels startup Aether Fuels is raising $34.3 million, per filing

Fisker was facing “potential financial distress” as early as last August, according to a new filing in its Chapter 11 bankruptcy proceeding, which the EV startup initiated earlier this week.…

Fisker faced financial distress as early as last August

Cruise, the self-driving subsidiary of General Motors, has agreed to pay a $112,500 fine for failing to provide full information about an accident involving one of its robotaxis last year.…

Cruise clears key hurdle to getting robotaxis back on roads in California

Feel Therapeutics has a pretty original deck, with some twists we rarely see; the company did a great job telling the overall story.

Pitch Deck Teardown: Feel Therapeutics’ $3.5M seed deck

The Rockset buy fits into OpenAI’s broader recent strategy of investing heavily in its enterprise sales and tech orgs.

OpenAI buys Rockset to bolster its enterprise AI

The U.S. government announced sanctions against 12 executives and senior leaders of the Russia-based cybersecurity giant Kaspersky. In a press release, the Department of the Treasury’s Office of Foreign Assets…

US government sanctions Kaspersky executives

Style DNA, an AI-powered fashion stylist app, creates a personalized style profile from a single selfie. The app is particularly useful for people interested in seasonal color analysis, a process…

Style DNA gets a generative AI chatbot that suggests outfit ideas based on your color type

Rates of depression, anxiety and suicidal thoughts are surging among U.S. teens. A recent report from the Center of Disease Control found that nearly one in three girls have seriously…

Khosla-backed Marble, built by former Headway founders, offers affordable group therapy for teens

Cover says what sets it apart is the underlying technology it employs, which has been exclusively licensed from NASA’s Jet Propulsion Laboratory.

A new startup from Figure’s founder is licensing NASA tech in a bid to curb school shootings

Spotify is introducing a new “Basic” streaming plan in the United States, the company announced on Friday. The new plan costs $10.99 per month and includes all of the benefits…

Spotify launches a new Basic streaming plan in the US

Photographers say the social media giant is applying a ‘Made with AI’ label to photos they took, causing confusion for users.

Meta is tagging real photos as ‘Made with AI,’ say photographers

Website building platform Squarespace is selling Tock, its restaurant reservation service, to American Express in a deal worth $400 million — the exact figure that Squarespace paid for the service…

Squarespace sells restaurant reservation system Tock to American Express for $400M

Featured Article

Change Healthcare confirms ransomware hackers stole medical records on a ‘substantial proportion’ of Americans

The February ransomware attack on UHG-owned Change Healthcare stands as one of the largest-ever known digital thefts of U.S. medical records.

13 hours ago
Change Healthcare confirms ransomware hackers stole medical records on a ‘substantial proportion’ of Americans

Google said today that it globally paused its experiment that aimed to allow new kinds of real-money games on the Play Store, citing the challenges that come with the lack…

Google pauses its experiment to expand real-money games on the Play Store

Venture firms raised $9.3 billion in Q1 according to PitchBook data, which means this year likely won’t match or surpass 2023’s $81.8 billion total. While emerging managers are feeling the…

Kevin Hartz’s A* raises its second oversubscribed fund in three years

Google is making reviews of all your movies, TV shows, books, albums and games visible under one profile page starting June 24, according to an email sent to users last…

Google is making your movie and TV reviews visible under a new profile page

Zepto, an Indian quick commerce startup, has more than doubled its valuation to $3.6 billion in a new funding round of $665 million.

Zepto, a 10-minute delivery app, raises $665M at $3.6B valuation

Speak, the AI-powered language learning app, has raised new money from investors at double its previous valuation.

Language learning app Speak nets $20M, doubles valuation

SpaceX unveiled Starlink Mini, a more portable version of its satellite internet product that is small enough to fit inside a backpack.  Early Starlink customers were invited to purchase the…

SpaceX debuts portable Starlink Mini for $599

Ali Rathod-Papier has stepped down from her role as global head of compliance at corporate card expense management startup Brex to join venture firm Andreessen Horowitz (a16z) as a partner…

Brex’s compliance head has left the fintech startup to join Andreessen Horowitz as a partner

U.S. officials imposed the “first of its kind” ban arguing that Kaspersky threatens U.S. national security because of its links to Russia.

US bans sale of Kaspersky software citing security risk from Russia 

Apple has released Final Cut Pro for iPad 2 and Final Cut Camera, the company announced on Thursday. Both apps were previously announced during the company’s iPad event in May.…

Apple releases Final Cut Pro for iPad 2 and Final Cut Camera

Paris has quickly established itself as a major European center for AI startups, and now another big deal is in the works.

Poolside is raising $400M+ at a $2B valuation to build a supercharged coding co-pilot

The space industry is all abuzz about how SpaceX’s Starship, Blue Origin’s New Glenn, and other heavy-lift rockets will change just about everything. One likely consequence is that spacecraft will…

Gravitics prepares a testing gauntlet for a new generation of giant spacecraft

LTK (formerly LiketoKnow.it and RewardStyle), the influencer shopping app with 40 million monthly users, announced on Thursday the launch of a free direct message tool for creators to instantly share…

Influencer shopping app LTK gets an automatic direct message tool

YouTube appears to be taking a firm stance against Premium subscribers who attempt to use a VPN (virtual private network) to access cheaper subscription prices in other countries. This week,…

YouTube confirms crackdown on VPN users accessing cheaper Premium plans