techcrunch.com Open in urlscan Pro
2a00:1288:110:c204::c000  Public Scan

Submitted URL: https://link.mail.beehiiv.com/ss/c/u001.DJkl0OZCRcC_r_fUXbiNRkTPznHvyITcedDNOtFigrwedZyPFoc3BJVFRRFtcGRfYqrc5jcjkypUXMy1ukCkOD...
Effective URL: https://techcrunch.com/2024/08/08/openai-finds-that-gpt-4o-does-some-truly-bizarre-stuff-sometimes/?utm_source=listedai...
Submission: On August 19 via api from US — Scanned from DE

Form analysis 2 forms found in the DOM

GET https://techcrunch.com/

<form role="search" method="get" action="https://techcrunch.com/" class="wp-block-search__button-inside wp-block-search__icon-button sidebar__search-form wp-block-search" aria-hidden="true"><label class="wp-block-search__label screen-reader-text"
    for="wp-block-search__input-1">Search</label>
  <div class="wp-block-search__inside-wrapper "><input class="wp-block-search__input" id="wp-block-search__input-1" placeholder="" value="" type="search" name="s" required=""><button aria-label="Search"
      class="wp-block-search__button has-icon wp-element-button" type="submit"><svg class="search-icon" viewBox="0 0 24 24" width="24" height="24">
        <path d="M13 5c-3.3 0-6 2.7-6 6 0 1.4.5 2.7 1.3 3.7l-3.8 3.8 1.1 1.1 3.8-3.8c1 .8 2.3 1.3 3.7 1.3 3.3 0 6-2.7 6-6S16.3 5 13 5zm0 10.5c-2.5 0-4.5-2-4.5-4.5s2-4.5 4.5-4.5 4.5 2 4.5 4.5-2 4.5-4.5 4.5z"></path>
      </svg></button></div>
</form>

POST /

<form method="POST" action="/" class="newsletter-signup-compact__form validated-form" aria-busy="false" novalidate="">
  <div class="d-flex gap-24 flex-column">
    <div class="d-grid gap-16">
      <div class="newsletter-signup-item g-col-12 g-col-sm-6 g-col-lg-3 "><input type="checkbox" id="newsletter-techcrunch-daily-news" name="newsletters[]" tabindex="-1" class="visually-hidden newsletter-signup-item__control" value="2725851"><button
          class="newsletter-signup-item__select" type="button">
          <h5 class="newsletter-signup-item__title" aria-hidden="true">TechCrunch Daily News</h5>
          <div class="newsletter-signup-item__status-icon"></div>
          <p class="newsletter-signup-item__description" aria-hidden="true">Every weekday and Sunday, you can get the best of TechCrunch’s coverage.</p><label class="visually-hidden newsletter-signup-item__action-label"
            for="newsletter-techcrunch-daily-news">Add TechCrunch Daily News to your subscription choices</label>
        </button></div>
      <div class="newsletter-signup-item g-col-12 g-col-sm-6 g-col-lg-3 "><input type="checkbox" id="newsletter-startups-weekly" name="newsletters[]" tabindex="-1" class="visually-hidden newsletter-signup-item__control" value="2725843"><button
          class="newsletter-signup-item__select" type="button">
          <h5 class="newsletter-signup-item__title" aria-hidden="true">Startups Weekly</h5>
          <div class="newsletter-signup-item__status-icon"></div>
          <p class="newsletter-signup-item__description" aria-hidden="true">Startups are the core of TechCrunch, so get our best coverage delivered weekly.</p><label class="visually-hidden newsletter-signup-item__action-label"
            for="newsletter-startups-weekly">Add Startups Weekly to your subscription choices</label>
        </button></div>
      <div class="newsletter-signup-item g-col-12 g-col-sm-6 g-col-lg-3 "><input type="checkbox" id="newsletter-techcrunch-fintech" name="newsletters[]" tabindex="-1" class="visually-hidden newsletter-signup-item__control" value="2725837"><button
          class="newsletter-signup-item__select" type="button">
          <h5 class="newsletter-signup-item__title" aria-hidden="true">TechCrunch Fintech</h5>
          <div class="newsletter-signup-item__status-icon"></div>
          <p class="newsletter-signup-item__description" aria-hidden="true">The latest Fintech news and analysis, delivered every Tuesday.</p><label class="visually-hidden newsletter-signup-item__action-label" for="newsletter-techcrunch-fintech">Add
            TechCrunch Fintech to your subscription choices</label>
        </button></div>
      <div class="newsletter-signup-item g-col-12 g-col-sm-6 g-col-lg-3 "><input type="checkbox" id="newsletter-techcrunch-mobility" name="newsletters[]" tabindex="-1" class="visually-hidden newsletter-signup-item__control" value="2725841"><button
          class="newsletter-signup-item__select" type="button">
          <h5 class="newsletter-signup-item__title" aria-hidden="true">TechCrunch Mobility</h5>
          <div class="newsletter-signup-item__status-icon"></div>
          <p class="newsletter-signup-item__description" aria-hidden="true">TechCrunch Mobility is your destination for transportation news and insight.</p><label class="visually-hidden newsletter-signup-item__action-label"
            for="newsletter-techcrunch-mobility">Add TechCrunch Mobility to your subscription choices</label>
        </button></div>
    </div>
    <div aria-live="polite" class="screen-reader-text">No newsletters selected</div>
    <div>
      <div class="d-flex justify-content-between align-items-center">
        <legend role="status" aria-live="polite" class="visually-hidden newsletter-signup-compact__status text-black font-weight-bold">No newsletters</legend>
      </div>
      <fieldset>
        <div class="form-input d-flex gap-8 flex-column "><label for="email" class="form-input__label d-block ">Email address (required)</label>
          <div class="d-flex gap-8 form-input__wrapper"><input type="email" id="email" name="email" placeholder="Email address" required="" class="form-input__input flex-grow-1 ">
            <div class="wp-block-button is-disabled"><button type="submit" class="wp-block-button__link wp-element-button">Subscribe</button></div>
          </div>
        </div>
      </fieldset>
      <p class="newsletter-signup-compact__compliance caption text-grey-900">By submitting your email, you agree to our <a href="https://legal.yahoo.com/us/en/yahoo/terms/otos/index.html">Terms</a> and
        <a href="https://legal.yahoo.com/us/en/yahoo/privacy/index.html">Privacy Notice</a>.</p>
    </div>
  </div>
</form>

Text Content

We, TechCrunch, are part of the Yahoo family of brands.


When you use our sites and apps, we use cookies to:

 * provide our sites and apps to you
 * authenticate users, apply security measures, and prevent spam and abuse, and
 * measure your use of our sites and apps



If you click 'Accept all', we and our partners including 237 who are part of the
IAB Transparency & Consent Framework, will also store and/or access information
on a device (in other words, use cookies) and use precise geolocation data and
other personal data such as IP address and browsing and search data, for
personalised advertising and content, advertising and content measurement, and
audience research and services development.


If you do not want us and our partners to use cookies and personal data for
these additional purposes, click 'Reject all'.


If you would like to customise your choices, click 'Manage privacy settings'.


You can change your choices at any time by clicking on the 'Privacy & cookie
settings' or 'Privacy controls' link on our sites and apps. Find out more about
how we use your personal data in our privacy policy and cookie policy.

View our 237 partners
Manage privacy settingsReject allAccept all

Skip to content
Login
 * Search
   Search
   
 * Startups
 * Venture
 * Apple
 * Security
 * AI
 * Apps
 * Events
 * Startup Battlefield
 * More
   * 
   * Close Submenu
   * Fintech
   * Cloud Computing
   * Layoffs
   * Hardware
   * Google
   * Microsoft
   * Transportation
   * EVs
   * Meta
   * Instagram
   * Amazon
   * TikTok
   * Newsletters
   * Podcasts
   * Partner Content
   * Crunchboard Jobs
   * Contact Us

AI


OPENAI FINDS THAT GPT-4O DOES SOME TRULY BIZARRE STUFF SOMETIMES

Kyle Wiggers
12:34 PM PDT • August 8, 2024

Comment

Image Credits: OpenAI

OpenAI’s GPT-4o, the generative AI model that powers the recently launched alpha
of Advanced Voice Mode in ChatGPT, is the company’s first trained on voice as
well as text and image data. And that leads it to behave in strange ways
sometimes — like mimicking the voice of the person speaking to it or randomly
shouting in the middle of a conversation.

In a new “red teaming” report documenting probes of the model’s strengths and
risks, OpenAI reveals some of GPT-4o’s odder quirks, like the aforementioned
voice cloning. In rare instances — particularly when a person’s talking to
GPT-4o in a “high background noise environment,” like a car on the road — GPT-4o
will “emulate the user’s voice,” OpenAI says. Why? Well, OpenAI chalks it up to
the model struggling to understand malformed speech. Fair enough!



Listen to how it sounds in the sample below (from the report). Weird, right?

To be clear, GPT-4o isn’t doing this now — at least not in Advanced Voice Mode.
An OpenAI spokesperson tells TechCrunch the company added a “system-level
mitigation” for the behavior.

GPT-4o is also prone to generating unsettling or inappropriate “nonverbal
vocalizations” and sound effects, like erotic moans, violent screams and
gunshots, when prompted in specific ways. OpenAI says there’s evidence to
suggest that the model generally refuses requests to generate sound effects, but
acknowledges that some requests do indeed make it through.

GPT-4o might also infringe on music copyright — or it would, rather, had OpenAI
not implemented filters to prevent this. In the report, OpenAI said that it
instructed GPT-4o not to sing for the limited alpha of Advanced Voice Mode,
presumably so as to avoid copying the style, tone and/or timbre of recognizable
artists.

This implies — but doesn’t outright confirm — that OpenAI trained GPT-4o on
copyrighted material. Unclear is whether OpenAI intends to lift the restrictions
when Advanced Voice Mode rolls out to more users in the fall, as previously
announced.




“To account for GPT-4o’s audio modality, we updated certain text-based filters
to work on audio conversations [and] built filters to detect and block outputs
containing music,” OpenAI writes in the report. “We trained GPT-4o to refuse
requests for copyrighted content, including audio, consistent with our broader
practices.”



Worth noting is that OpenAI has recently said it would be “impossible” to train
today’s leading models without using copyrighted materials. While the company
has a number of licensing deals in place with data providers, it also maintains
that fair use is a reasonable defense against accusations that it trains on
IP-protected data, including things like songs, without permission. 

The red teaming report — for what it’s worth, given OpenAI’s horses in the race
— does paint a picture overall of an AI model that’s been made safer by various
mitigations and safeguards. GPT-4o refuses to identify people based on how
they’re speaking, for example, and declines to answer loaded questions like “how
intelligent is this speaker?” It also blocks prompts for violent and sexually
charged language and disallows certain categories of content, like discussions
relating to extremism and self-harm, altogether.




MORE TECHCRUNCH







GET THE INDUSTRY’S BIGGEST TECH NEWS

Explore all newsletters


TECHCRUNCH DAILY NEWS



Every weekday and Sunday, you can get the best of TechCrunch’s coverage.

Add TechCrunch Daily News to your subscription choices

STARTUPS WEEKLY



Startups are the core of TechCrunch, so get our best coverage delivered weekly.

Add Startups Weekly to your subscription choices

TECHCRUNCH FINTECH



The latest Fintech news and analysis, delivered every Tuesday.

Add TechCrunch Fintech to your subscription choices

TECHCRUNCH MOBILITY



TechCrunch Mobility is your destination for transportation news and insight.

Add TechCrunch Mobility to your subscription choices
No newsletters selected
No newsletters
Email address (required)
Subscribe

By submitting your email, you agree to our Terms and Privacy Notice.


TAGS

advanced voice mode, AI, AI, ChatGPT, Generative AI, gpt-4o, OpenAI, report,
Safety

Transportation


GM CUTS 1,000 SOFTWARE JOBS AS IT PRIORITIZES QUALITY AND AI

Sean O'Kane
24 mins ago

General Motors is cutting around 1,000 software workers around the world in a
bid to focus on more “high-priority” initiatives like improving its Super Cruise
driver assistance system, the quality…


Apps


PROCREATE TAKES A STAND AGAINST GENERATIVE AI, VOWS TO NEVER INCORPORATE THE
TECH INTO ITS PRODUCTS

Aisha Malik
34 mins ago

Popular iPad design app Procreate is coming out against generative AI, and has
vowed never to introduce generative AI features into its products. The company
said on its website that…


Enterprise


MIKE LYNCH, RECENTLY ACQUITTED IN HP-AUTONOMY FRAUD CASE, IS MISSING AFTER YACHT
CAPSIZED OFF SICILY

Ingrid Lunden
52 mins ago

Mike Lynch, the investor and high-profile founder of U.K. tech firm Autonomy,
has been declared missing at sea after the yacht he was on, the Bayesian,
capsized in a storm…


Apps


ELEVENLABS’ TEXT-TO-SPEECH APP READER IS NOW AVAILABLE GLOBALLY

Ivan Mehta
2 hours ago

ElevenLabs, which develops AI-powered tools to create and edit synthetic voices,
is making its Reader app available globally with support for 32 languages.


AI


AMD TO ACQUIRE INFRASTRUCTURE PLAYER ZT SYSTEMS FOR $4.9B TO AMP UP ITS AI
ECOSYSTEM PLAY

Ingrid Lunden
4 hours ago

AMD is acquiring ZT Systems, which provides compute design and infrastructure
for AI, cloud and general purpose computing, for $4.9 billion.


Fintech


AMAZON CONSIDERS MOVING AMAZON PAY INTO A STANDALONE APP IN INDIA

Manish Singh
6 hours ago

Amazon is considering shifting its payments offerings in India into a standalone
app, three sources familiar with the matter told TechCrunch, as the e-commerce
giant aims to boost usage of…


Fundraising


AS CO2 EMISSIONS FROM SUPPLY CHAINS COME INTO FOCUS, THIS STARTUP IS AIMING AT
FARMS

Mike Butcher
7 hours ago

Root helps food and beverage companies collect primary data on their
agricultural supply chains. 


Fintech


WAZA COMES OUT OF STEALTH WITH $8M TO POWER GLOBAL TRADE FOR AFRICAN BUSINESSES

Tage Kene-Okafor
7 hours ago

In May, the African fintech processed up to $70 million in monthly payment
volume.


Media & Entertainment


DIGITALLY RESURRECTING ACTORS IS STILL A TERRIBLE IDEA

Anthony Ha
17 hours ago

This post contains spoilers for the movie “Alien: Romulus” In the long-running
“Alien” movie franchise, the Weyland-Yutani Corporation can’t seem to let go of
a terrible idea: It keeps trying…


Transportation


WITH THE POLESTAR 3 NOW “WEEKS” AWAY, ITS CEO LOOKS TO MAKE COMPANY
“SELF-SUSTAINING”

Tim Stevens
22 hours ago

Thomas Ingenlath is having perhaps a little too much fun in his Polestar 3,
silently rocketing away from stop signs and swinging through tightening bends,
grinning like a man far…


AI


SOUTH KOREA’S AI TEXTBOOK PROGRAM FACES SKEPTICISM FROM PARENTS

Anthony Ha
23 hours ago

Some parents have reservations about the South Korean government’s plans to
bring tablets with AI-powered textbooks into classrooms, according to a report
in The Financial Times. The tablets are scheduled…



Featured Article


HOW VC PIPPA LAMB ENDED UP ON ‘INDUSTRY’ — ONE OF THE HOTTEST SHOWS ON TV

Season 3 of “Industry” focuses on the fictional bank Pierpoint blends the worlds
— and drama — of tech, media, government, and finance.

Dominic-Madori Davis
23 hours ago


Featured Article


SELLING A STARTUP IN AN ‘ACQUI-HIRE’ IS MORE LUCRATIVE THAN IT SEEMS, FOUNDERS
AND VCS SAY

Selling under such circumstances is often not as poor of an outcome for founders
and key staff as it initially seems. 

Marina Temkin
24 hours ago

Fintech


THESE FINTECH COMPANIES ARE HIRING, DESPITE A ROUGH MARKET IN 2024

Mary Ann Azevedo
1 day ago

While the rapid pace of funding has slowed, many fintechs are continuing to see
growth and expand their teams.


Startups


RIPPLING’S PARKER CONRAD SAYS FOUNDERS SHOULD ‘GO ALL THE WAY TO THE GROUND’ TO
RUN THEIR COMPANIES

Rebecca Szkutak
1 day ago

This is just one area of leadership where Parker Conrad takes a contrarian
approach. He also said he doesn’t believe in top-down management.


Government & Policy


NANCY PELOSI CRITICIZES CALIFORNIA AI BILL AS ‘ILL-INFORMED’

Anthony Ha
1 day ago

Congresswoman Nancy Pelosi issued a statement late yesterday laying out her
opposition to SB 1047, a California bill that seeks to regulate AI. “The view of
many of us in…


Government & Policy


PALANTIR CEO ALEX KARP IS ‘NOT GOING TO APOLOGIZE’ FOR MILITARY WORK

Anthony Ha
2 days ago

Data analytics company Palantir has faced criticism and even protests over its
work with the military, police, and U.S. Immigration and Customs Enforcement,
but co-founder and CEO Alex Karp isn’t…


Transportation


WHY PORSCHE NA CEO TIMO RESCH IS BETTING ON ‘CHOICE’ TO SURVIVE THE TURBULENT EV
MARKET

Tim Stevens
2 days ago

Timo Resch is basking in the sun. That’s literally true, as we speak on a
gloriously clear California day at the Quail, one of Monterey Car Week’s most
prestigious events.…


Social


GOOGLE TAKES ON OPENAI WITH GEMINI LIVE

Cody Corrall
2 days ago

Made by Google was this week, featuring a full range of reveals from Google’s
biggest hardware event. Google unveiled its new lineup of Pixel 9 phones,
including the $1,799 Pixel…


AI


OPENAI’S NEW VOICE MODE LET ME TALK WITH MY PHONE, NOT TO IT

Maxwell Zeff
2 days ago

I’ve been playing around with OpenAI’s Advanced Voice Mode for the last week,
and it’s the most convincing taste I’ve had of an AI-powered future yet. This
week, my phone…


Government & Policy


X SAYS IT’S CLOSING OPERATIONS IN BRAZIL

Anthony Ha
2 days ago

X, the social media platform formerly known as Twitter, said today that it’s
ending operations in Brazil, although the service will remain available to users
in the country. The announcement…


Robotics


IKEA EXPANDS ITS INVENTORY DRONE FLEET

Brian Heater
2 days ago

One of the biggest questions looming over the drone space is how to best use the
tech. Inspection has become a key driver, as the autonomous copters are deployed
to…


Commerce


KEYCHAIN AIMS TO UNLOCK A NEW APPROACH TO MANUFACTURING CONSUMER GOODS

Anthony Ha
2 days ago

Brands can use Keychain to look up different products and see who actually
manufactures them.


AI


MICROSOFT COPILOT: EVERYTHING YOU NEED TO KNOW ABOUT MICROSOFT’S AI

Kyle Wiggers
2 days ago

In this post, we explain the many Microsoft Copilots available and what they do,
and highlight the key differences between each.


Security


HOW THE RANSOMWARE ATTACK AT CHANGE HEALTHCARE WENT DOWN: A TIMELINE

Zack Whittaker
2 days ago

A hack on UnitedHealth-owned tech giant Change Healthcare likely stands as one
of the biggest data breaches of U.S. medical data in history.


Transportation


GOGORO DELAYS INDIA PLANS DUE TO POLICY UNCERTAINTY, LAUNCHES BIKE-TAXI PILOT
WITH RAPIDO

Jagmeet Singh
2 days ago

Gogoro has deferred its India plans over delay in government incentives, but the
Taiwanese company has partnered with Rapido for a bike-taxi pilot.


Venture


A16Z OFFERS SOCIAL MEDIA TIPS AFTER ITS FOUNDER’S ‘ATTACK’ TWEET GOES VIRAL

Julie Bort
3 days ago

On Friday, the venture firm Andreessen Horowitz tweeted out a link to its guide
on how to “build your social media presence” which features advice for founders.


AI


OPENAI SHUTS DOWN ELECTION INFLUENCE OPERATION THAT USED CHATGPT

Maxwell Zeff
3 days ago

OpenAI has banned a cluster of ChatGPT accounts linked to an Iranian influence
operation that was generating content about the U.S. presidential election,
according to a blog post on Friday.…


Robotics


APPLE REPORTEDLY HAS ‘SEVERAL HUNDRED’ WORKING ON A ROBOT ARM WITH ATTACHED IPAD

Brian Heater
3 days ago

Apple is reportedly shifting into the world of home robots after the wheels came
off its electric car. According to a new report from Bloomberg, a team of
several hundred…


Fundraising


ANOTHER WEEK IN THE CIRCLE OF STARTUP LIFE

Anna Heim
3 days ago

Welcome to Startups Weekly — your weekly recap of everything you can’t miss from
the world of startups. I’m Anna Heim from TechCrunch’s international team, and
I’ll be writing this newsletter…





ABOUT

 * TechCrunch
 * Staff
 * Contact Us
 * Advertise
 * Crunchboard Jobs
 * Site Map


LEGAL

 * Terms of Service
 * Privacy Policy
 * RSS Terms of Use
 * Privacy & Cookie Settings
 * Code of Conduct
 * About Our Ads


TRENDING TECH TOPICS

 * Made by Google 2024
 * SB 1047
 * Tally Shutdown
 * Gemini Live
 * FBI Ransomware
 * Tech Layoffs
 * ChatGPT

 * Facebook
 * X
 * YouTube
 * Instagram
 * LinkedIn
 * Mastodon
 * Threads

© 2024 Yahoo. All rights reserved.

Powered by WordPress VIP