www.cnbc.com Open in urlscan Pro
23.32.58.121  Public Scan

URL: https://www.cnbc.com/2022/01/07/deep-learning-and-large-language-how-ai-is-set-to-evolve-in-2022.html
Submission: On March 30 via manual from US — Scanned from DE

Form analysis 0 forms found in the DOM

Text Content

Skip Navigation
How A.I. is set to evolve in 2022
 * watchliveSquawk on the Street

Markets
 * Pre-Markets
 * U.S. Markets
 * Europe Markets
 * China Markets
 * Asia Markets
 * World Markets
 * Currencies
 * Cryptocurrency
 * Futures & Commodities
 * Bonds
 * Funds & ETFs

Business
 * Economy
 * Finance
 * Health & Science
 * Media
 * Real Estate
 * Energy
 * Climate
 * Transportation
 * Industrials
 * Retail
 * Wealth
 * Life
 * Small Business

Investing
 * Invest In You
 * Personal Finance
 * Fintech
 * Financial Advisors
 * Trading Nation
 * Options Action
 * ETF Street
 * Buffett Archive
 * Earnings
 * Trader Talk

Tech
 * Cybersecurity
 * Enterprise
 * Internet
 * Media
 * Mobile
 * Social Media
 * CNBC Disruptor 50
 * Tech Guide

Politics
 * White House
 * Policy
 * Defense
 * Congress
 * Equity and Opportunity
 * Europe Politics
 * China Politics
 * Asia Politics
 * World Politics

CNBC TV
 * Live Audio
 * Latest Video
 * Top Video
 * CEO Interviews
 * Europe TV
 * Asia TV
 * CNBC Podcasts
 * Digital Originals

Watchlist
Investing Club
 * Newsletter
 * Morning Meeting
 * Trade Alerts
 * Trust Portfolio

PRO
 * Pro News
 * Pro Live
 * Subscribe
 * Sign In



Menu

 * Make It

 * USA
 * INTL

Search quotes, news & videos
Watchlist
SIGN IN
How A.I. is set to evolve in 2022
 * watchliveSquawk on the Street

Markets
Business
Investing
Tech
Politics
CNBC TV
Watchlist
Investing Club
PRO


Menu


Tech


HOW A.I. IS SET TO EVOLVE IN 2022

Published Fri, Jan 7 20221:47 AM ESTUpdated Fri, Jan 7 20223:23 AM EST
Sam Shead@Sam_L_Shead
WATCH LIVE
ShareShare Article via FacebookShare Article via TwitterShare Article via
LinkedInShare Article via Email
Key Points
 * AI can excel at specific narrow tasks such as playing chess but it struggles
   to do more than one thing well.
 * While AI still has a long way to go before anything like human-level
   intelligence is achieved, it hasn’t stopped the likes of Google, Facebook and
   Amazon investing billions of dollars.

An Ubtech Walker X Robot plays Chinese chess during 2021 World Artificial
Intelligence Conference (WAIC) at Shanghai World Expo Center on July 8, 2021 in
Shanghai, China.
VCG | VCG via Getty Images

Machines are getting smarter and smarter every year, but artificial intelligence
is yet to live up to the hype that’s been generated by some of the world’s
largest technology companies.

AI can excel at specific narrow tasks such as playing chess but it struggles to
do more than one thing well. A seven-year-old has far broader intelligence than
any of today’s AI systems, for example.



“AI algorithms are good at approaching individual tasks, or tasks that include a
small degree of variability,” Edward Grefenstette, a research scientist at Meta
AI, formerly Facebook AI Research, told CNBC.

“However, the real world encompasses significant potential for change, a dynamic
which we are bad at capturing within our training algorithms, yielding brittle
intelligence,” he added.

AI researchers have started to show that there are ways to efficiently adapt AI
training methods to changing environments or tasks, resulting in more robust
agents, Grefenstette said. He believes there will be more industrial and
scientific applications of such methods this year that will produce “noticeable
leaps.”

While AI still has a long way to go before anything like human-level
intelligence is achieved, it hasn’t stopped the likes of Google, Facebook (Meta)
and Amazon investing billions of dollars into hiring talented AI researchers who
can potentially improve everything from search engines and voice assistants to
aspects of the so-called “metaverse.”

Anthropologist Beth Singler, who studies AI and robots at the University of
Cambridge, told CNBC that claims about the effectiveness and reality of AI in
spaces that are now being labeled as the metaverse will become more commonplace
in 2022 as more money is invested in the area and the public start to recognize
the “metaverse” as a term and a concept.



Singler also warned that there could be “too little discussion” in 2022 of the
effect of the metaverse on people’s “identities, communities, and rights.”

VIDEO3:2403:24
The robot cafe bridging the virtual and physical workplace
The Edge


Gary Marcus, a scientist who sold an AI start-up to Uber and is currently
executive chairman of another firm called Robust AI, told CNBC that the most
important AI breakthrough in 2022 will likely be one that the world doesn’t
immediately see.

“The cycle from lab discovery to practicality can take years,” he said, adding
that the field of deep learning still has a long way to go. Deep learning is an
area of AI that attempts to mimic the activity in layers of neurons in the brain
to learn how to recognize complex patterns in data.

Marcus believes the most important challenge for AI right now is to “find a good
way of combining all the world’s immense knowledge of science and technology”
with deep learning. At the moment “deep learning can’t leverage all that
knowledge and instead is stuck again and again trying to learn everything from
scratch,” he said.

“I predict there will be progress on this problem this year that will ultimately
be transformational, towards what I called hybrid systems, but that it’ll be
another few years before we see major dividends,” Marcus added. “The thing that
we probably will see this year or next is the first medicine in which AI played
a substantial role in the discovery process.”


DEEPMIND’S NEXT STEPS

One of the biggest AI breakthroughs in the last couple of years has come from
London-headquartered research lab DeepMind, which is owned by Alphabet.

The company has successfully created AI software that can accurately predict the
structure that proteins will fold into in a matter of days, solving a
50-year-old “grand challenge” that could pave the way for better understanding
of diseases and drug discovery.

Neil Lawrence, a professor of machine learning at the University of Cambridge,
told CNBC that he expects to see DeepMind target more big science questions in
2022.

VIDEO2:5302:53
DeepMind’s CEO on machine learning
Street Signs Asia


Language models — AI systems that can generate convincing text, converse with
humans, respond to questions, and more — are also set to improve in 2022.

The best-known language model is OpenAI’s GPT-3 but DeepMind said in December
that its new “RETRO” language model can beat others 25 times its size.

Catherine Breslin, a machine learning scientist who used to work on Amazon
Alexa, thinks Big Tech will race toward larger and larger language models next
year.

Breslin, who now runs AI consultancy firm Kingfisher Labs, told CNBC that there
will also be a move toward models that combine vision, speech and language
capability, rather than treat them as separate tasks.

Nathan Benaich, a venture capitalist with Air Street Capital and the co-author
of the annual State of AI report, told CNBC that a new breed of companies will
likely use language models to predict the most effective RNA (ribonucleic acid)
sequences.

“Last year we witnessed the impact of RNA technologies as novel covid vaccines,
many of them built on this technology, brought an end to nation-wide lockdowns,”
he said. “This year, I believe we will see a new crop of AI-first RNA
therapeutic companies. Using language models to predict the most effective RNA
sequences to target a disease of interest, these new companies could
dramatically speed up the time it takes to discover new drugs and vaccines.”


ETHICAL CONCERNS

While a number of advancements could be around the corner, there are major
concerns around the ethics of AI, which can be highly discriminative and biased
when trained on certain datasets. AI systems are also being used to power
autonomous weapons and to generate fake porn.

Verena Rieser, a professor of conversational AI at Heriot-Watt University in
Edinburgh, told CNBC that there will be a stronger focus on ethical questions
around AI in 2022.

“I don’t know whether AI will be able to do much ‘new’ stuff by the end of 2022
but hopefully it will do it better,” she said, adding that this means it would
be fairer, less biased and more inclusive.

Samim Winiger, an independent AI researcher who used to work for a Big Tech
firm, added that he believes there will be revelations around the use of machine
learning models in financial markets, spying, and health care.

“It will raise major questions about privacy, legality, ethics and economics,”
he told CNBC.



TV
Squawk on the StreetWATCH LIVEWATCH IN THE APP
UP NEXT | TechCheck 11:00 am ETListen
TV
Squawk on the StreetWATCH LIVEWATCH IN THE APP
UP NEXT | TechCheck 11:00 am ETListen

Trending Now

 1. Putin might be seen as a ‘mad dictator’ — but he has built powerful barriers
    to prevent a coup
    
 2. CDC recommends fourth Pfizer and Moderna Covid vaccine doses for people age
    50 and older
    
 3. Sen. Collins will back Supreme Court pick Jackson, giving her likely
    confirmation GOP support
    
 4. Mortgage refinance demand plunges 60%, as rates hit their highest level
    since 2018
    
 5. Walgreens turns to robots to fill prescriptions, as pharmacists take on more
    responsibilities
    




 * Subscribe to CNBC PRO
 * Licensing & Reprints
 * CNBC Councils
 * Supply Chain Values
 * CNBC on Peacock
 * Advertise With Us
 * Join the CNBC Panel
 * Digital Products
 * News Releases
 * Closed Captioning
 * Corrections
 * About CNBC
 * Internships
 * Site Map
 * Manage Cookie Preferences
 * Careers
 * Help
 * Contact

 * 
 * 
 * 
 * 
 * 
 * 
 * 

NEWS TIPS

Got a confidential news tip? We want to hear from you.

Get In Touch

CNBC NEWSLETTERS

Sign up for free newsletters and get more CNBC delivered to your inbox

Sign Up Now

Get this delivered to your inbox, and more info about our products and
services. 

Privacy Policy|Do Not Sell My Personal Information|CA Notice|Terms of Service

© 2022 CNBC LLC. All Rights Reserved. A Division of NBCUniversal

Data is a real-time snapshot *Data is delayed at least 15 minutes. Global
Business and Financial News, Stock Quotes, and Market Data and Analysis.

Market Data Terms of Use and Disclaimers

Data also provided by






COOKIE SETTINGS

We and our partners collect information from your device, such as device
identifiers, IP address, and your browser type to personalize and deliver
content, marketing and advertising—across devices and platforms; for analytics
and measurement, so we can improve our services and develop new ones; to match
and combine offline data with your online activity; and for social features. We
share this information with selected partners with your consent. By clicking
“Allow All”, you consent to our use of these Cookies. Click on the Cookie
categories or the “Detailed purpose descriptions” below to learn more about
these Cookies. We will also use other Cookies that are essential for our site
and Services, including for security and fraud prevention. To learn more about
some of our partners, see the List of IAB Vendors below. Visit our Cookie Notice
and Privacy Policy to learn more.
Allow All


MANAGE CONSENT PREFERENCES

STRICTLY NECESSARY COOKIES

Always Active

These Cookies are required for Service functionality, including security and
fraud prevention, and to enable any purchasing capabilities. You can set your
browser to block these Cookies, but some parts of the site may not function
properly.

Non-IAB Cookies‎

ENSURE SECURITY, PREVENT FRAUD, AND DEBUG

Always Active

Your data can be used to monitor for and prevent fraudulent activity, and ensure
systems and processes work properly and securely.

List of IAB Vendors‎ | Detailed Purpose Descriptions Opens in a new Tab

TECHNICALLY DELIVER ADS OR CONTENT

Always Active

Your device can receive and send information that allows you to see and interact
with ads and content.

List of IAB Vendors‎ | Detailed Purpose Descriptions Opens in a new Tab

STORE AND/OR ACCESS INFORMATION ON A DEVICE

Store and/or access information on a device

Cookies, device identifiers, or other information can be stored or accessed on
your device for the purposes presented to you.

List of IAB Vendors‎ | Detailed Purpose Descriptions Opens in a new Tab
Non-IAB Cookies‎

PERSONALISED ADS, AND AD MEASUREMENT

Personalised ads, and ad measurement

 * SELECT PERSONALISED ADS
   
   Switch Label
   
   Personalised ads can be shown to you based on a profile about you.

 * MEASURE AD PERFORMANCE
   
   Switch Label
   
   The performance and effectiveness of ads that you see or interact with can be
   measured.

 * CREATE A PERSONALISED ADS PROFILE
   
   Switch Label
   
   A profile can be built about you and your interests to show you personalised
   ads that are relevant to you.

 * SELECT BASIC ADS
   
   Switch Label
   
   Ads can be shown to you based on the content you’re viewing, the app you’re
   using, your approximate location, or your device type.

 * TARGETED ADVERTISING COOKIES
   
   Switch Label
   
   These Cookies are used to collect data about your browsing habits, use of the
   Services, your preferences, and your interaction with advertisements across
   platforms and devices for the purpose of delivering targeted advertising
   content, both on our Services and on third party sites. Third-party sites and
   services also use Targeting Cookies to deliver content, including
   advertisements relevant to your interests on the Services. If you reject
   these Cookies, you will see less relevant advertising.

List of IAB Vendors‎ | Detailed Purpose Descriptions Opens in a new Tab
Non-IAB Cookies‎

PERSONALISED CONTENT, CONTENT MEASUREMENT, AUDIENCE INSIGHTS, AND PRODUCT
DEVELOPMENT

Personalised content, content measurement, audience insights, and product
development

 * DEVELOP AND IMPROVE PRODUCTS
   
   Switch Label
   
   Your data can be used to improve existing systems and software, and to
   develop new products

 * SELECT PERSONALISED CONTENT
   
   Switch Label
   
   Personalised content can be shown to you based on a profile about you.

 * APPLY MARKET RESEARCH TO GENERATE AUDIENCE INSIGHTS
   
   Switch Label
   
   Market research can be used to learn more about the audiences who visit
   sites/apps and view ads.

 * CREATE A PERSONALISED CONTENT PROFILE
   
   Switch Label
   
   A profile can be built about you and your interests to show you personalised
   content that is relevant to you.

 * MEASURE CONTENT PERFORMANCE
   
   Switch Label
   
   The performance and effectiveness of content that you see or interact with
   can be measured.

 * CONTENT SELECTION COOKIES
   
   Switch Label
   
   This group is so Content Selection IAB group can have an id

List of IAB Vendors‎ | Detailed Purpose Descriptions Opens in a new Tab
Non-IAB Cookies‎

SOCIAL MEDIA COOKIES

Social Media Cookies

These Cookies are set by social media platforms on the Services to enable you to
share content with your friends and networks. Social media platforms have the
ability to track your online activity outside of the Services. This may impact
the content and messages you see on other websites you visit.

Non-IAB Cookies‎


BACK BUTTON PERFORMANCE COOKIES



Vendor Search Search Icon
Filter Icon

Clear
checkbox label label
Apply Cancel
Consent Leg.Interest
checkbox label label
checkbox label label
checkbox label label


 * 33ACROSS
   
   HOST DESCRIPTION
   
   VIEW COOKIES
   
   
    * Name
      cookie name

Confirm My Choices


We and our partners collect information from your device, such as device
identifiers, IP address, and your browser type to personalize and deliver
content, marketing and advertising—across devices and platforms; for analytics
and measurement, so we can improve our services and develop new ones; to match
and combine offline data with your online activity; and for social features. We
share this information with selected partners with your consent. By clicking “I
accept”, you consent to our use of these Cookies. Click Manage Choices to learn
more about these. We will also use other Cookies that are essential for our site
and Services, including for security and fraud prevention. To learn more about
some of our partners select Show Vendors. You can adjust your preferences at any
time via the “Manage Cookie Preferences” link in the footer of relevant
NBCUniversal websites or in-app settings. Visit our Cookie Notice and Privacy
Policy to learn more.


WE AND OUR PARTNERS PROCESS DATA FOR THE FOLLOWING PURPOSES:

Store and/or access information on a device. Personalised ads, and ad
measurement. Personalised content, content measurement, audience insights, and
product development. List of IAB Vendors

I Accept Manage Choices