venturebeat.com Open in urlscan Pro
2606:4700::6812:8ee  Public Scan

Form analysis
2 forms found in the DOM

GET https://venturebeat.com/

<form method="get" action="https://venturebeat.com/" class="search-form" id="nav-search-form">
  <input id="mobile-search-input" class="" type="text" placeholder="Search" name="s" aria-label="Search" required="">
  <button type="submit" class="">
    <svg width="24" height="24" viewBox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg">
      <g>
        <path fill-rule="evenodd" clip-rule="evenodd"
          d="M14.965 14.255H15.755L20.745 19.255L19.255 20.745L14.255 15.755V14.965L13.985 14.685C12.845 15.665 11.365 16.255 9.755 16.255C6.16504 16.255 3.255 13.345 3.255 9.755C3.255 6.16501 6.16504 3.255 9.755 3.255C13.345 3.255 16.255 6.16501 16.255 9.755C16.255 11.365 15.665 12.845 14.6851 13.985L14.965 14.255ZM5.255 9.755C5.255 12.245 7.26501 14.255 9.755 14.255C12.245 14.255 14.255 12.245 14.255 9.755C14.255 7.26501 12.245 5.255 9.755 5.255C7.26501 5.255 5.255 7.26501 5.255 9.755Z">
        </path>
      </g>
    </svg>
  </button>
</form>

<form action="" data-action="nonce_mailchimp_boilerplate_subscribe" id="boilerplateNewsletterForm" class="Form js-vb-newsletter-cta">
  <input type="email" name="email" placeholder="Email" class="Form__input" id="boilerplateNewsletterEmail" required="">
  <input type="hidden" name="newsletter" value="vb_dailyroundup">
  <input type="hidden" name="b_f67554569818c29c4c844d121_89d8059242" value="">
  <input type="hidden" id="nonce_mailchimp_boilerplate_subscribe" name="nonce_mailchimp_boilerplate_subscribe" value="41a0f9ca78"><input type="hidden" name="_wp_http_referer"
    value="/ai/sp-global-launches-groundbreaking-ai-benchmark-for-financial-industry/"> <button type="submit" class="Form__button Newsletter__sub-btn">Subscribe</button>
</form>

Text Content

WE VALUE YOUR PRIVACY

We and our partners store and/or access information on a device, such as cookies
and process personal data, such as unique identifiers and standard information
sent by a device for personalised advertising and content, advertising and
content measurement, audience research and services development. With your
permission we and our partners may use precise geolocation data and
identification through device scanning. You may click to consent to our and our
1413 partners’ processing as described above. Alternatively you may access more
detailed information and change your preferences before consenting or to refuse
consenting. Please note that some processing of your personal data may not
require your consent, but you have a right to object to such processing. Your
preferences will apply to this website only. You can change your preferences or
withdraw your consent at any time by returning to this site and clicking the
"Privacy" button at the bottom of the webpage.
MORE OPTIONSAGREE

Skip to main content
Events Video Special Issues Jobs
VentureBeat Homepage

Subscribe

 * Artificial Intelligence
   * View All
   * AI, ML and Deep Learning
   * Auto ML
   * Data Labelling
   * Synthetic Data
   * Conversational AI
   * NLP
   * Text-to-Speech
 * Security
   * View All
   * Data Security and Privacy
   * Network Security and Privacy
   * Software Security
   * Computer Hardware Security
   * Cloud and Data Storage Security
 * Data Infrastructure
   * View All
   * Data Science
   * Data Management
   * Data Storage and Cloud
   * Big Data and Analytics
   * Data Networks
 * Automation
   * View All
   * Industrial Automation
   * Business Process Automation
   * Development Automation
   * Robotic Process Automation
   * Test Automation
 * Enterprise Analytics
   * View All
   * Business Intelligence
   * Disaster Recovery Business Continuity
   * Statistical Analysis
   * Predictive Analysis
 * More
   * Data Decision Makers
   * Virtual Communication
     * Team Collaboration
     * UCaaS
     * Virtual Reality Collaboration
     * Virtual Employee Experience
   * Programming & Development
     * Product Development
     * Application Development
     * Test Management
     * Development Languages


Subscribe Events Video Special Issues Jobs



S&P GLOBAL LAUNCHES GROUNDBREAKING AI BENCHMARK FOR FINANCIAL INDUSTRY

Michael Nuñez@MichaelFNunez
April 4, 2024 7:00 AM
 * Share on Facebook
 * Share on X
 * Share on LinkedIn



Discover how companies are responsibly integrating AI in production. This
invite-only event in SF will explore the intersection of technology and
business. Find out how you can attend here.

--------------------------------------------------------------------------------



S&P Global, a leading provider of financial intelligence, quietly announced on
Wednesday the launch of S&P AI Benchmarks by Kensho. This innovative solution
aims to set a new standard for evaluating the performance of large language
models (LLMs) in complex financial and quantitative applications.

Developed by S&P Global’s AI-focused division, Kensho, the benchmarking tool
assesses an LLM’s ability to handle tasks such as quantitative reasoning, data
extraction from financial documents and demonstrating domain-specific knowledge.
The results are then displayed on a leaderboard, providing a transparent view of
each model’s capabilities.

1
/
3
Unleashing Generative AI: Building trustworthy solutions with flawless data
Read More

61.1K
87




Video Player is loading.
Play Video
Unmute

Duration 0:00
/
Current Time 0:00
Playback Speed Settings
1x
Loaded: 0%

0:00

Remaining Time -0:00
 
FullscreenPlayRewind 10 SecondsUp Next

This is a modal window.



Beginning of dialog window. Escape will cancel and close the window.

TextColorWhiteBlackRedGreenBlueYellowMagentaCyanTransparencyOpaqueSemi-TransparentBackgroundColorBlackWhiteRedGreenBlueYellowMagentaCyanTransparencyOpaqueSemi-TransparentTransparentWindowColorBlackWhiteRedGreenBlueYellowMagentaCyanTransparencyTransparentSemi-TransparentOpaque
Font Size50%75%100%125%150%175%200%300%400%Text Edge
StyleNoneRaisedDepressedUniformDropshadowFont FamilyProportional
Sans-SerifMonospace Sans-SerifProportional SerifMonospace SerifCasualScriptSmall
Caps
Reset restore all settings to the default valuesDone
Close Modal Dialog

End of dialog window.

Share
Playback Speed

0.25x
0.5x
1x Normal
1.5x
2x
Replay the list

TOP ARTICLES






 * Powered by AnyClip
 * Privacy Policy




Unleashing Generative AI: Building trustworthy solutions with flawless data

S&P AI Benchmarks by Kensho ranks the performance of large language models
(LLMs) across key financial and quantitative metrics, including domain
knowledge, quantity extraction, and program synthesis. (Source:
benchmarks.kensho.com)

“S&P AI Benchmarks combined Kensho’s cutting-edge AI research and engineering
with S&P Global’s leading financial intelligence capabilities,” said Bhavesh
Dayalji, Chief AI Officer for S&P Global and CEO of Kensho, in an interview with
VentureBeat. “Our hope is that the solution becomes the industry standard for
understanding how LLMs perform on complex financial reasoning and that it
encourages broader innovation in the FinAI space.”

The launch of S&P AI Benchmarks comes at a pivotal moment for the financial
services industry, as more institutions explore the potential of generative AI
and LLMs to streamline operations and gain a competitive edge. However, the lack
of standardized benchmarks has made it challenging for organizations to assess
the suitability of different models for their specific use cases.


VB EVENT

The AI Impact Tour – San Francisco

Join us as we navigate the complexities of responsibly integrating AI in
business at the next stop of VB’s AI Impact Tour in San Francisco. Don’t miss
out on the chance to gain insights from industry experts, network with
like-minded innovators, and explore the future of GenAI with customer
experiences and optimize business processes.


Request an invite
advertisement



FUELING INNOVATION AND INFORMED DECISION-MAKING

“Benchmark solutions like ours are critical to helping institutions and
professionals across our industry determine which LLMs they should be using for
their particular use cases,” Dayalji explained. “And we believe that S&P AI
Benchmarks is also going to fuel innovation by helping financial professionals
identify where each model is performing well and how it can add the most value.”

The S&P AI Benchmarks methodology was developed and validated by a diverse team
of experts, including engineers, researchers, academics and financial
professionals from across S&P Global’s divisions. The evaluation set consists of
600 questions, designed to rigorously test an LLM’s performance across three key
categories.


A MILESTONE FOR AI ADOPTION IN FINANCE

advertisement


Industry analysts believe that the launch of S&P AI Benchmarks could mark a
significant milestone in the adoption of AI within the financial sector. As more
advanced AI permeates the financial industry, having a reliable and transparent
benchmarking tool will be essential for firms looking to make informed decisions
about which models to deploy. S&P Global’s solution could help accelerate the
responsible adoption of LLMs and drive innovation in the FinAI space.

Looking ahead, S&P Global envisions S&P AI Benchmarks playing a crucial role in
shaping the future of AI in financial services. “Our vision is to see LLMs
become more effective and better adapted to the needs of the industries we
operate in across the board, and solutions like ours will help us get there,”
Dayalji said. “We encourage all model providers to participate so that we can
continue to evolve our framework.”

As the financial industry navigates the rapidly evolving landscape of AI and
generative AI, tools like S&P AI Benchmarks by Kensho are poised to become
essential guides, helping organizations harness the power of these technologies
while ensuring accuracy, transparency, and responsible deployment.

VB Daily

Stay in the know! Get the latest news in your inbox daily

Subscribe

By subscribing, you agree to VentureBeat's Terms of Service.

Thanks for subscribing. Check out more VB newsletters here.

An error occured.






NEXT STOP: THE AI IMPACT TOUR IN SAN FRANCISCO

Join GenAI leaders in San Francisco on May 8th for an exclusive invitation-only
event focused on the latest advancements shaping the future with the practical
applications of generative AI in production.

Request an Invite


 * VentureBeat Homepage
 * Follow us on Facebook
 * Follow us on X
 * Follow us on LinkedIn
 * Follow us on RSS

 * Press Releases
 * Contact Us
 * Advertise
 * Share a News Tip
 * Contribute to DataDecisionMakers

 * Privacy Policy
 * Terms of Service
 * Do Not Sell My Personal Information

© 2024 VentureBeat. All rights reserved.