www.diffblue.com Open in urlscan Pro
2606:4700:10::6816:4d9e  Public Scan

URL: https://www.diffblue.com/goldman-sachs/
Submission: On November 30 via api from SE — Scanned from DE

Form analysis 1 forms found in the DOM

POST https://forms.hsforms.com/submissions/v3/public/submit/formsnext/multipart/7183665/c9bec888-3c6a-48cd-86eb-468ca0500cfb

<form novalidate="" accept-charset="UTF-8" action="https://forms.hsforms.com/submissions/v3/public/submit/formsnext/multipart/7183665/c9bec888-3c6a-48cd-86eb-468ca0500cfb" enctype="multipart/form-data" id="hsForm_c9bec888-3c6a-48cd-86eb-468ca0500cfb"
  method="POST"
  class="lead-form hs-email-form  footer-form hs-form hs-form-private hsForm_c9bec888-3c6a-48cd-86eb-468ca0500cfb hs-form-c9bec888-3c6a-48cd-86eb-468ca0500cfb hs-form-c9bec888-3c6a-48cd-86eb-468ca0500cfb_556105fa-e731-4700-a46c-8b4508d804da"
  data-form-id="c9bec888-3c6a-48cd-86eb-468ca0500cfb" data-portal-id="7183665" target="target_iframe_c9bec888-3c6a-48cd-86eb-468ca0500cfb" data-reactid=".hbspt-forms-0">
  <div class="hs_email hs-email hs-fieldtype-text field hs-form-field" data-reactid=".hbspt-forms-0.1:$0"><label id="label-email-c9bec888-3c6a-48cd-86eb-468ca0500cfb" class="" placeholder="Enter your Email"
      for="email-c9bec888-3c6a-48cd-86eb-468ca0500cfb" data-reactid=".hbspt-forms-0.1:$0.0"><span data-reactid=".hbspt-forms-0.1:$0.0.0">Email</span><span class="hs-form-required" data-reactid=".hbspt-forms-0.1:$0.0.1">*</span></label>
    <legend class="hs-field-desc" style="display:none;" data-reactid=".hbspt-forms-0.1:$0.1"></legend>
    <div class="input" data-reactid=".hbspt-forms-0.1:$0.$email"><input id="email-c9bec888-3c6a-48cd-86eb-468ca0500cfb" class="hs-input" type="email" name="email" required="" placeholder="Email address" value="" autocomplete="email"
        data-reactid=".hbspt-forms-0.1:$0.$email.0" inputmode="email"></div>
  </div>
  <div class="legal-consent-container" data-reactid=".hbspt-forms-0.2">
    <div class="hs-richtext" data-reactid=".hbspt-forms-0.2.2">
      <p>We will process your personal data in accordance with our <a href="https://www.diffblue.com/privacy/" target="_blank">Privacy Notice</a></p>
    </div>
  </div>
  <div class="hs_submit hs-submit" data-reactid=".hbspt-forms-0.5">
    <div class="hs-field-desc" style="display:none;" data-reactid=".hbspt-forms-0.5.0"></div>
    <div class="actions" data-reactid=".hbspt-forms-0.5.1"><input type="submit" value="Sign up" class="button" data-reactid=".hbspt-forms-0.5.1.0"></div>
  </div><noscript data-reactid=".hbspt-forms-0.6"></noscript><input name="hs_context" type="hidden"
    value="{&quot;rumScriptExecuteTime&quot;:2064.6000003814697,&quot;rumServiceResponseTime&quot;:2306.699998855591,&quot;rumFormRenderTime&quot;:1.5,&quot;rumTotalRenderTime&quot;:2308.8999996185303,&quot;rumTotalRequestTime&quot;:241.10000038146973,&quot;renderRawHtml&quot;:&quot;true&quot;,&quot;lang&quot;:&quot;en&quot;,&quot;embedType&quot;:&quot;REGULAR&quot;,&quot;legalConsentOptions&quot;:&quot;{\&quot;legitimateInterestSubscriptionTypes\&quot;:[8631984,8532550,8823266],\&quot;communicationConsentCheckboxes\&quot;:[{\&quot;communicationTypeId\&quot;:8631984,\&quot;label\&quot;:\&quot;I agree to receive other communications from Diffblue Ltd..\&quot;,\&quot;required\&quot;:false}],\&quot;legitimateInterestLegalBasis\&quot;:\&quot;LEGITIMATE_INTEREST_PQL\&quot;,\&quot;communicationConsentText\&quot;:\&quot;<p>Diffblue Ltd. is committed to protecting and respecting your privacy, and we’ll only use your personal information to administer your account and to provide the products and services you requested from us. From time to time, we would like to contact you about our products and services, as well as other content that may be of interest to you. If you consent to us contacting you for this purpose, please tick below to say how you would like us to contact you:</p>\&quot;,\&quot;processingConsentType\&quot;:\&quot;IMPLICIT\&quot;,\&quot;processingConsentText\&quot;:\&quot;<p>In order to provide you the content requested, we need to store and process your personal data. If you consent to us storing your personal data for this purpose, please tick the checkbox below.</p>\&quot;,\&quot;processingConsentCheckboxLabel\&quot;:\&quot;<p>I agree to allow Diffblue Ltd. to store and process my personal data.</p>\&quot;,\&quot;privacyPolicyText\&quot;:\&quot;<p>We will process your personal data in accordance with our <a href=\\\&quot;https://www.diffblue.com/privacy/\\\&quot; target=\\\&quot;_blank\\\&quot;>Privacy Notice</a></p>\&quot;,\&quot;isLegitimateInterest\&quot;:true}&quot;,&quot;embedAtTimestamp&quot;:&quot;1638299802293&quot;,&quot;formDefinitionUpdatedAt&quot;:&quot;1620830802832&quot;,&quot;pageUrl&quot;:&quot;https://www.diffblue.com/goldman-sachs/&quot;,&quot;pageTitle&quot;:&quot;Goldman Sachs | Diffblue&quot;,&quot;source&quot;:&quot;FormsNext-static-5.415&quot;,&quot;sourceName&quot;:&quot;FormsNext&quot;,&quot;sourceVersion&quot;:&quot;5.415&quot;,&quot;sourceVersionMajor&quot;:&quot;5&quot;,&quot;sourceVersionMinor&quot;:&quot;415&quot;,&quot;timestamp&quot;:1638299802293,&quot;userAgent&quot;:&quot;Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.45 Safari/537.36&quot;,&quot;originalEmbedContext&quot;:{&quot;portalId&quot;:&quot;7183665&quot;,&quot;formId&quot;:&quot;c9bec888-3c6a-48cd-86eb-468ca0500cfb&quot;,&quot;cssClass&quot;:&quot;lead-form hs-email-form  footer-form&quot;,&quot;submitButtonClass&quot;:&quot;button&quot;,&quot;errorClass&quot;:&quot;error&quot;,&quot;errorMessageClass&quot;:&quot;error-list&quot;,&quot;target&quot;:&quot;#hbspt-form-1638299802126-9219710705&quot;},&quot;renderedFieldsIds&quot;:[&quot;email&quot;],&quot;formTarget&quot;:&quot;#hbspt-form-1638299802126-9219710705&quot;,&quot;correlationId&quot;:&quot;86c2cec2-b7fa-45e2-b0a7-42fb872c26bb&quot;,&quot;hutk&quot;:&quot;a596ad0456a4fe9f5ed6a748946e13ad&quot;,&quot;captchaStatus&quot;:&quot;NOT_APPLICABLE&quot;}"
    data-reactid=".hbspt-forms-0.7"><iframe name="target_iframe_c9bec888-3c6a-48cd-86eb-468ca0500cfb" style="display:none;" data-reactid=".hbspt-forms-0.8"></iframe>
</form>

Text Content

We use third party cookies and scripts to improve and customize your browsing
experience of this website. To find out more about the cookies we use, see our
Cookie Statement.

Okay!

Menu Close

✎ Edit navigation

 * What is Cover?
   * What is Cover?
   * Use Cases
   * Free Community Edition
   * Pricing
 * Using Cover
   * Getting Started
   * Documentation
   * Community Forum
   * Support
   * What's new?
 * Resources
   * Blog
   * Guides
   * eBooks
   * Webinars & Videos
   * Research
 * About Diffblue
   * About us
   * News
   * Careers
   * Contact us
   Try now


GOLDMAN SACHS

Saves over a year of manual effort with Diffblue Cover and AI for Code



For Goldman Sachs, higher code coverage provides greater confidence in
application stability when adding new code, improving the speed at which the
company’s engineering teams can deliver business value.


CHALLENGE

Unit test suites are a key part of effective software development and continuous
integration, but creating them for legacy code is resource-intensive. Goldman
Sachs aimed to efficiently boost legacy code coverage and allow engineering
teams to refocus their efforts on the development of innovative,
business-critical new features.


SOLUTION

Goldman Sachs has a long history as a technology leader among global banks. The
latest advance is the company’s use of Diffblue Cover, an AI-powered tool that
enables the engineering teams to improve code quality and efficiency through the
automatic generation of unit tests.


RESULTS

Since starting the legacy modernization program using Diffblue Cover, the
engineering teams have increased test coverage for the first batch of
applications from 36% to 72% in less than 10% of the time it would take to do
manually.*

For some applications, this result was achievable in hours or days rather than
man-years. Higher code coverage has also provided greater confidence in
application stability when adding new code, improving the speed at which the
engineering teams can deliver business value.


KEY BENEFITS


CODE COVERAGE

With Diffblue Cover, new code coverage levels exceed industry standards.


AGILITY

Increase in agility and efficiency of new development.


CONFIDENCE

Engineering teams can modify code with confidence.


SAVINGS

Create test suites in less than 10% of the manual time,* saving years of work
and sharply reducing cost.


CONTINUOUS INTEGRATION

Developers can catch regressions early in the software delivery lifecycle.

Coverage was boosted by 100% in less than 24 hours for one repo

Achieved a time savings of 1 man-year* for a core application


THE LEGACY CODE CHALLENGE

Unit tests—tests that confirm the functionality of individual units of code—are
a small but critical part of the software development lifecycle. These fast,
lightweight tests make it possible to track the connections between units of
code so developers can write and refactor with confidence. When an organization
has an automated suite of unit tests that covers all existing code, any new code
a developer adds is immediately checked against the entire codebase, and the
developer is alerted if their modifications cause any issues or breaking changes
in the code’s behavior.

Achieving high code coverage (the percent of a codebase covered by unit tests)
can make a big difference to continuous integration efforts, which depend on
being able to tell right away if any unintended behavioral changes have been
introduced.

High code coverage has been a longstanding challenge for Goldman Sachs and other
banks with significant legacy software, most of which incorporate code that was
written before unit testing became an established practice. Editing or adding to
poorly documented legacy code without unit tests can result in unexpected bugs
and headaches, but writing the required quantity of new unit tests is time- and
labor-intensive. As a result, meeting unit testing goals and new feature
development goals simultaneously can be an uphill battle.

In the 2018 book Accelerate: Building and Scaling High Performing Technology
Organizations, authors Nicole Forsgren, Jez Humble and Gene Kim found a
relationship with high software delivery performance and the use of automated
testing, and Goldman Sachs has been automating the execution of their unit tests
for years. Until recently, however, the technology did not exist for automating
the writing of unit tests themselves, leaving organizations with only the option
of using the manual efforts of internal or external development teams.


GOLDMAN SACHS’ QAE TEAM

Goldman Sachs has a long history as a technology leader among global banks, and
the Goldman Sachs Quality Assurance Engineering (QAE) team is responsible for
empowering the company’s engineers to proactively deliver quality software and
services. The processes put in place by the QAE team enable the early
identification of quality gaps with low-touch controls across Goldman Sachs
technology.

The QAE team has been working towards reaching industry best coverage levels.
However, given the company’s large legacy estate and the volume of unit tests
required to increase the average level of code coverage, the team had also been
looking for ways to efficiently bolster productivity. Artificial intelligence
(AI) was a natural avenue to explore.


PROPOSED SOLUTION: DIFFBLUE COVER

While working towards the goal of bringing every application in Goldman Sachs to
higher levels of code coverage, the QAE team landed on Diffblue Cover, a tool
that automatically and intelligently writes unit tests for Java applications
using AI for code. One of Diffblue Cover’s primary benefits is its unique
ability to rapidly generate a test suite for legacy codebases.

“We decided to use Diffblue Cover because of the potential it offered for
helping us meet our most ambitious code coverage targets, while also freeing up
developers’ time for the work only they can do,” says Matt Davey, Managing
Director, Technology QAE & SDLC. “Diffblue Cover is enabling us to improve
quality and build new software faster.”

> Diffblue Cover is enabling us to improve quality and build new software,
> faster.
> 
> Matt Davey, MD, Technology QAE & SDLC at Goldman Sachs


RESULTS: DOUBLED CODE COVERAGE IN A FRACTION OF THE TIME

Diffblue Cover has been implemented on various applications within Goldman
Sachs; for each software product, a suite of high-quality tests has been
generated in less than one day. For one module within an important backend
system, existing unit test coverage was boosted from 36% to 72% in less than 24
hours. Creating the same number of unit tests manually would have taken more
than eight days of developer time,* compared to three-quarters of a workday with
Diffblue—a time savings of more than 90%. Diffblue Cover also picked up on edge
cases in other applications that could have led to customer-impacting incidents.

Another back-end application has fifteen thousand lines of code. Diffblue Cover
created over three thousand tests overnight. Compared to the time it would have
taken to write these 3,211 unit tests manually, Diffblue Cover was more than 180
times faster.*

Diffblue Cover not only increased the quantity of tests, but also passed the
quality bar for application owners. The tests were immediately ready to be
integrated into the test suite, and the review of these generated tests took one
day.

“We are thrilled with these results,” adds Jonathan Goodfellow, Managing
Director, QAE. “They have definitely exceeded our expectations and we’re excited
about how much time and work this has saved our engineers so they can refocus on
increasing Goldman Sachs’ feature velocity, code quality, and software security.
It’s great to have higher confidence in the integrity of our existing codebase.”

TIME SPENT WRITING UNIT TESTS

 Manual Effort*Diffblue CoverNumber of tests3,2113,211Average time to write
each30 minutes10 secondsDays spent writing tests per application268 workdays1/3
day (run overnight)

* Manual effort assumes industry averages of 30 minutes per manual test and 6
hours productive time per day.

> We’re excited about how much time and work this has saved our engineers so
> they can refocus on increasing Goldman Sachs’ feature velocity, code quality,
> and software security. It’s great to have higher confidence in the integrity
> of our existing codebase.
> 
> Jonathan Goodfellow, Managing Director, QAE


NEXT STEPS FOR CODE QUALITY

To further streamline the development of quality code at Goldman Sachs in the
future, the QAE team will be introducing Diffblue Cover across the company to
help improve code coverage. With the confidence and reduced operational risk
conferred by high coverage, the company expects to continue to see the
transformation of legacy code into accessible and highly functional modern
software.

“We expect this to be a key technology for our transformation and a game-changer
for Goldman Sachs,” Matt Davey concluded.

✎ Edit banner


READY TO TRY DIFFBLUE COVER?

Get started now

✎ Edit footer

Product

 * What is Cover
 * Use Cases
 * Try Cover
 * Pricing
 * Documentation
 * Case Studies
 * Support

Resources

 * Blog
 * Guides
 * eBooks
 * Webinars & Videos
 * Research
 * Newsletters

Company

 * About Us
 * News
 * Brand
 * Careers
 * FAQs

Get in Touch

 * Contact Us
 * Schedule a Demo
 * Get a Free Trial
 * Community Forum

Sign up to our Newsletter

Email*


We will process your personal data in accordance with our Privacy Notice




© 2021 Diffblue Ltd. | Privacy ⋅ Legal