www.forrester.com
Open in
urlscan Pro
149.126.77.115
Public Scan
Submitted URL: http://link.mail.beehiiv.com/ss/c/u001.MjqciNziQ9SRAWwP9F7s9V2jCHLT26jlRjTHeT2f1q-kPurUmx408cHkj5I2IdVIu6ulyxkzXZPHXZVfcpTjy9...
Effective URL: https://www.forrester.com/blogs/announcing-our-inaugural-ai-foundation-models-for-language-forrester-wave-21-criteria-to-c...
Submission: On June 10 via api from NL — Scanned from NL
Effective URL: https://www.forrester.com/blogs/announcing-our-inaugural-ai-foundation-models-for-language-forrester-wave-21-criteria-to-c...
Submission: On June 10 via api from NL — Scanned from NL
Form analysis
4 forms found in the DOMGET /allSearch
<form action="/allSearch" method="get" class="header-search js-header-search">
<label for="header-search-desktop" class="sr-only">Search</label>
<input id="header-search-desktop" class="header-search__input js-header-search-input" type="search" name="q">
<span class="header-search__clear js-header-search-clear"></span>
<input type="hidden" name="s" value="relevance">
<input type="hidden" name="dateRange" value="365">
</form>
GET /allSearch
<form action="/allSearch" method="get" class="header-search js-header-search">
<label for="header-search-mobile" class="sr-only">Search</label>
<input id="header-search-mobile" class="header-search__input js-header-search-input" type="search" name="q">
<span class="header-search__clear js-header-search-clear"></span>
<input type="hidden" name="s" value="relevance">
<input type="hidden" name="dateRange" value="365">
</form>
Name: LEAD3.0Wordpress — POST
<form method="post" name="LEAD3.0Wordpress" id="form2069_sidebar" action="" class="forr-form" data-type="subscribe-article" data-behavior="confirmation" data-redirecturl="" novalidate="novalidate">
<div class="forr-form__row dropdown">
<label for="emailFieldSidebar" class="forr-form__label">Email Address*</label>
<input id="emailFieldSidebar" class="forr-form__input forr-form__input--text" name="email" type="email" placeholder="Enter your email address" required="">
</div>
<div class="forr-form__row">
<div class="forr-form__item">
<label for="countryFieldSidebar" class="forr-form__label">Country*</label>
<select id="countryFieldSidebar" class="forr-form__input forr-form__input--select" name="country" required="">
<option disabled="" selected="" value=""> Country </option>
<option value="US">United States</option>
<option value="AX">Åland Islands</option>
<option value="DZ">Algeria</option>
<option value="AS">American Samoa</option>
<option value="AD">Andorra</option>
<option value="AO">Angola</option>
<option value="AI">Anguilla</option>
<option value="AQ">Antarctica</option>
<option value="AG">Antigua and Barbuda</option>
<option value="AR">Argentina</option>
<option value="AM">Armenia</option>
<option value="AW">Aruba</option>
<option value="AU">Australia</option>
<option value="AT">Austria</option>
<option value="AZ">Azerbaijan</option>
<option value="BS">Bahamas</option>
<option value="BH">Bahrain</option>
<option value="BD">Bangladesh</option>
<option value="BB">Barbados</option>
<option value="BY">Belarus</option>
<option value="BE">Belgium</option>
<option value="BZ">Belize</option>
<option value="BJ">Benin</option>
<option value="BM">Bermuda</option>
<option value="BT">Bhutan</option>
<option value="BO">Bolivia, Plurinational State of</option>
<option value="BQ">Bonaire, Sint Eustatius and Saba</option>
<option value="BW">Botswana</option>
<option value="BV">Bouvet Island</option>
<option value="BR">Brazil</option>
<option value="IO">British Indian Ocean Territory</option>
<option value="BN">Brunei Darussalam</option>
<option value="BG">Bulgaria</option>
<option value="BF">Burkina Faso</option>
<option value="KH">Cambodia</option>
<option value="CM">Cameroon</option>
<option value="CA">Canada</option>
<option value="CV">Cape Verde</option>
<option value="KY">Cayman Islands</option>
<option value="TD">Chad</option>
<option value="CL">Chile</option>
<option value="CN">China</option>
<option value="CX">Christmas Island</option>
<option value="CC">Cocos (Keeling) Islands</option>
<option value="CO">Colombia</option>
<option value="KM">Comoros</option>
<option value="CK">Cook Islands</option>
<option value="CR">Costa Rica</option>
<option value="CI">Côte d'Ivoire</option>
<option value="HR">Croatia</option>
<option value="CU">Cuba</option>
<option value="CW">Curaçao</option>
<option value="CY">Cyprus</option>
<option value="CZ">Czech Republic</option>
<option value="DK">Denmark</option>
<option value="DJ">Djibouti</option>
<option value="DM">Dominica</option>
<option value="DO">Dominican Republic</option>
<option value="EC">Ecuador</option>
<option value="EG">Egypt</option>
<option value="SV">El Salvador</option>
<option value="GQ">Equatorial Guinea</option>
<option value="ER">Eritrea</option>
<option value="EE">Estonia</option>
<option value="FK">Falkland Islands</option>
<option value="FO">Faroe Islands</option>
<option value="FJ">Fiji</option>
<option value="FI">Finland</option>
<option value="FR">France</option>
<option value="GF">French Guiana</option>
<option value="PF">French Polynesia</option>
<option value="TF">French Southern Territories</option>
<option value="GA">Gabon</option>
<option value="GM">Gambia</option>
<option value="GE">Georgia</option>
<option value="DE">Germany</option>
<option value="GH">Ghana</option>
<option value="GI">Gibraltar</option>
<option value="GR">Greece</option>
<option value="GL">Greenland</option>
<option value="GD">Grenada</option>
<option value="GP">Guadeloupe</option>
<option value="GU">Guam</option>
<option value="GT">Guatemala</option>
<option value="GG">Guernsey</option>
<option value="GN">Guinea</option>
<option value="GY">Guyana</option>
<option value="HT">Haiti</option>
<option value="HM">Heard Island and McDonald Islands</option>
<option value="HN">Honduras</option>
<option value="HK">Hong Kong</option>
<option value="HU">Hungary</option>
<option value="IS">Iceland</option>
<option value="IN">India</option>
<option value="ID">Indonesia</option>
<option value="IQ">Iraq</option>
<option value="IE">Ireland</option>
<option value="IM">Isle of Man</option>
<option value="IL">Israel</option>
<option value="IT">Italy</option>
<option value="JM">Jamaica</option>
<option value="JP">Japan</option>
<option value="JE">Jersey</option>
<option value="JO">Jordan</option>
<option value="KZ">Kazakhstan</option>
<option value="KE">Kenya</option>
<option value="KI">Kiribati</option>
<option value="KR">Korea, Republic of</option>
<option value="KW">Kuwait</option>
<option value="KG">Kyrgyzstan</option>
<option value="LA">Lao People's Democratic Republic</option>
<option value="LV">Latvia</option>
<option value="LS">Lesotho</option>
<option value="LR">Liberia</option>
<option value="LI">Liechtenstein</option>
<option value="LT">Lithuania</option>
<option value="LU">Luxembourg</option>
<option value="MO">Macao</option>
<option value="MG">Madagascar</option>
<option value="MW">Malawi</option>
<option value="MY">Malaysia</option>
<option value="MV">Maldives</option>
<option value="MT">Malta</option>
<option value="MH">Marshall Islands</option>
<option value="MQ">Martinique</option>
<option value="MR">Mauritania</option>
<option value="MU">Mauritius</option>
<option value="YT">Mayotte</option>
<option value="MX">Mexico</option>
<option value="FM">Micronesia, Federated States of</option>
<option value="MD">Moldova, Republic of</option>
<option value="MC">Monaco</option>
<option value="MN">Mongolia</option>
<option value="MS">Montserrat</option>
<option value="MA">Morocco</option>
<option value="MZ">Mozambique</option>
<option value="MM">Myanmar</option>
<option value="NA">Namibia</option>
<option value="NR">Nauru</option>
<option value="NP">Nepal</option>
<option value="NL">Netherlands</option>
<option value="NC">New Caledonia</option>
<option value="NZ">New Zealand</option>
<option value="NE">Niger</option>
<option value="NG">Nigeria</option>
<option value="NU">Niue</option>
<option value="NF">Norfolk Island</option>
<option value="MP">Northern Mariana Islands</option>
<option value="NO">Norway</option>
<option value="OM">Oman</option>
<option value="PK">Pakistan</option>
<option value="PW">Palau</option>
<option value="PS">Palestinian Territory, Occupied</option>
<option value="PA">Panama</option>
<option value="PG">Papua New Guinea</option>
<option value="PY">Paraguay</option>
<option value="PE">Peru</option>
<option value="PH">Philippines</option>
<option value="PN">Pitcairn</option>
<option value="PL">Poland</option>
<option value="PT">Portugal</option>
<option value="PR">Puerto Rico</option>
<option value="QA">Qatar</option>
<option value="RE">Réunion</option>
<option value="RO">Romania</option>
<option value="RW">Rwanda</option>
<option value="BL">Saint Barthélemy</option>
<option value="SH">Saint Helena, Ascension and Tristan da Cunha</option>
<option value="KN">Saint Kitts and Nevis</option>
<option value="LC">Saint Lucia</option>
<option value="MF">Saint Martin</option>
<option value="PM">Saint Pierre and Miquelon</option>
<option value="VC">Saint Vincent and the Grenadines</option>
<option value="WS">Samoa</option>
<option value="SM">San Marino</option>
<option value="ST">Sao Tome and Principe</option>
<option value="SA">Saudi Arabia</option>
<option value="SN">Senegal</option>
<option value="SC">Seychelles</option>
<option value="SL">Sierra Leone</option>
<option value="SG">Singapore</option>
<option value="SX">Sint Maarten (Dutch part)</option>
<option value="SK">Slovakia</option>
<option value="SI">Slovenia</option>
<option value="SB">Solomon Islands</option>
<option value="ZA">South Africa</option>
<option value="GS">South Georgia and the South Sandwich Islands</option>
<option value="ES">Spain</option>
<option value="LK">Sri Lanka</option>
<option value="SD">Sudan</option>
<option value="SR">Suriname</option>
<option value="SJ">Svalbard and Jan Mayen</option>
<option value="SZ">Swaziland</option>
<option value="SE">Sweden</option>
<option value="CH">Switzerland</option>
<option value="SY">Syria</option>
<option value="TW">Taiwan</option>
<option value="TJ">Tajikistan</option>
<option value="TZ">Tanzania, United Republic of</option>
<option value="TH">Thailand</option>
<option value="TL">Timor-Leste</option>
<option value="TG">Togo</option>
<option value="TK">Tokelau</option>
<option value="TO">Tonga</option>
<option value="TT">Trinidad and Tobago</option>
<option value="TN">Tunisia</option>
<option value="TR">Turkey</option>
<option value="TM">Turkmenistan</option>
<option value="TC">Turks and Caicos Islands</option>
<option value="TV">Tuvalu</option>
<option value="UG">Uganda</option>
<option value="UA">Ukraine</option>
<option value="AE">United Arab Emirates</option>
<option value="GB">United Kingdom</option>
<option value="US">United States</option>
<option value="UM">United States Minor Outlying Islands</option>
<option value="UY">Uruguay</option>
<option value="UZ">Uzbekistan</option>
<option value="VU">Vanuatu</option>
<option value="VA">Vatican City</option>
<option value="VN">Vietnam</option>
<option value="VG">Virgin Islands, British</option>
<option value="VI">Virgin Islands, U.S.</option>
<option value="WF">Wallis and Futuna</option>
<option value="EH">Western Sahara</option>
<option value="ZM">Zambia</option>
</select>
</div>
</div>
<div class="forr-form__row forr-form__row--checkbox">
<input id="optinFieldSidebar" class="forr-form__checkbox" name="optin" type="checkbox" required="">
<label for="optinFieldSidebar" class="forr-form__label">Yes, I’d like to receive Forrester’s Insights At Work newsletter and receive occasional survey invitations and marketing communications.</label>
</div>
<!-- Hidden Fields -->
<input value="LEAD3.0Wordpress" type="hidden" name="elqFormName">
<input value="332" type="hidden" name="elqSiteId">
<input value="" type="hidden" name="elqCustomerGUID">
<input value="0" type="hidden" name="elqCookieWrite">
<input value="Insights-Newsletter-Signup_Trigger" type="hidden" name="eloquahtmlformname">
<input value="Wordpress" type="hidden" name="src">
<input value="https://www.forrester.com/blogs/announcing-our-inaugural-ai-foundation-models-for-language-forrester-wave-21-criteria-to-consider-beyond-benchmarks" type="hidden" name="formsource">
<input value="7011O0000021f49QAA" type="hidden" name="scid">
<input value="" type="hidden" name="leadtype">
<input value="" type="hidden" name="leadcontext">
<input type="hidden" name="blindsubmit" id="blindsubmit" value="no">
<div class="forr-form__row forr-form__row--submit">
<input type="submit" class="forr-cta -primary" value="Subscribe Now">
</div>
</form>
Name: LEAD3.0Wordpress — POST
<form method="post" name="LEAD3.0Wordpress" id="form2069" action="" class="forr-form" data-type="subscribe" data-behavior="confirmation" data-redirecturl="" novalidate="novalidate">
<div class="forr-form__row dropdown">
<label for="emailField" class="forr-form__label">Email Address*</label>
<input id="emailField" class="forr-form__input forr-form__input--text" name="email" type="email" placeholder="Enter your email address" required="">
</div>
<div class="forr-form__row">
<div class="forr-form__item">
<label for="countryField" class="forr-form__label">Country*</label>
<select id="countryField" class="forr-form__input forr-form__input--select" name="country" required="">
<option disabled="" selected="" value=""> Country </option>
<option value="US">United States</option>
<option value="AX">Åland Islands</option>
<option value="DZ">Algeria</option>
<option value="AS">American Samoa</option>
<option value="AD">Andorra</option>
<option value="AO">Angola</option>
<option value="AI">Anguilla</option>
<option value="AQ">Antarctica</option>
<option value="AG">Antigua and Barbuda</option>
<option value="AR">Argentina</option>
<option value="AM">Armenia</option>
<option value="AW">Aruba</option>
<option value="AU">Australia</option>
<option value="AT">Austria</option>
<option value="AZ">Azerbaijan</option>
<option value="BS">Bahamas</option>
<option value="BH">Bahrain</option>
<option value="BD">Bangladesh</option>
<option value="BB">Barbados</option>
<option value="BY">Belarus</option>
<option value="BE">Belgium</option>
<option value="BZ">Belize</option>
<option value="BJ">Benin</option>
<option value="BM">Bermuda</option>
<option value="BT">Bhutan</option>
<option value="BO">Bolivia, Plurinational State of</option>
<option value="BQ">Bonaire, Sint Eustatius and Saba</option>
<option value="BW">Botswana</option>
<option value="BV">Bouvet Island</option>
<option value="BR">Brazil</option>
<option value="IO">British Indian Ocean Territory</option>
<option value="BN">Brunei Darussalam</option>
<option value="BG">Bulgaria</option>
<option value="BF">Burkina Faso</option>
<option value="KH">Cambodia</option>
<option value="CM">Cameroon</option>
<option value="CA">Canada</option>
<option value="CV">Cape Verde</option>
<option value="KY">Cayman Islands</option>
<option value="TD">Chad</option>
<option value="CL">Chile</option>
<option value="CN">China</option>
<option value="CX">Christmas Island</option>
<option value="CC">Cocos (Keeling) Islands</option>
<option value="CO">Colombia</option>
<option value="KM">Comoros</option>
<option value="CK">Cook Islands</option>
<option value="CR">Costa Rica</option>
<option value="CI">Côte d'Ivoire</option>
<option value="HR">Croatia</option>
<option value="CU">Cuba</option>
<option value="CW">Curaçao</option>
<option value="CY">Cyprus</option>
<option value="CZ">Czech Republic</option>
<option value="DK">Denmark</option>
<option value="DJ">Djibouti</option>
<option value="DM">Dominica</option>
<option value="DO">Dominican Republic</option>
<option value="EC">Ecuador</option>
<option value="EG">Egypt</option>
<option value="SV">El Salvador</option>
<option value="GQ">Equatorial Guinea</option>
<option value="ER">Eritrea</option>
<option value="EE">Estonia</option>
<option value="FK">Falkland Islands</option>
<option value="FO">Faroe Islands</option>
<option value="FJ">Fiji</option>
<option value="FI">Finland</option>
<option value="FR">France</option>
<option value="GF">French Guiana</option>
<option value="PF">French Polynesia</option>
<option value="TF">French Southern Territories</option>
<option value="GA">Gabon</option>
<option value="GM">Gambia</option>
<option value="GE">Georgia</option>
<option value="DE">Germany</option>
<option value="GH">Ghana</option>
<option value="GI">Gibraltar</option>
<option value="GR">Greece</option>
<option value="GL">Greenland</option>
<option value="GD">Grenada</option>
<option value="GP">Guadeloupe</option>
<option value="GU">Guam</option>
<option value="GT">Guatemala</option>
<option value="GG">Guernsey</option>
<option value="GN">Guinea</option>
<option value="GY">Guyana</option>
<option value="HT">Haiti</option>
<option value="HM">Heard Island and McDonald Islands</option>
<option value="HN">Honduras</option>
<option value="HK">Hong Kong</option>
<option value="HU">Hungary</option>
<option value="IS">Iceland</option>
<option value="IN">India</option>
<option value="ID">Indonesia</option>
<option value="IQ">Iraq</option>
<option value="IE">Ireland</option>
<option value="IM">Isle of Man</option>
<option value="IL">Israel</option>
<option value="IT">Italy</option>
<option value="JM">Jamaica</option>
<option value="JP">Japan</option>
<option value="JE">Jersey</option>
<option value="JO">Jordan</option>
<option value="KZ">Kazakhstan</option>
<option value="KE">Kenya</option>
<option value="KI">Kiribati</option>
<option value="KR">Korea, Republic of</option>
<option value="KW">Kuwait</option>
<option value="KG">Kyrgyzstan</option>
<option value="LA">Lao People's Democratic Republic</option>
<option value="LV">Latvia</option>
<option value="LS">Lesotho</option>
<option value="LR">Liberia</option>
<option value="LI">Liechtenstein</option>
<option value="LT">Lithuania</option>
<option value="LU">Luxembourg</option>
<option value="MO">Macao</option>
<option value="MG">Madagascar</option>
<option value="MW">Malawi</option>
<option value="MY">Malaysia</option>
<option value="MV">Maldives</option>
<option value="MT">Malta</option>
<option value="MH">Marshall Islands</option>
<option value="MQ">Martinique</option>
<option value="MR">Mauritania</option>
<option value="MU">Mauritius</option>
<option value="YT">Mayotte</option>
<option value="MX">Mexico</option>
<option value="FM">Micronesia, Federated States of</option>
<option value="MD">Moldova, Republic of</option>
<option value="MC">Monaco</option>
<option value="MN">Mongolia</option>
<option value="MS">Montserrat</option>
<option value="MA">Morocco</option>
<option value="MZ">Mozambique</option>
<option value="MM">Myanmar</option>
<option value="NA">Namibia</option>
<option value="NR">Nauru</option>
<option value="NP">Nepal</option>
<option value="NL">Netherlands</option>
<option value="NC">New Caledonia</option>
<option value="NZ">New Zealand</option>
<option value="NE">Niger</option>
<option value="NG">Nigeria</option>
<option value="NU">Niue</option>
<option value="NF">Norfolk Island</option>
<option value="MP">Northern Mariana Islands</option>
<option value="NO">Norway</option>
<option value="OM">Oman</option>
<option value="PK">Pakistan</option>
<option value="PW">Palau</option>
<option value="PS">Palestinian Territory, Occupied</option>
<option value="PA">Panama</option>
<option value="PG">Papua New Guinea</option>
<option value="PY">Paraguay</option>
<option value="PE">Peru</option>
<option value="PH">Philippines</option>
<option value="PN">Pitcairn</option>
<option value="PL">Poland</option>
<option value="PT">Portugal</option>
<option value="PR">Puerto Rico</option>
<option value="QA">Qatar</option>
<option value="RE">Réunion</option>
<option value="RO">Romania</option>
<option value="RW">Rwanda</option>
<option value="BL">Saint Barthélemy</option>
<option value="SH">Saint Helena, Ascension and Tristan da Cunha</option>
<option value="KN">Saint Kitts and Nevis</option>
<option value="LC">Saint Lucia</option>
<option value="MF">Saint Martin</option>
<option value="PM">Saint Pierre and Miquelon</option>
<option value="VC">Saint Vincent and the Grenadines</option>
<option value="WS">Samoa</option>
<option value="SM">San Marino</option>
<option value="ST">Sao Tome and Principe</option>
<option value="SA">Saudi Arabia</option>
<option value="SN">Senegal</option>
<option value="SC">Seychelles</option>
<option value="SL">Sierra Leone</option>
<option value="SG">Singapore</option>
<option value="SX">Sint Maarten (Dutch part)</option>
<option value="SK">Slovakia</option>
<option value="SI">Slovenia</option>
<option value="SB">Solomon Islands</option>
<option value="ZA">South Africa</option>
<option value="GS">South Georgia and the South Sandwich Islands</option>
<option value="ES">Spain</option>
<option value="LK">Sri Lanka</option>
<option value="SD">Sudan</option>
<option value="SR">Suriname</option>
<option value="SJ">Svalbard and Jan Mayen</option>
<option value="SZ">Swaziland</option>
<option value="SE">Sweden</option>
<option value="CH">Switzerland</option>
<option value="SY">Syria</option>
<option value="TW">Taiwan</option>
<option value="TJ">Tajikistan</option>
<option value="TZ">Tanzania, United Republic of</option>
<option value="TH">Thailand</option>
<option value="TL">Timor-Leste</option>
<option value="TG">Togo</option>
<option value="TK">Tokelau</option>
<option value="TO">Tonga</option>
<option value="TT">Trinidad and Tobago</option>
<option value="TN">Tunisia</option>
<option value="TR">Turkey</option>
<option value="TM">Turkmenistan</option>
<option value="TC">Turks and Caicos Islands</option>
<option value="TV">Tuvalu</option>
<option value="UG">Uganda</option>
<option value="UA">Ukraine</option>
<option value="AE">United Arab Emirates</option>
<option value="GB">United Kingdom</option>
<option value="US">United States</option>
<option value="UM">United States Minor Outlying Islands</option>
<option value="UY">Uruguay</option>
<option value="UZ">Uzbekistan</option>
<option value="VU">Vanuatu</option>
<option value="VA">Vatican City</option>
<option value="VN">Vietnam</option>
<option value="VG">Virgin Islands, British</option>
<option value="VI">Virgin Islands, U.S.</option>
<option value="WF">Wallis and Futuna</option>
<option value="EH">Western Sahara</option>
<option value="ZM">Zambia</option>
</select>
</div>
</div>
<div class="forr-form__row forr-form__row--checkbox">
<input id="optinField" class="forr-form__checkbox" name="optin" type="checkbox" required="">
<label for="optinField" class="forr-form__label">Yes, I’d like to receive Forrester’s Insights At Work newsletter and receive occasional survey invitations and marketing communications.</label>
</div>
<!-- Hidden Fields -->
<input value="LEAD3.0Wordpress" type="hidden" name="elqFormName">
<input value="332" type="hidden" name="elqSiteId">
<input value="" type="hidden" name="elqCustomerGUID">
<input value="0" type="hidden" name="elqCookieWrite">
<input value="Insights-Newsletter-Signup_Trigger" type="hidden" name="eloquahtmlformname">
<input value="Wordpress" type="hidden" name="src">
<input value="https://www.forrester.com/blogs/announcing-our-inaugural-ai-foundation-models-for-language-forrester-wave-21-criteria-to-consider-beyond-benchmarks" type="hidden" name="formsource">
<input value="" type="hidden" name="notes">
<input value="7011O0000021f49QAA" type="hidden" name="scid">
<input value="" type="hidden" name="leadtype">
<input value="" type="hidden" name="leadcontext">
<input type="hidden" name="blindsubmit" id="blindsubmit" value="no">
<div class="forr-form__row forr-form__row--submit">
<input type="submit" class="forr-cta -primary" value="Subscribe Now">
</div>
</form>
Text Content
Skip to content * Blogs & Podcasts * Blogs * Complimentary Webinars * Podcasts * Who We Serve * Technology and Security * Technology Architecture And Delivery * Customer Experience * Digital Business * B2C Marketing * B2B Marketing * Sales * Product Management * Government * Featured Insights * Annual Planning * Client Success Stories * Cross-Functional Alignment * Customer Obsession * Emerging Technology * Generative AI * Predictions * Sustainability * Zero Trust Security * What We Offer * Research * Forrester Decisions is our portfolio of research services that helps executives, functional leaders, and their teams plan and pursue their most pressing initiatives. * Blank * B2B Marketing Executives * B2B Sales * B2C Marketing Executives * Customer Experience * Demand & ABM * Digital Business & Strategy * Partner Ecosystem Marketing * Portfolio Marketing * Blank * Product Management * Revenue Operations * Security & Risk * Technology Architecture & Delivery * Technology Executives * Forrester Market Insights * Blank * Consulting * Events * B2B Summits * CX Summits * Technology Summits * ADDITIONAL OFFERINGS * Analyst Relations Council * Certification * FeedbackNow * Reprints * Who We Are * About Us * Our Objectivity * Diversity And Inclusion * Environmental, Social, and Governance * Blank * Our Leadership * Our Board * Newsroom * Careers * Investor Relations Search Log In Become A Client Show Menu Log In Search * Blogs & Podcasts * Blogs * Complimentary Webinars * Podcasts * Who We Serve * Technology and Security * Technology Architecture And Delivery * Customer Experience * Digital Business * B2C Marketing * B2B Marketing * Sales * Product Management * Government * Featured Insights * Annual Planning * Client Success Stories * Cross-Functional Alignment * Customer Obsession * Emerging Technology * Generative AI * Predictions * Sustainability * Zero Trust Security * What We Offer * Research * Forrester Decisions is our portfolio of research services that helps executives, functional leaders, and their teams plan and pursue their most pressing initiatives. * Blank * B2B Marketing Executives * B2B Sales * B2C Marketing Executives * Customer Experience * Demand & ABM * Digital Business & Strategy * Partner Ecosystem Marketing * Portfolio Marketing * Blank * Product Management * Revenue Operations * Security & Risk * Technology Architecture & Delivery * Technology Executives * Forrester Market Insights * Blank * Consulting * Events * B2B Summits * CX Summits * Technology Summits * ADDITIONAL OFFERINGS * Analyst Relations Council * Certification * FeedbackNow * Reprints * Who We Are * About Us * Our Objectivity * Diversity And Inclusion * Environmental, Social, and Governance * Blank * Our Leadership * Our Board * Newsroom * Careers * Investor Relations Become A Client < Blogs Home > Featured Blogs > Announcing Our Inaugural AI Foundation Models For Language Forrester Wave™ — 21 Criteria To Consider, Beyond Benchmarks ANNOUNCING OUR INAUGURAL AI FOUNDATION MODELS FOR LANGUAGE FORRESTER WAVE™ — 21 CRITERIA TO CONSIDER, BEYOND BENCHMARKS Mike Gualtieri, VP, Principal Analyst Rowan Curran, Senior Analyst Srividya Sridharan, VP, Group Director Jun 5 2024 * * * * AI researchers and scientists love their benchmarks and model parameter counts, but perhaps not as much as tech journalists love to report on them. Every week, there is news about a model beating a benchmark or exceeding parameter counts. While these two factors are important, they are not the only ones to focus on when choosing a provider of foundation models, especially within an enterprise AI context. We went much deeper … much, much deeper. In our inaugural evaluation, The Forrester Wave™: AI Foundation Models For Language, Q2 2024, we break down large language model (LLM) model offering, strategy, and market presence across 21 criteria for 10 providers that offer foundation models for language: Amazon Web Services, Anthropic, Cohere, Databricks, Google, IBM, Microsoft, Mistral AI, NVIDIA, and, of course, OpenAI. Sure, you want to choose a great model, but it is also important to understand the vendor’s vision, innovation, roadmap, pricing transparency, adoption in the market, and market momentum. While a well-performing model is important to a successful use case, enterprise buyers must look for AI foundation models for language (AI-FML) providers that: * Have a strategy geared toward serving enterprise needs. Enterprises are especially skeptical of the staying power of startups and, sometimes, the commitment of larger tech companies. It is important for enterprises to critically examine the model vendor’s strategy to make sure that it aligns with the needs of enterprises and that the company has staying power in the market. To evaluate a vendor’s strategy, we looked at the vendor’s vision, innovation, roadmap, partner ecosystem, pricing flexibility, and supporting services. * Offer a rich set of tools to configure, test, and govern model usage. APIs and SDKs are super bare-bones, albeit essential, base functionality for the techiest of techs. But enterprises demand more tooling that empowers a broader AI team to configure models, perform prompt engineering, test models, set governance rules, deploy production use cases, and more. To evaluate a vendor’s tooling, we looked at enterprise governance and security, enterprise application development, model alignment, and deployment model management. * Have rising benchmarks. There are dozens of benchmarks conceived and used by AI researchers to measure model performance against a variety of tasks. What’s important is that a vendor’s subsequent models keep performing better. To evaluate a vendor’s model core capabilities, we used MMLU (Massive Multitask Language Understanding) for human language tasks and HumanEval for TuringBot (coding) use cases because they are the most cited benchmarks by AI researchers and vendors alike. * Can scale at low latency. Users of AI chatbots are all too familiar with the jittery output, often taking several seconds to return a result. This might be acceptable for some human-model interaction use cases, but for automated uses, such as generating real-time custom product descriptions for an e-commerce application, a few seconds is unacceptable. A model must perform architecturally to return results quickly, scale as the number of users/queries increases, and be fault-tolerant. To evaluate a vendor’s architectural performance, we looked at the vendor’s operational resilience and scalability. THE ABSURD RATE OF INNOVATION MAKES CHOOSING AN LLM CHALLENGING Compounding the complexity of choosing an AI foundation model is that enterprises are likely to need more than one. In addition to the commercial model providers in our evaluation, there is a vibrant community of open-weight models that many enterprises are already using, such as the Llama models from Meta. There is also an emerging market for domain-specific models for fields such as healthcare, legal, and many more. The absurd rate of innovation in this market can make the choice between startups and tech giants even more confusing. This is why we recommend a balanced and longer-term outlook on how the foundation models will fit the needs of a complex enterprise beyond benchmarks. WE GIVE YOU AN INDEPENDENT VIEW OF THE MODEL MARKET Whatever you do, please don’t ask #AI to help you choose. It will not be unbiased! Instead, Forrester clients can schedule a guidance session or inquiry with us to discuss vendor selection and overall trends in this #AI foundation models market. CATEGORIES * AI Insights * Application Development & Delivery * Business Intelligence * Generative AI GET THE INSIGHTS AT WORK NEWSLETTER Email Address* Country* Country United States Åland Islands Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint Eustatius and Saba Botswana Bouvet Island Brazil British Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Cambodia Cameroon Canada Cape Verde Cayman Islands Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Cook Islands Costa Rica Côte d'Ivoire Croatia Cuba Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Falkland Islands Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guyana Haiti Heard Island and McDonald Islands Honduras Hong Kong Hungary Iceland India Indonesia Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Korea, Republic of Kuwait Kyrgyzstan Lao People's Democratic Republic Latvia Lesotho Liberia Liechtenstein Lithuania Luxembourg Macao Madagascar Malawi Malaysia Maldives Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia, Federated States of Moldova, Republic of Monaco Mongolia Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Niger Nigeria Niue Norfolk Island Northern Mariana Islands Norway Oman Pakistan Palau Palestinian Territory, Occupied Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Puerto Rico Qatar Réunion Romania Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Seychelles Sierra Leone Singapore Sint Maarten (Dutch part) Slovakia Slovenia Solomon Islands South Africa South Georgia and the South Sandwich Islands Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syria Taiwan Tajikistan Tanzania, United Republic of Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates United Kingdom United States United States Minor Outlying Islands Uruguay Uzbekistan Vanuatu Vatican City Vietnam Virgin Islands, British Virgin Islands, U.S. Wallis and Futuna Western Sahara Zambia Yes, I’d like to receive Forrester’s Insights At Work newsletter and receive occasional survey invitations and marketing communications. THANKS FOR SIGNING UP. Stay tuned for updates from the Forrester blogs. AVOID ZOMBIE AI PROJECTS WITH OUR BEST PRACTICES DOWNLOAD OUR AI MYTHS AND BEST PRACTICES GUIDE. LEARN HOW TO AVOID MISSTEPS, PRIORITIZE VALUE, AND MOVE AI PROJECTS OUT OF LIMBO WITH QUICK WINS. Download The Guide Blog INSIGHTS FROM CISCO LIVE 2024: SPLUNK INTEGRATION, SECURITY (AND MORE SECURITY), AND AI PRAGMATISM Stephanie Balaouras 3 days ago At its annual flagship event, Cisco Live, about 20,000 IT and security pros gathered in Las Vegas to hear the company’s latest announcements, plans for its $28 billion Splunk acquisition, and vision for the future. While there was a heavy dose of AI everywhere, as compared to other vendor pronouncements, Cisco’s AI aspirations are modest […] Read More Blog FORRESTER’S AI WEBINAR SERIES: NAVIGATE THE CHOPPY AND EXCITING WATERS OF ENTERPRISE AI Sudha Maheshwari 3 days ago Navigate the choppy and exciting waters of AI with Forrester’s analysts. Forrester’s multi-episode webinar series on AI delves into the profound impact AI has — and will continue to have — on how data scientists and software engineers approach their work and how other job functions will have to adapt to new AI workflows, processes, […] Read More GET THE INSIGHTS AT WORK NEWSLETTER Email Address* Country* Country United States Åland Islands Algeria American Samoa Andorra Angola Anguilla Antarctica Antigua and Barbuda Argentina Armenia Aruba Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bermuda Bhutan Bolivia, Plurinational State of Bonaire, Sint Eustatius and Saba Botswana Bouvet Island Brazil British Indian Ocean Territory Brunei Darussalam Bulgaria Burkina Faso Cambodia Cameroon Canada Cape Verde Cayman Islands Chad Chile China Christmas Island Cocos (Keeling) Islands Colombia Comoros Cook Islands Costa Rica Côte d'Ivoire Croatia Cuba Curaçao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Falkland Islands Faroe Islands Fiji Finland France French Guiana French Polynesia French Southern Territories Gabon Gambia Georgia Germany Ghana Gibraltar Greece Greenland Grenada Guadeloupe Guam Guatemala Guernsey Guinea Guyana Haiti Heard Island and McDonald Islands Honduras Hong Kong Hungary Iceland India Indonesia Iraq Ireland Isle of Man Israel Italy Jamaica Japan Jersey Jordan Kazakhstan Kenya Kiribati Korea, Republic of Kuwait Kyrgyzstan Lao People's Democratic Republic Latvia Lesotho Liberia Liechtenstein Lithuania Luxembourg Macao Madagascar Malawi Malaysia Maldives Malta Marshall Islands Martinique Mauritania Mauritius Mayotte Mexico Micronesia, Federated States of Moldova, Republic of Monaco Mongolia Montserrat Morocco Mozambique Myanmar Namibia Nauru Nepal Netherlands New Caledonia New Zealand Niger Nigeria Niue Norfolk Island Northern Mariana Islands Norway Oman Pakistan Palau Palestinian Territory, Occupied Panama Papua New Guinea Paraguay Peru Philippines Pitcairn Poland Portugal Puerto Rico Qatar Réunion Romania Rwanda Saint Barthélemy Saint Helena, Ascension and Tristan da Cunha Saint Kitts and Nevis Saint Lucia Saint Martin Saint Pierre and Miquelon Saint Vincent and the Grenadines Samoa San Marino Sao Tome and Principe Saudi Arabia Senegal Seychelles Sierra Leone Singapore Sint Maarten (Dutch part) Slovakia Slovenia Solomon Islands South Africa South Georgia and the South Sandwich Islands Spain Sri Lanka Sudan Suriname Svalbard and Jan Mayen Swaziland Sweden Switzerland Syria Taiwan Tajikistan Tanzania, United Republic of Thailand Timor-Leste Togo Tokelau Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Turks and Caicos Islands Tuvalu Uganda Ukraine United Arab Emirates United Kingdom United States United States Minor Outlying Islands Uruguay Uzbekistan Vanuatu Vatican City Vietnam Virgin Islands, British Virgin Islands, U.S. Wallis and Futuna Western Sahara Zambia Yes, I’d like to receive Forrester’s Insights At Work newsletter and receive occasional survey invitations and marketing communications. THANKS FOR SIGNING UP. Stay tuned for updates from the Forrester blogs. * Analyst Briefings * Newsroom * Complimentary Webinars * Contact Us * Investor Information * Careers * Policies * Podcasts * Fraud Alerts * Brand * UK Slavery Statement Become A Client © 2024 Forrester Research, Inc. and/or its subsidiaries. All rights reserved. Terms of use Privacy Policy Cookie Settings * Twitter * LinkedIn * YouTube We use cookies to enable website functionality and to tailor content to your interests. Cookie Settings Reject All Accept All Cookies COOKIE SETTINGS Your cookie preferences The performance and customization that Forrester can provide you is determined in part by the level of cookie use that you accept. Privacy Policy Allow All PREFERENCE CENTER STRICTLY NECESSARY COOKIES Always Active These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. PERFORMANCE AND FUNCTIONAL COOKIES Performance and Functional Cookies These cookies allow us to track analytics by counting visits and traffic sources so we can measure and improve the performance of our website and enable the website to provide enhanced functionality and personalisation based on your interaction with the website. They may be set by us or by third party providers providers whose services we have added to our pages to help us to know which pages are the most and least popular and see how visitors move around the website. TARGETING COOKIES Targeting Cookies These cookies may be set through our site by our advertising partners. They may be used by those partners to build a profile of your interests and show you relevant advertisements on other websites. Back Button COOKIE LIST Search Icon Filter Icon Clear checkbox label label Apply Cancel Consent Leg.Interest checkbox label label checkbox label label checkbox label label Reject All Confirm My Choices