dataforseo.com
Open in
urlscan Pro
2606:4700:20::681a:6ca
Public Scan
URL:
https://dataforseo.com/dataforseo-bot
Submission: On December 07 via manual from CL — Scanned from DE
Submission: On December 07 via manual from CL — Scanned from DE
Form analysis
2 forms found in the DOM<form id="frr_form">
<input type="hidden" id="g-recaptcha-response" name="g-recaptcha-response">
<input type="hidden" name="action" value="validate_captcha">
<input type="text" name="force_reload_sitename" id="force_reload_sitename" placeholder="Enter domain name..." autocomplete="off">
<button type="submit" id="frr_form_submit">Send</button>
<button id="load_robots_button" type="button">Check Your Robots.txt Settings</button>
<div id="frr_result"></div>
<div id="get_robots_result"></div>
</form>
POST /dataforseo-bot#wpcf7-f16384-p16355-o1
<form action="/dataforseo-bot#wpcf7-f16384-p16355-o1" method="post" class="wpcf7-form init" aria-label="Contact form" novalidate="novalidate" data-status="init">
<div style="display: none;">
<input type="hidden" name="_wpcf7" value="16384">
<input type="hidden" name="_wpcf7_version" value="5.8.4">
<input type="hidden" name="_wpcf7_locale" value="en_US">
<input type="hidden" name="_wpcf7_unit_tag" value="wpcf7-f16384-p16355-o1">
<input type="hidden" name="_wpcf7_container_post" value="16355">
<input type="hidden" name="_wpcf7_posted_data_hash" value="">
<input type="hidden" name="_wpcf7_recaptcha_response"
value="03AFcWeA5M5_51xCkNJ95a6_Ox5ArfDzKCtSTwSckbOnz7VYjYa0v3bCovyRNynBgT465ewzm2VnufzZfkqoQxl5BCh178D15RbWUyWqwrCRhUvsH2EF_ZGEEKDCtIe_btsMqLNGO8km8HydvmZY_se6v8lr9giec3C1OKlhCzFQJZIOqMYf90zGZRkENOtPlI9N4-BVsVnVUVWD8HrLRq7KX5wUX5OWQQup95K09a0C27g0SLT093OUv9qlPikoCgMm-Njog25hqMdiH0Q-BWqCYiET6Mg0k5dyEnwBquwmUD5q77JvB2ejhuOgElXLkTvJaEpvA3pd8xbyagtB__yV88_x0y8K5jLSV51Ok3qiN3_ksS-VpfSBn6iXGRrTAutskjOU1wE7HEpfDRz7fcqbb5cgIRfFhwNr0Mo88TxFUd3S9oKP5LhdfvvxlwV2bmWFX4g1pVs7aSiTAFvNkCRd5j5DEiKjgs_rvkHgzt_J-0r0I998bbv9By0yE2EK1gTftSrRonuStvsH06Y9RXoudjboigaCJWnEjMm_t2DVzrFCTgA3QUQ4SxjnVodTarRa6fuHWcsZPC">
</div>
<div class="qodef-two-columns-50-50">
<div class="qodef-two-columns-50-50-inner">
<div class="qodef-column">
<div class="qodef-column-inner">
<p><span class="qodef-input-title contact-valid-mark">Your Name</span><br>
<label> <span class="wpcf7-form-control-wrap" data-name="your-name"><input size="40" class="wpcf7-form-control wpcf7-text wpcf7-validates-as-required" aria-required="true" aria-invalid="false" value="" type="text" name="your-name"></span>
</label>
</p>
</div>
</div>
<div class="qodef-column">
<div class="qodef-column-inner">
<p><span class="qodef-input-title contact-valid-mark">Your Email</span><br>
<label> <span class="wpcf7-form-control-wrap" data-name="your-email"><input size="40" class="wpcf7-form-control wpcf7-email wpcf7-validates-as-required wpcf7-text wpcf7-validates-as-email" aria-required="true" aria-invalid="false"
value="" type="email" name="your-email"></span> </label>
</p>
</div>
</div>
</div>
</div>
<div>
<p><span class="qodef-input-title contact-valid-mark">Your Subject</span><br>
<label> <span class="wpcf7-form-control-wrap" data-name="your-subject"><input size="40" class="wpcf7-form-control wpcf7-text wpcf7-validates-as-required" aria-required="true" aria-invalid="false" value="" type="text" name="your-subject"></span>
</label>
</p>
</div>
<div>
<p><span class="qodef-input-title contact-valid-mark">Your Message</span><br>
<label> <span class="wpcf7-form-control-wrap" data-name="your-message"><textarea cols="40" rows="10" class="wpcf7-form-control wpcf7-textarea wpcf7-validates-as-required" aria-required="true" aria-invalid="false"
name="your-message"></textarea></span> </label>
</p>
</div>
<p><input class="wpcf7-form-control wpcf7-submit has-spinner" type="submit" value="Send"><span class="wpcf7-spinner"></span>
</p>
<div class="wpcf7-response-output" aria-hidden="true"></div>
</form>
Text Content
* Products * APIs * SERP API * Keyword Data API * Google Ads * Google Trends * Bing Ads * Backlinks API * On-Page API * DataForSEO Labs API * Reviews API * Google Reviews API * Yelp Reviews API * Trustpilot Reviews API * Amazon Reviews API * Tripadvisor Reviews API * Google Play Reviews API * App Store Reviews API * Social Media API * Pinterest API * Facebook API * Reddit API * App Data API * Google Play Store API * App Store API * Business Data API * Google My Business API * Google Hotels API * Trustpilot API * Tripadvisor API * Yelp API * Business Listings API * Merchant API * Amazon * Google Shopping * Domain Analytics API * Content Analysis API * Content Generation API * Databases * Google Databases * Bing Databases * Amazon Database * App Store Database * Google Play Database * Business Listings Database * Whois Domains Database * Backlink Domains Database * Solutions * By industry * Media * Ecommerce * Digital Marketing * Marketing Tech * By company type * SEO Agency * SEO Software * By application * Backlink App * Reputation Management Tool * Rank Tracking App * Pricing * Docs * Knowledge base * Resources * FAQ * Ukrainian Bravery * SERP features * Free SEO Stats * Top Sites by Keywords * Top Keywords * Top Sites by Rank * Top Sites by Traffic * SERP Volatility Index * Google Sheets Connector * Our data * Status Page * Contact * Try for free * Login * Products * APIs * SERP API * Keyword Data API * Google Ads * Google Trends * Bing Ads * Backlinks API * On-Page API * DataForSEO Labs API * Reviews API * Google Reviews API * Yelp Reviews API * Trustpilot Reviews API * Amazon Reviews API * Tripadvisor Reviews API * Google Play Reviews API * App Store Reviews API * Social Media API * Pinterest API * Facebook API * Reddit API * App Data API * Google Play Store API * App Store API * Business Data API * Google My Business API * Google Hotels API * Trustpilot API * Tripadvisor API * Yelp API * Business Listings API * Merchant API * Amazon * Google Shopping * Domain Analytics API * Content Analysis API * Content Generation API * Databases * Google Databases * Bing Databases * Amazon Database * App Store Database * Google Play Database * Business Listings Database * Whois Domains Database * Backlink Domains Database * Solutions * By industry * Media * Ecommerce * Digital Marketing * Marketing Tech * By company type * SEO Agency * SEO Software * By application * Backlink App * Reputation Management Tool * Rank Tracking App * Pricing * Docs * Knowledge base * Resources * FAQ * Ukrainian Bravery * SERP features * Free SEO Stats * Top Sites by Keywords * Top Keywords * Top Sites by Rank * Top Sites by Traffic * SERP Volatility Index * Google Sheets Connector * Our data * Status Page * Contact * Try for free * Login * PRODUCTS * APIs * SERP API * Keyword Data API * Google Ads * Google Trends * Bing Ads * Backlinks API * On-Page API * DataForSEO Labs API * Reviews API * Google Reviews API * Yelp Reviews API * Trustpilot Reviews API * Amazon Reviews API * Tripadvisor Reviews API * Google Play Reviews API * App Store Reviews API * Social Media API * Pinterest API * Facebook API * Reddit API * App Data API * Google Play Store API * App Store API * Business Data API * Google My Business API * Google Hotels API * Trustpilot API * Tripadvisor API * Yelp API * Business Listings API * Merchant API * Amazon * Google Shopping * Domain Analytics API * Content Analysis API * Content Generation API * Databases * Google Databases * Bing Databases * Amazon Database * App Store Database * Google Play Database * Business Listings Database * Whois Domains Database * Backlink Domains Database * Solutions * BY INDUSTRY * Media * Ecommerce * Digital Marketing * Marketing Tech * BY COMPANY TYPE * SEO Agency * SEO Software * BY APPLICATION * Backlink App * Reputation Management Tool * Rank Tracking App * Pricing * Docs * Knowledge base * RESOURCES * FAQ * Ukrainian Bravery * SERP features * Free SEO Stats * Top Sites by Keywords * Top Keywords * Top Sites by Rank * Top Sites by Traffic * SERP Volatility Index * Google Sheets Connector * Our data * Status Page * Contact * Try for free * Login DATAFORSEO LINK BOT Good bot for a fair play WHAT IS DATAFORSEO LINK BOT? Many people would classify DataForSEO Link Bot as yet another web crawler. Well, they are wrong, and here’s why. Ever since we launched DataForSEO, our mission was to level the playing field by providing quality data to SEO enthusiasts and professionals around the world. DataForSEO Link Bot is key to ensuring that every member of the SEO community – no matter the size of the pocket – can access the core element of Google’s ranking algorithm. Yes, we’re working on the biggest available backlink database on the web that every single member of the community, including you, can use and benefit from. DATAFORSEO LINK BOT Version: 1.0 Bot type: backlink checker bot Obeys robots.txt: YES Obeys crawl delay: YES User agent string: Mozilla/5.0 (compatible; DataForSeoBot; +https://dataforseo.com/dataforseo-bot) ENTER THE BACKLINKS API Backlinks API is the name of our new product that has been developed with a single purpose: providing website owners, webmasters, and SEO professionals with opportunities to analyze the key component of website optimization – backlinks. To attain this ambitious goal, we had to build a system similar to Google’s PageRank algorithm and make sure it works. Our team had spent the past year researching, planning, building, and iterating this system. But to go any further, we’ll need your help. No, this time we don’t want to sell you anything. In fact, the best thing you can do is… well, do nothing. If you’re reading this, don’t rush straight to your robots.txt to block our user agent. This way, you will help thousands of website owners – like yourself – to improve their websites’ visibility. MODIFY DATAFORSEO BOT FOR A SMOOTHER RIDE There are literally thousands of good bots crawling your website to help parse and index your content and make it available to users searching for it. DataForSEO Bot belongs to the category of Good Bots, meaning it won’t harm your website in any way. Our bot supports your robots.txt settings, explicitely identifies itself and has an official moniker. You have a full control over what DataForSEO Bot can and cannot do on your website. For example, you can change the default 5-second frequency of it visiting your site or block it from accessing certain pages or folders by using wildcards (*). CHANGE CRAWL DELAY OF DATAFORSEO BOT User-agent: DataForSeoBot Crawl-delay: 5 DISALLOW DATAFORSEO BOT ON A PAGE User-agent: DataForSeoBot Disallow: /example-page REQUEST THE FORCE-RELOAD OF ROBOTS.TXT Send Check Your Robots.txt Settings WANT TO LEARN MORE ABOUT DATAFORSEO BOT? Contact our support team to request more information. Contact us QUICK FAQ What is DataForSeoBot? DataForSEO Bot is constantly crawling the web to add new links to our backlink database and check links that are already included. This is crucial to support our mission – providing website owners, webmasters and SEOs with equal access to vital data. What is DataForSeoBot doing on my website? DataForSEO Bot crawls your website pages and adds all found links to our backlink database. It does not collect any other data about your website and won’t trigger ads or add numbers to your traffic in Google Analytics. How to change crawl delay? DataForSEO Bot is a good bot that plays by your rules. It allows modifying lots of crawling parameters, including crawl delay. Add the following snippet with a crawl delay you need to your website’s robots.txt file: User-agent: DataForSeoBot Crawl-delay: [value] What subnets does DataForSEO Link Bot use to make requests? DataForSEO Bot relies on a number of subnets to collect backlink data. You can use these subnets to identify DataForSEO Bot. The following are IPv4 and IPv6 identifiers of our subnets. IPv4: 136.243.220.208/29 136.243.228.176/29 136.243.228.192/29 IPv6: 2a01:4f8:271:6283::/64 2a01:4f8:271:6284::/64 2a01:4f8:271:6285::/64 What is the Reverse DNS mask of DataForSEO Bot? You can verify if a web crawler accessing your website is a legitimate DataForSEO Bot by running a reverse DNS lookup. Reverse DNS mask: crawling-gateway-*.dataforseo.com Example: # host 136.243.228.176 176.228.243.136.in-addr.arpa domain name pointer crawling-gateway-136-243-228-176.dataforseo.com. How do I disallow DataForSEO bot on certain pages? To disallow our bot on certain pages of your website, add the following snippet to your website’s robots.txt file: User-agent: DataForSeoBot Disallow: /[url path] How do I disallow DataForSEO bot on the entire website? To disallow our bot on all pages of your website, add the following snippet to your website’s robots.txt file: User-agent: DataForSeoBot Disallow: / CONTACT US Your Name Your Email Your Subject Your Message Built with love in Ukraine Vesivärava tn 50-201, Kesklinna linnaosa, Tallinn, Harju maakond, Republic of Estonia, 10152 616 Corporate Way, Suite 2-4116 Valley Cottage, 10989, NY, USA 63 Kolomenskaya Str, Kharkiv, Ukraine, 61166 Email: info@dataforseo.com * LinkedIn * Facebook * Twitter APIS * SERP API * Google Ads API * Backlinks API * OnPage API * DataForSEO Labs API * Business Data API * Amazon API * Google Shopping API * Domain Analytics API * Content Analysis API * Content Generation API DATABASES * Google Databases * Bing Databases * Amazon Database * App Store Database * Google Play Database * Domains Database * Backlink Database SOLUTIONS * Backlink App * SEO Agency * SEO Software * Media * Ecommerce * Market Research * Digital Marketing * Marketing Tech * Scraping Services KNOWLEDGE BASE * Blog * White Papers * Help Center * Updates RESOURCES * FAQ * Ukrainian Bravery * SERP Features * Top 1000 Sites * Google Sheets Connector * Our data * Status Page LEGAL INFORMATION * Privacy Policy * Terms of Services PAYMENT METHODS: EMBED DATAFORSEO WIDGET ON YOUR WEBSITE Width: Height: Embed code: Copy Code Preview: Notifications Allow dataforseo.com to send you web push notifications Allow Block