seoapi.com Open in urlscan Pro
2001:4860:4802:32::15  Public Scan

Form analysis
0 forms found in the DOM

Text Content

Close sidebar


SEO APIS

URL Parse API new Googlebot APIMore SEO APIs
 * Applebot API
 * Baiduspider API
 * Bingbot API
 * Cốc Cốc Bot API
 * DuckDuckBot API
 * Naver Yeti Spider API
 * PetalBot API
 * SeznamBot API
 * Sogou Web Spider API
 * Yahoo! Slurp API
 * YandexBot API

--------------------------------------------------------------------------------


SEO TOOLBOX

HTTP Status Tester new Cumulative Layout Shift Debugger Web Vitals Score
CardDisavow File Validator Disavow File Generator

--------------------------------------------------------------------------------


RESOURCES

HTTP Status Codes HTTP Headers


IMPROVE YOUR SEO!

With SEO audits by ex-Google Search engineers

seo.services




SEO APIS

URL Parse API new Googlebot APIMore SEO APIs
 * Applebot API
 * Baiduspider API
 * Bingbot API
 * Cốc Cốc Bot API
 * DuckDuckBot API
 * Naver Yeti Spider API
 * PetalBot API
 * SeznamBot API
 * Sogou Web Spider API
 * Yahoo! Slurp API
 * YandexBot API

--------------------------------------------------------------------------------


SEO TOOLBOX

HTTP Status Tester new Cumulative Layout Shift Debugger Web Vitals Score
CardDisavow File Validator Disavow File Generator

--------------------------------------------------------------------------------


RESOURCES

HTTP Status Codes HTTP Headers


IMPROVE YOUR SEO!

With SEO audits by ex-Google Search engineers

seo.services

Open sidebar


GOOGLEBOT API


LATEST GOOGLEBOT USER AGENTS DETECTED

GOOGLEBOT MOBILE USER AGENT

Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36
(KHTML, like Gecko) Chrome/99.0.4844.84 Mobile Safari/537.36 (compatible;
Googlebot/2.1; +http://www.google.com/bot.html)

GOOGLEBOT DESKTOP USER AGENT

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1;
+http://www.google.com/bot.html) Chrome/127.0.6533.99 Safari/537.36


GOOGLEBOT API DOCUMENTATION

The Googlebot API makes it easy to check if an IP address is officially used by
Googlebot to crawl the web, including your website.

The Googlebot API is a 'REST API' which is accessible via HTTPS using the GET
method at a predefined URL. It returns either JSON of plain text response.

Benefits of using the Googlebot API are:

 * Querying the Googlebot API is free of charge and anonymous.
 * The Googlebot API works across applications and scripting languages, e.g. see
   below the Google Spreadsheets and Python implementations.
 * The Googlebot API contains historical records, which means that IP addresses
   which may have been once used but are currently not resolving can still be
   identified when performing log file analysis on historical logs.
 * As Googlebot is crawling the web, the database for the Googlebot API is
   continuously and automatically updated with the latest IP addresses and user
   agents.
 * Instead of performing two seperate lookups (forward and reverse) with the
   'host' command on the command line locally, this API provides a single lookup
   method which can be accessed from anywhere.
 * The Googlebot API contains one of the largest freely and publicly accessible
   collection of IP addresses for Googlebot.



This Googlebot API is coded and provided by ex-Google engineer and technical SEO
expert Fili.


AUTHENTICATION

This Googlebot API is free of charge and can be accessed without credentials. If
you have any questions about using the Googlebot API on a larger scale or like
to discuss ways to utilize this database internally, contact Fili.

> Rate-limiting
Currently the Googlebot API is rate-limited to 1000 requests/hour for each IP
address. If you need more, contact Fili.
> TIP
Optimize your Googlebot API requests and avoid hitting the rate-limits by
locally caching 200 status responses from the Googlebot API for at least 6 hours
before resubmitting a duplicate query to the Googlebot API.


QUICKSTART GUIDE

You can query the API endpoint using a GET request and replace IPADDRESS with
the IP address you wish to query.

        https://googlebot.seoapi.com/v1/validate/?ip=IPADDRESS
    
Copied!


ENDPOINT DEFINITIONS

By default the API will return a JSON response with:

 * a body containing "valid": "true" if the queried IP address is found in the
   database,
 * or a body containing "valid": "false" if the queried IP address is not found
   in the database.



Alternatively, it is also possible to request just a BOOLEAN in plain text
(useful in some situations, e.g. Google Spreadsheets - see below).

URL parameters which are accepted by the Googlebot API are:

URL ParameterValueip(string) IP address, IPv4 or IPv6compact(integer) default is
0 and return JSON response, 1 will return a plain text response




CODE SNIPPETS

Here are some examples of how to query the Googlebot API:

COMMAND LINE (CURL) EXAMPLE 1

        curl -i https://googlebot.seoapi.com/v1/validate/?ip=66.249.69.137
    
Copied!

It is also possible to use this API in Google Spreadsheets by adding &compact=1
to the API URL.

In the following example, the content of cell A1 contains the IP address to
check and replaces in the =IMPORTDATA formula the __IPADDRESS__. Be sure to
replace the cell ID when using this in Google Spreadsheets.

GOOGLE SPREADSHEETS

        =IMPORTDATA(SUBSTITUTE("https://googlebot.seoapi.com/v1/validate/?ip=__IPADDRESS__&compact=1","__IPADDRESS__",A1))
    
Copied!

It is also possible to use this API in your code with python or similar other
languages.

PYTHON 3

        import requests

r = requests.get(
    'https://googlebot.seoapi.com/v1/validate/?ip=66.249.69.137'
).json()
print(r.get('valid', None))
    
Copied!


EXAMPLE RESPONSES

When the URL parameter compact is missing or has a value of 0 (zero) the API
returns a JSON response with a queried IP address, query timestamp and boolean
if the IP address validates.

EXAMPLE 1: JSON RESPONSE

        {
    "ip": "66.249.69.137",
    "timestamp": 1615471876.25665,
    "valid": true
}
    
Copied!

EXAMPLE 2: JSON RESPONSE

        {
    "ip": "127.0.0.1",
    "timestamp": 1615471876.25665,
    "valid": false
}
    
Copied!

When the URL parameter compact is present and has a value of 1 (one) the API
returns a plain text response with a boolean if the IP address validates.

EXAMPLE 3: PLAIN TEXT (COMPACT) RESPONSE

        true
    
Copied!

EXAMPLE 4: PLAIN TEXT (COMPACT) RESPONSE

        false
    
Copied!


LATEST IP ADDRESSES ADDED

 * 66.249.69.137
 * 66.249.79.67
 * 66.249.76.230
 * 66.249.76.197
 * 66.249.76.194
 * 66.249.73.201
 * 66.249.73.200
 * 66.249.73.200
 * 66.249.66.89
 * 66.249.66.84
 * 66.249.66.83
 * 66.249.66.7
 * 66.249.66.79
 * 66.249.66.41
 * 66.249.66.40
 * 66.249.66.40
 * 66.249.66.39
 * 66.249.66.38
 * 66.249.66.37
 * 66.249.66.37
 * 66.249.66.36
 * 66.249.66.35
 * 66.249.66.34
 * 66.249.66.33


DISCLAIMER

The data shown on this website is automatically collected from multiple sources,
mostly websites and domains under the control of ex-Google engineer Fili. The
SEO APIs on this website are under constant development and improvements will be
added over time.

Any data and/or query submitted to this website or its APIs are only used to
verify whether an IP address is associated with a known search bot. When not,
the IP address (or any other submitted data) is completely disregarded and
ignored. Only after an IP address is separately confirmed to be a search bot IP
address, the IP address is anonymously stored for future queries.

Bugs will happen. Despite best efforts to maintain the code base and data
quality, no guarantees can or will be given. Data may be incomplete and/or
errors may occur. This is a personal website and for-fun project. Use at your
own risk.

--------------------------------------------------------------------------------

Made with ♥ by SEO Expert Fili - Join me on SEO.chat © 2020 - 2024 This page
loaded in 1.24s

TABLE OF CONTENTS

 * Latest detected Googlebot user agents
 * Googlebot API documentation
   * Authentication
   * Quickstart guide
   * Endpoint definitions
 * Code snippets
   * Command Line (curl)
   * Google Spreadsheets
   * Python 3
 * Example responses
 * Latest IPs added
 * Disclaimer