Submitted URL: http://ahrefs.com/robot/)
Effective URL: https://ahrefs.com/robot/)
Submission: On March 11 via api from US

Summary

This website contacted 6 IPs in 1 countries across 4 domains to perform 10 HTTP transactions. The main IP is 13.248.206.194, located in United States and belongs to AMAZON-02, US. The main domain is ahrefs.com.
TLS certificate: Issued by DigiCert SHA2 Extended Validation Ser... on December 22nd 2020. Valid for: a year.
This is the only time ahrefs.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
1 4 13.248.206.194 16509 (AMAZON-02)
1 2606:4700::68... 13335 (CLOUDFLAR...)
2 2606:4700:10:... 13335 (CLOUDFLAR...)
1 1 65.9.96.19 16509 (AMAZON-02)
3 65.9.96.38 16509 (AMAZON-02)
1 75.2.88.188 16509 (AMAZON-02)
10 6
Domain Requested by
4 ahrefs.com 1 redirects ahrefs.com
3 js.intercomcdn.com widget.intercom.io
2 analytics.ahrefs.com ahrefs.com
1 api-iam.intercom.io js.intercomcdn.com
1 widget.intercom.io 1 redirects
1 maxcdn.bootstrapcdn.com ahrefs.com
10 6

This site contains no links.

Subject Issuer Validity Valid
ahrefs.com
DigiCert SHA2 Extended Validation Server CA
2020-12-22 -
2022-01-21
a year crt.sh
sni.cloudflaressl.com
Cloudflare Inc ECC CA-3
2021-03-01 -
2022-02-28
a year crt.sh
*.intercomcdn.com
Amazon
2021-03-01 -
2022-03-30
a year crt.sh
*.intercom.com
Amazon
2020-05-13 -
2021-06-13
a year crt.sh

This page contains 2 frames:

Primary Page: https://ahrefs.com/robot/)
Frame ID: A6E0CBD41D42951B5E0CBB01D8D73B47
Requests: 8 HTTP requests in this frame

Frame: https://js.intercomcdn.com/frame-modern.e8a85d5b.js
Frame ID: 2622EAC87FDDEA791760E9C4F471F396
Requests: 3 HTTP requests in this frame

Screenshot


Page URL History Show full URLs

  1. http://ahrefs.com/robot/) HTTP 301
    https://ahrefs.com/robot/) Page URL

Detected technologies

Overall confidence: 100%
Detected patterns
  • html /<link[^>]+?href="[^"]*bootstrap(?:\.min)?\.css/i

Overall confidence: 100%
Detected patterns
  • headers server /nginx(?:\/([\d.]+))?/i

Page Statistics

10
Requests

100 %
HTTPS

33 %
IPv6

4
Domains

6
Subdomains

6
IPs

1
Countries

191 kB
Transfer

600 kB
Size

0
Cookies

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

  1. http://ahrefs.com/robot/) HTTP 301
    https://ahrefs.com/robot/) Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 6
  • https://widget.intercom.io/widget/dic5omcp HTTP 302
  • https://js.intercomcdn.com/shim.latest.js

10 HTTP transactions

Resource
Path
Size
x-fer
Type
MIME-Type
Primary Request )
ahrefs.com/robot/
Redirect Chain
  • http://ahrefs.com/robot/)
  • https://ahrefs.com/robot/)
3 KB
2 KB
Document
General
Full URL
https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
13.248.206.194 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
89122d088633b6c4838bf878cfeeb7439d7afcaf537d2abcaeed04420a8c9764
Security Headers
Name Value
Strict-Transport-Security max-age=63072000

Request headers

:method
GET
:authority
ahrefs.com
:scheme
https
:path
/robot/)
pragma
no-cache
cache-control
no-cache
upgrade-insecure-requests
1
user-agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36
accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
sec-fetch-site
none
sec-fetch-mode
navigate
sec-fetch-user
?1
sec-fetch-dest
document
accept-encoding
gzip, deflate, br
accept-language
en-US
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

server
nginx
date
Thu, 11 Mar 2021 18:35:22 GMT
content-type
text/html; charset=utf8
vary
Accept-Encoding
etag
W/"604887e9-bec"
strict-transport-security
max-age=63072000
x-request-id
0af4111b7451e01066e8c8774180934e
content-encoding
gzip

Redirect headers

Server
nginx
Date
Thu, 11 Mar 2021 18:35:22 GMT
Content-Type
text/html
Content-Length
162
Connection
keep-alive
Location
https://ahrefs.com/robot/)
X-Frame-Options
SAMEORIGIN
Content-Security-Policy
frame-ancestors 'self'
X-Request-ID
9729757683d54e763d91ce124d80e35d
bootstrap.min.css
maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/
93 KB
16 KB
Stylesheet
General
Full URL
https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/bootstrap.min.css
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2606:4700::6812:acf , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software
cloudflare /
Resource Hash
c567912a3cf283a6dea7d0f502c1f350f1161db58cce545cf38674686fadca6b
Security Headers
Name Value
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff

Request headers

Referer
https://ahrefs.com/
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

date
Thu, 11 Mar 2021 18:35:22 GMT
content-encoding
br
x-content-type-options
nosniff
cf-cache-status
HIT
cdn-edgestorageid
565, 617
age
83140
cdn-cachedat
2021-03-10 20:29:42
cdn-pullzone
252412
cross-origin-resource-policy
cross-origin
alt-svc
h3-27=":443"; ma=86400, h3-28=":443"; ma=86400, h3-29=":443"; ma=86400
cf-request-id
08c42b7d3c0000c2f9bb219000000001
timing-allow-origin
*
access-control-allow-origin
*
last-modified
Mon, 25 Jan 2021 22:04:00 GMT
server
cloudflare
cdn-requestpullcode
200
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=31536000; includeSubDomains; preload
content-type
text/css; charset=utf-8
cdn-cache
MISS
vary
Accept-Encoding
cache-control
public, max-age=31919000
cdn-uid
b1941f61-b576-4f40-80de-5677acb38f74
cdn-requestid
b2c772c5b01a7f07ea0880ca56ba1b74
cf-ray
62e6e1db9961c2f9-FRA
cdn-requestcountrycode
DE
cdn-requestpullsuccess
True
notfound.css
ahrefs.com/assets/css/
2 KB
1 KB
Stylesheet
General
Full URL
https://ahrefs.com/assets/css/notfound.css
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
13.248.206.194 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
84208699e751a42c649c48354f18584a472d62a8b72c2076e63100de3a91dcd6

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

pragma
public
date
Thu, 11 Mar 2021 18:35:22 GMT
content-encoding
gzip
last-modified
Wed, 10 Mar 2021 08:48:41 GMT
server
nginx
etag
W/"604887e9-8db"
vary
Accept-Encoding
content-type
text/css
cache-control
max-age=31536000, public
expires
Fri, 11 Mar 2022 18:35:22 GMT
robot-error.png
ahrefs.com/images/service/
35 KB
35 KB
Image
General
Full URL
https://ahrefs.com/images/service/robot-error.png
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
13.248.206.194 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
2d6333654303d90c9cd9c4a694c1e226149804b48f6dbb36c182c304d5a0390a

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

pragma
public
date
Thu, 11 Mar 2021 18:35:22 GMT
last-modified
Wed, 10 Mar 2021 08:48:41 GMT
server
nginx
etag
"604887e9-8be6"
content-type
image/png
cache-control
max-age=31536000, public
accept-ranges
bytes
content-length
35814
expires
Fri, 11 Mar 2022 18:35:22 GMT
matomo.js
analytics.ahrefs.com/
69 KB
24 KB
Script
General
Full URL
https://analytics.ahrefs.com/matomo.js
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2606:4700:10::6816:118c , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software
cloudflare /
Resource Hash
0995371a359a4a701d66f8b183de6144de9a042e5bac84b6f920968f51567742
Security Headers
Name Value
X-Frame-Options SAMEORIGIN

Request headers

Referer
https://ahrefs.com/
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

date
Thu, 11 Mar 2021 18:35:22 GMT
content-encoding
gzip
vary
Accept-Encoding
cf-cache-status
HIT
last-modified
Tue, 06 Oct 2020 15:57:56 GMT
server
cloudflare
age
6958
etag
"1131c-5b102a993581e-gzip"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
x-frame-options
SAMEORIGIN
content-type
application/javascript
accept-ranges
bytes
cf-ray
62e6e1dc1d26d6bd-FRA
content-length
23691
cf-request-id
08c42b7d8c0000d6bd96391000000001
truncated
/
691 B
0
Image
General
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
bdc4d74d1594b58a45c618064cfec3fb1f66db5108d52ee86840ec20de469dc0

Request headers

Referer
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

Content-Type
image/svg+xml
matomo.php
analytics.ahrefs.com/
43 B
187 B
Image
General
Full URL
https://analytics.ahrefs.com/matomo.php?action_name=404%20Error%20-%20Ahrefs&idsite=1&rec=1&r=133957&h=19&m=35&s=22&url=https%3A%2F%2Fahrefs.com%2Frobot%2F)&_id=&_idts=1615487723&_idvc=1&_idn=1&_refts=0&_viewts=1615487723&send_image=1&cookie=1&res=1600x1200&gt_ms=79&pv_id=1FggmE
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2606:4700:10::6816:118c , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software
cloudflare / PHP/7.3.17
Resource Hash
548f2d6f4d0d820c6c5ffbeffcbd7f0e73193e2932eefe542accc84762deec87
Security Headers
Name Value
X-Frame-Options SAMEORIGIN

Request headers

Referer
https://ahrefs.com/
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

date
Thu, 11 Mar 2021 18:35:23 GMT
cf-cache-status
DYNAMIC
server
cloudflare
x-powered-by
PHP/7.3.17
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
x-frame-options
SAMEORIGIN
content-type
image/gif
cache-control
no-store
cf-ray
62e6e1dc8dcbd6bd-FRA
cf-request-id
08c42b7dd90000d6bd61b1d000000001
shim.latest.js
js.intercomcdn.com/
Redirect Chain
  • https://widget.intercom.io/widget/dic5omcp
  • https://js.intercomcdn.com/shim.latest.js
16 KB
6 KB
Script
General
Full URL
https://js.intercomcdn.com/shim.latest.js
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
65.9.96.38 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software
AmazonS3 /
Resource Hash
eafc7103f3158e56145c4056c01b29d19f8bbaa26aecdfb0f61e09e8f4bdca42

Request headers

Referer
https://ahrefs.com/
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

x-amz-server-side-encryption
AES256
date
Thu, 11 Mar 2021 18:35:23 GMT
content-encoding
gzip
last-modified
Thu, 11 Mar 2021 10:40:18 GMT
server
AmazonS3
age
1
etag
"c54f06377638cc6254a81931eb7badbb"
x-cache
Hit from cloudfront
content-type
application/javascript; charset=UTF-8
via
1.1 7df0d6b4ce8f8b155434dd5d830b76be.cloudfront.net (CloudFront)
cache-control
max-age=300, s-maxage=300, public
x-amz-cf-pop
PRG50-C1
accept-ranges
bytes
content-length
5657
x-amz-cf-id
io8UQ6av-kCGlS_w9XgfFkVGZ-E3WZNjTxGw5VNB1sse6-56EPjjHg==

Redirect headers

date
Thu, 11 Mar 2021 18:13:12 GMT
via
1.1 d9c696d6d0c92f63870873ced2895baa.cloudfront.net (CloudFront)
server
AmazonS3
age
1332
x-cache
Hit from cloudfront
location
https://js.intercomcdn.com/shim.latest.js
x-amz-cf-pop
PRG50-C1
content-length
0
x-amz-cf-id
wC-KKdsgYRpneoR_we1rJMSLlCrH8L-H2M8sJ-9RnZrj4bzj1K1k_A==
frame-modern.e8a85d5b.js
js.intercomcdn.com/ Frame 2622
247 KB
67 KB
Script
General
Full URL
https://js.intercomcdn.com/frame-modern.e8a85d5b.js
Requested by
Host: widget.intercom.io
URL: https://widget.intercom.io/widget/dic5omcp
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
65.9.96.38 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software
AmazonS3 /
Resource Hash
9e14c6d9263541098ecc0801e8c9617e807ddd3ccdf9517ce4ddc8fac1e3c0cd

Request headers

Referer
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

x-amz-server-side-encryption
AES256
date
Thu, 11 Mar 2021 16:40:23 GMT
content-encoding
gzip
last-modified
Thu, 11 Mar 2021 10:35:33 GMT
server
AmazonS3
age
6901
etag
"bb6cb4ff6562391a0d6587aeeaa64022"
x-cache
Hit from cloudfront
content-type
application/javascript; charset=UTF-8
via
1.1 7df0d6b4ce8f8b155434dd5d830b76be.cloudfront.net (CloudFront)
cache-control
max-age=31536000, s-maxage=7200, public
x-amz-cf-pop
PRG50-C1
accept-ranges
bytes
content-length
67850
x-amz-cf-id
LK3qs7bRI9riRWk8JzohjwLLbdUso-Aa91kZU4IVuaBcrQPkGfeqYw==
vendor-modern.c4b9303b.js
js.intercomcdn.com/ Frame 2622
123 KB
38 KB
Script
General
Full URL
https://js.intercomcdn.com/vendor-modern.c4b9303b.js
Requested by
Host: widget.intercom.io
URL: https://widget.intercom.io/widget/dic5omcp
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
65.9.96.38 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software
AmazonS3 /
Resource Hash
08b7a2e506cea7f2808a59e807b3f3682b0555bb319379a16d1fe21cd73b1d3d

Request headers

Referer
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36

Response headers

x-amz-server-side-encryption
AES256
date
Thu, 11 Mar 2021 18:00:20 GMT
content-encoding
gzip
last-modified
Thu, 04 Mar 2021 10:43:55 GMT
server
AmazonS3
age
2104
etag
"aca42783513f845ac188e1caaf2b3ba8"
x-cache
Hit from cloudfront
content-type
application/javascript; charset=UTF-8
via
1.1 7df0d6b4ce8f8b155434dd5d830b76be.cloudfront.net (CloudFront)
cache-control
max-age=31536000, s-maxage=7200, public
x-amz-cf-pop
PRG50-C1
accept-ranges
bytes
content-length
38313
x-amz-cf-id
5dmW3f8mRWmjNLt6T-OZo8in8kSVLQFZBqrfofVhRzS2PqrUF-nwsw==
ping
api-iam.intercom.io/messenger/web/ Frame 2622
11 KB
3 KB
XHR
General
Full URL
https://api-iam.intercom.io/messenger/web/ping
Requested by
Host: js.intercomcdn.com
URL: https://js.intercomcdn.com/frame-modern.e8a85d5b.js
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
75.2.88.188 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
ad8b87a22ce463223.awsglobalaccelerator.com
Software
nginx /
Resource Hash
41ae1d5045393755821c0fb910ed3b900d0eb86cc02260cc9d3af83708d0ef65
Security Headers
Name Value
Strict-Transport-Security max-age=31556952; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options SAMEORIGIN
X-Xss-Protection 1; mode=block

Request headers

Referer
User-Agent
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/89.0.4389.72 Safari/537.36
Content-Type
application/x-www-form-urlencoded

Response headers

date
Thu, 11 Mar 2021 18:35:24 GMT
content-encoding
gzip
x-ami-version
ami-04b949e354e67e20b
status
200 OK
strict-transport-security
max-age=31556952; includeSubDomains; preload
vary
Accept-Encoding
x-xss-protection
1; mode=block
x-request-id
000occnkufp0bquqnr20
x-runtime
0.320109
server
nginx
x-frame-options
SAMEORIGIN
etag
W/"41ae1d5045393755821c0fb910ed3b90"
x-ratelimit-remaining
19729
access-control-allow-methods
POST, GET, OPTIONS
content-type
application/json; charset=utf-8
access-control-allow-origin
https://ahrefs.com
x-intercom-version
bf3dbbec059ff251cd0080a54ab290408d32d387
cache-control
max-age=0, private, must-revalidate
access-control-allow-credentials
true
x-ratelimit-reset
1615487760
x-ratelimit-limit
20000
access-control-allow-headers
Content-Type
x-content-type-options
nosniff

Verdicts & Comments Add Verdict or Comment

19 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

object| 0 object| ontransitionrun object| ontransitionstart object| ontransitioncancel object| cookieStore function| showDirectoryPicker function| showOpenFilePicker function| showSaveFilePicker object| trustedTypes boolean| crossOriginIsolated object| _paq object| intercomSettings function| Intercom object| JSON_PIWIK object| Piwik object| Matomo object| AnalyticsTracker function| piwik_log function| __intercomAssignLocation

0 Cookies

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header Value
Strict-Transport-Security max-age=63072000