urlscan.io logo urlscan.io
SecurityTrails logo

ahrefs.com Open in urlscan Pro
76.223.89.128  Public Scan

Go To Rescan Add Verdict Report
Submitted URL: http://ahrefs.com/robot/)
Effective URL: https://ahrefs.com/robot/)
Submission: On October 14 via api from US
 Behaviour Indicators
Similar DOM Content API
Verdicts

Summary

This website contacted 6 IPs in 2 countries across 4 domains to perform 10 HTTP transactions. The main IP is 76.223.89.128, located in Seattle, United States and belongs to AMAZON-02, US. The main domain is ahrefs.com.
TLS certificate: Issued by DigiCert SHA2 Extended Validation Ser... on October 12th 2018. Valid for: 2 years.
This is the only time ahrefs.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
1 4 76.223.89.128 16509 (AMAZON-02)
1 2001:4de0:ac1... 20446 (HIGHWINDS3)
2 2606:4700:10:... 13335 (CLOUDFLAR...)
1 1 99.86.243.12 16509 (AMAZON-02)
3 99.86.243.48 16509 (AMAZON-02)
1 75.2.88.188 16509 (AMAZON-02)
10 6
4    76.223.89.128 (Seattle, United States)

ASN16509 (AMAZON-02, US)
PTR: a2b4d5fc59b05f5ef.awsglobalaccelerator.com
ahrefs.com
1    2001:4de0:ac19::1:b:2b (Netherlands)

ASN20446 (HIGHWINDS3, US)
maxcdn.bootstrapcdn.com
2    2606:4700:10::6816:118c (United States)

ASN13335 (CLOUDFLARENET, US)
analytics.ahrefs.com
1    99.86.243.12 (Seattle, United States)

ASN16509 (AMAZON-02, US)
PTR: server-99-86-243-12.vie50.r.cloudfront.net
widget.intercom.io
3    99.86.243.48 (Seattle, United States)

ASN16509 (AMAZON-02, US)
PTR: server-99-86-243-48.vie50.r.cloudfront.net
js.intercomcdn.com
1    75.2.88.188 (Seattle, United States)

ASN16509 (AMAZON-02, US)
PTR: ad8b87a22ce463223.awsglobalaccelerator.com
api-iam.intercom.io
Domain Requested by
4 ahrefs.com 1 redirects ahrefs.com
3 js.intercomcdn.com widget.intercom.io
2 analytics.ahrefs.com ahrefs.com
1 api-iam.intercom.io js.intercomcdn.com
1 widget.intercom.io 1 redirects
1 maxcdn.bootstrapcdn.com ahrefs.com
10 6

This site contains no links.

Subject Issuer Validity Valid
ahrefs.com
DigiCert SHA2 Extended Validation Server CA		 2018-10-12 -
2021-01-11		 2 years crt.sh
*.bootstrapcdn.com
Sectigo RSA Domain Validation Secure Server CA		 2020-09-22 -
2021-10-12		 a year crt.sh
sni.cloudflaressl.com
Cloudflare Inc ECC CA-3		 2020-08-18 -
2021-08-18		 a year crt.sh
*.intercomcdn.com
Amazon		 2020-03-29 -
2021-04-29		 a year crt.sh
*.intercom.com
Amazon		 2020-05-13 -
2021-06-13		 a year crt.sh

This page contains 2 frames:

Primary Page: https://ahrefs.com/robot/)
Frame ID: 66C1EA5986A3C6E29BC81F9557D2F797
Requests: 8 HTTP requests in this frame

Frame: https://js.intercomcdn.com/frame-modern.4bc7ef24.js
Frame ID: 0DEBE3144E9CA462553B95C6E587F46D
Requests: 3 HTTP requests in this frame

Screenshot
Live screenshot
Full Image

Page URL History Show full URLs

  1. http://ahrefs.com/robot/) HTTP 301
    https://ahrefs.com/robot/) Page URL

Detected technologies

Overall confidence: 100%
Detected patterns
  • html /<link[^>]+?href="[^"]*bootstrap(?:\.min)?\.css/i
Overall confidence: 100%
Detected patterns
  • headers server /nginx(?:\/([\d.]+))?/i

Page Statistics

10
Requests

100 %
HTTPS

33 %
IPv6

4
Domains

6
Subdomains

6
IPs

2
Countries

186 kB
Transfer

573 kB
Size

1
Cookies

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

  1. http://ahrefs.com/robot/) HTTP 301
    https://ahrefs.com/robot/) Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 6
  • https://widget.intercom.io/widget/dic5omcp HTTP 302
  • https://js.intercomcdn.com/shim.latest.js

10 HTTP transactions

Resource
Path		 Size
x-fer		 Type
MIME-Type
Primary Request )
ahrefs.com/robot/
Redirect Chain
  • http://ahrefs.com/robot/)
  • https://ahrefs.com/robot/)
3 KB
2 KB 		Document
General
Check archive.org
Download Go to
Full URL
https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
76.223.89.128 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
6f3d1048da6f1c02424012f29fd34f5149a6afb21bbd18dc6d02e83b936c5e7d
Security Headers
Name Value
Strict-Transport-Security max-age=63072000

Request headers

:method
GET
:authority
ahrefs.com
:scheme
https
:path
/robot/)
pragma
no-cache
cache-control
no-cache
upgrade-insecure-requests
1
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36
accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
sec-fetch-site
none
sec-fetch-mode
navigate
sec-fetch-user
?1
sec-fetch-dest
document
accept-encoding
gzip, deflate, br
accept-language
en-US
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

status
404
server
nginx
date
Wed, 14 Oct 2020 05:25:11 GMT
content-type
text/html; charset=utf8
vary
Accept-Encoding
etag
W/"5f85ecf9-be1"
strict-transport-security
max-age=63072000
x-request-id
3697a3373307c36161aed0b3f6f3eb44
content-encoding
gzip

Redirect headers

Server
nginx
Date
Wed, 14 Oct 2020 05:25:10 GMT
Content-Type
text/html
Content-Length
178
Connection
keep-alive
Location
https://ahrefs.com/robot/)
X-Frame-Options
SAMEORIGIN
Content-Security-Policy
frame-ancestors 'self'
X-Request-ID
4bd20e3924452ab1e908460fa3fd45ce
bootstrap.min.css
maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/ 		93 KB
17 KB 		Stylesheet
General
Check archive.org
Download Go to
Full URL
https://maxcdn.bootstrapcdn.com/bootstrap/4.0.0-alpha.2/css/bootstrap.min.css
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2001:4de0:ac19::1:b:2b , Netherlands, ASN20446 (HIGHWINDS3, US),
Reverse DNS
Software
/
Resource Hash
c567912a3cf283a6dea7d0f502c1f350f1161db58cce545cf38674686fadca6b
Security Headers
Name Value
X-Content-Type-Options nosniff

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 05:25:14 GMT
content-encoding
gzip
x-content-type-options
nosniff
last-modified
Wed, 12 Dec 2018 18:34:08 GMT
status
200
etag
"1544639648"
vary
Accept-Encoding
x-cache
HIT
content-type
text/css; charset=utf-8
access-control-allow-origin
*
cache-control
public, max-age=31536000
cross-origin-resource-policy
cross-origin
accept-ranges
bytes
timing-allow-origin
*
content-length
17650
notfound.css
ahrefs.com/assets/css/ 		2 KB
1 KB 		Stylesheet
General
Check archive.org
Download Go to
Full URL
https://ahrefs.com/assets/css/notfound.css
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
76.223.89.128 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
84208699e751a42c649c48354f18584a472d62a8b72c2076e63100de3a91dcd6

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

pragma
public
date
Wed, 14 Oct 2020 05:25:11 GMT
content-encoding
gzip
last-modified
Tue, 13 Oct 2020 18:07:53 GMT
server
nginx
etag
W/"5f85ecf9-8db"
vary
Accept-Encoding
content-type
text/css
status
200
cache-control
max-age=31536000, public
expires
Thu, 14 Oct 2021 05:25:11 GMT
robot-error.png
ahrefs.com/images/service/ 		35 KB
35 KB 		Image
General
Check archive.org
Download Go to Show image
Full URL
https://ahrefs.com/images/service/robot-error.png
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
76.223.89.128 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
a2b4d5fc59b05f5ef.awsglobalaccelerator.com
Software
nginx /
Resource Hash
2d6333654303d90c9cd9c4a694c1e226149804b48f6dbb36c182c304d5a0390a

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

pragma
public
date
Wed, 14 Oct 2020 05:25:11 GMT
last-modified
Tue, 13 Oct 2020 18:07:54 GMT
server
nginx
etag
"5f85ecfa-8be6"
content-type
image/png
status
200
cache-control
max-age=31536000, public
accept-ranges
bytes
content-length
35814
expires
Thu, 14 Oct 2021 05:25:11 GMT
matomo.js
analytics.ahrefs.com/ 		69 KB
24 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://analytics.ahrefs.com/matomo.js
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2606:4700:10::6816:118c , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software
cloudflare /
Resource Hash
0995371a359a4a701d66f8b183de6144de9a042e5bac84b6f920968f51567742
Security Headers
Name Value
X-Frame-Options SAMEORIGIN

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 05:25:14 GMT
content-encoding
gzip
cf-cache-status
HIT
age
5775
status
200
content-length
23691
cf-request-id
05c72ae87d0000d6ed28a26200000001
last-modified
Tue, 06 Oct 2020 15:57:56 GMT
server
cloudflare
x-frame-options
SAMEORIGIN
etag
"1131c-5b102a993581e-gzip"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
vary
Accept-Encoding
content-type
application/javascript
accept-ranges
bytes
cf-ray
5e1ee0ed98c3d6ed-FRA
truncated
/ 		691 B
0 		Image
General
Check archive.org
Download Go to Show image
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
bdc4d74d1594b58a45c618064cfec3fb1f66db5108d52ee86840ec20de469dc0

Request headers

Referer
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

Content-Type
image/svg+xml
matomo.php
analytics.ahrefs.com/ 		43 B
162 B 		Image
General
Check archive.org
Download Go to Show image
Full URL
https://analytics.ahrefs.com/matomo.php?action_name=404%20Error%20-%20Ahrefs&idsite=1&rec=1&r=738968&h=7&m=25&s=14&url=https%3A%2F%2Fahrefs.com%2Frobot%2F)&_id=&_idts=1602653115&_idvc=1&_idn=1&_refts=0&_viewts=1602653115&send_image=1&cookie=1&res=1600x1200&gt_ms=77&pv_id=St2ppE
Requested by
Host: ahrefs.com
URL: https://ahrefs.com/robot/)
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
2606:4700:10::6816:118c , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software
cloudflare / PHP/7.3.17
Resource Hash
548f2d6f4d0d820c6c5ffbeffcbd7f0e73193e2932eefe542accc84762deec87
Security Headers
Name Value
X-Frame-Options SAMEORIGIN

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 05:25:14 GMT
cf-cache-status
DYNAMIC
server
cloudflare
x-powered-by
PHP/7.3.17
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
x-frame-options
SAMEORIGIN
content-type
image/gif
status
200
cache-control
no-store
cf-ray
5e1ee0edc921d6ed-FRA
cf-request-id
05c72ae8a00000d6ed28a28200000001
shim.latest.js
js.intercomcdn.com/
Redirect Chain
  • https://widget.intercom.io/widget/dic5omcp
  • https://js.intercomcdn.com/shim.latest.js
9 KB
4 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://js.intercomcdn.com/shim.latest.js
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
99.86.243.48 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
server-99-86-243-48.vie50.r.cloudfront.net
Software
AmazonS3 /
Resource Hash
65c29d71c046ae88487629fb5bbfd9ed5514b1adb6f27824e80afba06defb477

Request headers

Referer
https://ahrefs.com/robot/)
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 05:23:12 GMT
content-encoding
gzip
age
123
x-amz-server-side-encryption
AES256
x-cache
Hit from cloudfront
status
200
content-length
3443
last-modified
Tue, 13 Oct 2020 13:08:03 GMT
server
AmazonS3
etag
"c669f426182d88c379890a6510bd4bd2"
content-type
application/javascript; charset=UTF-8
via
1.1 a01b7aca64c6d4b437b814f64422d6c8.cloudfront.net (CloudFront)
cache-control
max-age=300, s-maxage=300, public
x-amz-cf-pop
VIE50-C1
accept-ranges
bytes
x-amz-cf-id
aH2GTg68x8evLn6DZ-oLUtXADv6op2_hchgJ-njeeyWJuMTPUFQeoQ==

Redirect headers

date
Mon, 12 Oct 2020 10:36:22 GMT
via
1.1 bb014bef6518ccd6aad6b497f5e9c1d2.cloudfront.net (CloudFront)
server
AmazonS3
age
154133
status
302
x-cache
Hit from cloudfront
location
https://js.intercomcdn.com/shim.latest.js
x-amz-cf-pop
VIE50-C1
content-length
0
x-amz-cf-id
9BqxgLb_3COkLE-l50usyIKqGD0aQRaEed4NvoeWkTQJxV6oIYU3ug==
frame-modern.4bc7ef24.js
js.intercomcdn.com/ Frame 0DEB 		229 KB
63 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://js.intercomcdn.com/frame-modern.4bc7ef24.js
Requested by
Host: widget.intercom.io
URL: https://widget.intercom.io/widget/dic5omcp
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
99.86.243.48 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
server-99-86-243-48.vie50.r.cloudfront.net
Software
AmazonS3 /
Resource Hash
ef78aa58ecbce0eb67b7c53ed4973491faffeacd22d1cdeea0800430ea7b2706

Request headers

Referer
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 05:08:09 GMT
content-encoding
gzip
age
1026
x-amz-server-side-encryption
AES256
x-cache
Hit from cloudfront
status
200
content-length
63666
last-modified
Tue, 13 Oct 2020 12:57:20 GMT
server
AmazonS3
etag
"2c52f44dc165b5f65621a728aa42f146"
content-type
application/javascript; charset=UTF-8
via
1.1 a01b7aca64c6d4b437b814f64422d6c8.cloudfront.net (CloudFront)
cache-control
max-age=31536000, s-maxage=7200, public
x-amz-cf-pop
VIE50-C1
accept-ranges
bytes
x-amz-cf-id
ai31Pi0cJcHymx0JrZgJSwGiwUw_D1AV4z_mPjbqAEevE7t04ru88Q==
vendor-modern.ed2d3f4b.js
js.intercomcdn.com/ Frame 0DEB 		123 KB
38 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://js.intercomcdn.com/vendor-modern.ed2d3f4b.js
Requested by
Host: widget.intercom.io
URL: https://widget.intercom.io/widget/dic5omcp
Protocol
H2
Security
TLS 1.3, , AES_128_GCM
Server
99.86.243.48 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
server-99-86-243-48.vie50.r.cloudfront.net
Software
AmazonS3 /
Resource Hash
9279592c2993962bc752f635a7af514b3f6c1bbe874819efcc9bef159061568a

Request headers

Referer
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date
Wed, 14 Oct 2020 03:49:27 GMT
content-encoding
gzip
age
5748
x-amz-server-side-encryption
AES256
x-cache
Hit from cloudfront
status
200
content-length
38291
last-modified
Tue, 13 Oct 2020 12:57:20 GMT
server
AmazonS3
etag
"ab5dfbd5919db7e02593e80342846d13"
content-type
application/javascript; charset=UTF-8
via
1.1 a01b7aca64c6d4b437b814f64422d6c8.cloudfront.net (CloudFront)
cache-control
max-age=31536000, s-maxage=7200, public
x-amz-cf-pop
VIE50-C1
accept-ranges
bytes
x-amz-cf-id
3vXUAyQ81-mdiQpSzr_r7l4Oohn7sUEslvOQJKII9Xh7mKzgev8OFQ==
ping
api-iam.intercom.io/messenger/web/ Frame 0DEB 		8 KB
3 KB 		XHR
General
Check archive.org
Download Go to
Full URL
https://api-iam.intercom.io/messenger/web/ping
Requested by
Host: js.intercomcdn.com
URL: https://js.intercomcdn.com/frame-modern.4bc7ef24.js
Protocol
H2
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
75.2.88.188 Seattle, United States, ASN16509 (AMAZON-02, US),
Reverse DNS
ad8b87a22ce463223.awsglobalaccelerator.com
Software
nginx /
Resource Hash
8f1d494fddaf9c0af0a3d6bc80895492051f70dfcb66ad6979fa05b25571d428
Security Headers
Name Value
Strict-Transport-Security max-age=31556952; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options SAMEORIGIN
X-Xss-Protection 1; mode=block

Request headers

Referer
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36
Content-Type
application/x-www-form-urlencoded

Response headers

date
Wed, 14 Oct 2020 05:25:15 GMT
content-encoding
gzip
x-ami-version
ami-0d1426a98d00c16c7
status
200, 200 OK
strict-transport-security
max-age=31556952; includeSubDomains; preload
vary
Accept-Encoding
x-xss-protection
1; mode=block
x-request-id
003vti7pqs0dvqmt5qpg
x-runtime
0.354712
server
nginx
x-frame-options
SAMEORIGIN
etag
W/"8f1d494fddaf9c0af0a3d6bc80895492"
x-ratelimit-remaining
19919
access-control-allow-methods
POST, GET, OPTIONS
content-type
application/json; charset=utf-8
access-control-allow-origin
https://ahrefs.com
x-intercom-version
f816369d9ac71ac0b9add81c705be7ec97d6e604
cache-control
max-age=0, private, must-revalidate
access-control-allow-credentials
true
x-ratelimit-reset
1602653160
x-ratelimit-limit
20000
access-control-allow-headers
Content-Type
x-content-type-options
nosniff

Verdicts & Comments Add Verdict or Comment

14 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

object| 0 function| showDirectoryPicker function| showOpenFilePicker function| showSaveFilePicker object| trustedTypes object| _paq object| intercomSettings function| Intercom object| JSON_PIWIK object| Piwik object| Matomo object| AnalyticsTracker function| piwik_log function| __intercomAssignLocation

1 Cookies

Domain/Path Name / Value
.ahrefs.com/ Name: __cfduid
Value: d38be8ea560037429429df778f9714a801602653114

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header Value
Strict-Transport-Security max-age=63072000