crawler.ninja Open in urlscan Pro
2606:4700:3030::681c:1a21 Public Scan

Go To Rescan
Add Verdict Report

Submitted URL:
http://178.128.0.34/
Effective URL:
https://crawler.ninja/
Submission: On November 01 via manual (November 1st 2020, 9:10:57 am UTC) from PH

Summary HTTP 14 Redirects Links 19 Behaviour Indicators

Summary

This website contacted 4 IPs in 2 countries across 4 domains to perform 14 HTTP transactions. The main IP is 2606:4700:3030::681c:1a21, located in United States and belongs to CLOUDFLARENET, US. The main domain is crawler.ninja.
TLS certificate: Issued by Cloudflare Inc ECC CA-3 on August 12th 2020. Valid for: a year.

This is the only time crawler.ninja was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

	IP Address	AS Autonomous System
1 1	178.128.0.34 178.128.0.34	14061 (DIGITALOC...) (DIGITALOCEAN-ASN)
5	2606:4700:303... 2606:4700:3030::681c:1a21	13335 (CLOUDFLAR...) (CLOUDFLARENET)
5	2606:4700::68... 2606:4700::6810:125e	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	2a00:1450:400... 2a00:1450:4001:820::200a	15169 (GOOGLE) (GOOGLE)
3	2a00:1450:400... 2a00:1450:4001:815::2003	15169 (GOOGLE) (GOOGLE)
14	4

1 178.128.0.34 (Santa Clara, United States) 1 redirects

ASN14061 (DIGITALOCEAN-ASN, US)

178.128.0.34	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 2606:4700:3030::681c:1a21 (United States)

ASN13335 (CLOUDFLARENET, US)

crawler.ninja	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 2606:4700::6810:125e (United States)

ASN13335 (CLOUDFLARENET, US)

cdnjs.cloudflare.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:820::200a (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

fonts.googleapis.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2a00:1450:4001:815::2003 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

fonts.gstatic.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

	Apex Domain Subdomains	Transfer
5	cloudflare.com cdnjs.cloudflare.com	120 KB
5	crawler.ninja crawler.ninja	8 KB
3	gstatic.com fonts.gstatic.com	39 KB
1	googleapis.com fonts.googleapis.com	1 KB
14	4

	Domain	Requested by
5	cdnjs.cloudflare.com	crawler.ninja cdnjs.cloudflare.com
5	crawler.ninja	crawler.ninja cdnjs.cloudflare.com
3	fonts.gstatic.com	fonts.googleapis.com
1	fonts.googleapis.com	crawler.ninja
14	4

This site contains links to these domains. Also see Links.

Domain
sslstudy.s3.eu-central-003.backblazeb2.com
scotthelme.co.uk
www.paypal.me
securityheaders.com
twitter.com
www.facebook.com
plus.google.com
www.linkedin.com
creativecommons.org

Subject Issuer	Validity	Valid
sni.cloudflaressl.com Cloudflare Inc ECC CA-3	`2020-08-12` - `2021-08-12`	a year	crt.sh
upload.video.google.com GTS CA 1O1	`2020-10-06` - `2020-12-29`	3 months	crt.sh
*.gstatic.com GTS CA 1O1	`2020-10-06` - `2020-12-29`	3 months	crt.sh

This page contains 1 frames:

Primary Page: https://crawler.ninja/
Frame ID: B2973C0DC6D5D8A6C0C717D097E17473
Requests: 14 HTTP requests in this frame

Screenshot
Live screenshot

Full Image

Page URL History Show full URLs

http://178.128.0.34/ HTTP 301
https://crawler.ninja/ Page URL

Detected technologies

CloudFlare (CDN) Expand

Overall confidence: 100%
Detected patterns

headers server /^cloudflare$/i

Page Statistics

14
Requests

100 %
HTTPS

80 %
IPv6

4
Domains

4
Subdomains

4
IPs

2
Countries

169 kB
Transfer

302 kB
Size

1
Cookies

19 Outgoing links

These are links going to different origins than the main page.

URL: https://sslstudy.s3.eu-central-003.backblazeb2.com/index.html
Title: Download the raw data files which contain everything.

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/top-1-million-analysis-march-2020/
Title: View statistics in the latest crawl report.

Search URL Search Domain Scan URL

URL: https://www.paypal.me/scotthelme/
Title: Donate

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/top-1-million-analysis-september-2019/
Title: September 2019

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-analysis-february-2019/
Title: February 2019

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-analysis-august-2018/
Title: August 2018

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-analysis-february-2018/
Title: February 2018

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-analysis-aug-2017/
Title: August 2017

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-analysis-feb-2017/
Title: February 2017

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/alexa-top-1-million-crawl-aug-2016/
Title: August 2016

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/security-headers-alexa-top-million/
Title: February 2016

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/how-widely-used-are-security-based-http-response-headers/
Title: August 2015

Search URL Search Domain Scan URL

URL: https://scotthelme.co.uk/
Title: blog

Search URL Search Domain Scan URL

URL: https://securityheaders.com/
Title: securityheaders.com

Search URL Search Domain Scan URL

URL: https://twitter.com/Scott_Helme
Title: Twitter

Search URL Search Domain Scan URL

URL: https://www.facebook.com/scott.helme
Title: Facebook

Search URL Search Domain Scan URL

URL: https://plus.google.com/+ScottHelme
Title: Google+

Search URL Search Domain Scan URL

URL: https://www.linkedin.com/in/scotthelme/
Title: Linkedin

Search URL Search Domain Scan URL

URL: https://creativecommons.org/licenses/by-sa/4.0/
Title: CC BY-SA 4.0

Search URL Search Domain Scan URL

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

http://178.128.0.34/ HTTP 301
https://crawler.ninja/ Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

14 HTTP transactions
0 data transactions

Method
Protocol Status Resource
Path Size
x-fer Time
Latency Type
MIME-Type IP
Location

GET
H2

200

Primary Request / Show response
crawler.ninja/
Redirect Chain

http://178.128.0.34/
https://crawler.ninja/

7 KB
3 KB

45ms
14ms

Document
text/html

2606:4700:3030::681c:1a21
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:3030::681c:1a21 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

e4290262b3dd484f956389e4b531226b61975375f78cae9373087c42d4ab819e

Security Headers

Name	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	1; mode=block

Request headers

:method: GET
:authority: crawler.ninja
:scheme: https
:path: /
pragma: no-cache
cache-control: no-cache
upgrade-insecure-requests: 1
user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36
accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
sec-fetch-site: none
sec-fetch-mode: navigate
sec-fetch-user: ?1
sec-fetch-dest: document
accept-encoding: gzip, deflate, br
accept-language: en-US
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

status: 200
date: Sun, 01 Nov 2020 09:10:39 GMT
content-type: text/html
set-cookie: __cfduid=dbd45a3f1be4d3dd31768aa74fcddc4ca1604221839; expires=Tue, 01-Dec-20 09:10:39 GMT; path=/; domain=.crawler.ninja; HttpOnly; SameSite=Lax; Secure
last-modified: Wed, 30 Sep 2020 11:42:12 GMT
strict-transport-security: max-age=31536000; includeSubDomains; preload
content-security-policy: upgrade-insecure-requests
x-frame-options: DENY
x-xss-protection: 1; mode=block
x-content-type-options: nosniff
referrer-policy: no-referrer
feature-policy: accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
cache-control: max-age=7200
cf-cache-status: HIT
age: 912
cf-request-id: 0624abbedb000063b93c090000000001
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=Cy02MxKcj9gfWysUCN%2Frt3rjB3XTL6IVzVDfnkXFAsBxqOq0up3gTjFn4b6ieAnpftgcPArT%2BzeVxskyBAmL9Oef9Q6jezfFXM1jELfYc1HgpeeQpZiRp%2FlZ"}],"group":"cf-nel","max_age":604800}
nel: {"report_to":"cf-nel","max_age":604800}
vary: Accept-Encoding
server: cloudflare
cf-ray: 5eb47bde2c4f63b9-FRA
content-encoding: br

Redirect headers

Server: nginx/1.14.0 (Ubuntu)
Date: Sun, 01 Nov 2020 09:10:38 GMT
Content-Type: text/html
Content-Length: 194
Connection: keep-alive
Location: https://crawler.ninja/

GET
H2 200 jquery.min.js Show response
cdnjs.cloudflare.com/ajax/libs/jquery/3.3.1/ 85 KB
27 KB 31ms
16ms Script
application/javascript 2606:4700::6810:125e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdnjs.cloudflare.com/ajax/libs/jquery/3.3.1/jquery.min.js

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6810:125e , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

160a426ff2894252cd7cebbdd6d6b7da8fcd319c65b70468f10b6690c45d02ef

Security Headers

Name	Value
Strict-Transport-Security	max-age=15780000

Request headers

Origin: https://crawler.ninja
Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
vary: Accept-Encoding
cf-cache-status: HIT
nel: {"report_to":"cf-nel","max_age":604800}
age: 910552
x-via: cfworker/kv
status: 200
content-length: 27433
cf-request-id: 0624abbefe00001f2d4484e000000001
timing-allow-origin: *
last-modified: Mon, 04 May 2020 16:11:48 GMT
server: cloudflare
etag: "5eb03ec4-1538f"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15780000
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=lyPaIAtUGkWAZ7aINjThRBANQR9e9bis2tt%2F9StX4t2QR5hf7geKV7cvILmggrLbvyGpP1miVgrSMZPU958bZDPlGE8741%2FyxQjWtAb1pJvaD6tXllh6Lgr80Vx8jkA9gw%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=30672000
accept-ranges: bytes
cf-ray: 5eb47bde6bd71f2d-FRA
expires: Fri, 22 Oct 2021 09:10:39 GMT

GET
H2 200 skel.min.js Show response
cdnjs.cloudflare.com/ajax/libs/skel/3.0.1/ 9 KB
3 KB 33ms
18ms Script
application/javascript 2606:4700::6810:125e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdnjs.cloudflare.com/ajax/libs/skel/3.0.1/skel.min.js

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6810:125e , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

ddef8dbceabe0ffc9e272d6aad6a5890452be9294e08be661e97369d97d7ef81

Security Headers

Name	Value
Strict-Transport-Security	max-age=15780000

Request headers

Origin: https://crawler.ninja
Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
vary: Accept-Encoding
cf-cache-status: HIT
nel: {"report_to":"cf-nel","max_age":604800}
age: 910354
x-via: cfworker/kv
status: 200
content-length: 2816
cf-request-id: 0624abbefe00001f2da3a70000000001
timing-allow-origin: *
last-modified: Mon, 04 May 2020 16:16:21 GMT
server: cloudflare
etag: "5eb03fd5-237d"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15780000
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=7UDE8NeUEPrfNfn8GNKBYY3OGwxxSVYKSbjJXqiU0bnF4OSG0c7KzEuFcSW8u2bmluRb75r%2BLa%2BKfG%2BGXHjl38Hyv%2F8T03b6uyjeZc5R1bll5rHxHn0xjLnvgY%2BSBNYSVQ%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=30672000
accept-ranges: bytes
cf-ray: 5eb47bde6bdd1f2d-FRA
expires: Fri, 22 Oct 2021 09:10:39 GMT

GET
H2 200 skel.min.js Show response
cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/ 26 KB
7 KB 40ms
25ms Script
application/javascript 2606:4700::6810:125e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/skel.min.js

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6810:125e , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

eb181ffc28a96ec71d9406943800255959a97cfcbd579710bd97a3c574847dcc

Security Headers

Name	Value
Strict-Transport-Security	max-age=15780000

Request headers

Origin: https://crawler.ninja
Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
vary: Accept-Encoding
cf-cache-status: HIT
nel: {"report_to":"cf-nel","max_age":604800}
age: 909022
x-via: cfworker/kv
status: 200
content-length: 7300
cf-request-id: 0624abbeff00001f2d94265000000001
timing-allow-origin: *
last-modified: Mon, 04 May 2020 16:16:21 GMT
server: cloudflare
etag: "5eb03fd5-69c9"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15780000
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=i5vYXeSolNA9kGsj8R4MLb1wL%2B%2FUnDhORrPsgOk550NlqbYekAg5oWvOsCoSG0%2B6jK8dWZ86Rg5xeCAE88xACBwD4sEDILODLVVd5OVYUHEpODxILc4CQH6O%2FXp7t8%2FWsA%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=30672000
accept-ranges: bytes
cf-ray: 5eb47bde6bdf1f2d-FRA
expires: Fri, 22 Oct 2021 09:10:39 GMT

GET
H2 200 init.min.js Show response
crawler.ninja/js/ 773 B
668 B 210ms
209ms Script
application/javascript 2606:4700:3030::681c:1a21
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://crawler.ninja/js/init.min.js?v=1.0.0

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:3030::681c:1a21 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

85ee4cb0eed37d6f29ba26e6692edfab1aca0818e0133c55beeed4823ac426ba

Security Headers

Name	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	1; mode=block

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: REVALIDATED
nel: {"report_to":"cf-nel","max_age":604800}
status: 200
vary: Accept-Encoding
cf-request-id: 0624abbef2000063b91299f000000001
referrer-policy: no-referrer
last-modified: Tue, 24 Jul 2018 05:57:00 GMT
server: cloudflare
x-frame-options: DENY
etag: W/"5b56bfac-305"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=31536000; includeSubDomains; preload
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=gQuIH%2F3pGltQHdxm8%2FitnEr2f%2FS%2FsyupEF3d1kgARgNYMAgKMBRNSxT%2BMWNbfnp5E%2BbH%2BJYE37512F6xIzDo55m%2BjLvsuh9TUMs4R9aQqIk5sVEpYZGzr1FO"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript
x-xss-protection: 1; mode=block
cache-control: max-age=7200
feature-policy: accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy: upgrade-insecure-requests
cf-ray: 5eb47bde4c5c63b9-FRA

GET
H2 200 email-decode.min.js Show response
crawler.ninja/cdn-cgi/scripts/5c5dd728/cloudflare-static/ 1 KB
1 KB 11ms
11ms Script
application/javascript 2606:4700:3030::681c:1a21
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://crawler.ninja/cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:3030::681c:1a21 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

2595496fe48df6fcf9b1bc57c29a744c121eb4dd11566466bc13d2e52e6bbcc8

Security Headers

Name	Value
X-Frame-Options	SAMEORIGIN

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: gzip
vary: Accept-Encoding
nel: {"report_to":"cf-nel","max_age":604800}
status: 200
cf-request-id: 0624abbef2000063b942a57000000001
last-modified: Tue, 27 Oct 2020 17:34:18 GMT
server: cloudflare
etag: W/"5f985a1a-4d7"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
x-frame-options: SAMEORIGIN
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=oXzVYXDrQz7UXX2E%2B556yIq9qu4rCL0GlZODKw8qGtTFiJVEqRORXVma2vL5y3wPcFB5%2BCY0LY5FNHo9h%2Fbdo%2Fbh5CoTRMQQZ4TVjwIGKB1YQ%2FGaNDhJ941n"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript
cache-control: max-age=172800, public
cf-ray: 5eb47bde4c5d63b9-FRA
expires: Tue, 03 Nov 2020 09:10:39 GMT

GET
H2 200 style.min.css
crawler.ninja/css/ 11 KB
3 KB 202ms
202ms Stylesheet
text/css 2606:4700:3030::681c:1a21
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://crawler.ninja/css/style.min.css

Requested by

Host: cdnjs.cloudflare.com
URL: https://cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/skel.min.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:3030::681c:1a21 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

ff1fd0be432075ee88f261a6a173d5730dfd43e441f2b7c3478c87c014f2a7b2

Security Headers

Name	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	1; mode=block

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: REVALIDATED
nel: {"report_to":"cf-nel","max_age":604800}
status: 200
vary: Accept-Encoding
cf-request-id: 0624abbfc7000063b90f23d000000001
referrer-policy: no-referrer
last-modified: Fri, 20 Jul 2018 14:34:13 GMT
server: cloudflare
x-frame-options: DENY
etag: W/"5b51f2e5-2da1"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=31536000; includeSubDomains; preload
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=mrFQyMl%2BP7NU6QEgWZwGDCm%2F9zB6V4X0Jds%2ByzBptgt3bZP8ZiQez%2BLnIzh42uK92unWpq%2BUd6MOmosRphNxnRG%2FHT9WLMW%2BntBJHWo8Q%2FQiBCu%2BwIJLN%2BxI"}],"group":"cf-nel","max_age":604800}
content-type: text/css
x-xss-protection: 1; mode=block
cache-control: max-age=7200
feature-policy: accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy: upgrade-insecure-requests
cf-ray: 5eb47bdfad0c63b9-FRA

GET
H2 200 css
fonts.googleapis.com/ 16 KB
1 KB 34ms
14ms Stylesheet
text/css 2a00:1450:4001:820::200a
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/css/style.min.css

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:820::200a Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

ESF /

Resource Hash

042db6f6060427973eb2fbf321c408402a381370f51b0b3b0ce210626ffcd048

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	0

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

strict-transport-security: max-age=31536000
content-encoding: gzip
x-content-type-options: nosniff
status: 200
alt-svc: h3-Q050=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-T050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
x-xss-protection: 0
last-modified: Sun, 01 Nov 2020 08:59:52 GMT
server: ESF
date: Sun, 01 Nov 2020 09:10:39 GMT
x-frame-options: SAMEORIGIN
content-type: text/css; charset=utf-8
access-control-allow-origin: *
cache-control: private, max-age=86400, stale-while-revalidate=604800
timing-allow-origin: *
link: <https://fonts.gstatic.com>; rel=preconnect; crossorigin
expires: Sun, 01 Nov 2020 09:10:39 GMT

GET
H2 200 font-awesome.min.css
cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/ 30 KB
6 KB 39ms
25ms Stylesheet
text/css 2606:4700::6810:125e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/css/style.min.css

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6810:125e , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

799aeb25cc0373fdee0e1b1db7ad6c2f6a0e058dfadaa3379689f583213190bd

Security Headers

Name	Value
Strict-Transport-Security	max-age=15780000

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
vary: Accept-Encoding
cf-cache-status: HIT
nel: {"report_to":"cf-nel","max_age":604800}
age: 910552
x-via: cfworker/kv
status: 200
content-length: 5631
cf-request-id: 0624abc0a200002b22bd102000000001
timing-allow-origin: *
last-modified: Mon, 04 May 2020 16:10:07 GMT
server: cloudflare
etag: "5eb03e5f-7918"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15780000
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=VzDxi7d5AD1Lhw5tUslf137SC6LAdnBkQBofdKCReLisjkEI3zmLSQ8gkcEHQUU9cIFSfvdmnazKKTfdejT34BjMEjTRw4U79evyp8a98XN4P4P0puAZFqS%2BzY6GbWCNCQ%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: text/css; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=30672000
accept-ranges: bytes
cf-ray: 5eb47be1094e2b22-FRA
expires: Fri, 22 Oct 2021 09:10:39 GMT

GET
H2 200 banner.svg
crawler.ninja/css/images/ 1 KB
680 B 197ms
196ms Image
image/svg+xml 2606:4700:3030::681c:1a21
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://crawler.ninja/css/images/banner.svg

Requested by

Host: crawler.ninja
URL: https://crawler.ninja/css/style.min.css

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:3030::681c:1a21 , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

c85e578fe01b43c2118025b9d83f7f232ed8ceba5e6d8b8f1a6eafecb5d481b5

Security Headers

Name	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	1; mode=block

Request headers

Referer
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
content-encoding: br
x-content-type-options: nosniff
cf-cache-status: REVALIDATED
nel: {"report_to":"cf-nel","max_age":604800}
status: 200
vary: Accept-Encoding
cf-request-id: 0624abc0c1000063b950221000000001
referrer-policy: no-referrer
last-modified: Fri, 20 Jul 2018 14:34:07 GMT
server: cloudflare
x-frame-options: DENY
etag: W/"5b51f2df-50d"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=31536000; includeSubDomains; preload
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=GekE8%2Fi%2FpucT%2BBVn5STfgS68MYLAh8zn1bf%2FkVLtJOriqnV1Ovl8%2BXMaMPucaYB1WitHs2TCBVGun430K%2B5Qpjxsbi%2F0JNw3Mm9wYOmWNG30XCgP34AaRyDw"}],"group":"cf-nel","max_age":604800}
content-type: image/svg+xml
x-xss-protection: 1; mode=block
cache-control: max-age=7200
feature-policy: accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy: upgrade-insecure-requests
cf-ray: 5eb47be13dc363b9-FRA

GET
H2 200 6xKydSBYKcSV-LCoeQqfX1RYOo3ig4vwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v14/ 13 KB
13 KB 27ms
7ms Font
font/woff2 2a00:1450:4001:815::2003
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.gstatic.com/s/sourcesanspro/v14/6xKydSBYKcSV-LCoeQqfX1RYOo3ig4vwlxdu3cOWxw.woff2

Requested by

Host: fonts.googleapis.com
URL: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:815::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

487f2e9da2ff0740755a5ef01dc15a2888b89537795895203a831b13b199d8bb

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

Origin: https://crawler.ninja
Referer: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Fri, 30 Oct 2020 11:20:36 GMT
x-content-type-options: nosniff
last-modified: Tue, 15 Sep 2020 18:10:11 GMT
server: sffe
age: 165003
status: 200
content-type: font/woff2
access-control-allow-origin: *
cache-control: public, max-age=31536000
accept-ranges: bytes
timing-allow-origin: *
alt-svc: h3-Q050=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-T050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
content-length: 12976
x-xss-protection: 0
expires: Sat, 30 Oct 2021 11:20:36 GMT

GET
H2 200 6xKydSBYKcSV-LCoeQqfX1RYOo3ik4zwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v14/ 13 KB
13 KB 24ms
6ms Font
font/woff2 2a00:1450:4001:815::2003
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.gstatic.com/s/sourcesanspro/v14/6xKydSBYKcSV-LCoeQqfX1RYOo3ik4zwlxdu3cOWxw.woff2

Requested by

Host: fonts.googleapis.com
URL: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:815::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

7ec7f22119da3493aedefd66ffd30f0aaf4cf4aee42d8254638bcca5971c3568

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

Origin: https://crawler.ninja
Referer: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Fri, 30 Oct 2020 11:20:36 GMT
x-content-type-options: nosniff
last-modified: Tue, 15 Sep 2020 18:10:08 GMT
server: sffe
age: 165003
status: 200
content-type: font/woff2
access-control-allow-origin: *
cache-control: public, max-age=31536000
accept-ranges: bytes
timing-allow-origin: *
alt-svc: h3-Q050=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-T050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
content-length: 13224
x-xss-protection: 0
expires: Sat, 30 Oct 2021 11:20:36 GMT

GET
H2 200 fontawesome-webfont.woff2
cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/fonts/ 75 KB
76 KB 11ms
11ms Font
application/octet-stream 2606:4700::6810:125e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/fonts/fontawesome-webfont.woff2?v=4.7.0

Requested by

Host: cdnjs.cloudflare.com
URL: https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700::6810:125e , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

d792afdac7f7ae5de7c6964950c6c61dc6e3f3813180a59e141c7cb4ac4364dc

Security Headers

Name	Value
Strict-Transport-Security	max-age=15780000

Request headers

Origin: https://crawler.ninja
Referer: https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Sun, 01 Nov 2020 09:10:39 GMT
vary: Accept-Encoding
cf-cache-status: HIT
nel: {"report_to":"cf-nel","max_age":604800}
age: 910551
x-via: cfworker/kv
status: 200
content-length: 77160
cf-request-id: 0624abc0c500001f2d6f155000000001
timing-allow-origin: *
last-modified: Mon, 04 May 2020 16:10:07 GMT
server: cloudflare
etag: "5eb03e5f-12d68"
expect-ct: max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security: max-age=15780000
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report?s=5KRQMmlkgSCqy3lOix0Bf3acnqAjhIM2IQBPzfPaeLV9EkZq0qlMZ3dbOUSlFzBZ0%2F0oCXt2WjqJCWVCjimmZoEiSf9UaLSpeLpbp96Etpz05pUAcTBEmqI4DYe%2FbEgzYg%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/octet-stream; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=30672000
accept-ranges: bytes
cf-ray: 5eb47be139e61f2d-FRA
expires: Fri, 22 Oct 2021 09:10:39 GMT

GET
H2 200 6xKydSBYKcSV-LCoeQqfX1RYOo3i54rwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v14/ 13 KB
13 KB 27ms
12ms Font
font/woff2 2a00:1450:4001:815::2003
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://fonts.gstatic.com/s/sourcesanspro/v14/6xKydSBYKcSV-LCoeQqfX1RYOo3i54rwlxdu3cOWxw.woff2

Requested by

Host: fonts.googleapis.com
URL: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:815::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

sffe /

Resource Hash

fc772b0188bc262494be9dc529c50893ae189110dfcad5a286512b737aef93b8

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

Origin: https://crawler.ninja
Referer: https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36

Response headers

date: Fri, 30 Oct 2020 11:20:37 GMT
x-content-type-options: nosniff
last-modified: Tue, 15 Sep 2020 18:12:16 GMT
server: sffe
age: 165002
status: 200
content-type: font/woff2
access-control-allow-origin: *
cache-control: public, max-age=31536000
accept-ranges: bytes
timing-allow-origin: *
alt-svc: h3-Q050=":443"; ma=2592000,h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-T050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
content-length: 13108
x-xss-protection: 0
expires: Sat, 30 Oct 2021 11:20:37 GMT

Verdicts & Comments Add Verdict or Comment

8 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

1 Cookies

Cookies are little pieces of information stored in the browser of a user. Whenever a user visits the site again, he will also send his cookie values, thus allowing the website to re-identify him even if he changed locations. This is how permanent logins work.

			Domain/Path	Expires	Name / Value
			.crawler.ninja/	1970-01-19 14:20:13	Name: __cfduid Value: dbd45a3f1be4d3dd31768aa74fcddc4ca1604221839

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; includeSubDomains; preload
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	1; mode=block

Indicators

This is a term in the security industry to describe indicators such as IPs, Domains, Hashes, etc. This does not imply that any of these indicate malicious activity.

cdnjs.cloudflare.com
crawler.ninja
fonts.googleapis.com
fonts.gstatic.com
178.128.0.34
2606:4700:3030::681c:1a21
2606:4700::6810:125e
2a00:1450:4001:815::2003
2a00:1450:4001:820::200a
042db6f6060427973eb2fbf321c408402a381370f51b0b3b0ce210626ffcd048
160a426ff2894252cd7cebbdd6d6b7da8fcd319c65b70468f10b6690c45d02ef
2595496fe48df6fcf9b1bc57c29a744c121eb4dd11566466bc13d2e52e6bbcc8
487f2e9da2ff0740755a5ef01dc15a2888b89537795895203a831b13b199d8bb
799aeb25cc0373fdee0e1b1db7ad6c2f6a0e058dfadaa3379689f583213190bd
7ec7f22119da3493aedefd66ffd30f0aaf4cf4aee42d8254638bcca5971c3568
85ee4cb0eed37d6f29ba26e6692edfab1aca0818e0133c55beeed4823ac426ba
c85e578fe01b43c2118025b9d83f7f232ed8ceba5e6d8b8f1a6eafecb5d481b5
d792afdac7f7ae5de7c6964950c6c61dc6e3f3813180a59e141c7cb4ac4364dc
ddef8dbceabe0ffc9e272d6aad6a5890452be9294e08be661e97369d97d7ef81
e4290262b3dd484f956389e4b531226b61975375f78cae9373087c42d4ab819e
eb181ffc28a96ec71d9406943800255959a97cfcbd579710bd97a3c574847dcc
fc772b0188bc262494be9dc529c50893ae189110dfcad5a286512b737aef93b8
ff1fd0be432075ee88f261a6a173d5730dfd43e441f2b7c3478c87c014f2a7b2

crawler.ninja Open in urlscan Pro 2606:4700:3030::681c:1a21 Public Scan

Summary

urlscan.io Verdict: No classification

Domain & IP information

Screenshot Live screenshot Full Image

Page URL History Show full URLs

Detected technologies

Page Statistics

14 Requests

100 %HTTPS

80 %IPv6

4 Domains

4 Subdomains

4 IPs

2 Countries

169 kBTransfer

302 kBSize

1 Cookies

19 Outgoing links

Page URL History

Redirected requests

14 HTTP transactions Everything HTML Script AJAX CSS Image Expand all 0 data transactions

Request headers

Response headers

Redirect headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Verdicts & Comments Add Verdict or Comment

8 JavaScript Global Variables

1 Cookies

Security Headers

Indicators

crawler.ninja Open in urlscan Pro
2606:4700:3030::681c:1a21 Public Scan

Screenshot
Live screenshot

Full Image

14
Requests

100 %
HTTPS

80 %
IPv6

4
Domains

4
Subdomains

4
IPs

2
Countries

169 kB
Transfer

302 kB
Size

1
Cookies

14 HTTP transactions
0 data transactions