urlscan.io logo urlscan.io
SecurityTrails logo

crawler.ninja Open in urlscan Pro
2606:4700:30::681c:1a21  Public Scan

Go To Rescan Add Verdict Report
Submitted URL: http://crawler.ninja/
Effective URL: https://crawler.ninja/
Submission: On November 15 via manual from US
 Behaviour Indicators
Similar DOM Content API
Verdicts

Summary

This website contacted 5 IPs in 2 countries across 4 domains to perform 14 HTTP transactions. The main IP is 2606:4700:30::681c:1a21, located in United States and belongs to CLOUDFLARENET - Cloudflare, Inc., US. The main domain is crawler.ninja.
TLS certificate: Issued by COMODO ECC Domain Validation Secure S... on November 11th 2018. Valid for: 6 months.
This is the only time crawler.ninja was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
1 1 2606:4700:30:... 13335 (CLOUDFLAR...)
5 2606:4700:30:... 13335 (CLOUDFLAR...)
4 2606:4700::68... 13335 (CLOUDFLAR...)
1 2a00:1450:400... 15169 (GOOGLE)
1 2606:4700::68... 13335 (CLOUDFLAR...)
3 2a00:1450:400... 15169 (GOOGLE)
14 5
1    2606:4700:30::681c:1b21 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)
crawler.ninja
5    2606:4700:30::681c:1a21 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)
crawler.ninja
4    2606:4700::6813:c697 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)
cdnjs.cloudflare.com
1    2a00:1450:4001:81a::200a (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
fonts.googleapis.com
1    2606:4700::6813:c497 (United States)

ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US)
cdnjs.cloudflare.com
3    2a00:1450:4001:81a::2003 (Ireland)

ASN15169 (GOOGLE - Google LLC, US)
fonts.gstatic.com
Apex Domain
Subdomains		 Transfer
6 crawler.ninja
crawler.ninja
8 KB
5 cloudflare.com
cdnjs.cloudflare.com
124 KB
3 gstatic.com
fonts.gstatic.com
38 KB
1 googleapis.com
fonts.googleapis.com
1008 B
14 4
Domain Requested by
6 crawler.ninja 1 redirects crawler.ninja
cdnjs.cloudflare.com
5 cdnjs.cloudflare.com crawler.ninja
3 fonts.gstatic.com
1 fonts.googleapis.com crawler.ninja
14 4
Subject Issuer Validity Valid
sni101751.cloudflaressl.com
COMODO ECC Domain Validation Secure Server CA 2		 2018-11-11 -
2019-05-20		 6 months crt.sh
ssl412106.cloudflaressl.com
COMODO ECC Domain Validation Secure Server CA 2		 2018-09-22 -
2019-03-31		 6 months crt.sh
*.googleapis.com
Google Internet Authority G3		 2018-10-30 -
2019-01-22		 3 months crt.sh
*.google.com
Google Internet Authority G3		 2018-10-30 -
2019-01-22		 3 months crt.sh

This page contains 1 frames:

Primary Page: https://crawler.ninja/
Frame ID: E1EC624B1225F6C3CC490B8014F36FDB
Requests: 14 HTTP requests in this frame

Screenshot
Live screenshot
Full Image

Page URL History Show full URLs

  1. http://crawler.ninja/ HTTP 301
    https://crawler.ninja/ Page URL

Detected technologies

Overall confidence: 100%
Detected patterns
  • headers server /cloudflare/i
Overall confidence: 100%
Detected patterns
  • script /\/([\d.]+)\/jquery(?:\.min)?\.js/i
  • script /jquery.*\.js/i
  • env /^jQuery$/i

Page Statistics

14
Requests

100 %
HTTPS

100 %
IPv6

4
Domains

4
Subdomains

5
IPs

2
Countries

171 kB
Transfer

300 kB
Size

1
Cookies

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

  1. http://crawler.ninja/ HTTP 301
    https://crawler.ninja/ Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

14 HTTP transactions

Resource
Path		 Size
x-fer		 Type
MIME-Type
Primary Request /
crawler.ninja/
Redirect Chain
  • http://crawler.ninja/
  • https://crawler.ninja/
7 KB
3 KB 		Document
General
Check archive.org
Download Go to
Full URL
https://crawler.ninja/
Protocol
H2
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700:30::681c:1a21 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
83acab5185bcbf22a20b909a4c305a66a58f24b17ec4ca68e46ac89ee2b3de47
Security Headers
Name Value
Content-Security-Policy upgrade-insecure-requests
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options DENY
X-Xss-Protection 1; mode=block

Request headers

:method
GET
:authority
crawler.ninja
:scheme
https
:path
/
pragma
no-cache
cache-control
no-cache
upgrade-insecure-requests
1
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8
accept-encoding
gzip, deflate
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

status
200
date
Thu, 15 Nov 2018 17:55:05 GMT
content-type
text/html
set-cookie
__cfduid=d296d3c0207d3ed9be94a3977227e89e71542304505; expires=Fri, 15-Nov-19 17:55:05 GMT; path=/; domain=.crawler.ninja; HttpOnly; Secure
last-modified
Wed, 31 Oct 2018 08:27:01 GMT
strict-transport-security
max-age=31536000; includeSubDomains; preload
content-security-policy
upgrade-insecure-requests
x-frame-options
DENY
x-xss-protection
1; mode=block
x-content-type-options
nosniff
referrer-policy
no-referrer
feature-policy
accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
server
cloudflare
cf-ray
47a396355d8327a4-FRA
content-encoding
gzip

Redirect headers

Date
Thu, 15 Nov 2018 17:55:05 GMT
Transfer-Encoding
chunked
Connection
keep-alive
Cache-Control
max-age=3600
Expires
Thu, 15 Nov 2018 18:55:05 GMT
Location
https://crawler.ninja/
Vary
Accept-Encoding
Server
cloudflare
CF-RAY
47a3963501b6c279-FRA
jquery.min.js
cdnjs.cloudflare.com/ajax/libs/jquery/3.3.1/ 		85 KB
30 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://cdnjs.cloudflare.com/ajax/libs/jquery/3.3.1/jquery.min.js
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700::6813:c697 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
160a426ff2894252cd7cebbdd6d6b7da8fcd319c65b70468f10b6690c45d02ef
Security Headers
Name Value
Strict-Transport-Security max-age=15780000; includeSubDomains

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Origin
https://crawler.ninja

Response headers

date
Thu, 15 Nov 2018 17:55:05 GMT
content-encoding
gzip
vary
Accept-Encoding
cf-cache-status
HIT
status
200
served-in-seconds
0.045
last-modified
Thu, 17 May 2018 09:20:15 GMT
server
cloudflare
etag
W/"5afd494f-1538f"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=15780000; includeSubDomains
content-type
application/javascript
access-control-allow-origin
*
cache-control
public, max-age=30672000
cf-ray
47a39639bcb7c2f1-FRA
expires
Tue, 05 Nov 2019 17:55:05 GMT
skel.min.js
cdnjs.cloudflare.com/ajax/libs/skel/3.0.1/ 		9 KB
3 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://cdnjs.cloudflare.com/ajax/libs/skel/3.0.1/skel.min.js
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700::6813:c697 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
ddef8dbceabe0ffc9e272d6aad6a5890452be9294e08be661e97369d97d7ef81
Security Headers
Name Value
Strict-Transport-Security max-age=15780000; includeSubDomains

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Origin
https://crawler.ninja

Response headers

date
Thu, 15 Nov 2018 17:55:05 GMT
content-encoding
gzip
vary
Accept-Encoding
cf-cache-status
HIT
status
200
served-in-seconds
0.004
last-modified
Thu, 17 May 2018 09:26:46 GMT
server
cloudflare
etag
W/"5afd4ad6-237d"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=15780000; includeSubDomains
content-type
application/javascript
access-control-allow-origin
*
cache-control
public, max-age=30672000
cf-ray
47a39639bcbbc2f1-FRA
expires
Tue, 05 Nov 2019 17:55:05 GMT
skel.min.js
cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/ 		26 KB
8 KB 		Script
General
Check archive.org
Download Go to
Full URL
https://cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/skel.min.js
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700::6813:c697 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
eb181ffc28a96ec71d9406943800255959a97cfcbd579710bd97a3c574847dcc
Security Headers
Name Value
Strict-Transport-Security max-age=15780000; includeSubDomains

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Origin
https://crawler.ninja

Response headers

date
Thu, 15 Nov 2018 17:55:06 GMT
content-encoding
gzip
vary
Accept-Encoding
cf-cache-status
MISS
status
200
served-in-seconds
0.001
last-modified
Thu, 17 May 2018 09:25:37 GMT
server
cloudflare
etag
W/"5afd4a91-69c9"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=15780000; includeSubDomains
content-type
application/javascript
access-control-allow-origin
*
cache-control
public, max-age=30672000
cf-ray
47a39639bcbcc2f1-FRA
expires
Tue, 05 Nov 2019 17:55:06 GMT
init.min.js
crawler.ninja/js/ 		773 B
578 B 		Script
General
Check archive.org
Download Go to
Full URL
https://crawler.ninja/js/init.min.js?v=1.0.0
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
H2
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700:30::681c:1a21 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
85ee4cb0eed37d6f29ba26e6692edfab1aca0818e0133c55beeed4823ac426ba
Security Headers
Name Value
Content-Security-Policy upgrade-insecure-requests
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options DENY
X-Xss-Protection 1; mode=block

Request headers

:path
/js/init.min.js?v=1.0.0
pragma
no-cache
accept-encoding
gzip, deflate
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
accept
*/*
cache-control
no-cache
:authority
crawler.ninja
cookie
__cfduid=d296d3c0207d3ed9be94a3977227e89e71542304505
:scheme
https
:method
GET
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Thu, 15 Nov 2018 17:55:06 GMT
content-encoding
gzip
x-content-type-options
nosniff
cf-cache-status
REVALIDATED
status
200
vary
Accept-Encoding
x-xss-protection
1; mode=block
referrer-policy
no-referrer
last-modified
Tue, 24 Jul 2018 05:57:00 GMT
server
cloudflare
x-frame-options
DENY
etag
W/"5b56bfac-305"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=31536000; includeSubDomains; preload
content-type
application/javascript
cache-control
public, max-age=14400
feature-policy
accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy
upgrade-insecure-requests
cf-ray
47a39639892327a4-FRA
expires
Thu, 15 Nov 2018 21:55:06 GMT
email-decode.min.js
crawler.ninja/cdn-cgi/scripts/5c5dd728/cloudflare-static/ 		1 KB
830 B 		Script
General
Check archive.org
Download Go to
Full URL
https://crawler.ninja/cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
H2
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700:30::681c:1a21 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
2595496fe48df6fcf9b1bc57c29a744c121eb4dd11566466bc13d2e52e6bbcc8
Security Headers
Name Value
X-Frame-Options SAMEORIGIN

Request headers

:path
/cdn-cgi/scripts/5c5dd728/cloudflare-static/email-decode.min.js
pragma
no-cache
accept-encoding
gzip, deflate
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
accept
*/*
cache-control
no-cache
:authority
crawler.ninja
cookie
__cfduid=d296d3c0207d3ed9be94a3977227e89e71542304505
:scheme
https
:method
GET
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Thu, 15 Nov 2018 17:55:05 GMT
content-encoding
gzip
vary
Accept-Encoding
last-modified
Mon, 12 Nov 2018 16:20:09 GMT
server
cloudflare
etag
W/"5be9a839-4d7"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
x-frame-options
SAMEORIGIN
content-type
application/javascript
status
200
cache-control
max-age=172800 public
cf-ray
47a39639892427a4-FRA
expires
Sat, 17 Nov 2018 17:55:05 GMT
style.min.css
crawler.ninja/css/ 		11 KB
3 KB 		Stylesheet
General
Check archive.org
Download Go to
Full URL
https://crawler.ninja/css/style.min.css
Requested by
Host: cdnjs.cloudflare.com
URL: https://cdnjs.cloudflare.com/ajax/libs/skel-layers/2.2.1/skel.min.js
Protocol
H2
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700:30::681c:1a21 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
ff1fd0be432075ee88f261a6a173d5730dfd43e441f2b7c3478c87c014f2a7b2
Security Headers
Name Value
Content-Security-Policy upgrade-insecure-requests
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options DENY
X-Xss-Protection 1; mode=block

Request headers

:path
/css/style.min.css
pragma
no-cache
accept-encoding
gzip, deflate
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
accept
text/css,*/*;q=0.1
cache-control
no-cache
:authority
crawler.ninja
cookie
__cfduid=d296d3c0207d3ed9be94a3977227e89e71542304505
:scheme
https
:method
GET
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Thu, 15 Nov 2018 17:55:07 GMT
content-encoding
gzip
x-content-type-options
nosniff
cf-cache-status
REVALIDATED
status
200
vary
Accept-Encoding
x-xss-protection
1; mode=block
referrer-policy
no-referrer
last-modified
Fri, 20 Jul 2018 14:34:13 GMT
server
cloudflare
x-frame-options
DENY
etag
W/"5b51f2e5-2da1"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=31536000; includeSubDomains; preload
content-type
text/css
cache-control
public, max-age=14400
feature-policy
accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy
upgrade-insecure-requests
cf-ray
47a3963d5cc527a4-FRA
expires
Thu, 15 Nov 2018 21:55:07 GMT
css
fonts.googleapis.com/ 		15 KB
1008 B 		Stylesheet
General
Check archive.org
Download Go to
Full URL
https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2a00:1450:4001:81a::200a , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
ESF /
Resource Hash
ee7442093a8e948e040a1dd2287663f2a0c23ce127a6ea5002c6e59646e87bc3
Security Headers
Name Value
Strict-Transport-Security max-age=604800
X-Frame-Options SAMEORIGIN
X-Xss-Protection 1; mode=block

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

strict-transport-security
max-age=604800
content-encoding
gzip
last-modified
Thu, 15 Nov 2018 17:55:07 GMT
server
ESF
link
<https://fonts.gstatic.com>; rel=preconnect; crossorigin
status
200
date
Thu, 15 Nov 2018 17:55:07 GMT
x-frame-options
SAMEORIGIN
content-type
text/css; charset=utf-8
access-control-allow-origin
*
cache-control
private, max-age=86400, stale-while-revalidate=604800
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
x-xss-protection
1; mode=block
expires
Thu, 15 Nov 2018 17:55:07 GMT
font-awesome.min.css
cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/ 		30 KB
7 KB 		Stylesheet
General
Check archive.org
Download Go to
Full URL
https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css
Requested by
Host: crawler.ninja
URL: https://crawler.ninja/
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700::6813:c497 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
799aeb25cc0373fdee0e1b1db7ad6c2f6a0e058dfadaa3379689f583213190bd
Security Headers
Name Value
Strict-Transport-Security max-age=15780000; includeSubDomains

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Thu, 15 Nov 2018 17:55:07 GMT
content-encoding
gzip
vary
Accept-Encoding
cf-cache-status
HIT
status
200
served-in-seconds
0.001
last-modified
Thu, 17 May 2018 09:19:53 GMT
server
cloudflare
etag
W/"5afd4939-7918"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=15780000; includeSubDomains
content-type
text/css
access-control-allow-origin
*
cache-control
public, max-age=30672000
cf-ray
47a396417883c297-FRA
expires
Tue, 05 Nov 2019 17:55:07 GMT
6xKydSBYKcSV-LCoeQqfX1RYOo3ik4zwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v11/ 		13 KB
13 KB 		Font
General
Check archive.org
Download Go to
Full URL
https://fonts.gstatic.com/s/sourcesanspro/v11/6xKydSBYKcSV-LCoeQqfX1RYOo3ik4zwlxdu3cOWxw.woff2
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2a00:1450:4001:81a::2003 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
sffe /
Resource Hash
435102c6994284c58e63143d49204d6c3876633ffec220cc73ca05ff8e0156c9
Security Headers
Name Value
X-Content-Type-Options nosniff
X-Xss-Protection 1; mode=block

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Referer
https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
Origin
https://crawler.ninja

Response headers

date
Wed, 14 Nov 2018 21:00:19 GMT
x-content-type-options
nosniff
last-modified
Wed, 11 Oct 2017 18:25:43 GMT
server
sffe
age
75288
status
200
content-type
font/woff2
access-control-allow-origin
*
cache-control
public, max-age=31536000
accept-ranges
bytes
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
12968
x-xss-protection
1; mode=block
expires
Thu, 14 Nov 2019 21:00:19 GMT
6xKydSBYKcSV-LCoeQqfX1RYOo3ig4vwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v11/ 		12 KB
12 KB 		Font
General
Check archive.org
Download Go to
Full URL
https://fonts.gstatic.com/s/sourcesanspro/v11/6xKydSBYKcSV-LCoeQqfX1RYOo3ig4vwlxdu3cOWxw.woff2
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2a00:1450:4001:81a::2003 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
sffe /
Resource Hash
a0066433a645f196eb0ece299c86dc27a5c74dbe2cae7ae6d9211c1549a92085
Security Headers
Name Value
X-Content-Type-Options nosniff
X-Xss-Protection 1; mode=block

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Referer
https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
Origin
https://crawler.ninja

Response headers

date
Mon, 12 Nov 2018 23:41:47 GMT
x-content-type-options
nosniff
last-modified
Wed, 11 Oct 2017 18:26:10 GMT
server
sffe
age
238400
status
200
content-type
font/woff2
access-control-allow-origin
*
cache-control
public, max-age=31536000
accept-ranges
bytes
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
12600
x-xss-protection
1; mode=block
expires
Tue, 12 Nov 2019 23:41:47 GMT
banner.svg
crawler.ninja/css/images/ 		1 KB
616 B 		Image
General
Check archive.org
Download Go to Show image
Full URL
https://crawler.ninja/css/images/banner.svg
Protocol
H2
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700:30::681c:1a21 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
c85e578fe01b43c2118025b9d83f7f232ed8ceba5e6d8b8f1a6eafecb5d481b5
Security Headers
Name Value
Content-Security-Policy upgrade-insecure-requests
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options DENY
X-Xss-Protection 1; mode=block

Request headers

:path
/css/images/banner.svg
pragma
no-cache
accept-encoding
gzip, deflate
user-agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
accept
image/webp,image/apng,image/*,*/*;q=0.8
cache-control
no-cache
:authority
crawler.ninja
:scheme
https
:method
GET
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Thu, 15 Nov 2018 17:55:07 GMT
content-encoding
gzip
x-content-type-options
nosniff
cf-cache-status
UPDATING
status
200
vary
Accept-Encoding
x-xss-protection
1; mode=block
referrer-policy
no-referrer
last-modified
Fri, 20 Jul 2018 14:34:07 GMT
server
cloudflare
x-frame-options
DENY
etag
W/"5b51f2df-50d"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=31536000; includeSubDomains; preload
content-type
image/svg+xml
cache-control
public, max-age=14400
feature-policy
accelerometer 'none'; camera 'none'; geolocation 'none'; gyroscope 'none'; magnetometer 'none'; microphone 'none'; payment 'none'; usb 'none'
content-security-policy
upgrade-insecure-requests
set-cookie
__cfduid=ded1ffc04da12046e93488e1e2f8c654a1542304507; expires=Fri, 15-Nov-19 17:55:07 GMT; path=/; domain=.crawler.ninja; HttpOnly; Secure
cf-ray
47a39641a89827a4-FRA
expires
Thu, 15 Nov 2018 21:55:07 GMT
fontawesome-webfont.woff2
cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/fonts/ 		75 KB
76 KB 		Font
General
Check archive.org
Download Go to
Full URL
https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/fonts/fontawesome-webfont.woff2?v=4.7.0
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2606:4700::6813:c697 , United States, ASN13335 (CLOUDFLARENET - Cloudflare, Inc., US),
Reverse DNS
Software
cloudflare /
Resource Hash
2adefcbc041e7d18fcf2d417879dc5a09997aa64d675b7a3c4b6ce33da13f3fe
Security Headers
Name Value
Strict-Transport-Security max-age=15780000; includeSubDomains

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Referer
https://cdnjs.cloudflare.com/ajax/libs/font-awesome/4.7.0/css/font-awesome.min.css
Origin
https://crawler.ninja

Response headers

date
Thu, 15 Nov 2018 17:55:07 GMT
vary
Accept-Encoding
cf-cache-status
HIT
status
200
content-length
77160
served-in-seconds
0.001
last-modified
Thu, 17 May 2018 09:19:12 GMT
server
cloudflare
etag
"5afd4910-12d68"
expect-ct
max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct"
strict-transport-security
max-age=15780000; includeSubDomains
content-type
application/octet-stream
access-control-allow-origin
*
cache-control
public, max-age=30672000
accept-ranges
bytes
cf-ray
47a39641ac0cc2f1-FRA
expires
Tue, 05 Nov 2019 17:55:07 GMT
6xKydSBYKcSV-LCoeQqfX1RYOo3i54rwlxdu3cOWxw.woff2
fonts.gstatic.com/s/sourcesanspro/v11/ 		13 KB
13 KB 		Font
General
Check archive.org
Download Go to
Full URL
https://fonts.gstatic.com/s/sourcesanspro/v11/6xKydSBYKcSV-LCoeQqfX1RYOo3i54rwlxdu3cOWxw.woff2
Protocol
SPDY
Security
TLS 1.2, ECDHE_ECDSA, AES_128_GCM
Server
2a00:1450:4001:81a::2003 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
sffe /
Resource Hash
4a58441133d85539974e4b136c25eaa5512ac1b018d4f6d53124a08c6f19b55e
Security Headers
Name Value
X-Content-Type-Options nosniff
X-Xss-Protection 1; mode=block

Request headers

User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Referer
https://fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700,900
Origin
https://crawler.ninja

Response headers

date
Wed, 14 Nov 2018 14:38:19 GMT
x-content-type-options
nosniff
last-modified
Wed, 11 Oct 2017 18:25:50 GMT
server
sffe
age
98208
status
200
content-type
font/woff2
access-control-allow-origin
*
cache-control
public, max-age=31536000
accept-ranges
bytes
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
12916
x-xss-protection
1; mode=block
expires
Thu, 14 Nov 2019 14:38:19 GMT

Verdicts & Comments Add Verdict or Comment

4 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

function| $ function| jQuery object| skel function| onorientationchange

1 Cookies

Domain/Path Name / Value
.crawler.ninja/ Name: __cfduid
Value: ded1ffc04da12046e93488e1e2f8c654a1542304507

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header Value
Content-Security-Policy upgrade-insecure-requests
Strict-Transport-Security max-age=31536000; includeSubDomains; preload
X-Content-Type-Options nosniff
X-Frame-Options DENY
X-Xss-Protection 1; mode=block