crawler.ninja
Open in
urlscan Pro
2606:4700:3030::681c:1a21
Public Scan
Submission: On June 29 via manual from US
Summary
TLS certificate: Issued by CloudFlare Inc ECC CA-2 on February 5th 2020. Valid for: 8 months.
This is the only time crawler.ninja was scanned on urlscan.io!
urlscan.io Verdict: No classification
Domain & IP information
| IP Address | AS Autonomous System | ||
|---|---|---|---|
| 1 | 2606:4700:303... 2606:4700:3030::681c:1a21 | 13335 (CLOUDFLAR...) (CLOUDFLARENET) | |
| 1 | 1 |
| Apex Domain Subdomains |
Transfer | |
|---|---|---|
| 1 |
crawler.ninja
crawler.ninja |
922 KB |
| 1 | 1 |
| Domain | Requested by | |
|---|---|---|
| 1 | crawler.ninja | |
| 1 | 1 |
This site contains no links.
| Subject Issuer | Validity | Valid | |
|---|---|---|---|
| sni.cloudflaressl.com CloudFlare Inc ECC CA-2 |
2020-02-05 - 2020-10-09 |
8 months | crt.sh |
This page contains 1 frames:
Primary Page:
https://crawler.ninja/files/xxp-sites.txt
Frame ID: 7B1B79FDDC3AEDFDEE0A590B71C102ED
Requests: 1 HTTP requests in this frame
Screenshot
Detected technologies
CloudFlare
(CDN)
Expand
Detected patterns
- headers server /^cloudflare$/i
Page Statistics
0 Outgoing links
These are links going to different origins than the main page.
Redirected requests
There were HTTP redirect chains for the following requests:
1 HTTP transactions
| Method Protocol |
Resource Path |
Size x-fer |
Type MIME-Type |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
GET H2 |
Primary Request
xxp-sites.txt
crawler.ninja/files/ |
2 MB 922 KB |
Document
text/plain |
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
General
Request headers
Response headers
|
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Verdicts & Comments Add Verdict or Comment
2 JavaScript Global Variables
These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.
object| onformdata object| onpointerrawupdate1 Cookies
Cookies are little pieces of information stored in the browser of a user. Whenever a user visits the site again, he will also send his cookie values, thus allowing the website to re-identify him even if he changed locations. This is how permanent logins work.
| Domain/Path | Expires | Name / Value |
|---|---|---|
| .crawler.ninja/ | Name: __cfduid Value: d7f8b48bf2e01932f1245b8aba889ad561593450659 |
Security Headers
This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page
| Header | Value |
|---|---|
| Content-Security-Policy | upgrade-insecure-requests |
| Strict-Transport-Security | max-age=31536000; includeSubDomains; preload |
| X-Content-Type-Options | nosniff |
| X-Frame-Options | DENY |
| X-Xss-Protection | 1; mode=block |
Indicators
This is a term in the security industry to describe indicators such as IPs, Domains, Hashes, etc. This does not imply that any of these indicate malicious activity.
crawler.ninja
2606:4700:3030::681c:1a21
9da769796b35345b757f0207ae46dbe3f0fce15f80036e6d87fad5652759133d