Submitted URL: http://metacrawler.com/
Effective URL: http://www.metacrawler.com/
Submission: On September 21 via api from CZ

Summary

This website contacted 4 IPs in 2 countries across 3 domains to perform 4 HTTP transactions. The main IP is 52.213.40.66, located in Dublin, Ireland and belongs to AMAZON-02 - Amazon.com, Inc., US. The main domain is www.metacrawler.com.
This is the only time www.metacrawler.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

IP Address AS Autonomous System
1 1 52.216.129.130 16509 (AMAZON-02)
1 52.213.40.66 16509 (AMAZON-02)
1 2a00:1450:400... 15169 (GOOGLE)
2 2a00:1450:400... 15169 (GOOGLE)
4 4
Domain Requested by
2 www.google-analytics.com www.googletagmanager.com
1 www.googletagmanager.com www.metacrawler.com
1 www.metacrawler.com
1 metacrawler.com 1 redirects
4 4

This site contains links to these domains. Also see Links.

Domain
www.infospace.com
Subject Issuer Validity Valid
*.google-analytics.com
Google Internet Authority G3
2018-08-28 -
2018-11-20
3 months crt.sh

This page contains 1 frames:

Primary Page: http://www.metacrawler.com/
Frame ID: 718AB4257C23B32C52369AEEF7C5509C
Requests: 6 HTTP requests in this frame

Screenshot


Page URL History Show full URLs

  1. http://metacrawler.com/ HTTP 301
    http://www.metacrawler.com/ Page URL

Detected technologies

Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i

Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i

Overall confidence: 100%
Detected patterns
  • headers server /openresty(?:\/([\d.]+))?/i

Overall confidence: 100%
Detected patterns
  • env /^gaGlobal$/i

Overall confidence: 100%
Detected patterns
  • env /^google_tag_manager$/i

Page Statistics

4
Requests

75 %
HTTPS

50 %
IPv6

3
Domains

4
Subdomains

4
IPs

2
Countries

50 kB
Transfer

135 kB
Size

2
Cookies

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

  1. http://metacrawler.com/ HTTP 301
    http://www.metacrawler.com/ Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

4 HTTP transactions

Resource
Path
Size
x-fer
Type
MIME-Type
Primary Request /
www.metacrawler.com/
Redirect Chain
  • http://metacrawler.com/
  • http://www.metacrawler.com/
15 KB
7 KB
Document
General
Full URL
http://www.metacrawler.com/
Protocol
HTTP/1.1
Server
52.213.40.66 Dublin, Ireland, ASN16509 (AMAZON-02 - Amazon.com, Inc., US),
Reverse DNS
ec2-52-213-40-66.eu-west-1.compute.amazonaws.com
Software
openresty/1.11.2.2 /
Resource Hash
eb28657f20c2c611c7bc7850be37d8d366166995c5a4eca2d8b5a3ba8a72d001

Request headers

Host
www.metacrawler.com
Connection
keep-alive
Pragma
no-cache
Cache-Control
no-cache
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36
Accept
text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8
Accept-Encoding
gzip, deflate
Upgrade-Insecure-Requests
1
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

Content-Encoding
gzip
Content-Type
text/html; charset=utf-8
Date
Fri, 21 Sep 2018 15:56:35 GMT
Server
openresty/1.11.2.2
Vary
Accept-Encoding
Content-Length
6858
Connection
keep-alive

Redirect headers

x-amz-id-2
jaBnsxnwAMmwPGrS8YMVJfDYOUFQCvff7QasEQkJHZwK7Gf8ao1l3vjk1o8Ne+1kmPubUbjcuTM=
x-amz-request-id
EE6DD956DFCB986F
Date
Fri, 21 Sep 2018 15:56:35 GMT
Location
http://www.metacrawler.com/
Content-Length
0
Server
AmazonS3
truncated
/
4 KB
0
Image
General
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
748131dfc543c1943cff964d37ce92f00770cc017fca729bd0879441e9c2f193

Request headers

Response headers

Access-Control-Allow-Origin
*
Content-Type
image/svg+xml;charset=utf-8
js
www.googletagmanager.com/gtag/
77 KB
28 KB
Script
General
Full URL
https://www.googletagmanager.com/gtag/js?id=UA-123175321-1
Requested by
Host: www.metacrawler.com
URL: http://www.metacrawler.com/
Protocol
SPDY
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:820::2008 , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
Google Tag Manager (scaffolding) /
Resource Hash
7f82a9feb0cb3d49a7d01b7dc2003e70ad1f62193112a3ed22cc75c5ca4285cc
Security Headers
Name Value
X-Xss-Protection 1; mode=block

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

date
Fri, 21 Sep 2018 15:56:35 GMT
content-encoding
gzip
server
Google Tag Manager (scaffolding)
access-control-allow-headers
Cache-Control
status
200
vary
Accept-Encoding
content-type
application/javascript; charset=UTF-8
access-control-allow-origin
http://www.googletagmanager.com
cache-control
private, max-age=900
access-control-allow-credentials
true
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
28173
x-xss-protection
1; mode=block
expires
Fri, 21 Sep 2018 15:56:35 GMT
truncated
/
469 B
0
Image
General
Full URL
data:truncated
Protocol
DATA
Server
-, , ASN (),
Reverse DNS
Software
/
Resource Hash
ef49e9a1d79a2e7c98976fa2c84fe5dfe0ce3f05fedfab07c4d900765041d1de

Request headers

Response headers

Access-Control-Allow-Origin
*
Content-Type
image/svg+xml;charset=utf-8
analytics.js
www.google-analytics.com/
39 KB
16 KB
Script
General
Full URL
https://www.google-analytics.com/analytics.js
Requested by
Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=UA-123175321-1
Protocol
SPDY
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:820::200e , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
Golfe2 /
Resource Hash
ed17a6e7532cc3065f9fbd8f607dfd30e09b4531ada9f7cb5732a2bf6cf6744c
Security Headers
Name Value
Strict-Transport-Security max-age=10886400; includeSubDomains; preload
X-Content-Type-Options nosniff

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

strict-transport-security
max-age=10886400; includeSubDomains; preload
content-encoding
gzip
x-content-type-options
nosniff
last-modified
Thu, 13 Sep 2018 23:12:19 GMT
server
Golfe2
age
1714
date
Fri, 21 Sep 2018 15:28:01 GMT
vary
Accept-Encoding
content-type
text/javascript
status
200
cache-control
public, max-age=7200
timing-allow-origin
*
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
16173
expires
Fri, 21 Sep 2018 17:28:01 GMT
collect
www.google-analytics.com/r/
35 B
101 B
Image
General
Full URL
https://www.google-analytics.com/r/collect?v=1&_v=j69&a=1397016773&t=pageview&_s=1&dl=http%3A%2F%2Fwww.metacrawler.com%2F&ul=en-us&de=UTF-8&dt=Metacrawler&sd=24-bit&sr=1600x1200&vp=1600x1200&je=0&_u=IEBAAUAB~&jid=1611795315&gjid=618267215&cid=2135794038.1537545395&tid=UA-123175321-1&_gid=633773726.1537545395&_r=1&gtm=u9h&z=656664021
Protocol
SPDY
Security
TLS 1.2, ECDHE_RSA, AES_128_GCM
Server
2a00:1450:4001:820::200e , Ireland, ASN15169 (GOOGLE - Google LLC, US),
Reverse DNS
Software
Golfe2 /
Resource Hash
8337212354871836e6763a41e615916c89bac5b3f1f0adf60ba43c7c806e1015
Security Headers
Name Value
X-Content-Type-Options nosniff

Request headers

Referer
http://www.metacrawler.com/
User-Agent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_13_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.87 Safari/537.36

Response headers

pragma
no-cache
date
Fri, 21 Sep 2018 15:56:35 GMT
x-content-type-options
nosniff
last-modified
Sun, 17 May 1998 03:00:00 GMT
server
Golfe2
status
200
content-type
image/gif
access-control-allow-origin
*
cache-control
no-cache, no-store, must-revalidate
alt-svc
quic=":443"; ma=2592000; v="44,43,39,35"
content-length
35
expires
Fri, 01 Jan 1990 00:00:00 GMT

Verdicts & Comments Add Verdict or Comment

10 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

function| gtag object| dataLayer object| google_tag_manager string| GoogleAnalyticsObject function| ga object| google_tag_data object| gaplugins object| sa object| gaGlobal object| gaData

2 Cookies

Domain/Path Name / Value
.metacrawler.com/ Name: _gid
Value: GA1.2.633773726.1537545395
.metacrawler.com/ Name: _ga
Value: GA1.2.2135794038.1537545395