www.searchenginejournal.com Open in urlscan Pro
148.251.128.81 Public Scan

Go To Rescan
Add Verdict Report

Submitted URL:
https://www.searchenginejournal.com/x-robots-tag-simple-alternate-robots-txt-meta-tag/67138/
Effective URL:
https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Submission: On August 31 via api (August 31st 2023, 4:20:46 pm UTC) from GB — Scanned from GB

Summary HTTP 158 Redirects Links 31 Behaviour Indicators

Summary

This website contacted 35 IPs in 5 countries across 28 domains to perform 158 HTTP transactions. The main IP is 148.251.128.81, located in Falkenstein, Germany and belongs to HETZNER-AS, DE. The main domain is www.searchenginejournal.com. The Cisco Umbrella rank of the primary domain is 164339.
TLS certificate: Issued by R3 on August 17th 2023. Valid for: 3 months.

This is the only time www.searchenginejournal.com was scanned on urlscan.io!

urlscan.io Verdict: No classification

Domain & IP information

	IP Address	AS Autonomous System
2 90	148.251.128.81 148.251.128.81	24940 (HETZNER-AS) (HETZNER-AS)
9	2606:4700:e2:... 2606:4700:e2::ac40:8d0b	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	2606:4700:e4:... 2606:4700:e4::ac40:a40e	13335 (CLOUDFLAR...) (CLOUDFLARENET)
2	2a00:1450:400... 2a00:1450:4001:827::2002	15169 (GOOGLE) (GOOGLE)
3	52.222.208.154 52.222.208.154	16509 (AMAZON-02) (AMAZON-02)
1	2606:4700:20:... 2606:4700:20::ac43:4686	13335 (CLOUDFLAR...) (CLOUDFLARENET)
3	130.211.23.194 130.211.23.194	15169 (GOOGLE) (GOOGLE)
2	2606:4700:20:... 2606:4700:20::681a:246	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	142.250.185.198 142.250.185.198	15169 (GOOGLE) (GOOGLE)
1	13.32.99.97 13.32.99.97	16509 (AMAZON-02) (AMAZON-02)
2	2a03:2880:f08... 2a03:2880:f083:100:face:b00c:0:3	32934 (FACEBOOK) (FACEBOOK)
1	143.204.98.71 143.204.98.71	16509 (AMAZON-02) (AMAZON-02)
1	23.209.239.88 23.209.239.88	16625 (AKAMAI-AS) (AKAMAI-AS)
1	18.66.97.9 18.66.97.9	16509 (AMAZON-02) (AMAZON-02)
1	2606:4700:10:... 2606:4700:10::6816:34ad	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	2606:4700:10:... 2606:4700:10::ac43:266a	13335 (CLOUDFLAR...) (CLOUDFLARENET)
6	2a00:1450:400... 2a00:1450:4001:828::2008	15169 (GOOGLE) (GOOGLE)
2	2a02:26f0:480... 2a02:26f0:480:f::213:7edd	20940 (AKAMAI-ASN1) (AKAMAI-ASN1)
3	2606:4700:10:... 2606:4700:10::6816:445	13335 (CLOUDFLAR...) (CLOUDFLARENET)
1	34.252.126.23 34.252.126.23	16509 (AMAZON-02) (AMAZON-02)
1	13.32.99.35 13.32.99.35	16509 (AMAZON-02) (AMAZON-02)
2	2a03:2880:f17... 2a03:2880:f177:185:face:b00c:0:25de	32934 (FACEBOOK) (FACEBOOK)
1	146.75.120.157 146.75.120.157	54113 (FASTLY) (FASTLY)
3	2600:9000:20e... 2600:9000:20eb:e800:2:53b2:240:93a1	16509 (AMAZON-02) (AMAZON-02)
4 4	2620:1ec:21::14 2620:1ec:21::14	8068 (MICROSOFT...) (MICROSOFT-CORP-MSN-AS-BLOCK)
1	13.107.42.14 13.107.42.14	8068 (MICROSOFT...) (MICROSOFT-CORP-MSN-AS-BLOCK)
1	2a00:1450:400... 2a00:1450:4001:829::2002	15169 (GOOGLE) (GOOGLE)
1	2600:9000:225... 2600:9000:2250:2400:4:d7e1:700:93a1	16509 (AMAZON-02) (AMAZON-02)
3	104.244.42.69 104.244.42.69	13414 (TWITTER) (TWITTER)
3	104.244.42.67 104.244.42.67	13414 (TWITTER) (TWITTER)
5	2001:4860:480... 2001:4860:4802:34::36	15169 (GOOGLE) (GOOGLE)
2	2a00:1450:400... 2a00:1450:400c:c02::9b	15169 (GOOGLE) (GOOGLE)
3	2a00:1450:400... 2a00:1450:4001:806::2003	15169 (GOOGLE) (GOOGLE)
1	2a00:1450:400... 2a00:1450:4001:829::2004	15169 (GOOGLE) (GOOGLE)
1	18.66.112.30 18.66.112.30	16509 (AMAZON-02) (AMAZON-02)
158	35

90 148.251.128.81 (Falkenstein, Germany) 2 redirects

ASN24940 (HETZNER-AS, DE)
PTR: edge.presslabs.net

www.searchenginejournal.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

9 2606:4700:e2::ac40:8d0b (United States)

ASN13335 (CLOUDFLARENET, US)

cmp.uniconsent.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:e4::ac40:a40e (United States)

ASN13335 (CLOUDFLARENET, US)

yne8nhtpw4pmzzo2a.ay.delivery	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:4001:827::2002 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

securepubads.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 52.222.208.154 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-52-222-208-154.fra56.r.cloudfront.net

c.amazon-adsystem.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:20::ac43:4686 (United States)

ASN13335 (CLOUDFLARENET, US)

btloader.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 130.211.23.194 (Kansas City, United States)

ASN15169 (GOOGLE, US)
PTR: 194.23.211.130.bc.googleusercontent.com

api.btloader.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2606:4700:20::681a:246 (United States)

ASN13335 (CLOUDFLARENET, US)

ad-delivery.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 142.250.185.198 (United States)

ASN15169 (GOOGLE, US)
PTR: fra16s52-in-f6.1e100.net

ad.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 13.32.99.97 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-13-32-99-97.fra60.r.cloudfront.net

openfpcdn.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a03:2880:f083:100:face:b00c:0:3 (Frankfurt am Main, Germany)

ASN32934 (FACEBOOK, US)

connect.facebook.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 143.204.98.71 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-143-204-98-71.fra50.r.cloudfront.net

ats.rlcdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 23.209.239.88 (Schiphol, Netherlands)

ASN16625 (AKAMAI-AS, US)
PTR: a23-209-239-88.deploy.static.akamaitechnologies.com

secure.cdn.fastclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.66.97.9 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-18-66-97-9.fra56.r.cloudfront.net

tags.crwdcntrl.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:10::6816:34ad (United States)

ASN13335 (CLOUDFLARENET, US)

cdn.hadronid.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2606:4700:10::ac43:266a (United States)

ASN13335 (CLOUDFLARENET, US)

cdn.id5-sync.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

6 2a00:1450:4001:828::2008 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.googletagmanager.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a02:26f0:480:f::213:7edd (Frankfurt am Main, Germany)

ASN20940 (AKAMAI-ASN1, NL)

snap.licdn.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2606:4700:10::6816:445 (United States)

ASN13335 (CLOUDFLARENET, US)

id.hadron.ad.gt	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
a.ad.gt	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 34.252.126.23 (Dublin, Ireland)

ASN16509 (AMAZON-02, US)
PTR: ec2-34-252-126-23.eu-west-1.compute.amazonaws.com

bcp.crwdcntrl.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 13.32.99.35 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-13-32-99-35.fra60.r.cloudfront.net

geo.privacymanager.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a03:2880:f177:185:face:b00c:0:25de (Frankfurt am Main, Germany)

ASN32934 (FACEBOOK, US)

www.facebook.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 146.75.120.157 (Frankfurt am Main, Germany)

ASN54113 (FASTLY, US)

static.ads-twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2600:9000:20eb:e800:2:53b2:240:93a1 (United States)

ASN16509 (AMAZON-02, US)

cdn.linkedin.oribi.io	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

4 2620:1ec:21::14 (United States) 4 redirects

ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK, US)

px.ads.linkedin.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
www.linkedin.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 13.107.42.14 (United States)

ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK, US)

px4.ads.linkedin.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:829::2002 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

googleads.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2600:9000:2250:2400:4:d7e1:700:93a1 (United States)

ASN16509 (AMAZON-02, US)

sc.lfeeder.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 104.244.42.69 (United States)

ASN13414 (TWITTER, US)

t.co	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 104.244.42.67 (United States)

ASN13414 (TWITTER, US)

analytics.twitter.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

5 2001:4860:4802:34::36 (United States)

ASN15169 (GOOGLE, US)

region1.google-analytics.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools
region1.analytics.google.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

2 2a00:1450:400c:c02::9b (Brussels, Belgium)

ASN15169 (GOOGLE, US)

stats.g.doubleclick.net	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

3 2a00:1450:4001:806::2003 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.google.co.uk	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 2a00:1450:4001:829::2004 (Frankfurt am Main, Germany)

ASN15169 (GOOGLE, US)

www.google.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

1 18.66.112.30 (United States)

ASN16509 (AMAZON-02, US)
PTR: server-18-66-112-30.fra56.r.cloudfront.net

tr.lfeeder.com	Domain lookup VirusTotal SecurityTrails crt.sh Censys Domaintools

	Apex Domain Subdomains	Transfer
90	searchenginejournal.com 2 redirects www.searchenginejournal.com — Cisco Umbrella Rank: 164339	2 MB
9	uniconsent.com cmp.uniconsent.com — Cisco Umbrella Rank: 27097	145 KB
6	googletagmanager.com www.googletagmanager.com — Cisco Umbrella Rank: 47	512 KB
6	doubleclick.net securepubads.g.doubleclick.net — Cisco Umbrella Rank: 203 ad.doubleclick.net — Cisco Umbrella Rank: 173 googleads.g.doubleclick.net — Cisco Umbrella Rank: 40 stats.g.doubleclick.net — Cisco Umbrella Rank: 87	158 KB
5	linkedin.com 4 redirects px.ads.linkedin.com — Cisco Umbrella Rank: 365 www.linkedin.com — Cisco Umbrella Rank: 625 px4.ads.linkedin.com — Cisco Umbrella Rank: 6371	5 KB
4	btloader.com btloader.com — Cisco Umbrella Rank: 897 api.btloader.com — Cisco Umbrella Rank: 1014	7 KB
3	google.co.uk www.google.co.uk — Cisco Umbrella Rank: 4129	669 B
3	google.com region1.analytics.google.com — Cisco Umbrella Rank: 3238 www.google.com — Cisco Umbrella Rank: 2	526 B
3	google-analytics.com region1.google-analytics.com — Cisco Umbrella Rank: 2547	325 B
3	twitter.com analytics.twitter.com — Cisco Umbrella Rank: 742	2 KB
3	t.co t.co — Cisco Umbrella Rank: 577	778 B
3	oribi.io cdn.linkedin.oribi.io — Cisco Umbrella Rank: 881	1 KB
3	ad.gt id.hadron.ad.gt — Cisco Umbrella Rank: 1772 a.ad.gt — Cisco Umbrella Rank: 2369	4 KB
3	amazon-adsystem.com c.amazon-adsystem.com — Cisco Umbrella Rank: 327	67 KB
2	lfeeder.com sc.lfeeder.com — Cisco Umbrella Rank: 14896 tr.lfeeder.com — Cisco Umbrella Rank: 22685	11 KB
2	facebook.com www.facebook.com — Cisco Umbrella Rank: 109	266 B
2	licdn.com snap.licdn.com — Cisco Umbrella Rank: 760	6 KB
2	crwdcntrl.net tags.crwdcntrl.net — Cisco Umbrella Rank: 809 bcp.crwdcntrl.net — Cisco Umbrella Rank: 776	12 KB
2	facebook.net connect.facebook.net — Cisco Umbrella Rank: 169	87 KB
2	ad-delivery.net ad-delivery.net — Cisco Umbrella Rank: 1048	1 KB
1	ads-twitter.com static.ads-twitter.com — Cisco Umbrella Rank: 758	15 KB
1	privacymanager.io geo.privacymanager.io — Cisco Umbrella Rank: 1934	608 B
1	id5-sync.com cdn.id5-sync.com — Cisco Umbrella Rank: 755	26 KB
1	hadronid.net cdn.hadronid.net — Cisco Umbrella Rank: 1866	10 KB
1	fastclick.net secure.cdn.fastclick.net — Cisco Umbrella Rank: 1190	17 KB
1	rlcdn.com ats.rlcdn.com — Cisco Umbrella Rank: 3550	78 KB
1	openfpcdn.io openfpcdn.io — Cisco Umbrella Rank: 18564	5 KB
1	ay.delivery yne8nhtpw4pmzzo2a.ay.delivery	27 KB
158	28

	Domain	Requested by
90	www.searchenginejournal.com	2 redirects www.searchenginejournal.com
9	cmp.uniconsent.com	www.searchenginejournal.com cmp.uniconsent.com
6	www.googletagmanager.com	www.searchenginejournal.com www.googletagmanager.com
3	www.google.co.uk
3	region1.google-analytics.com	www.googletagmanager.com
3	analytics.twitter.com
3	t.co
3	px.ads.linkedin.com	3 redirects
3	cdn.linkedin.oribi.io	snap.licdn.com
3	api.btloader.com	btloader.com
3	c.amazon-adsystem.com	www.searchenginejournal.com c.amazon-adsystem.com
2	stats.g.doubleclick.net	www.googletagmanager.com
2	region1.analytics.google.com	www.googletagmanager.com
2	www.facebook.com
2	id.hadron.ad.gt	cdn.hadronid.net
2	snap.licdn.com	www.searchenginejournal.com snap.licdn.com
2	connect.facebook.net	www.searchenginejournal.com connect.facebook.net
2	ad-delivery.net	www.searchenginejournal.com
2	securepubads.g.doubleclick.net	www.searchenginejournal.com securepubads.g.doubleclick.net
1	tr.lfeeder.com
1	www.google.com
1	a.ad.gt	cdn.hadronid.net
1	sc.lfeeder.com	www.searchenginejournal.com
1	googleads.g.doubleclick.net	www.googletagmanager.com
1	px4.ads.linkedin.com
1	www.linkedin.com	1 redirects
1	static.ads-twitter.com	www.searchenginejournal.com
1	geo.privacymanager.io	ats.rlcdn.com
1	bcp.crwdcntrl.net	tags.crwdcntrl.net
1	cdn.id5-sync.com	www.searchenginejournal.com
1	cdn.hadronid.net	www.searchenginejournal.com
1	tags.crwdcntrl.net	www.searchenginejournal.com
1	secure.cdn.fastclick.net	www.searchenginejournal.com
1	ats.rlcdn.com	www.searchenginejournal.com
1	openfpcdn.io	www.searchenginejournal.com
1	ad.doubleclick.net	www.searchenginejournal.com
1	btloader.com	www.searchenginejournal.com
1	yne8nhtpw4pmzzo2a.ay.delivery	www.searchenginejournal.com
158	38

This site contains links to these domains. Also see Links.

Domain
www.uniconsent.com
shopsej.com
www.linkedin.com
www.facebook.com
www.youtube.com
twitter.com
www.instagram.com
www.reddit.com
www.pinterest.com
seo.chat
rss.searchenginejournal.com
support.google.com
moz.com
webmasters.googleblog.com
ahrefs.com
yoast.com
www.semrush.com
www.bestbuy.com
www.whitecloudelectroniccigarettes.com
www.google.com
developers.google.com
www.leadfeeder.com
www.gsqi.com
wordpress.org
extensions.joomla.org
us16.list-manage.com

Subject Issuer	Validity	Valid
www.searchenginejournal.com R3	`2023-08-17` - `2023-11-15`	3 months	crt.sh
uniconsent.com GTS CA 1P5	`2023-07-15` - `2023-10-13`	3 months	crt.sh
ay.delivery GTS CA 1P5	`2023-08-30` - `2023-11-28`	3 months	crt.sh
*.g.doubleclick.net GTS CA 1C3	`2023-08-07` - `2023-10-30`	3 months	crt.sh
c.amazon-adsystem.com Amazon RSA 2048 M01	`2023-02-28` - `2024-02-17`	a year	crt.sh
sni.cloudflaressl.com Cloudflare Inc ECC CA-3	`2023-07-06` - `2024-07-05`	a year	crt.sh
api.btloader.com GTS CA 1D4	`2023-08-11` - `2023-11-09`	3 months	crt.sh
*.doubleclick.net GTS CA 1C3	`2023-08-07` - `2023-10-30`	3 months	crt.sh
openfpcdn.io Amazon RSA 2048 M01	`2023-01-25` - `2024-02-24`	a year	crt.sh
*.facebook.com DigiCert SHA2 High Assurance Server CA	`2023-06-10` - `2023-09-08`	3 months	crt.sh
*.rlcdn.com Sectigo RSA Domain Validation Secure Server CA	`2023-02-02` - `2024-03-03`	a year	crt.sh
secure.cdn.fastclick.net DigiCert TLS RSA SHA256 2020 CA1	`2022-12-02` - `2023-12-02`	a year	crt.sh
*.crwdcntrl.net Amazon RSA 2048 M01	`2022-11-07` - `2023-12-06`	a year	crt.sh
hadronid.net GTS CA 1P5	`2023-08-07` - `2023-11-05`	3 months	crt.sh
*.google-analytics.com GTS CA 1C3	`2023-08-07` - `2023-10-30`	3 months	crt.sh
snap.licdn.com DigiCert SHA2 Secure Server CA	`2023-02-01` - `2024-01-31`	a year	crt.sh
*.privacymanager.io Amazon RSA 2048 M01	`2023-07-27` - `2024-08-24`	a year	crt.sh
ads-twitter.com DigiCert Global G2 TLS RSA SHA256 2020 CA1	`2023-07-21` - `2024-07-19`	a year	crt.sh
linkedin.oribi.io Amazon RSA 2048 M01	`2023-06-08` - `2024-07-07`	a year	crt.sh
*.lfeeder.com Amazon RSA 2048 M01	`2023-03-22` - `2024-04-19`	a year	crt.sh
t.co DigiCert TLS RSA SHA256 2020 CA1	`2022-11-14` - `2023-11-14`	a year	crt.sh
*.twitter.com DigiCert TLS RSA SHA256 2020 CA1	`2022-10-01` - `2023-10-01`	a year	crt.sh
www.google.co.uk GTS CA 1C3	`2023-08-07` - `2023-10-30`	3 months	crt.sh
www.google.com GTS CA 1C3	`2023-08-07` - `2023-10-30`	3 months	crt.sh

This page contains 3 frames:

Primary Page: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Frame ID: 2F3D167147AFFDEF43882F4C13BA79DF
Requests: 168 HTTP requests in this frame

Frame: https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo
Frame ID: 733DD8F8ABDA30CB0E50D00FDFDFF5F6
Requests: 3 HTTP requests in this frame

Frame: https://www.facebook.com/tr/
Frame ID: 306051F0A08B17AE39849F91783F132A
Requests: 1 HTTP requests in this frame

Screenshot
Live screenshot

Full Image

Page Title

Best Practices for Setting Up Meta Robots Tags & Robots.txt

Page URL History Show full URLs

https://www.searchenginejournal.com/x-robots-tag-simple-alternate-robots-txt-meta-tag/67138/ HTTP 301
https://www.searchenginejournal.com/best-practices-setting-meta-robots-tags-robots-txt/188655/ HTTP 301
https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/ Page URL

Detected technologies

WordPress (CMS) Expand

Overall confidence: 100%
Detected patterns

/wp-(?:content|includes)/

Facebook (Widgets) Expand

Overall confidence: 100%
Detected patterns

//connect\.facebook\.([a-z]+)/[^/]*/[a-z]*\.js

Google Analytics (Analytics) Expand

Overall confidence: 100%
Detected patterns

Google Tag Manager (Tag Managers) Expand

Overall confidence: 100%
Detected patterns

googletagmanager\.com/gtm\.js
googletagmanager\.com/gtag/js

Linkedin Insight Tag (Analytics) Expand

Overall confidence: 100%
Detected patterns

snap\.licdn\.com/li\.lms-analytics/insight\.min\.js

OWL Carousel (Widgets) Expand

Overall confidence: 100%
Detected patterns

owl\.carousel.*\.js

jQuery (JavaScript Libraries) Expand

Overall confidence: 100%
Detected patterns

jquery[.-]([\d.]*\d)[^/]*\.js
jquery.*\.js(?:\?ver(?:sion)?=([\d.]+))?

Page Statistics

158
Requests

99 %
HTTPS

57 %
IPv6

28
Domains

38
Subdomains

35
IPs

5
Countries

2906 kB
Transfer

7065 kB
Size

34
Cookies

31 Outgoing links

These are links going to different origins than the main page.

URL: https://www.uniconsent.com/?utm_source=widget&utm_medium=v2&utm_campaign=cmpui

Search URL Search Domain Scan URL

URL: https://shopsej.com/
Title: ShopSEJ

Search URL Search Domain Scan URL

URL: https://www.linkedin.com/company/search-engine-journal
Title: LinkedIn

Search URL Search Domain Scan URL

URL: https://www.facebook.com/SearchEngineJournal
Title: Facebook

Search URL Search Domain Scan URL

URL: https://www.youtube.com/c/searchenginejournal?sub_confirmation=1
Title: YouTube

Search URL Search Domain Scan URL

URL: https://twitter.com/sejournal
Title: Twitter

Search URL Search Domain Scan URL

URL: https://www.instagram.com/sejournal/
Title: Instagram

Search URL Search Domain Scan URL

URL: https://www.reddit.com/r/SEJ/
Title: Reddit

Search URL Search Domain Scan URL

URL: http://www.pinterest.com/sejournal/
Title: Pinterest

Search URL Search Domain Scan URL

URL: https://seo.chat/@searchenginejournal
Title: Mastodon

Search URL Search Domain Scan URL

URL: https://rss.searchenginejournal.com/
Title: Rss

Search URL Search Domain Scan URL

URL: https://twitter.com/annaleacrowe

Search URL Search Domain Scan URL

URL: https://www.linkedin.com/in/annaleacrowe/

Search URL Search Domain Scan URL

URL: https://support.google.com/webmasters/answer/6062608?hl=en
Title: A robots.txt file

Search URL Search Domain Scan URL

URL: https://moz.com/robots.txt
Title: example

Search URL Search Domain Scan URL

URL: https://webmasters.googleblog.com/2017/01/what-crawl-budget-means-for-googlebot.html
Title: crawl budget

Search URL Search Domain Scan URL

URL: https://ahrefs.com/blog/meta-robots/
Title: common robots.txt directives

Search URL Search Domain Scan URL

URL: https://yoast.com/robots-meta-tags/
Title: Yoast for WordPress

Search URL Search Domain Scan URL

URL: https://moz.com/learn/seo/robots-meta-directives
Title: create your robots.txt file

Search URL Search Domain Scan URL

URL: https://www.semrush.com/robots.txt
Title: example of how a robots.txt

Search URL Search Domain Scan URL

URL: https://www.bestbuy.com/robots.txt
Title: as Best Buy

Search URL Search Domain Scan URL

URL: https://www.whitecloudelectroniccigarettes.com/robots.txt
Title: like I did here with this robots.txt file

Search URL Search Domain Scan URL

URL: https://www.google.com/webmasters/tools/robots-testing-tool?siteUrl=https://www.leadfeeder.com/
Title: use Google’s robots.txt testing tool

Search URL Search Domain Scan URL

URL: https://developers.google.com/search/reference/robots_meta_tag
Title: two types of tags

Search URL Search Domain Scan URL

URL: https://www.leadfeeder.com/thank-you/website-visitor-ebook/
Title: example

Search URL Search Domain Scan URL

URL: https://www.gsqi.com/marketing-blog/magically-moving-meta-robots-tag-seo-danger/
Title: this case study

Search URL Search Domain Scan URL

URL: https://wordpress.org/plugins/meta-tag-manager/
Title: Meta Tags Manager

Search URL Search Domain Scan URL

URL: https://wordpress.org/plugins/ga-meta-tags/
Title: GA Meta Tags

Search URL Search Domain Scan URL

URL: https://extensions.joomla.org/extensions/extension/site-management/seo-a-metadata/easy-frontend-seo/
Title: EFSEO

Search URL Search Domain Scan URL

URL: https://extensions.joomla.org/extensions/extension/site-management/seo-a-metadata/tag-meta/
Title: Tag Meta

Search URL Search Domain Scan URL

URL: https://us16.list-manage.com/subscribe?u=1cb771655710e830ed9f94ecc&id=ee8d223311
Title: this URL

Search URL Search Domain Scan URL

Page URL History

This captures the URL locations of the websites, including HTTP redirects and client-side redirects via JavaScript or Meta fields.

https://www.searchenginejournal.com/x-robots-tag-simple-alternate-robots-txt-meta-tag/67138/ HTTP 301
https://www.searchenginejournal.com/best-practices-setting-meta-robots-tags-robots-txt/188655/ HTTP 301
https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/ Page URL

Redirected requests

There were HTTP redirect chains for the following requests:

Request Chain 141

https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F HTTP 302
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true HTTP 302
https://www.linkedin.com/px/li_sync?redirect=https%3A%2F%2Fpx.ads.linkedin.com%2Fcollect%3Fv%3D2%26fmt%3Djs%26pid%3D2493106%26time%3D1693498841706%26url%3Dhttps%253A%252F%252Fwww.searchenginejournal.com%252Ftechnical-seo%252Fmeta-robots-tags-robots-txt%252F%26cookiesTest%3Dtrue%26liSync%3Dtrue HTTP 302
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync=true HTTP 302
https://px4.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync=true&e_ipv6=AQJPhi4DbnhCkgAAAYpMZZ1mi9p6-8BLZdUVtaeXPrKZ8zvSNbLEt0ALgfG6gm1P3FUU3GU

158 HTTP transactions
15 data transactions

Method
Protocol Status Resource
Path Size
x-fer Time
Latency Type
MIME-Type IP
Location

GET
H2

200

Primary Request / Show response
www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Redirect Chain

https://www.searchenginejournal.com/x-robots-tag-simple-alternate-robots-txt-meta-tag/67138/
https://www.searchenginejournal.com/best-practices-setting-meta-robots-tags-robots-txt/188655/
https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

397 KB
79 KB

48ms
48ms

Document
text/html

148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL

https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),

Reverse DNS

edge.presslabs.net

Software

nginx /

Resource Hash

478e96615c10014582839fa4322b9eb45aba6731060c2315fc793020ecc45312

Security Headers

Name	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Request headers

Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
accept-language: en-GB,en;q=0.9

Response headers

content-encoding: gzip
content-security-policy: upgrade-insecure-requests
content-type: text/html; charset=UTF-8
date: Thu, 31 Aug 2023 16:20:40 GMT
document-policy: force-load-at-top
last-modified: Fri, 08 May 2020 18:14:19 GMT
referrer-policy: strict-origin-when-cross-origin
server: nginx
strict-transport-security: max-age=31536000; preload
vary: Accept, Accept-Encoding, Cookie
x-content-type-options: nosniff
x-frame-options: SAMEORIGIN
x-presslabs-stats: HIT; 0.424s; 15 queries; desktop; ttl 172800s; refresh in 93119s
x-request-id: e3d299759abd10cbf7712b7468511e30
x-xss-protection: 1; mode=block

Redirect headers

cache-control: no-cache, must-revalidate, max-age=0
content-type: text/html; charset=UTF-8
date: Thu, 31 Aug 2023 16:20:40 GMT
expires: Wed, 11 Jan 1984 05:00:00 GMT
location: /technical-seo/meta-robots-tags-robots-txt/
server: nginx
vary: Accept, Accept-Encoding
x-presslabs-stats: MISS; 0.187s; 6 queries; desktop; ttl 7200s; refresh in 7041s
x-redirect-by: redirection
x-request-id: e87d58a50597920df2a49e14ecc2c956

GET
H2 200 inter.woff2
www.searchenginejournal.com/wp-content/themes/sej/fonts/ 37 KB
37 KB 90ms
89ms Font
font/woff2 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/fonts/inter.woff2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 450f3ba4e47ee174bd9692b396f264b907d37d2528f53911760f3d0edb785f7e

Request headers

Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 24 Aug 2023 08:06:16 GMT
server: nginx
etag: "64e70f78-9424"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: font/woff2
cache-control: max-age = 315360000
accept-ranges: bytes
x-cache-groups: assets
content-length: 37924
x-request-id: 70e11710330c7f09258afc508dd998a7
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 lora-italic.woff2
www.searchenginejournal.com/wp-content/themes/sej/fonts/ 38 KB
39 KB 90ms
89ms Font
font/woff2 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/fonts/lora-italic.woff2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 5d55ce9c3ac7a5f37a38813a2deed310abde9e63d0d36912e2e5e59751ca66c7

Request headers

Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 24 Aug 2023 08:06:16 GMT
server: nginx
etag: "64e70f78-9928"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: font/woff2
cache-control: max-age = 315360000
accept-ranges: bytes
x-cache-groups: assets
content-length: 39208
x-request-id: 78e76e4af09f96bebe784f6ad3dc00a8
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 lora-normal.woff2
www.searchenginejournal.com/wp-content/themes/sej/fonts/ 35 KB
35 KB 90ms
89ms Font
font/woff2 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/fonts/lora-normal.woff2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 9f46649ea544819982ea288c6f386dd67d46da0f453f95da542196372b79731e

Request headers

Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 24 Aug 2023 08:06:16 GMT
server: nginx
etag: "64e70f78-8c30"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: font/woff2
cache-control: max-age = 315360000
accept-ranges: bytes
x-cache-groups: assets
content-length: 35888
x-request-id: 78e76e4af09f96bebe784f6ad3dc00a8
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 location.json Show response
www.searchenginejournal.com/ 20 B
160 B 73ms
73ms XHR
application/json 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/location.json
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: d632f1fd8fd7e6f6a9fbbdf2ad865c79432d41f8e203db015dfb473005243d95

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
server: nginx
x-presslabs-stats: desktop
vary: Accept, Accept-Encoding
x-request-id: 26c1db32421d66e1c9d73ec0b2029ea1
content-type: application/json

GET
H2 200 wfs-form-skin.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 58 KB
11 KB 136ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/wfs-form-skin.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 013eec022b83c1f01c2127108b2724d94f43a2c91ac337a3d317632739117ff0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-e692"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 wsf-form-classes.css
www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/ 5 KB
2 KB 137ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/wsf-form-classes.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 360ec0a5e7fd9eb35367277e9257aa6378fedb7bbf0bc53ad8e3886820086b09

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-15e0"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 variables.css
www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/ 1 KB
739 B 137ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/variables.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 9ff3d76471ddf3e6dc85d985ac7911883108c186d71bca9fdaf4524de72ed421

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-440"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 reset.css
www.searchenginejournal.com/wp-content/themes/sej/css/vendor/ 4 KB
2 KB 137ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/vendor/reset.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: eef945f7b56946036572f7b2f4067b0c3c139440720704f39f1e25e7e250a57f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Fri, 18 Aug 2023 11:51:10 GMT
server: nginx
etag: W/"64df5b2e-ec1"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 bootstrap-grid-v2.css
www.searchenginejournal.com/wp-content/themes/sej/css/vendor/ 6 KB
960 B 137ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/vendor/bootstrap-grid-v2.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 494e6ad3ea844634436d169312c020a27761bd7fc0ae20649624296655c41cfb

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-1894"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 typography.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 5 KB
2 KB 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/typography.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 111d4518d77b165368c37669f563a1d435e3766dda9544ae28c7ed965e05afb6

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-1318"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 layout.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 2 KB
1 KB 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/layout.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 0c9fb498a29dd3d10f8a6ade5bfb1b38aa0f91be670eb0c538413963d1bc06ac

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-88c"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 navbar-desktop.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 11 KB
3 KB 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/navbar-desktop.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 4be18a8f3737b5c2ea4c46e00933d3bc636838cdb283cf4b89bfc2d2814d2222

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 23 Aug 2023 16:51:12 GMT
server: nginx
etag: W/"64e63900-2aed"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 buttons.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 3 KB
1 KB 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/buttons.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 63fa00bcc8093c9fc6652d02aebfe2e54e99ebad34954f877bdb51e655bdc5e2

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-a93"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 72888f39a77d1f4f3e40876bc6352ccc
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 inputs.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 4 KB
2 KB 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/inputs.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: c626dabe59f1e78ba16b99eec8c8291f67ce15788b7556911f68b9be562ac5bb

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-f64"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 navbar-more.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 1 KB
774 B 137ms
133ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/navbar-more.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 1d457324cbe10e73b26ccfbbe9b797e6972b85d4ba1419c4ab233b0ec427fcc1

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-484"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 sidebar.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 2 KB
972 B 137ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/sidebar.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 8b9180ed5e3b5e2d1acd5e2215070d59a589eae5de6ccd840e9e700acb71dcec

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-6a1"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 breadcrumbs.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 476 B
551 B 138ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/breadcrumbs.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 8af8ed19513c17a73f34a27b342003a52850988e6aa67c97c808f340d5f09878

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-1dc"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 chapters.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 2 KB
1009 B 138ms
134ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/chapters.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 4fca7e9d2305082e22ac89090f8b7e9488602b6b4ef27dd30c9342f9c36b0c1e

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-7fa"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 faq.css
www.searchenginejournal.com/wp-content/themes/sej/css/pages/ 718 B
598 B 138ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/pages/faq.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 2bc0406454463b7cca251018ae904ae21c02f0e835acd296c5a8229074756245

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-2ce"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 forms.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 0
268 B 138ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/forms.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: "64dd1ecc-0"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
accept-ranges: bytes
x-cache-groups: assets
content-length: 0
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 fancybox.css
www.searchenginejournal.com/wp-content/themes/sej/css/vendor/ 23 KB
6 KB 138ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/vendor/fancybox.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 46e1a5317649fd50f6f2cd67bbb8efb9a176e613d75442987855ba686b7682bf

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-5cd2"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 owl.carousel.css
www.searchenginejournal.com/wp-content/themes/sej/css/vendor/ 3 KB
1 KB 138ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/vendor/owl.carousel.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 1b9d62fca3818f9b4d6fbe625e0b7adeb32c98a9eac289519f6bf7c165571c12

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-c65"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 article.css
www.searchenginejournal.com/wp-content/themes/sej/css/pages/ 20 KB
6 KB 138ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/pages/article.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 382f122a9d53473605b8372e49a31660d0193e38ca95f5e8edd1cc5dcf7ee27e

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Fri, 18 Aug 2023 11:51:10 GMT
server: nginx
etag: W/"64df5b2e-5191"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 fancy-theme.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 3 KB
1 KB 138ms
136ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/fancy-theme.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 57b19a7a79fcf081749d34fdd3a96cbc11419416b760a3be213aaf509097de17

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-a7b"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ifrmae-css.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 722 B
497 B 138ms
136ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/ifrmae-css.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 340a49ba6b22c47b01b4aa9e42bc9b6b75f0a3b7938724ccf9347579cd0a0668

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-2d2"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 share-buttons.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 3 KB
1 KB 138ms
136ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/share-buttons.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: f50db6abd4c6f1298f381d938cee3dbc3fc2efd813723b5cbe62e2b215f036cc

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-aad"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 footer.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 3 KB
1 KB 138ms
136ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/footer.css?ver=6133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 3d8778a246ce2e2adfd3feeb4c8a60007f0c9a8a481503136a6ee80b7269d28e

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-a64"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 429c951a2fc2f21806d4d4acdc60b46a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 global-non-critical.css
www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/ 2 KB
941 B 138ms
137ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/global-non-critical.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 5da4ec024f5d8814b0f272f9e9ba8457e0c1615c7e25a4fda2dcf550eb46efe3

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-60c"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 public.layout.min.css
www.searchenginejournal.com/wp-content/uploads/ws-form/css/public/ 16 KB
2 KB 139ms
137ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/uploads/ws-form/css/public/public.layout.min.css?ver=1689249458
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 6095256b5d03a355c7dd87945ee5022f7a17135e2cba4f28834598cec0b09238

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Thu, 13 Jul 2023 11:57:38 GMT
server: nginx
etag: W/"64afe6b2-3f48"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 utilities.css
www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/ 8 KB
3 KB 139ms
137ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/utilities.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 0769251815f84e36af15c7f3253c7ab8835e9a4f86f8160b9f39552ae40fbd5a

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-1f04"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 classes.css
www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/ 6 KB
2 KB 139ms
137ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/abstracts/classes.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: f44af7fb8b5552625fa13bc43ac178243c267b6f9677a228603e7016fd051b06

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Fri, 18 Aug 2023 11:51:10 GMT
server: nginx
etag: W/"64df5b2e-1721"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 cmp.js Show response
cmp.uniconsent.com/v2/7d36e67838/ 3 KB
1 KB 140ms
58ms Script
application/javascript 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/7d36e67838/cmp.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 1797345cc8bb4b78403623bb9e67dfc3f49f03ae3a237b40149dfb50f1e48f3b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: br
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 67511
x-cache-status: MISS
alt-svc: h3=":443"; ma=86400
last-modified: Sun, 12 Mar 2023 03:11:55 GMT
server: cloudflare
etag: W/"3a93082548e3ff77231b5b39d1c19c67"
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=KFzykY%2F9N66IVD5srKn%2B1Ghtsu4KvMkh8mERa7NpfJvGpVMCPwZooxzmOtoIZhrRZo0BT94Snr6EMB%2FAkv3j9ic%2FGAHRZJffvEtmepHyekR1dYUYBgVSmxRsM7OCZuUrrPERe7%2FFivmqjUljDoKgTo0%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a297e3c2a7b-CDG

GET
H2 200 client-v2.js Show response
yne8nhtpw4pmzzo2a.ay.delivery/ 80 KB
27 KB 141ms
54ms Script
application/javascript 2606:4700:e4::ac40:a40e
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://yne8nhtpw4pmzzo2a.ay.delivery/client-v2.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:e4::ac40:a40e , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 8136d38f63fc0dc0045fc8f16f581ef8bf1b7882c834322cc6216b3f5c1d577d

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: br
cf-cache-status: HIT
last-modified: Mon, 28 Aug 2023 23:07:03 GMT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
age: 85
etag: W/"64ed2897-13f5e"
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=lBY2tQ7GDQAzuoF9xDY47lTwA07kfRqmhEVjlvGnHiXDR3Ysi2H8rCm%2FekheNlDOclU6YO3RwyJTRihM5lwB9ZoEP7pgZBRUdIv%2BRTSZzW2tXe%2BUpDAcx%2BqD3sMRwjEz6wOMwHDp%2Be2UJFzhfOHhu4xWMvpN4HFFv%2FcY9A%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript
cache-control: public, max-age=900, stale-while-revalidate=3600
cf-ray: 7ff69a298de800a6-CDG
alt-svc: h3=":443"; ma=86400

GET
H2 200 gpt.js Show response
securepubads.g.doubleclick.net/tag/js/ 99 KB
29 KB 210ms
124ms Script
text/javascript 2a00:1450:4001:827::2002
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://securepubads.g.doubleclick.net/tag/js/gpt.js

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:827::2002 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

db62c4431217c039c1b55093816e6a09be4e87fe931523f74a9da9c83d497339

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: br
x-content-type-options: nosniff
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
cross-origin-resource-policy: cross-origin
content-disposition: attachment; filename="f.txt"
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 29083
x-xss-protection: 0
server: cafe
etag: 473 / 19600 / 31077497 / config-hash: 511729982952978637
vary: Accept-Encoding
content-type: text/javascript; charset=UTF-8
cache-control: private, max-age=900, stale-while-revalidate=3600
timing-allow-origin: *
expires: Thu, 31 Aug 2023 16:20:40 GMT

GET
H2 200 prebid7-49.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/js/prebid/ 376 KB
120 KB 135ms
132ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/js/prebid/prebid7-49.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 44a9acb685e5eefe17f7dbf12979ca0ad98d742a0c90e8cd7f14eb7e52716fe7

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-5e14b"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 apstag.js Show response
c.amazon-adsystem.com/aax2/ 248 KB
61 KB 587ms
480ms Script
application/javascript 52.222.208.154
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/aax2/apstag.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 52.222.208.154 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-52-222-208-154.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: c2636d239c265a5656677b6ed3f842f55edaf2040281669bcf3d173c8fbf4e3f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
via: 1.1 6b17c6258978715ba0681e1d5589502c.cloudfront.net (CloudFront), 1.1 77ba839b79ec0a8b2031c8a828e7fdfa.cloudfront.net (CloudFront)
last-modified: Thu, 24 Aug 2023 18:15:56 GMT
server: AmazonS3
x-amz-cf-pop: FRA60-P1, FRA56-P3
x-amz-server-side-encryption: AES256
etag: W/"761fb227b5d9333f86d2e976465cc3f4"
vary: Accept-Encoding
x-cache: Miss from cloudfront
content-type: application/javascript
cache-control: max-age=3600
x-amz-cf-id: ErWbifhBtTvxYR3sbZUW-kvxaOrCBUTBPatt3ehcofpAe5WKWglQXw==

GET
H2 200 tag Show response
btloader.com/ 15 KB
7 KB 118ms
41ms Script
application/javascript 2606:4700:20::ac43:4686
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://btloader.com/tag?o=5132149699641344&upapi=true
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:20::ac43:4686 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 14a21fe9566f657b0de58994455d4fb1ebe13048c8bb9fac5c5d6b62c07cf68b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
via: 1.1 google
content-encoding: br
cf-cache-status: HIT
last-modified: Thu, 31 Aug 2023 15:21:23 GMT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
age: 3557
etag: W/"b19ea3351f59f423f531aed07b8f1c97"
vary: Origin, Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=ESuRRnekW1PgXxmqV8GVRtjEM8ItrCGbqrgajfM4Z%2BfQT1ZF56CohCyZ1kjIdYr7npVlO5Zfs4jvzjm3CqXc0wpyP9xkfwjAnNZDaFS9RVbm3ca9GMdtcGSBegVa4SVY4s9HG8wYwhfBuQ%3D%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript
access-control-allow-origin: *
cache-control: public, max-age=300, must-revalidate, stale-if-error=3600, stale-while-revalidate=300
cf-ray: 7ff69a2968527774-LHR

GET
H2 200 hb_js.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/hb/ 36 KB
8 KB 135ms
133ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/hb/hb_js.js?ver=1693418649
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 329bb171b8530032a8731ec39e14a0e80ddef531cc60d68d37cc8f1011bd0f3f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 30 Aug 2023 19:26:18 GMT
server: nginx
etag: W/"64ef97da-8f23"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 observer-lazy-load-a.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/js/ 18 KB
5 KB 135ms
133ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/infinte-scroll/js/observer-lazy-load-a.js?ver=1693419160
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 095002a3d50047f79f593ea4ccfa5dea16ba15155fee61e1a86bf8c44e4805c0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 30 Aug 2023 09:42:57 GMT
server: nginx
etag: W/"64ef0f21-46f7"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 jquery-3.6.1.min.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/jquery/ 88 KB
31 KB 135ms
133ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/jquery/jquery-3.6.1.min.js?ver=1692212939
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: a3cf00c109d907e543bc4f6dbc85eb31068f94515251347e9e57509b52ee3d74

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-15e40"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 print.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 5 KB
2 KB 143ms
142ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/print.css?ver=2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: e75ca65b543408f55b9fa0b19d8a28e21b6d710a5447a25a22cf6b786d428527

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Mon, 28 Aug 2023 10:12:27 GMT
server: nginx
etag: W/"64ec730b-14e0"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 xcs0MhRsfxHG.js Show response
www.searchenginejournal.com/ 91 B
310 B 135ms
134ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/xcs0MhRsfxHG.js?ts=14991
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 25ffc83cc41de6b1008a7a71b61931a10d8a8379c36b32eaa33d2f76135302d7

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
server: nginx
x-presslabs-stats: desktop
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: no-cache
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 01 Jan 1970 00:00:01 GMT

GET
H2 200 pix.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/ga/js/ 2 KB
1 KB 136ms
134ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/ga/js/pix.js?ver=1692893410
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: b4241bbc1b258b28db128b7ba8bc1c063982c7b110f25ab5ae91449e2433d0a8

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Thu, 24 Aug 2023 16:10:10 GMT
server: nginx
etag: W/"64e780e2-85e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 search-engine-journal-1x-63a425d735aa3-sej.webp
www.searchenginejournal.com/wp-content/uploads/2022/12/ 6 KB
6 KB 134ms
132ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2022/12/search-engine-journal-1x-63a425d735aa3-sej.webp
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 98aabe4d6eacbd5bb3bffeeb71a0946e9a7241984ef448a981d8f64618b60453

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 22 Dec 2022 09:39:36 GMT
server: nginx
etag: "63a425d8-18de"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 6366
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 hello-bar.css
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/hello-bar/css/ 2 KB
1 KB 136ms
135ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/hello-bar/css/hello-bar.css?ver=1692212939
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: c02addcf940dcfd73293ccb530238f1f1737d33a6f61f324ef09ad1c69fcf594

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-9bf"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: a92d207f8ce173c71e24451ef47d0094
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 hello.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/hello-bar/js/ 3 KB
1 KB 143ms
142ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/hello-bar/js/hello.js?ver=1693302636
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: d56ddb6d10ce41c10ff7f13b8b651cfea5afaf42a99421d728314cc639abe3fa

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Tue, 29 Aug 2023 09:50:36 GMT
server: nginx
etag: W/"64edbf6c-d88"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ga-prom.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ 3 KB
1 KB 143ms
142ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ga-prom.js?ver=1692212939
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 9a1eb559f60a9f2344882c89cc97365185663d3507382c35d77a30ad5bfda98a

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-d73"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 icons.svg
www.searchenginejournal.com/ 23 KB
10 KB 143ms
142ms Other
image/svg+xml 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/icons.svg?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 53303915256578353cd06340f59654a24cd04b404d2bfc0851bbebc03d946dc1

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-5d66"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/svg+xml
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 nav-bar-168x48-1x-64ec55b8577da-sej.gif
www.searchenginejournal.com/wp-content/uploads/2023/05/ 27 KB
27 KB 142ms
142ms Image
image/gif 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2023/05/nav-bar-168x48-1x-64ec55b8577da-sej.gif
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: e6d37686ce0a609903b11061c8f5a97f4f61e986d84ca1b366e2739a13aca87b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Mon, 28 Aug 2023 08:51:22 GMT
server: nginx
etag: "64ec600a-6a14"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/gif
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 27156
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 top-desktop-970x200-1x-64ec52d1e1767-sej.webp
www.searchenginejournal.com/wp-content/uploads/2023/05/ 23 KB
23 KB 142ms
142ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2023/05/top-desktop-970x200-1x-64ec52d1e1767-sej.webp
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: ddd056ea0784914f17c6730b6fe3b438edc90fb3587c1aedd907ee0f13225d11

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Mon, 28 Aug 2023 07:54:59 GMT
server: nginx
etag: "64ec52d3-5c1e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 23582
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 best-practices-for-setting-up-meta-robots-tags-robots.txt-5e397a5392f8e-760x400.webp
www.searchenginejournal.com/wp-content/uploads/2020/01/ 28 KB
28 KB 141ms
141ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/best-practices-for-setting-up-meta-robots-tags-robots.txt-5e397a5392f8e-760x400.webp
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: daa5cbff105aa4dd98b3982e70a45b7668f394e78b3e5b8a8a2ed470fa83c9c0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Mon, 16 Jan 2023 06:23:59 GMT
server: nginx
etag: "63c4ed7f-7018"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 28696
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
DATA 200
OK truncated
/ 67 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 486dbb49fb36a8b8e7bb750b738fab6a2bd3aee598b3a71d8da405245447dd0f

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 053cb3f560d39447ce5eae1f319e68e76c56c67bcd1727db08c6cd3a480be51f

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: a6333929a02027e96ecf154218e5fc09e7e64e629c4284d98766878a09d93988

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: ea7f8924b70229fe13fe0587bf81b59fa5a235690c936950f09cd0de156e013e

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 69 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 4117699ce11d0dab6c19cf61dd4ca27aaa826d2807c3462a624daa20dae58a95

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 16abe109580561cc0ef661ba3bc4c5c212998d4f4c9cc0e693e3eba57011e907

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: e9dfb181b7284e1d5674c9497da7aa98db42987a389b12f57b344285889bf893

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 38c872afb161a43f9bcfad5edefd2d2ee6583001be855fbee5be6069564523bc

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
H2 200 seo Show response
www.searchenginejournal.com/wp-json/sscats/v2/stext/ Frame 733D 8 KB
3 KB 108ms
108ms Document
text/html 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL

https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),

Reverse DNS

edge.presslabs.net

Software

nginx /

Resource Hash

42d9492da8ce7bf85afd06946f26c71ce280c08974bfdebaa203febd000fdd60

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
accept-language: en-GB,en;q=0.9

Response headers

access-control-allow-headers: Authorization, X-WP-Nonce, Content-Disposition, Content-MD5, Content-Type
access-control-expose-headers: X-WP-Total, X-WP-TotalPages, Link
content-encoding: gzip
content-type: text/html;charset=UTF-8
date: Thu, 31 Aug 2023 16:20:40 GMT
link: <https://www.searchenginejournal.com/wp-json/>; rel="https://api.w.org/"
server: nginx
vary: Accept, Accept-Encoding
x-content-type-options: nosniff
x-presslabs-stats: HIT; desktop
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
x-robots-tag: noindex

GET
H2 200 anna-0015-1-1-5f3edf426b6da-65x65.webp
www.searchenginejournal.com/wp-content/uploads/2020/08/ 4 KB
5 KB 109ms
108ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/08/anna-0015-1-1-5f3edf426b6da-65x65.webp
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 917106b3d05f0bda89390297ea5672b298a0bf21bd494a53ba930c235522dd94

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 20 Aug 2020 20:39:22 GMT
server: nginx
etag: "5f3edf7a-1180"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 4480
x-request-id: 9f0f8ddab6035a4cd755d65b9ac013e5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 9c2c86e88fe2074f9ddbd073add93e47208ae95d2947deb81e4da32c983b01d5

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: fb9cbcc030c3111a1c91b31feab02da45e55a4440b784cb6b4a4f743cd99edf7

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 69 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: a171e64ec4287990b354e03ec80aa0b83e9c01be406cf9af7c232ec40439e7e5

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 70 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 53b4ab18872c599c620b3d329d3894f9c2973d3339b4ca4679e6afd4215a01f0

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
DATA 200
OK truncated
/ 69 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: d7dd0007fc5d64b48c0fd0b26382a8c93b93ca82a9b32a7244cc73f63ba5393c

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
H2 200 icons.svg
www.searchenginejournal.com/ 23 KB
10 KB 99ms
99ms Other
image/svg+xml 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/icons.svg?ver=78
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 53303915256578353cd06340f59654a24cd04b404d2bfc0851bbebc03d946dc1

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-5d66"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/svg+xml
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 5ee7de6efbff8028b64e2990a14ae040
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 content-add.css
www.searchenginejournal.com/wp-content/themes/sej/css/components/ 929 B
752 B 98ms
98ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/css/components/content-add.css?ver=133
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: e98439db943f5748a9bcc5f687bb3b66b3c50f9b77cf3d4eb4ad2fd53aed1258

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-3a1"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: 5ee7de6efbff8028b64e2990a14ae040
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
DATA 200
OK truncated
/ 68 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: 0bb059e797c405edc79fe7bc59a52b17a5a3fd3511adaba3a56a1cf543c973aa

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
H2 200 frontend.min.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/ 3 KB
1 KB 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/frontend.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 272ec4c2207545c671ade6cbabdc91a23409cf238731cb2390e5440c13281e2c

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-c15"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 fancybox.umd.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/vendor/ 139 KB
40 KB 93ms
88ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/vendor/fancybox.umd.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: b81b00bc7e76a7bb3b4c63f58208f092f0dee448ef77b1a117822fa9dbcf0e89

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-22b6e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 owl.carousel.min.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/vendor/ 43 KB
11 KB 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/vendor/owl.carousel.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 1756fb46aa1a7fe26e8c57328db54497ef70236895be1a7160718bb772abe23b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-ad3a"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 gallery-min.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/pages/article/ 2 KB
1018 B 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/pages/article/gallery-min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: ab8f559ef6670cda1ce49b4a2dda28eaefc6f6f384cf9835484569cf89a986bb

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-646"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 instapage.js Show response
www.searchenginejournal.com/wp-content/themes/sej14/js/ 4 KB
2 KB 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej14/js/instapage.js?ver=1692212941
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: c4abf725ca2c888df89bee0a81a50fc7dfc69777cec49ef80ceef97123983f47

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:01 GMT
server: nginx
etag: W/"64dd1ecd-e64"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 cdet.js Show response
www.searchenginejournal.com/wp-content/themes/sej14/js/ 2 KB
1 KB 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej14/js/cdet.js?ver=1692212941
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: e5429ce4c488099db846eb6568ffd7965bca538d9a28cec723bf561c372880b3

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:01 GMT
server: nginx
etag: W/"64dd1ecd-82e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 lazyload.js Show response
www.searchenginejournal.com/wp-content/themes/sej14/js/lib/ 13 KB
5 KB 93ms
89ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej14/js/lib/lazyload.js?ver=1692212941
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 85b0fe439768c208c0b3d9157178b8a1ac48fba8a191a3d8d7f1c3c1dcb1dcbd

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:01 GMT
server: nginx
etag: W/"64dd1ecd-3467"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ga.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/ 5 KB
2 KB 94ms
90ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/ga.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: b13800888b404eb02827c017d56ae6e80c9a3a4d6fa2bec809a3ca261e2ebde1

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-1245"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 sej-new.js Show response
www.searchenginejournal.com/wp-content/themes/sej/js/ 25 KB
8 KB 94ms
90ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/js/sej-new.js?ver=1692893190
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 67e8edd6b472ee4f120a8576233e3954b0735bc261ff1aff11fc0629e1b2d17c

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Thu, 24 Aug 2023 16:06:30 GMT
server: nginx
etag: W/"64e78006-644d"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ws-form.min.js Show response
www.searchenginejournal.com/wp-content/plugins/ws-form-pro/shared/js/ 98 KB
25 KB 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/ws-form-pro/shared/js/ws-form.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: d0928d10c6a9b3d790fc7e11c7899f435f4374ddc31f7fefdd10e1e6e1d55e5d

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-187da"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ws-form-public-checkbox.min.js Show response
www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ 2 KB
1 KB 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ws-form-public-checkbox.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 61be5239a27eb231bc538ab7164a87e579ff695783709cb9f8eafcf71f3b4ccb

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-7ea"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ws-form-public-conditional.min.js Show response
www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ 35 KB
9 KB 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ws-form-public-conditional.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: a5ed5a045a88a29a2a50dcdc411f10ebc4f5bb18df64bfa1fbd1cbd6b0fe1c24

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-8d68"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ws-form-public.min.js Show response
www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ 59 KB
13 KB 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ws-form-public.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 471b6be282f70bd7404c7851171f4c3905a09f63c3d249fae1d36c8d6944fdf4

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-ea69"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 ws-form-public-tracking.min.js Show response
www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ 2 KB
968 B 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/ws-form-pro/public/js/ws-form-public-tracking.min.js?ver=1692212940
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 088a3fdf41602117cac6d3c843c7f89368719632f6e12a37b7a5cc2d16da19ed

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:09:00 GMT
server: nginx
etag: W/"64dd1ecc-6ef"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 disp-txt.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ 1 KB
1 KB 94ms
91ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/disp-txt.js?ver=1693413355
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 3101beb680551391e1b52cf702681807fe88f248ba4c41eeed398ad835f7ac80

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 30 Aug 2023 16:35:55 GMT
server: nginx
etag: W/"64ef6feb-5a8"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: bba13fc950935121dc168fe41584fdca
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 pop-css.css
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ 9 KB
3 KB 91ms
88ms Stylesheet
text/css 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/pop-css.css?ver=1692212939
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 1c72b9e917c02f6a4ea2416520397bc0b6a5f79a553ee092a116a4177e6d19b9

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-231c"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: text/css
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: fb4e6de0e6691eb13cc1a87315064e39
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 disp.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ 9 KB
2 KB 94ms
92ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/disp.js?ver=1693414318
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 4bfeaa13380e6ad01a2461fb050358e9b6a83aef5697c5ec1dd3a1313752bdd5

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 30 Aug 2023 16:51:58 GMT
server: nginx
etag: W/"64ef73ae-22a1"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: bba13fc950935121dc168fe41584fdca
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 pp.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/ 23 KB
5 KB 94ms
92ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/promos/assets/pp.js?ver=1692212939
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 72790a1735404379453c3f2c9f095b3c326f10c6efb14485931bac45075afbb9

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 16 Aug 2023 19:08:59 GMT
server: nginx
etag: W/"64dd1ecb-5b0c"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: bba13fc950935121dc168fe41584fdca
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 misc.js Show response
www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/js/ 7 KB
2 KB 94ms
92ms Script
application/javascript 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/js/misc.js?ver=1693388577
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 0f8b5718fb74df9076bc80ad9c0f85f387438f22989f6e33cbb5853ec96c6cd7

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: gzip
last-modified: Wed, 30 Aug 2023 09:42:57 GMT
server: nginx
etag: W/"64ef0f21-1adf"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: application/javascript
cache-control: max-age = 315360000
x-cache-groups: assets
x-request-id: bba13fc950935121dc168fe41584fdca
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 sej-today-1x-644d47cddc24a-sej.webp
www.searchenginejournal.com/wp-content/uploads/2023/04/ 3 KB
3 KB 81ms
81ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2023/04/sej-today-1x-644d47cddc24a-sej.webp
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 24ae7b9ac5220f301dcfc8032ba2e78994ef99a7d859c7c343c5829259e318af

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Sat, 29 Apr 2023 16:37:34 GMT
server: nginx
etag: "644d47ce-a22"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 2594
x-request-id: bba13fc950935121dc168fe41584fdca
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 204 state Show response
api.btloader.com/mw/ 0
101 B 207ms
134ms Fetch 130.211.23.194
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/mw/state?bt_env=prod
Requested by: Host: btloader.com
URL: https://btloader.com/tag?o=5132149699641344&upapi=true
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN15169 (GOOGLE, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

access-control-allow-origin: *
date: Thu, 31 Aug 2023 16:20:40 GMT
via: 1.1 google
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
vary: Origin

GET
H2 200 px.gif
ad-delivery.net/ 43 B
340 B 122ms
47ms Image
image/gif 2606:4700:20::681a:246
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://ad-delivery.net/px.gif?ch=2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:20::681a:246 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 131473
x-guploader-uploadid: ADPycduc0Kd8pWn6U1lnmRVSo76gZhjXXwkOF0PMtSYadXxRmxSkCq1jfIVbk0nRaNkgc2mNsaKbgyNiOUk7GN8lSjp2FTbWDAe3
x-goog-storage-class: MULTI_REGIONAL
x-goog-metageneration: 5
x-goog-stored-content-encoding: identity
content-length: 43
last-modified: Wed, 05 May 2021 19:25:32 GMT
server: cloudflare
etag: "ad4b0f606e0f8465bc4c4c170b37e1a3"
vary: Accept-Encoding
x-goog-generation: 1620242732037093
content-type: image/gif
access-control-allow-origin: *
x-goog-hash: crc32c=cpEfJQ==, md5=rUsPYG4PhGW8TEwXCzfhow==
access-control-expose-headers: *, Content-Length, Date, Server, Transfer-Encoding, X-GUploader-UploadID, X-Google-Trace
cache-control: public, max-age=86400
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=1mUdzoLPo%2FtXoS8XJc1WmyAOwSsZ%2Bgko3kmIXN66rufFEeBfZmFjuQqiw4S7L75QZEfhHPrszg033KnHHtMORg5rYw9UkRPpfNG0qrJWBQhbXtXQ9i4r%2BXx03vs0plITb5GXXN7H%2F1nYZ0Nwdw%3D%3D"}],"group":"cf-nel","max_age":604800}
x-goog-stored-content-length: 43
accept-ranges: bytes
cf-ray: 7ff69a2a4fa476b3-LHR
expires: Wed, 30 Aug 2023 04:39:56 GMT

GET
H2 200 favicon.ico
ad.doubleclick.net/ 1 KB
571 B 126ms
37ms Image
image/x-icon 142.250.185.198
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://ad.doubleclick.net/favicon.ico?ad=300x250&ad_box_=1&adnet=1&showad=1&size=250x250

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

142.250.185.198 , United States, ASN15169 (GOOGLE, US),

Reverse DNS

fra16s52-in-f6.1e100.net

Software

sffe /

Resource Hash

d961b08e4321250926de6f79087594975fe20ad1518de8f91eb711af5d1a6ef8

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 03:50:50 GMT
content-encoding: gzip
x-content-type-options: nosniff
age: 44990
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 104
x-xss-protection: 0
last-modified: Tue, 08 May 2012 13:08:06 GMT
server: sffe
vary: Accept-Encoding
report-to: {"group":"ads-doubleclick-media","max_age":2592000,"endpoints":[{"url":"https://csp.withgoogle.com/csp/report-to/ads-doubleclick-media"}]}
content-type: image/x-icon
access-control-allow-origin: *
cache-control: public, max-age=86400
accept-ranges: bytes
cross-origin-opener-policy-report-only: same-origin; report-to="ads-doubleclick-media"
expires: Fri, 01 Sep 2023 03:50:50 GMT

GET
H2 200 px.gif
ad-delivery.net/ 43 B
934 B 121ms
46ms Image
image/gif 2606:4700:20::681a:246
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://ad-delivery.net/px.gif?ch=1&e=0.420697082579101
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:20::681a:246 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 131473
x-guploader-uploadid: ADPycduc0Kd8pWn6U1lnmRVSo76gZhjXXwkOF0PMtSYadXxRmxSkCq1jfIVbk0nRaNkgc2mNsaKbgyNiOUk7GN8lSjp2FTbWDAe3
x-goog-storage-class: MULTI_REGIONAL
x-goog-metageneration: 5
x-goog-stored-content-encoding: identity
content-length: 43
last-modified: Wed, 05 May 2021 19:25:32 GMT
server: cloudflare
etag: "ad4b0f606e0f8465bc4c4c170b37e1a3"
vary: Accept-Encoding
x-goog-generation: 1620242732037093
content-type: image/gif
access-control-allow-origin: *
x-goog-hash: crc32c=cpEfJQ==, md5=rUsPYG4PhGW8TEwXCzfhow==
access-control-expose-headers: *, Content-Length, Date, Server, Transfer-Encoding, X-GUploader-UploadID, X-Google-Trace
cache-control: public, max-age=86400
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=jjCvYJb1muVw5fyImXsRayJ%2BYx3Sn0ryKt9DU2lXcXQuHhsMVIUhDE47TckudGUHx%2BLlzl6XQ0Ms2nc6LTJ1HTrLf0g%2FnwZMRVQeEnNJ76az739JaituDnq7DdqmtT60BivPNicBI%2FerFXdZ4A%3D%3D"}],"group":"cf-nel","max_age":604800}
x-goog-stored-content-length: 43
accept-ranges: bytes
cf-ray: 7ff69a2a4fa676b3-LHR
expires: Wed, 30 Aug 2023 04:39:56 GMT

GET
H2 200 inter.woff2
www.searchenginejournal.com/wp-content/themes/sej/fonts/ Frame 733D 37 KB
37 KB 49ms
48ms Font
font/woff2 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://www.searchenginejournal.com/wp-content/themes/sej/fonts/inter.woff2
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 450f3ba4e47ee174bd9692b396f264b907d37d2528f53911760f3d0edb785f7e

Request headers

Referer: https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Thu, 24 Aug 2023 08:06:16 GMT
server: nginx
etag: "64e70f78-9424"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: font/woff2
cache-control: max-age = 315360000
accept-ranges: bytes
x-cache-groups: assets
content-length: 37924
x-request-id: 8583210466fe6b6d15ff583a491bd683
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 pubcon-400x400-1-1-64ee448400cc3-sej.png
www.searchenginejournal.com/wp-content/uploads/2023/08/ Frame 733D 19 KB
19 KB 54ms
53ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2023/08/pubcon-400x400-1-1-64ee448400cc3-sej.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 4b8b01e2db6169d8257d0342cd62b76025e9003ba2e73a0bade425ef6af5b90b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/wp-json/sscats/v2/stext/seo
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Tue, 29 Aug 2023 19:18:29 GMT
server: nginx
etag: "64ee4485-4bea"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 19434
x-request-id: ccf65feb4ece2b07fdfbbe9de6b012d5
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 main.min.js Show response
cmp.uniconsent.com/v2/ 206 KB
50 KB 47ms
46ms Script
application/javascript 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/main.min.js
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/7d36e67838/cmp.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 0a03677a7e255d4d14265e4918f307dee169473d7b8b200ee02935a4104b923c

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: br
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 84347
x-cache-status: MISS
alt-svc: h3=":443"; ma=86400
last-modified: Sat, 01 Jul 2023 20:44:30 GMT
server: cloudflare
etag: W/"501152d449f4d09c82659e22324fcfcd"
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=mjeAIJka2aeZr1BXXqaGri2%2BIONZ%2BlSM%2FKsgGXZlZ%2BZqbfH62UNGD1uPBTPWreWXs4tHNlzXHLiOPs6Cd5p23ihKQ3VoVQDN3Yp3AEbiSWI3mudAYSKJ%2B2dFvXF87js3MrPfuYv9Vo%2B5ZVuwNd3cNzU%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2a789a2a7b-CDG

GET
H2 200 sidebar1x-64d095ca7bfe9-sej.jpg
www.searchenginejournal.com/wp-content/uploads/2023/08/ 5 KB
5 KB 48ms
48ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2023/08/sidebar1x-64d095ca7bfe9-sej.jpg
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: eee8aa7d4074bff36d1654782539f3ba2d29421d11fe2fcdd327d3f5bf750f8e

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Mon, 07 Aug 2023 06:57:14 GMT
server: nginx
etag: "64d095ca-134e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 4942
x-request-id: 06c4859a6cf1b235c7c647974e14ca29
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 robots-txt-file-example-5e31a4d66c64c.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 4 KB
4 KB 55ms
53ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/robots-txt-file-example-5e31a4d66c64c.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: fb19521eeb71c0b7bcdcbf3f457b81aac65f795eb7bda13b4c305b1f23ffa740

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 15:38:47 GMT
server: nginx
etag: "5e31a707-101e"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 4126
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 moz-robots-5e31a4a33399b-480x698.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 68 KB
68 KB 55ms
53ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/moz-robots-5e31a4a33399b-480x698.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 31a87e09bc3fc7ccb2149b418299ecae339b11000c5c0c4f0ff574cbe8b2318d

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 15:39:04 GMT
server: nginx
etag: "5e31a718-11008"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 69640
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 semrush-robots-5e31a53b7359b-480x810.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 39 KB
39 KB 57ms
55ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/semrush-robots-5e31a53b7359b-480x810.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 022c491ef985ac446182294ceb47e595ecdbb537300c51e2ec10fc47387c62f7

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 15:38:31 GMT
server: nginx
etag: "5e31a6f7-9ac6"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 39622
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 webceo-robots-5e31b3b1209b8-480x200.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 15 KB
15 KB 58ms
56ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/webceo-robots-5e31b3b1209b8-480x200.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 0247df6b9220981fc47473c27043ad09602f542a58d563f44ae5a4e91b827329

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:37:35 GMT
server: nginx
etag: "5e31b4cf-3c74"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 15476
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 webceo-robots-5e31b3b1209b8.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 13 KB
13 KB 58ms
57ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/webceo-robots-5e31b3b1209b8.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 28fb91355106692115c5ca2c04cd15b441692c106ed07bd4cd398d14568b8f0f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:37:35 GMT
server: nginx
etag: "5e31b4cf-340c"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 13324
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 mcays-robots-5e31b3c91d769.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 20 KB
20 KB 59ms
57ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/mcays-robots-5e31b3c91d769.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: d888d58ad34eaf2c795253ddc129cd07e5d7904bf6583614a4338e21901cd4c0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:37:12 GMT
server: nginx
etag: "5e31b4b8-5054"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 20564
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 leadfeeder-sitemap-5e31b5248237b.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 7 KB
7 KB 59ms
58ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/leadfeeder-sitemap-5e31b5248237b.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: abd2c31c501f8efcd7dcb8bfda286fd337d79183b340d7fd1bc81a37f8d8a1cc

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:43:52 GMT
server: nginx
etag: "5e31b648-1c4a"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 7242
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 robots-no-sitemap-5e31b57fda2d3.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 3 KB
3 KB 60ms
58ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/robots-no-sitemap-5e31b57fda2d3.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: d63969cac377eba8dc163b0ba842d53d263a6bbb31f1a6e59f3314da8d02de11

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:43:31 GMT
server: nginx
etag: "5e31b633-b66"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 2918
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 robots-correct-sitemap-5e31b5920f8b4-480x126.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 7 KB
7 KB 60ms
59ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/robots-correct-sitemap-5e31b5920f8b4-480x126.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 901a0b166ebe1970fd7e9d6d1c85791718ab530f1c63d293e9192063cebd20bf

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:41:20 GMT
server: nginx
etag: "5e31b5b0-1bc6"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 7110
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 noindex-thank-you-5e31b5aaed1c0.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 6 KB
7 KB 60ms
59ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/noindex-thank-you-5e31b5aaed1c0.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: cf79a232f8fe7bd21ac01c89f6e1c3774e8914bf8ae900ae979877504662699d

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:41:36 GMT
server: nginx
etag: "5e31b5c0-19a0"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 6560
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 robots-thank-you-5e31b5d3c39b6.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 5 KB
5 KB 61ms
59ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/robots-thank-you-5e31b5d3c39b6.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 61fe6af974028ea3358d36fa08e7b5a7df61010e4e91f2ff33914012a24084fe

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:42:37 GMT
server: nginx
etag: "5e31b5fd-1460"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 5216
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 robots-google-search-console-5e31b5f56f430.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 21 KB
22 KB 61ms
60ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/robots-google-search-console-5e31b5f56f430.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 34cf4cbc97aba634d40287ae9d58896d84105879cd2173ad0361662222f94aee

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:43:28 GMT
server: nginx
etag: "5e31b630-55e8"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 21992
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 leadfeeder-thank-you-page-5e31b63bebd87.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 397 KB
398 KB 62ms
61ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/leadfeeder-thank-you-page-5e31b63bebd87.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 62901637b079ad004302620acc29667e05931a0bf2f8f8f0a992f863b7a0febd

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:44:40 GMT
server: nginx
etag: "5e31b678-6343a"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 406586
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 noindex-nofollow-robots-5e31b6685081d.png
www.searchenginejournal.com/wp-content/uploads/2020/01/ 371 KB
371 KB 72ms
71ms Image
image/webp 148.251.128.81
HETZNER-AS

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://www.searchenginejournal.com/wp-content/uploads/2020/01/noindex-nofollow-robots-5e31b6685081d.png
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 148.251.128.81 Falkenstein, Germany, ASN24940 (HETZNER-AS, DE),
Reverse DNS: edge.presslabs.net
Software: nginx /
Resource Hash: 3da9f17f868d54688d41272be758db97faba155afdf559ade101edd299fb2b62

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
last-modified: Wed, 29 Jan 2020 16:50:34 GMT
server: nginx
etag: "5e31b7da-5cada"
x-presslabs-cache: HIT
vary: Accept, Accept-Encoding
content-type: image/webp
cache-control: max-age = 315360000
accept-ranges: bytes
content-length: 379610
x-request-id: dd22735ddad6a76352148e96a3401a8a
expires: Thu, 31 Dec 2037 23:55:55 GMT

GET
H2 200 pubads_impl.js Show response
securepubads.g.doubleclick.net/pagead/managed/js/gpt/m202308290101/ 403 KB
127 KB 38ms
37ms Script
text/javascript 2a00:1450:4001:827::2002
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://securepubads.g.doubleclick.net/pagead/managed/js/gpt/m202308290101/pubads_impl.js?cb=31077497

Requested by

Host: securepubads.g.doubleclick.net
URL: https://securepubads.g.doubleclick.net/tag/js/gpt.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:827::2002 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

2394d12e4577671d6d8a98826b3712c6c321b2d3fdc67d335ee329415631cebb

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 10:36:32 GMT
content-encoding: br
x-content-type-options: nosniff
age: 20648
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
cross-origin-resource-policy: cross-origin
content-disposition: attachment; filename="f.txt"
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 129682
x-xss-protection: 0
server: cafe
etag: 12917394590533080382
vary: Accept-Encoding
content-type: text/javascript; charset=UTF-8
cache-control: public, immutable, max-age=31536000
timing-allow-origin: *
expires: Fri, 30 Aug 2024 10:36:32 GMT

GET
DATA 200
OK truncated
/ 358 B
0 Image
image/svg+xml

General

Check archive.org

Show headers Download Go to Show image

Full URL: data:truncated
Protocol: DATA
Server: -, , ASN (),
Reverse DNS
Software: /
Resource Hash: bf0808bd9c80866718bc07d9445c6fdadadabe21cc341d4fe156a1b09708d3fd

Request headers

accept-language: en-GB,en;q=0.9
Referer
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

Content-Type: image/svg+xml

GET
H2 200 country Show response
api.btloader.com/ 16 B
141 B 121ms
120ms Fetch
application/json 130.211.23.194
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/country
Requested by: Host: btloader.com
URL: https://btloader.com/tag?o=5132149699641344&upapi=true
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN15169 (GOOGLE, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: 30c714bf4216e577686d238b98561d093672cb25bf90baab50dd956f75cda4b3

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
via: 1.1 google
vary: Origin
content-type: application/json
access-control-allow-origin: *
cache-control: private, max-age=300, stale-while-revalidate=600, stale-if-error=600
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 16

GET
H2 204 pv Show response
api.btloader.com/ 0
66 B 121ms
121ms XHR
text/plain 130.211.23.194
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://api.btloader.com/pv?tid=uAbshOws8N&w=5082459048247296&o=5132149699641344&cv=2.1.17-2-g0b33bd3&r=false&vr=1600x1200&pageURL=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&sid=YjTgX1olNe&upapi=true
Requested by: Host: btloader.com
URL: https://btloader.com/tag?o=5132149699641344&upapi=true
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 130.211.23.194 Kansas City, United States, ASN15169 (GOOGLE, US),
Reverse DNS: 194.23.211.130.bc.googleusercontent.com
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

access-control-allow-origin: *
date: Thu, 31 Aug 2023 16:20:40 GMT
cache-control: no-cache, no-store, must-revalidate
via: 1.1 google
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
vary: Origin

GET
H3 200 config.json Show response
cmp.uniconsent.com/v2/7d36e67838/ 22 KB
4 KB 158ms
88ms Fetch
application/json 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/7d36e67838/config.json
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 1632154cd5abe8555eb15315d6b3d0b1f40c26d08e6ce78f0160224de320ac4f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:40 GMT
content-encoding: br
cf-cache-status: DYNAMIC
last-modified: Sun, 12 Mar 2023 03:11:55 GMT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
etag: W/"6d1f5574b7b8237ab0d95078bdca5c98"
x-cache-status: HIT
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=p1EkngRE66ZrHrDa7%2FKWioueDDIQpGvmdmkH6TscUnDjBk8LeucupwITGMFcwVJltBAzzMSE3kuE7RHZGat%2Bpn%2BleE6lpsEeDG3%2BpYoDbRj9iO%2F6%2B0vsYVkld9QuBeM5gE4xzRkmNUf%2BkbLq4WLmv8s%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/json
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2bee83d34b-CDG
alt-svc: h3=":443"; ma=86400

GET
H3 200 / Show response
cmp.uniconsent.com/json/ 66 B
531 B 69ms
68ms Fetch
application/json 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/json/
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 189abbfd7d06f387e67fc91c6a25a0c838c8f2407ed7b89fc7d7faf8b26259bd

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
cf-cache-status: DYNAMIC
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
vary: Origin
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=AnK3byCDHN6vFuyxnugMDW4Wrq67rk%2B6baQ%2FEZJSZX8AU%2BaOKfwjROAUwJKZhvbee0UO0zSyuhVgKXVrjB%2BfMGocPmz59c6cuiFi8m8mMeLksC6GqDAs0N91IiOlvN6c4ednabCXEoXXfd%2FRMDT%2BIhI%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/json
access-control-allow-origin: *
cache-control: no-store, no-cache, must-revalidate, proxy-revalidate, max-age=0
access-control-allow-credentials: true
cf-ray: 7ff69a2c8f4dd34b-CDG
alt-svc: h3=":443"; ma=86400

GET
H3 200 vendor-list.json Show response
cmp.uniconsent.com/v2/ 404 KB
55 KB 74ms
74ms Fetch
application/json 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/vendor-list.json
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: bd362f4e6ebce8ac52397d018782ec0dd387292b6edd2d33809f0eec847ad114

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
cf-cache-status: DYNAMIC
last-modified: Thu, 23 Mar 2023 17:16:17 GMT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
etag: W/"00a5e2753b53b4ceee7351d18c18d74f"
x-cache-status: HIT
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=kspSQIf7BOrVix8bEK%2F3tWllQ8qsiPv6Z5%2Bs1jUYD6ZIpK3vwX6wtrc2kyj%2FnT1fajoDsfq7x%2FRNYWXpk4myDIacAGjzD%2BYlrLtJM1VcfuJMyyVKCNxM8Gp4S2FRzRrGlobFsljGXt49u4wCXfFRULY%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/json
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2d0fcad34b-CDG
alt-svc: h3=":443"; ma=86400

GET
H3 200 additional-consent-providers.json Show response
cmp.uniconsent.com/v2/7d36e67838/ 61 KB
17 KB 76ms
76ms Fetch
application/json 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/7d36e67838/additional-consent-providers.json
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 38d942c37363629ce7c383d43a2880d7851302037218acbf27281b044f1b6861

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
cf-cache-status: DYNAMIC
last-modified: Sun, 12 Mar 2023 03:11:56 GMT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
etag: W/"c88231697692ea3098bdcbaa49016be6"
x-cache-status: HIT
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=uD9M6xshUg6CaenPFScWGWNJWAAQFKgaNoMrEiGws0%2BqtFC2mUkZro0EANzapTNYCfp5u4rzMN7SLcwUcJfqxZ9Wi1Pd7yDza4aD4FRQQO4AGixvTcPiBB97%2Fn6Q%2FX9kBOj1BA9U9gZqHi6lv5a2eow%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/json
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2e0930d34b-CDG
alt-svc: h3=":443"; ma=86400

GET
H2 200 config Show response
c.amazon-adsystem.com/cdn/prod/ 3 KB
4 KB 42ms
41ms XHR
application/json 52.222.208.154
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/cdn/prod/config?src=600&u=https%3A%2F%2Fwww.searchenginejournal.com&pubid=4d881e84-98c1-4a13-ba07-b35ad4bb4dbc
Requested by: Host: c.amazon-adsystem.com
URL: https://c.amazon-adsystem.com/aax2/apstag.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 52.222.208.154 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-52-222-208-154.fra56.r.cloudfront.net
Software: Server /
Resource Hash: 4feba251a69abc0926f05804e759752ad346892f397ffdac23ab18a7b5b009e8

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 13:34:24 GMT
via: 1.1 77ba839b79ec0a8b2031c8a828e7fdfa.cloudfront.net (CloudFront)
server: Server
x-amz-cf-pop: FRA56-P3
age: 9977
x-cache: Hit from cloudfront
content-type: application/json;charset=UTF-8
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: max-age=21550, s-maxage=21600
access-control-allow-credentials: true
content-length: 3337
x-amz-cf-id: pF4D9tehWBdHcAtMMRYKtyV7WiLna6UjLEMPt2Ai5uievjMZfZ_RNg==

GET
H2 200 aps_csm.js Show response
c.amazon-adsystem.com/bao-csm/aps-comm/ 6 KB
3 KB 124ms
41ms XHR
application/javascript 52.222.208.154
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://c.amazon-adsystem.com/bao-csm/aps-comm/aps_csm.js
Requested by: Host: c.amazon-adsystem.com
URL: https://c.amazon-adsystem.com/aax2/apstag.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 52.222.208.154 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-52-222-208-154.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 06b99248a163333e36980a6cfb756f1a7de60fa49517162b87b1a44d5d48f844

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-amz-version-id: 9yABOonr2HqHtwbarUcdbIqN0f4A8Qog
content-encoding: gzip
via: 1.1 e45d812d65a0d0336b945e28b9381462.cloudfront.net (CloudFront)
date: Thu, 31 Aug 2023 08:30:43 GMT
x-amz-cf-pop: FRA56-P3
age: 28199
x-amz-server-side-encryption: AES256
x-cache: Hit from cloudfront
last-modified: Tue, 29 Aug 2023 08:30:37 GMT
server: AmazonS3
etag: W/"a4d296427fc806b21335359e398c025c"
access-control-max-age: 3000
access-control-allow-methods: GET
content-type: application/javascript
access-control-allow-origin: *
cache-control: public, max-age=86400
vary: Accept-Encoding,Origin
x-amz-cf-id: mIuqL4OrnBMJvpJMfpJtTDJJbshjfUHNKuswT2XKO0Wnxbz9KdY5OQ==

GET
H2 200 v1 Show response
openfpcdn.io/botd/ 14 KB
5 KB 137ms
42ms Script
text/javascript 13.32.99.97
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL

https://openfpcdn.io/botd/v1

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

13.32.99.97 , United States, ASN16509 (AMAZON-02, US),

Reverse DNS

server-13-32-99-97.fra60.r.cloudfront.net

Software

CloudFront /

Resource Hash

b697be2ac6551cd74ebd7ccbe571f934ba35440eba59039084641ca6e823319a

Security Headers

Name	Value
Strict-Transport-Security	max-age=63072000; includeSubDomains; preload
X-Content-Type-Options	nosniff

Request headers

Referer: https://www.searchenginejournal.com/
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

strict-transport-security: max-age=63072000; includeSubDomains; preload
content-encoding: gzip
x-content-type-options: nosniff
date: Thu, 31 Aug 2023 14:48:31 GMT
via: 1.1 68b2682a924ac399aa2724b5b439e75c.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA60-P3
age: 5530
x-cache: Hit from cloudfront
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
server: CloudFront
etag: W/"ERzWTKDJQGd1B/0QQCyBU6slRjs"
vary: Accept-Encoding
content-type: text/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: public, max-age=579373, s-maxage=10876
x-amz-cf-id: _zEFhVkoHecUPCu0LYAKfk0jRBH3skYJqa8OzGiCyBAFHAeLF7v7Ow==

GET
H2 200 fbevents.js Show response
connect.facebook.net/en_US/ 193 KB
52 KB 113ms
37ms Script
application/x-javascript 2a03:2880:f083:100:face:b00c:0:3
FACEBOOK

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/en_US/fbevents.js

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/ga/js/pix.js?ver=1692893410

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f083:100:face:b00c:0:3 Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

Resource Hash

9e41e783ec4cfc524c1666d1d5a4c805f8e92be52b030d130acfb31105e1e04c

Security Headers

Name	Value
Content-Security-Policy	default-src facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com data: blob: 'self';script-src .fbcdn.net .facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com;connect-src .fbcdn.net .facebook.net wss://*.fbcdn.net attachment.fbsbx.com blob: 'self';block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

content-security-policy: default-src facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com data: blob: 'self';script-src *.fbcdn.net *.facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com;connect-src *.fbcdn.net *.facebook.net wss://*.fbcdn.net attachment.fbsbx.com blob: 'self';block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;
content-encoding: gzip
x-content-type-options: nosniff
strict-transport-security: max-age=31536000; preload; includeSubDomains
date: Thu, 31 Aug 2023 16:20:41 GMT
document-policy: force-load-at-top
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 52127
x-xss-protection: 0
pragma: public
x-fb-debug: Dbm5JGiG0TtTsDMduib5DeYfBkySYA/3nkBVBqufJDi+Op2e3xh6/FMhXRaegbA8Lj0PdSBgtqaeo/Li2VlEbg==
cross-origin-opener-policy: same-origin-allow-popups
vary: Accept-Encoding
x-frame-options: DENY
content-type: application/x-javascript; charset=utf-8
origin-agent-cluster: ?0
cache-control: public, max-age=1200
permissions-policy: accelerometer=(), ambient-light-sensor=(), bluetooth=(), camera=(), gyroscope=(), hid=(), idle-detection=(), magnetometer=(), microphone=(), midi=(), payment=(), screen-wake-lock=(), serial=(), usb=()
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H3 200 vendors-v2.js Show response
cmp.uniconsent.com/v2/ 103 KB
12 KB 42ms
42ms Script
application/javascript 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/vendors-v2.js
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 4d9a0eb909eb2995442424b569d668de4f9e175558a2b288b1c382666e9af0f4

Request headers

Referer: https://www.searchenginejournal.com/
Origin: https://www.searchenginejournal.com
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 308
x-cache-status: HIT
alt-svc: h3=":443"; ma=86400
last-modified: Sat, 01 Jul 2023 20:44:30 GMT
server: cloudflare
etag: W/"932a78480503836551a4f38a4082c9e3"
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=PbzOeO4ItUKR8kJhFMgnTAJthd0qP0oiEKdOUgDtXq9Lju%2BXGjM9hdbHjIx1f0GSSipOj8N8T6395gDjLMlTpD%2FDC3d0wAL0XU7%2FhBvyyVolBTv7qOFLj%2FhZ4bUJQtOkm8teF%2Bp2gnFmKdGLv0pLuA0%3D"}],"group":"cf-nel","max_age":604800}
content-type: application/javascript; charset=utf-8
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2eea13d34b-CDG

GET
H2 200 ats.js Show response
ats.rlcdn.com/ 236 KB
78 KB 146ms
45ms Script
text/javascript 143.204.98.71
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://ats.rlcdn.com/ats.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 143.204.98.71 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-143-204-98-71.fra50.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: e820733377d4af31fd643ac9a24856e8f33ca799f97259e59c868302a513c874

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-amz-version-id: L2Uqg18UIi_4fqt_LD1.VZwHoDyvOGyd
content-encoding: gzip
via: 1.1 9128c49d19c76fd86ec4c647434ccb0a.cloudfront.net (CloudFront)
date: Thu, 31 Aug 2023 05:56:48 GMT
last-modified: Thu, 08 Jun 2023 08:56:13 GMT
server: AmazonS3
x-amz-cf-pop: FRA50-C1
age: 37434
x-amz-server-side-encryption: AES256
etag: W/"a23e5e8674928ef24c6825d63b8d2927"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: text/javascript
x-amz-cf-id: EX41nqvmCNQHhIt66fqxS__5kF2m5MAhYOJhjSNYo-d1qCusNXswGg==

GET
H2 200 pubcid.min.js Show response
secure.cdn.fastclick.net/js/pubcid/latest/ 54 KB
17 KB 141ms
46ms Script
application/javascript 23.209.239.88
AKAMAI-AS

General

Check archive.org

Show headers Download Go to

Full URL: https://secure.cdn.fastclick.net/js/pubcid/latest/pubcid.min.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_256_GCM
Server: 23.209.239.88 Schiphol, Netherlands, ASN16625 (AKAMAI-AS, US),
Reverse DNS: a23-209-239-88.deploy.static.akamaitechnologies.com
Software: Apache /
Resource Hash: 43f804d38a294c6df1ce8ee64fb95ad0ff5a8d6d5685d9537df02212668a1dff

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
last-modified: Mon, 23 Jan 2023 19:40:17 GMT
server: Apache
etag: "d734-5f2f3919e751f-gzip"
vary: Accept-Encoding
content-type: application/javascript
cache-control: max-age=900
accept-ranges: bytes
content-length: 17407
expires: Thu, 31 Aug 2023 16:35:41 GMT

GET
H2 200 sync.min.js Show response
tags.crwdcntrl.net/lt/c/16576/ 38 KB
12 KB 144ms
44ms Script
text/javascript 18.66.97.9
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://tags.crwdcntrl.net/lt/c/16576/sync.min.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.66.97.9 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-66-97-9.fra56.r.cloudfront.net
Software: AmazonS3 /
Resource Hash: 6e91aaec2cb3510b97bb0655abdb08942dbefd617b169d0cd97b23fc48e68b2b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 00:39:25 GMT
content-encoding: gzip
via: 1.1 b9d2ce196c8a711fb15d92175d58476e.cloudfront.net (CloudFront)
last-modified: Wed, 31 May 2023 20:34:15 GMT
server: AmazonS3
x-amz-cf-pop: FRA56-P2
age: 56477
x-amz-server-side-encryption: AES256
etag: W/"560498a44e7d42477433425cdafd6a16"
vary: Accept-Encoding
x-cache: Hit from cloudfront
content-type: text/javascript
cache-control: public, max-age=86400
x-amz-cf-id: 2d4febrC5I1x-E_h2bJf4QA8QR6KIGKsuro3FVJ2T7uWJccZNJoI0A==

GET
H2 200 hadron.js Show response
cdn.hadronid.net/ 55 KB
10 KB 114ms
39ms Script
application/javascript 2606:4700:10::6816:34ad
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.hadronid.net/hadron.js?url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&ref=&_it=amazon&partner_id=437
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:10::6816:34ad , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: f9e9d6c9d3b76ddbbaf7cd44bbcb5e7c0eb9cdb69bb4c3895117f2341474b75f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
cf-cache-status: HIT
cf-bgj: minify
last-modified: Mon, 22 May 2023 16:51:11 GMT
server: cloudflare
x-amz-request-id: D9H0BKD49BT4VXPH
age: 4263
etag: W/"82b3b53182a6a8dbe6684806275e839a"
vary: Accept-Encoding
content-type: application/javascript
cache-control: max-age=3600
cf-ray: 7ff69a2f6ca8386a-LHR
x-amz-id-2: NYMqTPppEBiG4bbM2+rgByDV6NSeJDUeioacPP/TyAP0fbAmvOO4RCVRrzA/p/xpSBZuJnb15Hs=

GET
H2 200 id5-api.js Show response
cdn.id5-sync.com/api/1.0/ 118 KB
26 KB 120ms
55ms Script
text/javascript 2606:4700:10::ac43:266a
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL

https://cdn.id5-sync.com/api/1.0/id5-api.js

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2606:4700:10::ac43:266a , United States, ASN13335 (CLOUDFLARENET, US),

Reverse DNS

Software

cloudflare /

Resource Hash

7d68e1b3634db2da8c394ef1754ae0bb9e0fe14e550643e0b913464ce66ba6ac

Security Headers

Name	Value
Strict-Transport-Security	max-age=15552000; includeSubDomains; preload

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=15552000; includeSubDomains; preload
content-encoding: gzip
cf-cache-status: HIT
last-modified: Mon, 21 Aug 2023 10:48:56 GMT
server: cloudflare
x-amz-request-id: 41993FWAJW9YBD6R
age: 1040
etag: W/"7799d2904b6b2427a4713f4da8b71602"
x-amz-server-side-encryption: AES256
vary: Accept-Encoding
content-type: text/javascript;charset=utf-8
cache-control: public, max-age=3600
cf-ray: 7ff69a2f5d44dd1b-LHR
x-amz-id-2: K1q7PVUo/0FHaC8D47KBtK5Fl+y1mncMeangiVVqJSVgSeXxIRJUoV67nT5G/R3VmEMim/WAOdA=

GET
H3 200 logo.svg
cmp.uniconsent.com/ 11 KB
5 KB 47ms
47ms Image
image/svg+xml 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://cmp.uniconsent.com/logo.svg
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 6c76972839a5126e9e07e4958eb6b5ed3ec40985e62564c9d31adcac47486da6

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
cf-cache-status: HIT
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
age: 84045
x-cache-status: MISS
alt-svc: h3=":443"; ma=86400
last-modified: Thu, 18 May 2023 15:32:43 GMT
server: cloudflare
etag: W/"062b26e035a7c2a34f2118af82a83a7a"
vary: Accept-Encoding
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=uXqiiSd3FIHMTrkDuiOqz%2F5w73G6gf8dUYMEU2Npw9RT33fbeGzJx4zGSyuN8nLvrRkRckvKXXgQ5FeqfqTLet1so8TJNqDk5S7az5Qn0exKO%2FYO0VC0Fd1gc6i8omEEYDm73xM1asGdu9V0GJ2tYas%3D"}],"group":"cf-nel","max_age":604800}
content-type: image/svg+xml
access-control-allow-origin: *
cache-control: max-age=86400
cf-ray: 7ff69a2f5b42119e-CDG

GET
H2 200 gtm.js Show response
www.googletagmanager.com/ 251 KB
81 KB 146ms
62ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

5de89f9d56f5fbeb9ac1a79ae0edc74a653d53910e82b14d09b0ad5f6f29d413

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 82253
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:41 GMT

GET
H2 200 insight.min.js Show response
snap.licdn.com/li.lms-analytics/ 1 KB
1 KB 128ms
39ms Script
application/javascript 2a02:26f0:480:f::213:7edd
AKAMAI-ASN1

General

Check archive.org

Show headers Download Go to

Full URL

https://snap.licdn.com/li.lms-analytics/insight.min.js

Requested by

Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/ga/js/pix.js?ver=1692893410

Protocol

Security

TLS 1.3, , AES_256_GCM

Server

2a02:26f0:480:f::213:7edd Frankfurt am Main, Germany, ASN20940 (AKAMAI-ASN1, NL),

Reverse DNS

Software

Resource Hash

292f853f9ef0e448c5536987fe87197f401bafcde3e0857e17de1f0676f5b2eb

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
x-content-type-options: nosniff
last-modified: Wed, 30 Aug 2023 18:41:20 GMT
x-cdn: AKAM
x-amz-server-side-encryption: AES256
content-type: application/javascript;charset=utf-8
cache-control: max-age=86150
accept-ranges: bytes
content-length: 1046

OPTIONS
H2 200 hadron.json
id.hadron.ad.gt/v1/ Frame 0
0 184ms
111ms Preflight
application/json 2606:4700:10::6816:445
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://id.hadron.ad.gt/v1/hadron.json?_it=amazon&partner_id=437&sync=0&domain=www.searchenginejournal.com&url=https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:10::6816:445 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash

Request headers

Accept: */*
Access-Control-Request-Headers: content-type
Access-Control-Request-Method: GET
Origin: https://www.searchenginejournal.com
Sec-Fetch-Mode: cors
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

access-control-allow-headers: Origin, X-Requested-With, Content-Type, Accept
access-control-allow-origin: *
allow: POST, OPTIONS, GET
cache-control: max-age=31536000 public, no-transform
cf-cache-status: DYNAMIC
cf-ray: 7ff69a302d6a48b7-LHR
content-length: 0
content-type: application/json
date: Thu, 31 Aug 2023 16:20:41 GMT
debug: OPTIONS block
expires: Fri, 30 Aug 2024 16:20:41 GMT
server: cloudflare

GET
H2 200 hadron.json Show response
id.hadron.ad.gt/v1/ 108 B
297 B 114ms
114ms XHR
application/json 2606:4700:10::6816:445
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://id.hadron.ad.gt/v1/hadron.json?_it=amazon&partner_id=437&sync=0&domain=www.searchenginejournal.com&url=https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Requested by: Host: cdn.hadronid.net
URL: https://cdn.hadronid.net/hadron.js?url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&ref=&_it=amazon&partner_id=437
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:10::6816:445 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: 64bf9288344a9fbdb4f273c888a10783201bf1a782d5471c82a8e7e7fa3feaed

Request headers

Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
Content-Type: application/json

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
cf-cache-status: DYNAMIC
server: cloudflare
access-control-allow-methods: HEAD,GET,POST,PUT,DELETE,OPTIONS
content-type: application/json
access-control-allow-origin: *
cache-control: private,max-age=30
access-control-allow-credentials: true
debug: NON-OPTIONS
access-control-allow-headers: authorization
cf-ray: 7ff69a30de6d48b7-LHR

POST
H2 200 map Show response
bcp.crwdcntrl.net/6/ 235 B
702 B 154ms
68ms XHR
application/json 34.252.126.23
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://bcp.crwdcntrl.net/6/map
Requested by: Host: tags.crwdcntrl.net
URL: https://tags.crwdcntrl.net/lt/c/16576/sync.min.js
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 34.252.126.23 Dublin, Ireland, ASN16509 (AMAZON-02, US),
Reverse DNS: ec2-34-252-126-23.eu-west-1.compute.amazonaws.com
Software: Jetty(9.4.38.v20210224) /
Resource Hash: 2ac577ea78b268c5160027844c41d409e0a857b9651dde69561dd6a69bb7ad8d

Request headers

Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:41 GMT
server: Jetty(9.4.38.v20210224)
content-type: application/json;charset=utf-8
p3p: CP=NOI DSP COR NID PSAa PSDa OUR UNI COM NAV
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache
x-server: 10.45.6.176
access-control-allow-credentials: true
content-length: 235
expires: 0

GET
H2 200 1321385257908563 Show response
connect.facebook.net/signals/config/ 137 KB
35 KB 39ms
38ms Script
application/x-javascript 2a03:2880:f083:100:face:b00c:0:3
FACEBOOK

General

Check archive.org

Show headers Download Go to

Full URL

https://connect.facebook.net/signals/config/1321385257908563?v=2.9.125&r=stable&domain=www.searchenginejournal.com

Requested by

Host: connect.facebook.net
URL: https://connect.facebook.net/en_US/fbevents.js

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f083:100:face:b00c:0:3 Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

Resource Hash

958f778236afbca87940af06f9fae60d4170bedfe89275710a3408d2ad9b92a4

Security Headers

Name	Value
Content-Security-Policy	default-src facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com data: blob: 'self';script-src .fbcdn.net .facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net .facebook.net fbcdn.net .fbcdn.net fbsbx.com .fbsbx.com;connect-src .fbcdn.net .facebook.net wss://*.fbcdn.net attachment.fbsbx.com blob: 'self';block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;
Strict-Transport-Security	max-age=31536000; preload; includeSubDomains
X-Content-Type-Options	nosniff
X-Frame-Options	DENY
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

content-security-policy: default-src facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com data: blob: 'self';script-src *.fbcdn.net *.facebook.net 'unsafe-inline' 'unsafe-eval' blob: data: 'self';style-src data: blob: 'unsafe-inline' facebook.net *.facebook.net fbcdn.net *.fbcdn.net fbsbx.com *.fbsbx.com;connect-src *.fbcdn.net *.facebook.net wss://*.fbcdn.net attachment.fbsbx.com blob: 'self';block-all-mixed-content;upgrade-insecure-requests;report-uri https://www.facebook.com/csp/reporting/?m=c&minimize=0;
content-encoding: gzip
x-content-type-options: nosniff
strict-transport-security: max-age=31536000; preload; includeSubDomains
date: Thu, 31 Aug 2023 16:20:41 GMT
document-policy: force-load-at-top
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 35949
x-xss-protection: 0
pragma: public
x-fb-debug: NK9xGhzdK5EY8op6J6O89K4I4YV15/2eakJn2nCqw7OWgI2fytKAlD7OrDJ4BnsWpQrtW3KppTSCmvJxsjaU9A==
cross-origin-opener-policy: same-origin-allow-popups
vary: Accept-Encoding
x-frame-options: DENY
content-type: application/x-javascript; charset=utf-8
origin-agent-cluster: ?0
cache-control: public, max-age=1200
permissions-policy: accelerometer=(), ambient-light-sensor=(), bluetooth=(), camera=(), gyroscope=(), hid=(), idle-detection=(), magnetometer=(), microphone=(), midi=(), payment=(), screen-wake-lock=(), serial=(), usb=()
expires: Sat, 01 Jan 2000 00:00:00 GMT

GET
H2 200 / Show response
geo.privacymanager.io/ 30 B
608 B 135ms
44ms Fetch
application/json 13.32.99.35
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://geo.privacymanager.io/
Requested by: Host: ats.rlcdn.com
URL: https://ats.rlcdn.com/ats.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 13.32.99.35 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-13-32-99-35.fra60.r.cloudfront.net
Software: /
Resource Hash: df790197e64683df0e6a96ff423dc23bd96010b5aa6bee119c148b70f6dc33ca

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 01:42:44 GMT
via: 1.1 68eb499493257a6d0620a0f6abdc78ca.cloudfront.net (CloudFront), 1.1 7251dede1ac94066b27bcd33919b30c6.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA56-P3, FRA60-P3
age: 52677
x-amzn-requestid: 537030eb-f376-4d79-963e-cab492b9ad0b
x-amzn-trace-id: Root=1-64eff014-3577650205dac5e961c473e0;Sampled=0;lineage=06620786:0
access-control-allow-methods: DELETE,GET,HEAD,OPTIONS,PATCH,POST,PUT
content-type: application/json
access-control-allow-origin: *
x-cache: Hit from cloudfront
x-amz-apigw-id: KgJzLE9hjoEF3ug=
content-length: 30
x-amz-cf-id: FfX_9aJVBpru-6BMFh1PqCAWBUyc-a-Qdp6tpt3U1c6J--2wCALMjQ==
access-control-allow-headers: Content-Type,Authorization,X-Amz-Date,X-Api-Key,X-Amz-Security-Token

GET
H2 200 /
www.facebook.com/tr/ 0
185 B 114ms
40ms Image
text/plain 2a03:2880:f177:185:face:b00c:0:25de
FACEBOOK

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.facebook.com/tr/?id=1321385257908563&ev=PageView&dl=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&rl=&if=false&ts=1693498841660&sw=1600&sh=1200&v=2.9.125&r=stable&ec=0&o=30&fbp=fb.1.1693498841659.1302405144&it=1693498841591&coo=false&rqm=GET

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f177:185:face:b00c:0:25de Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

proxygen-bolt /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

strict-transport-security: max-age=31536000; includeSubDomains
date: Thu, 31 Aug 2023 16:20:41 GMT
server: proxygen-bolt
content-type: text/plain
access-control-allow-origin
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=86400
content-length: 0

GET
H2 200 insight.old.min.js Show response
snap.licdn.com/li.lms-analytics/ 13 KB
5 KB 39ms
38ms Script
application/x-javascript 2a02:26f0:480:f::213:7edd
AKAMAI-ASN1

General

Check archive.org

Show headers Download Go to

Full URL

https://snap.licdn.com/li.lms-analytics/insight.old.min.js

Requested by

Host: snap.licdn.com
URL: https://snap.licdn.com/li.lms-analytics/insight.min.js

Protocol

Security

TLS 1.3, , AES_256_GCM

Server

2a02:26f0:480:f::213:7edd Frankfurt am Main, Germany, ASN20940 (AKAMAI-ASN1, NL),

Reverse DNS

Software

Resource Hash

fa53fcd8da139d256c0ca83b69cb37473ca627b6052368ed3327c80d9fb61e25

Security Headers

Name	Value
X-Content-Type-Options	nosniff

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
x-content-type-options: nosniff
last-modified: Mon, 28 Aug 2023 12:14:15 GMT
x-cdn: AKAM
x-amz-server-side-encryption: AES256
vary: Accept-Encoding
content-type: application/x-javascript;charset=utf-8
cache-control: max-age=46008
accept-ranges: bytes
content-length: 4862

GET
H2 200 uwt.js Show response
static.ads-twitter.com/ 56 KB
15 KB 143ms
40ms Script
application/javascript 146.75.120.157
FASTLY

General

Check archive.org

Show headers Download Go to

Full URL: https://static.ads-twitter.com/uwt.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/wp-content/plugins/abm-sej/includes/ga/js/pix.js?ver=1692893410
Protocol: H2
Security: TLS 1.2, ECDHE_RSA, AES_128_GCM
Server: 146.75.120.157 Frankfurt am Main, Germany, ASN54113 (FASTLY, US),
Reverse DNS
Software: /
Resource Hash: cf7fcc9f75c8717897bfaef72f303fab423ce1b70c98512aeb3677e4af988dee

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: gzip
last-modified: Thu, 27 Oct 2022 16:56:53 GMT
etag: "32ad004436155ec972bc50e6238b5b67+gzip+gzip"
vary: Accept-Encoding,Host
x-cache: HIT, HIT
content-type: application/javascript; charset=utf-8
p3p: CP="CAO DSP LAW CURa ADMa DEVa TAIa PSAa PSDa IVAa IVDa OUR BUS IND UNI COM NAV INT"
x-tw-cdn: FT
cache-control: no-cache
accept-ranges: bytes
content-length: 15375
x-served-by: cache-iad-kjyo7100081-IAD, cache-fra-etou8220087-FRA

GET
H2 200 token Show response
cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/ 36 B
393 B 156ms
40ms XHR
application/json 2600:9000:20eb:e800:2:53b2:240:93a1
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/token
Requested by: Host: snap.licdn.com
URL: https://snap.licdn.com/li.lms-analytics/insight.old.min.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2600:9000:20eb:e800:2:53b2:240:93a1 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software: /
Resource Hash: 7b1eaaaf180a13c29b6dddc3b0ae23333b4397e0f3c065b4c86da2f2530a5f89

Request headers

Accept: *
Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 12:24:08 GMT
content-encoding: gzip
via: 1.1 172e63b20fb363ed969de28ae3937e20.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA2-C1
age: 14193
vary: accept-encoding
x-cache: Hit from cloudfront
content-type: application/json
access-control-allow-origin: *
access-control-expose-headers: *
cache-control: public, max-age=32379
x-amz-cf-id: mOX6HDqgRb6jPDqLYzvYN8tATqJkSkJBluikHzh6jigSzGhIw0shWA==

GET
H2

200

collect
px4.ads.linkedin.com/
Redirect Chain

https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true
https://www.linkedin.com/px/li_sync?redirect=https%3A%2F%2Fpx.ads.linkedin.com%2Fcollect%3Fv%3D2%26fmt%3Djs%26pid%3D2493106%26time%3D1693498841706%26url%3Dhttps%253A%252F%252Fwww.searchenginejourna...
https://px.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync=...
https://px4.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync...

0
265 B

267ms
203ms

Image
application/javascript

13.107.42.14
MICROSOFT-CORP-MS...

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://px4.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync=true&e_ipv6=AQJPhi4DbnhCkgAAAYpMZZ1mi9p6-8BLZdUVtaeXPrKZ8zvSNbLEt0ALgfG6gm1P3FUU3GU
Protocol: H2
Server: 13.107.42.14 , United States, ASN8068 (MICROSOFT-CORP-MSN-AS-BLOCK, US),
Reverse DNS
Software: /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:42 GMT
x-li-pop: afd-prod-lor1-x
x-msedge-ref: Ref A: 39BBE3DEBB804A57974E72F194701CEE Ref B: LTSEDGE0806 Ref C: 2023-08-31T16:20:42Z
linkedin-action: 1
x-cache: CONFIG_NOCACHE
content-type: application/javascript
x-li-fabric: prod-lor1
x-li-proto: http/2
content-length: 0
x-li-uuid: AAYEOmzywLSdepechWAbDQ==

Redirect headers

date: Thu, 31 Aug 2023 16:20:41 GMT
x-li-pop: afd-prod-lor1-x
x-msedge-ref: Ref A: 5B073ECD2E0E49A0BD4383F1D5AF977C Ref B: LON04EDGE1118 Ref C: 2023-08-31T16:20:42Z
linkedin-action: 1
x-cache: CONFIG_NOCACHE
x-li-fabric: prod-lor1
location: https://px4.ads.linkedin.com/collect?v=2&fmt=js&pid=2493106&time=1693498841706&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&cookiesTest=true&liSync=true&e_ipv6=AQJPhi4DbnhCkgAAAYpMZZ1mi9p6-8BLZdUVtaeXPrKZ8zvSNbLEt0ALgfG6gm1P3FUU3GU
x-li-proto: http/2
content-length: 0
x-li-uuid: AAYEOmzutkYXxUJ01CXM1Q==

GET
H2 200 token Show response
cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/ 36 B
392 B 155ms
41ms XHR
application/json 2600:9000:20eb:e800:2:53b2:240:93a1
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/token
Requested by: Host: snap.licdn.com
URL: https://snap.licdn.com/li.lms-analytics/insight.old.min.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2600:9000:20eb:e800:2:53b2:240:93a1 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software: /
Resource Hash: 7b1eaaaf180a13c29b6dddc3b0ae23333b4397e0f3c065b4c86da2f2530a5f89

Request headers

Accept: *
Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 12:24:08 GMT
content-encoding: gzip
via: 1.1 172e63b20fb363ed969de28ae3937e20.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA2-C1
age: 14193
vary: accept-encoding
x-cache: Hit from cloudfront
content-type: application/json
access-control-allow-origin: *
access-control-expose-headers: *
cache-control: public, max-age=32379
x-amz-cf-id: 8D8XYwD9s0AwAr3-YS6LeA7Z57geQCfPCJYnXEXXPtO-b7QvJ2mqew==

GET
H2 200 token Show response
cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/ 36 B
390 B 154ms
41ms XHR
application/json 2600:9000:20eb:e800:2:53b2:240:93a1
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://cdn.linkedin.oribi.io/partner/2493106/domain/searchenginejournal.com/token
Requested by: Host: snap.licdn.com
URL: https://snap.licdn.com/li.lms-analytics/insight.old.min.js
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2600:9000:20eb:e800:2:53b2:240:93a1 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software: /
Resource Hash: 7b1eaaaf180a13c29b6dddc3b0ae23333b4397e0f3c065b4c86da2f2530a5f89

Request headers

Accept: *
Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 12:24:08 GMT
content-encoding: gzip
via: 1.1 172e63b20fb363ed969de28ae3937e20.cloudfront.net (CloudFront)
x-amz-cf-pop: FRA2-C1
age: 14193
vary: accept-encoding
x-cache: Hit from cloudfront
content-type: application/json
access-control-allow-origin: *
access-control-expose-headers: *
cache-control: public, max-age=32379
x-amz-cf-id: m8gcr2K00E3Jej8sX6FnlenvVTqLM1Z-aecbeOtMoPu3SKmLQzP0AQ==

GET
H2 200 / Show response
googleads.g.doubleclick.net/pagead/viewthroughconversion/536815543/ 3 KB
2 KB 174ms
85ms Script
text/javascript 2a00:1450:4001:829::2002
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://googleads.g.doubleclick.net/pagead/viewthroughconversion/536815543/?random=1693498841725&cv=11&fst=1693498841725&bg=ffffff&guid=ON&async=1&gtm=45He38u0&u_w=1600&u_h=1200&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&hn=www.googleadservices.com&frm=0&tiba=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&us_privacy=1---&auid=1771204427.1693498842&uamb=0&uaw=0&rfmt=3&fmt=4

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:829::2002 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

84d0f368d9fcacc627d966edb4e5c47a57b081455bd7eaf5fc8d5904d95b9b2f

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
x-content-type-options: nosniff
server: cafe
content-type: text/javascript; charset=UTF-8
p3p: policyref="https://googleads.g.doubleclick.net/pagead/gcn_p3p_.xml", CP="CURa ADMa DEVa TAIo PSAo PSDo OUR IND UNI PUR INT DEM STA PRE COM NAV OTC NOI DSP COR"
cache-control: no-cache, must-revalidate
cross-origin-resource-policy: cross-origin
content-disposition: attachment; filename="f.txt"
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 1368
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 lftracker_v1_ywVkO4XKPNd7Z6Bj.js Show response
sc.lfeeder.com/ 30 KB
11 KB 198ms
77ms Script
application/javascript 2600:9000:2250:2400:4:d7e1:700:93a1
AMAZON-02

General

Check archive.org

Show headers Download Go to

Full URL: https://sc.lfeeder.com/lftracker_v1_ywVkO4XKPNd7Z6Bj.js
Requested by: Host: www.searchenginejournal.com
URL: https://www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt/
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2600:9000:2250:2400:4:d7e1:700:93a1 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS
Software: AmazonS3 /
Resource Hash: 10dc140898ff0dbc97793f8f1f805d8f93b81cc0d80aa65d6b3040d4c71698fc

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-amz-version-id: mujbuR3EtMwGx5Q46ktgxNtPLj1IIJUd
content-encoding: gzip
via: 1.1 508d9aac3b0097e502b117c1e7390bb0.cloudfront.net (CloudFront)
date: Thu, 31 Aug 2023 16:20:42 GMT
last-modified: Wed, 30 Aug 2023 07:05:44 GMT
server: AmazonS3
x-amz-cf-pop: FRA60-P2
x-amz-server-side-encryption: AES256
etag: W/"bd5ed3833c2da121cb85b2541e4776d0"
vary: Accept-Encoding
x-cache: RefreshHit from cloudfront
content-type: application/javascript
cache-control: max-age=3600
x-amz-cf-id: SfyDn5Idm-81hhMkZrZfqZTO_KVXLPiAxfRqu4sKtcKU9cC3HZ2axA==

GET
H2 200 js Show response
www.googletagmanager.com/gtag/ 271 KB
89 KB 57ms
56ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/js?id=G-TJPZMKSHES&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

a3281e768c022f387f51e633512eb2baeb930c850855b5dd884c0acc64bee312

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 90546
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:41 GMT

GET
H2 200 js Show response
www.googletagmanager.com/gtag/ 281 KB
90 KB 79ms
78ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/js?id=G-S08JX510ES&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

02f29aa839f09fe8857e5dd54515e7234540e3c27e63cfbc7e97a1ed763cc223

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 92496
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:41 GMT

GET
H2 200 js Show response
www.googletagmanager.com/gtag/ 271 KB
90 KB 59ms
59ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/js?id=G-9QQPL212Z4&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

c4ae91e138391f227e39aa545c907ad7ecc287f64db772dde06ebb86bd5896ad

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:41 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 91684
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:41 GMT

GET
H2 200 adsct
t.co/1/i/ 43 B
202 B 183ms
123ms Image
image/gif 104.244.42.69
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://t.co/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=1aa49ef6-4f88-43e8-8217-66df4ed75162&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.69 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 97
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=0
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 7fdd427e5ce3345b
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 71b7b50e6d9a7981debde99e8a1f8be8e1530f9c9f7c98e0af315445b3af3d52
content-length: 43

GET
H2 200 adsct
analytics.twitter.com/1/i/ 43 B
547 B 249ms
188ms Image
image/gif 104.244.42.67
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://analytics.twitter.com/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=1aa49ef6-4f88-43e8-8217-66df4ed75162&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.67 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=631138519

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 162
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=631138519
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 8c786e771836e74b
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 16612022981d29feeb2f07364e2bb48730a2d3b1821defa1f8d054fdf74357dd
content-length: 43

GET
H2 200 adsct
t.co/1/i/ 43 B
376 B 181ms
121ms Image
image/gif 104.244.42.69
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://t.co/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=5be76277-99a9-428d-a641-7491d0727cbf&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.69 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 96
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=0
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 01876acc3cd27291
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 71b7b50e6d9a7981debde99e8a1f8be8e1530f9c9f7c98e0af315445b3af3d52
content-length: 43

GET
H2 200 adsct
analytics.twitter.com/1/i/ 43 B
724 B 184ms
123ms Image
image/gif 104.244.42.67
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://analytics.twitter.com/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=5be76277-99a9-428d-a641-7491d0727cbf&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.67 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=631138519

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 97
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=631138519
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 249973a9aa88f50c
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 16612022981d29feeb2f07364e2bb48730a2d3b1821defa1f8d054fdf74357dd
content-length: 43

GET
H2 200 adsct
t.co/1/i/ 43 B
200 B 182ms
122ms Image
image/gif 104.244.42.69
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://t.co/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=6cc5586a-b839-4058-ad87-e585e8768415&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.69 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 96
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=0
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 5b867b9430fef375
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 71b7b50e6d9a7981debde99e8a1f8be8e1530f9c9f7c98e0af315445b3af3d52
content-length: 43

GET
H2 200 adsct
analytics.twitter.com/1/i/ 43 B
546 B 253ms
192ms Image
image/gif 104.244.42.67
TWITTER

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://analytics.twitter.com/1/i/adsct?bci=4&eci=3&event=%7B%7D&event_id=6cc5586a-b839-4058-ad87-e585e8768415&integration=advertiser&p_id=Twitter&p_user_id=0&pl_id=e5301006-1dcd-4a4e-a071-f84224d52cf8&tw_document_href=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&tw_iframe_status=0&txn_id=o5w59&type=javascript&version=2.3.29

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

104.244.42.67 , United States, ASN13414 (TWITTER, US),

Reverse DNS

Software

tsa_f /

Resource Hash

ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957

Security Headers

Name	Value
Strict-Transport-Security	max-age=631138519

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

x-response-time: 166
date: Thu, 31 Aug 2023 16:20:41 GMT
strict-transport-security: max-age=631138519
server: tsa_f
content-type: image/gif;charset=utf-8
x-transaction-id: 215211f22874b185
cache-control: no-cache, no-store, max-age=0
perf: 7626143928
x-connection-hash: 16612022981d29feeb2f07364e2bb48730a2d3b1821defa1f8d054fdf74357dd
content-length: 43

GET
H2 200 437 Show response
a.ad.gt/api/v1/u/matches/ 12 KB
4 KB 302ms
221ms Script
application/javascript 2606:4700:10::6816:445
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://a.ad.gt/api/v1/u/matches/437?_it=amazon
Requested by: Host: cdn.hadronid.net
URL: https://cdn.hadronid.net/hadron.js?url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&ref=&_it=amazon&partner_id=437
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2606:4700:10::6816:445 , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: d8efad9b8eeac3ab790af7cdc4390945ee3085d4f63f3bcde1e8b6c30e9f3a4f

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:42 GMT
content-encoding: gzip
cf-cache-status: EXPIRED
last-modified: Thu, 31 Aug 2023 16:13:27 GMT
server: cloudflare
vary: Accept-Encoding
content-type: application/javascript
cache-control: max-age=14400
cross-origin-resource-policy: cross-origin
cf-ray: 7ff69a322f974970-LHR

POST
H2 204 collect
region1.google-analytics.com/g/ 0
254 B 98ms
33ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.google-analytics.com/g/collect?v=2&tid=G-9QQPL212Z4&gtm=45je38u0&_p=1500883060&cid=1738634928.1693498842&ul=en-us&sr=1600x1200&uaa=&uab=&uafvl=&uamb=0&uam=&uap=&uapv=&uaw=0&_s=1&dl=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&sid=1693498841&sct=1&seg=0&dt=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&en=page_view&_fv=1&_nsi=1&_ss=1&ep.author_name=anna%20crowe&ep.publish_year=2020&ep.article_all_categories=seo&ep.article_word_count=2000%2B&ep.title_word_count=50%20-%2074&ep.publish_year_month=2020-04&ep.content_type=in-depth%20guides&ep.primary_categories=seo&ep.content_group=in-depth%20guides&ep.shares_count=more%20than%20500&ep.is_refresh=yes&ep.page_url_no_params=www.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&ep.content_sections=seo&ep.infinte_scroll=no&ep.has_summary=no&ep.document_ref=&ep.custom_geo_location=GB
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-9QQPL212Z4&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:41 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 204 collect
region1.analytics.google.com/g/ 0
54 B 34ms
32ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.analytics.google.com/g/collect?v=2&tid=G-TJPZMKSHES&gtm=45je38u0&_p=1500883060&_gaz=1&cid=1738634928.1693498842&ul=en-us&sr=1600x1200&ir=1&uaa=&uab=&uafvl=&uamb=0&uam=&uap=&uapv=&uaw=0&_eu=EA&_s=1&dl=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&sid=1693498841&sct=1&seg=0&dt=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&en=page_view&_fv=1&_ss=1&ep.author_name=anna%20crowe&ep.publish_year=2020&ep.article_all_categories=seo&ep.article_word_count=2000%2B&ep.title_word_count=50%20-%2074&ep.publish_year_month=2020-04&ep.content_type=in-depth%20guides&ep.primary_categories=seo&ep.content_group=in-depth%20guides&ep.shares_count=more%20than%20500&ep.is_refresh=yes&ep.content_sections=seo&ep.infinte_scroll=no&ep.has_summary=no&ep.document_ref=&ep.pers_op=yes
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-TJPZMKSHES&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 204 collect
stats.g.doubleclick.net/g/ 0
254 B 97ms
32ms Ping
text/plain 2a00:1450:400c:c02::9b
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://stats.g.doubleclick.net/g/collect?v=2&tid=G-TJPZMKSHES&cid=1738634928.1693498842&gtm=45je38u0&aip=1
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-TJPZMKSHES&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2a00:1450:400c:c02::9b Brussels, Belgium, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 ga-audiences
www.google.co.uk/ads/ 42 B
107 B 161ms
79ms Image
image/gif 2a00:1450:4001:806::2003
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-TJPZMKSHES&cid=1738634928.1693498842&gtm=45je38u0&aip=1&z=21563549

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:806::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
x-content-type-options: nosniff
server: cafe
content-type: image/gif
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cache-control: no-cache, no-store, must-revalidate
cross-origin-resource-policy: cross-origin
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 204 collect
region1.google-analytics.com/g/ 0
54 B 33ms
32ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.google-analytics.com/g/collect?v=2&tid=G-S08JX510ES&gtm=45je38u0&_p=1500883060&cid=1738634928.1693498842&ul=en-us&sr=1600x1200&uaa=&uab=&uafvl=&uamb=0&uam=&uap=&uapv=&uaw=0&_s=1&dl=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&sid=1693498841&sct=1&seg=0&dt=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&en=page_view&_fv=1&_ss=1&ep.author_name=anna%20crowe&ep.publish_year=2020&ep.article_all_categories=seo&ep.article_word_count=2000%2B&ep.title_word_count=50%20-%2074&ep.publish_year_month=2020-04&ep.content_type=in-depth%20guides&ep.primary_categories=seo&ep.content_group=seo&ep.shares_count=more%20than%20500&ep.is_refresh=yes&ep.content_sections=seo&ep.infinte_scroll=no&ep.has_summary=no&ep.document_ref=&ep.pers_op=yes
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-S08JX510ES&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 /
www.google.com/pagead/1p-user-list/536815543/ 42 B
455 B 136ms
55ms Image
image/gif 2a00:1450:4001:829::2004
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.com/pagead/1p-user-list/536815543/?random=1693498841725&cv=11&fst=1693497600000&bg=ffffff&guid=ON&async=1&gtm=45He38u0&u_w=1600&u_h=1200&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&frm=0&tiba=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&fmt=3&is_vtc=1&random=2525102911&rmt_tld=0&ipr=y

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:829::2004 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
Content-Security-Policy	script-src 'none'; object-src 'none'
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
content-security-policy: script-src 'none'; object-src 'none'
x-content-type-options: nosniff
server: cafe
content-type: image/gif
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cache-control: no-cache, no-store, must-revalidate
cross-origin-resource-policy: cross-origin
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 /
www.google.co.uk/pagead/1p-user-list/536815543/ 42 B
455 B 51ms
49ms Image
image/gif 2a00:1450:4001:806::2003
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.co.uk/pagead/1p-user-list/536815543/?random=1693498841725&cv=11&fst=1693497600000&bg=ffffff&guid=ON&async=1&gtm=45He38u0&u_w=1600&u_h=1200&url=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&frm=0&tiba=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&fmt=3&is_vtc=1&random=2525102911&rmt_tld=1&ipr=y

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:806::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
Content-Security-Policy	script-src 'none'; object-src 'none'
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
content-security-policy: script-src 'none'; object-src 'none'
x-content-type-options: nosniff
server: cafe
content-type: image/gif
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cache-control: no-cache, no-store, must-revalidate
cross-origin-resource-policy: cross-origin
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 /
tr.lfeeder.com/ 43 B
294 B 231ms
94ms Image
image/gif 18.66.112.30
AMAZON-02

General

Check archive.org

Show headers Download Go to Show image

Full URL: https://tr.lfeeder.com/?sid=ywVkO4XKPNd7Z6Bj&data=eyJnYVRyYWNraW5nSWRzIjpbXSwiZ2FNZWFzdXJlbWVudElkcyI6WyJHLTlRUVBMMjEyWjQiLCJHLVRKUFpNS1NIRVMiLCJHLVMwOEpYNTEwRVMiXSwiZ2FDbGllbnRJZHMiOlsiMTczODYzNDkyOC4xNjkzNDk4ODQyIl0sImNvbnRleHQiOnsibGlicmFyeSI6eyJuYW1lIjoibGZ0cmFja2VyIiwidmVyc2lvbiI6IjIuNjEuMyJ9LCJwYWdlVXJsIjoiaHR0cHM6Ly93d3cuc2VhcmNoZW5naW5lam91cm5hbC5jb20vdGVjaG5pY2FsLXNlby9tZXRhLXJvYm90cy10YWdzLXJvYm90cy10eHQvIiwicGFnZVRpdGxlIjoiQmVzdCBQcmFjdGljZXMgZm9yIFNldHRpbmcgVXAgTWV0YSBSb2JvdHMgVGFncyAmIFJvYm90cy50eHQiLCJyZWZlcnJlciI6IiJ9LCJldmVudCI6InRyYWNraW5nLWV2ZW50IiwiY2xpZW50RXZlbnRJZCI6IjVjNWQwN2E2MDYxZDViMjkiLCJzY3JpcHRJZCI6Inl3VmtPNFhLUE5kN1o2QmoiLCJjb29raWVzRW5hYmxlZCI6dHJ1ZSwiY29uc2VudExldmVsIjoibm9uZSIsImFub255bWl6ZUlwIjpmYWxzZSwibGZDbGllbnRJZCI6IkxGMS4xLjZlM2E5NzM4M2Q5MThkNWEuMTY5MzQ5ODg0MjA2OCIsImZvcmVpZ25Db29raWVzIjpbXSwicHJvcGVydGllcyI6e30sImF1dG9UcmFja2luZ0VuYWJsZWQiOnRydWUsImF1dG9UcmFja2luZ01vZGUiOiJvbl9zY3JpcHRfbG9hZCJ9
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 18.66.112.30 , United States, ASN16509 (AMAZON-02, US),
Reverse DNS: server-18-66-112-30.fra56.r.cloudfront.net
Software: CloudFront /
Resource Hash: b1442e85b03bdcaf66dc58c7abb98745dd2687d86350be9a298a1d9382ac849b

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:42 GMT
via: 1.1 98652de9f742fc1df9de714d921e14c2.cloudfront.net (CloudFront)
server: CloudFront
x-amz-cf-pop: FRA56-P5
x-cache: LambdaGeneratedResponse from cloudfront
content-type: image/gif
content-length: 43
x-amz-cf-id: efqa4zNszQ5TRI5EKldiMWPlnb8KcKlhtbLge3yEId9dvkVQXKL2XQ==

POST
H2 200 / Show response
www.facebook.com/tr/ Frame 3060 0
81 B 38ms
37ms Document
text/plain 2a03:2880:f177:185:face:b00c:0:25de
FACEBOOK

General

Check archive.org

Show headers Download Go to

Full URL

https://www.facebook.com/tr/

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a03:2880:f177:185:face:b00c:0:25de Frankfurt am Main, Germany, ASN32934 (FACEBOOK, US),

Reverse DNS

Software

proxygen-bolt /

Resource Hash

e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains

Request headers

Content-Type: application/x-www-form-urlencoded
Origin: https://www.searchenginejournal.com
Referer: https://www.searchenginejournal.com/
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
accept-language: en-GB,en;q=0.9

Response headers

access-control-allow-credentials: true
access-control-allow-origin: https://www.searchenginejournal.com
alt-svc: h3=":443"; ma=86400
content-length: 0
content-type: text/plain
cross-origin-resource-policy: cross-origin
date: Thu, 31 Aug 2023 16:20:42 GMT
server: proxygen-bolt
strict-transport-security: max-age=31536000; includeSubDomains

GET
H3 200 destination Show response
www.googletagmanager.com/gtag/ 223 KB
79 KB 52ms
52ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/destination?id=G-8FYBBBFMTF&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

QUIC, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

35525e7dd09f30770f4e568573d86e80d72f8dff50036ea684abf4545c2782da

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:42 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 80519
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:42 GMT

POST
H3 204 collect
region1.google-analytics.com/g/ 0
17 B 32ms
32ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.google-analytics.com/g/collect?v=2&tid=G-8FYBBBFMTF&gtm=45je38u0&_p=1500883060&cid=1738634928.1693498842&ul=en-us&sr=1600x1200&uaa=&uab=&uafvl=&uamb=0&uam=&uap=&uapv=&uaw=0&_s=1&dl=%2Ftsp_https%3A%2F%2Fwww.pubcon.com%2Fpubcon-pro-annual-2023&dt=PUBCON%20PRO%20ANNUAL%202023%20%5BCONFERENCE%20%26%20WORKSHOPS%5D&sid=1693498842&sct=1&seg=0&en=page_view&_fv=1&_ss=1&ep.category_spons_advertiser=PUBCON&ep.category_spons_campaign=PUBCON%20Q3&ep.category_spons_topic=SEO&ep.category_spons_path=%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&ep.category_spons_site_section=seo
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/destination?id=G-8FYBBBFMTF&l=dataLayer&cx=c
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:42 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H3 204 edge Show response
cmp.uniconsent.com/v2/ 0
456 B 66ms
66ms XHR
application/json 2606:4700:e2::ac40:8d0b
CLOUDFLARENET

General

Check archive.org

Show headers Download Go to

Full URL: https://cmp.uniconsent.com/v2/edge
Requested by: Host: cmp.uniconsent.com
URL: https://cmp.uniconsent.com/v2/main.min.js
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2606:4700:e2::ac40:8d0b , United States, ASN13335 (CLOUDFLARENET, US),
Reverse DNS
Software: cloudflare /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

Referer: https://www.searchenginejournal.com/
accept-language: en-GB,en;q=0.9
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36
Content-Type: text/plain;charset=UTF-8

Response headers

date: Thu, 31 Aug 2023 16:20:42 GMT
cf-cache-status: DYNAMIC
nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
server: cloudflare
access-control-allow-methods: GET, POST, OPTIONS
content-type: application/json
access-control-allow-origin: *
report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=QRAeaGqgnNJZtW1MhnF9kmugtlt9RQM1a0qid1WSxxipfaTRKC5uV20MAxGQptcx3pVnbU6%2FClkcE6UzQ1TwLGuS5pH7kn0u7x43v%2Fkf7QvXHe8Afby7MUWifTR%2B6rg9CjQBt2cv9HSraH8srbj2L%2Bo%3D"}],"group":"cf-nel","max_age":604800}
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cf-ray: 7ff69a359a4ad34b-CDG
access-control-allow-headers: Content-Type
alt-svc: h3=":443"; ma=86400

GET
H3 200 js Show response
www.googletagmanager.com/gtag/ 247 KB
84 KB 55ms
54ms Script
application/javascript 2a00:1450:4001:828::2008
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL

https://www.googletagmanager.com/gtag/js?id=G-QMGPZ7WN5P&l=dataLayer&cx=c

Requested by

Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtm.js?id=GTM-M2HM2DB

Protocol

Security

QUIC, , AES_128_GCM

Server

2a00:1450:4001:828::2008 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

Google Tag Manager /

Resource Hash

bb6b129d41ceaa66c9917448148b4120bd94630097e9a884756505b67bc54108

Security Headers

Name	Value
Strict-Transport-Security	max-age=31536000; includeSubDomains
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

date: Thu, 31 Aug 2023 16:20:43 GMT
content-encoding: br
strict-transport-security: max-age=31536000; includeSubDomains
server: Google Tag Manager
vary: Accept-Encoding
content-type: application/javascript; charset=UTF-8
access-control-allow-origin: *
cache-control: private, max-age=900
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
access-control-allow-headers: Cache-Control
content-length: 86218
x-xss-protection: 0
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
expires: Thu, 31 Aug 2023 16:20:43 GMT

POST
H3 204 collect
region1.analytics.google.com/g/ 0
17 B 33ms
32ms Ping
text/plain 2001:4860:4802:34::36
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://region1.analytics.google.com/g/collect?v=2&tid=G-QMGPZ7WN5P&gtm=45je38u0&_p=1500883060&_gaz=1&cid=1738634928.1693498842&ul=en-us&sr=1600x1200&ir=1&uaa=&uab=&uafvl=&uamb=0&uam=&uap=&uapv=&uaw=0&_eu=EA&_s=1&sid=1693498843&sct=1&seg=0&dl=https%3A%2F%2Fwww.searchenginejournal.com%2Ftechnical-seo%2Fmeta-robots-tags-robots-txt%2F&dt=Best%20Practices%20for%20Setting%20Up%20Meta%20Robots%20Tags%20%26%20Robots.txt&en=page_view&_fv=1&_ss=1
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-QMGPZ7WN5P&l=dataLayer&cx=c
Protocol: H3
Security: QUIC, , AES_128_GCM
Server: 2001:4860:4802:34::36 , United States, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:43 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

POST
H2 204 collect
stats.g.doubleclick.net/g/ 0
54 B 33ms
32ms Ping
text/plain 2a00:1450:400c:c02::9b
GOOGLE

General

Check archive.org

Show headers Download Go to

Full URL: https://stats.g.doubleclick.net/g/collect?v=2&tid=G-QMGPZ7WN5P&cid=1738634928.1693498842&gtm=45je38u0&aip=1
Requested by: Host: www.googletagmanager.com
URL: https://www.googletagmanager.com/gtag/js?id=G-QMGPZ7WN5P&l=dataLayer&cx=c
Protocol: H2
Security: TLS 1.3, , AES_128_GCM
Server: 2a00:1450:400c:c02::9b Brussels, Belgium, ASN15169 (GOOGLE, US),
Reverse DNS
Software: Golfe2 /
Resource Hash: e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:43 GMT
server: Golfe2
content-type: text/plain
access-control-allow-origin: https://www.searchenginejournal.com
cache-control: no-cache, no-store, must-revalidate
access-control-allow-credentials: true
cross-origin-resource-policy: cross-origin
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

GET
H2 200 ga-audiences
www.google.co.uk/ads/ 42 B
107 B 78ms
78ms Image
image/gif 2a00:1450:4001:806::2003
GOOGLE

General

Check archive.org

Show headers Download Go to Show image

Full URL

https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-QMGPZ7WN5P&cid=1738634928.1693498842&gtm=45je38u0&aip=1&z=1646329435

Protocol

Security

TLS 1.3, , AES_128_GCM

Server

2a00:1450:4001:806::2003 Frankfurt am Main, Germany, ASN15169 (GOOGLE, US),

Reverse DNS

Software

cafe /

Resource Hash

ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629

Security Headers

Name	Value
X-Content-Type-Options	nosniff
X-Xss-Protection	0

Request headers

accept-language: en-GB,en;q=0.9
Referer: https://www.searchenginejournal.com/
User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Safari/537.36

Response headers

pragma: no-cache
date: Thu, 31 Aug 2023 16:20:43 GMT
x-content-type-options: nosniff
server: cafe
content-type: image/gif
p3p: policyref="https://www.googleadservices.com/pagead/p3p.xml", CP="NOI DEV PSA PSD IVA IVD OTP OUR OTR IND OTC"
cache-control: no-cache, no-store, must-revalidate
cross-origin-resource-policy: cross-origin
timing-allow-origin: *
alt-svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
content-length: 42
x-xss-protection: 0
expires: Fri, 01 Jan 1990 00:00:00 GMT

Verdicts & Comments Add Verdict or Comment

515 JavaScript Global Variables

These are the non-standard "global" variables defined on the window object. These can be helpful in identifying possible client-side frameworks and code.

34 Cookies

Cookies are little pieces of information stored in the browser of a user. Whenever a user visits the site again, he will also send his cookie values, thus allowing the website to re-identify him even if he changed locations. This is how permanent logins work.

Domain/Path	Expires	Name / Value
www.searchenginejournal.com/technical-seo/meta-robots-tags-robots-txt	1970-01-21 00:00:58	Name: unic_usp Value: 1
.searchenginejournal.com/	1970-01-20 21:36:58	Name: __unid Value: f5cb36bd-d71e-bf83-4b67-dab4ed195fa1
.searchenginejournal.com/	1970-01-20 14:24:58	Name: lotame_domain_check Value: searchenginejournal.com
.searchenginejournal.com/	1970-01-20 16:34:34	Name: _fbp Value: fb.1.1693498841659.1302405144
.searchenginejournal.com/	1970-01-20 16:34:34	Name: _gcl_au Value: 1.1.1771204427.1693498842
.crwdcntrl.net/	1970-01-20 20:53:45	Name: _cc_dc Value: 1
.crwdcntrl.net/	1970-01-20 20:53:45	Name: _cc_id Value: be72ac0c6fce90dc35676659609844c1
.searchenginejournal.com/	1970-01-20 20:53:46	Name: _cc_id Value: be72ac0c6fce90dc35676659609844c1
.searchenginejournal.com/	1970-01-20 14:35:03	Name: panoramaId_expiry Value: 1694103641688
.searchenginejournal.com/	1970-01-20 14:35:03	Name: panoramaId Value: 4e20a97496e3eed52ae419c1843b4945a702c6018a9ab1de3b45d92b72798eb0
.searchenginejournal.com/	1970-01-20 14:35:03	Name: panoramaIdType Value: panoIndiv
www.searchenginejournal.com/	1970-01-20 14:26:25	Name: _lr_geo_location Value: US
www.searchenginejournal.com/	1970-01-20 14:26:25	Name: _lr_geo_location_state Value: CA
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga_9QQPL212Z4 Value: GS1.1.1693498841.1.0.1693498841.0.0.0
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga Value: GA1.1.1738634928.1693498842
www.searchenginejournal.com/	1970-01-20 14:26:25	Name: ln_or Value: eyIyNDkzMTA2IjoiZCJ9
.doubleclick.net/	1970-01-20 14:24:59	Name: test_cookie Value: CheckForPermission
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga_TJPZMKSHES Value: GS1.1.1693498841.1.0.1693498841.60.0.0
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga_S08JX510ES Value: GS1.1.1693498841.1.0.1693498841.0.0.0
.linkedin.com/	1970-01-20 16:34:34	Name: li_sugr Value: 5f9179f4-3888-44df-8cc3-a0a622daab71
.linkedin.com/	1970-01-20 23:10:34	Name: bcookie Value: "v=2&f26dbe7d-8e7c-42b6-8b28-11a27ddbe124"
.linkedin.com/	1970-01-20 14:26:25	Name: lidc Value: "b=OGST02:s=O:r=O:a=O:p=O:g=2996:u=1:x=1:i=1693498841:t=1693585241:v=2:sig=AQEQeO3Ip9m4nM1A8bih59gcrYGuvNO-"
.t.co/	1970-01-21 00:00:58	Name: muc_ads Value: bd62c03d-d5d6-4a29-ac58-5eaa2c1cd28a
.searchenginejournal.com/	1970-01-20 23:10:34	Name: _lfa Value: LF1.1.6e3a97383d918d5a.1693498842068
.twitter.com/	1970-01-21 00:00:58	Name: guest_id_marketing Value: v1%3A169349884196140433
.twitter.com/	1970-01-21 00:00:58	Name: guest_id_ads Value: v1%3A169349884196140433
.twitter.com/	1970-01-21 00:00:58	Name: personalization_id Value: "v1_7b+vNfA2rWHqAUcC3Brsmg=="
.twitter.com/	1970-01-21 00:00:58	Name: guest_id Value: v1%3A169349884196140433
.linkedin.com/	1970-01-20 15:08:10	Name: UserMatchHistory Value: AQILeQLpSAWKlwAAAYpMZZvP00hTEwpcINregNK2T1L_-w7B8u_Fh8FoC1qkoTs_WR_G4Sj4P4vQaQ
.linkedin.com/	1970-01-20 15:08:10	Name: AnalyticsSyncHistory Value: AQIKn4mBxemVyQAAAYpMZZvPrc3Sij6rNzYgdxHNNq56GHJ9WLICGqk7UTVJQ1X_-MaWI93izf6Oj_C6au_ZCQ
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga_8FYBBBFMTF Value: GS1.1.1693498842.1.0.1693498842.0.0.0
.www.linkedin.com/	1970-01-20 23:10:34	Name: bscookie Value: "v=1&2023083116204212b6ad00-2390-4c31-878f-155728660b6fAQGeTiuROf83tU49tH5Ib8CDVEHbmpFY"
.linkedin.com/	1970-01-20 18:44:10	Name: li_gc Value: MTswOzE2OTM0OTg4NDI7MjswMjEN0kSLZThe/+oCDHgI6nN2fVFYOSlj3AVjHk8WlLHxPA==
.searchenginejournal.com/	1970-01-21 00:00:58	Name: _ga_QMGPZ7WN5P Value: GS1.1.1693498843.1.0.1693498843.60.0.0

Security Headers

This page lists any security headers set by the main page. If you want to understand what these mean and how to use them, head on over to this page

Header	Value
Content-Security-Policy	upgrade-insecure-requests
Strict-Transport-Security	max-age=31536000; preload
X-Content-Type-Options	nosniff
X-Frame-Options	SAMEORIGIN
X-Xss-Protection	1; mode=block

Indicators

This is a term in the security industry to describe indicators such as IPs, Domains, Hashes, etc. This does not imply that any of these indicate malicious activity.

a.ad.gt
ad-delivery.net
ad.doubleclick.net
analytics.twitter.com
api.btloader.com
ats.rlcdn.com
bcp.crwdcntrl.net
btloader.com
c.amazon-adsystem.com
cdn.hadronid.net
cdn.id5-sync.com
cdn.linkedin.oribi.io
cmp.uniconsent.com
connect.facebook.net
geo.privacymanager.io
googleads.g.doubleclick.net
id.hadron.ad.gt
openfpcdn.io
px.ads.linkedin.com
px4.ads.linkedin.com
region1.analytics.google.com
region1.google-analytics.com
sc.lfeeder.com
secure.cdn.fastclick.net
securepubads.g.doubleclick.net
snap.licdn.com
static.ads-twitter.com
stats.g.doubleclick.net
t.co
tags.crwdcntrl.net
tr.lfeeder.com
www.facebook.com
www.google.co.uk
www.google.com
www.googletagmanager.com
www.linkedin.com
www.searchenginejournal.com
yne8nhtpw4pmzzo2a.ay.delivery
104.244.42.67
104.244.42.69
13.107.42.14
13.32.99.35
13.32.99.97
130.211.23.194
142.250.185.198
143.204.98.71
146.75.120.157
148.251.128.81
18.66.112.30
18.66.97.9
2001:4860:4802:34::36
23.209.239.88
2600:9000:20eb:e800:2:53b2:240:93a1
2600:9000:2250:2400:4:d7e1:700:93a1
2606:4700:10::6816:34ad
2606:4700:10::6816:445
2606:4700:10::ac43:266a
2606:4700:20::681a:246
2606:4700:20::ac43:4686
2606:4700:e2::ac40:8d0b
2606:4700:e4::ac40:a40e
2620:1ec:21::14
2a00:1450:4001:806::2003
2a00:1450:4001:827::2002
2a00:1450:4001:828::2008
2a00:1450:4001:829::2002
2a00:1450:4001:829::2004
2a00:1450:400c:c02::9b
2a02:26f0:480:f::213:7edd
2a03:2880:f083:100:face:b00c:0:3
2a03:2880:f177:185:face:b00c:0:25de
34.252.126.23
52.222.208.154
013eec022b83c1f01c2127108b2724d94f43a2c91ac337a3d317632739117ff0
022c491ef985ac446182294ceb47e595ecdbb537300c51e2ec10fc47387c62f7
0247df6b9220981fc47473c27043ad09602f542a58d563f44ae5a4e91b827329
02f29aa839f09fe8857e5dd54515e7234540e3c27e63cfbc7e97a1ed763cc223
053cb3f560d39447ce5eae1f319e68e76c56c67bcd1727db08c6cd3a480be51f
06b99248a163333e36980a6cfb756f1a7de60fa49517162b87b1a44d5d48f844
0769251815f84e36af15c7f3253c7ab8835e9a4f86f8160b9f39552ae40fbd5a
088a3fdf41602117cac6d3c843c7f89368719632f6e12a37b7a5cc2d16da19ed
095002a3d50047f79f593ea4ccfa5dea16ba15155fee61e1a86bf8c44e4805c0
0a03677a7e255d4d14265e4918f307dee169473d7b8b200ee02935a4104b923c
0bb059e797c405edc79fe7bc59a52b17a5a3fd3511adaba3a56a1cf543c973aa
0c9fb498a29dd3d10f8a6ade5bfb1b38aa0f91be670eb0c538413963d1bc06ac
0f8b5718fb74df9076bc80ad9c0f85f387438f22989f6e33cbb5853ec96c6cd7
10dc140898ff0dbc97793f8f1f805d8f93b81cc0d80aa65d6b3040d4c71698fc
111d4518d77b165368c37669f563a1d435e3766dda9544ae28c7ed965e05afb6
14a21fe9566f657b0de58994455d4fb1ebe13048c8bb9fac5c5d6b62c07cf68b
1632154cd5abe8555eb15315d6b3d0b1f40c26d08e6ce78f0160224de320ac4f
16abe109580561cc0ef661ba3bc4c5c212998d4f4c9cc0e693e3eba57011e907
1756fb46aa1a7fe26e8c57328db54497ef70236895be1a7160718bb772abe23b
1797345cc8bb4b78403623bb9e67dfc3f49f03ae3a237b40149dfb50f1e48f3b
189abbfd7d06f387e67fc91c6a25a0c838c8f2407ed7b89fc7d7faf8b26259bd
1b9d62fca3818f9b4d6fbe625e0b7adeb32c98a9eac289519f6bf7c165571c12
1c72b9e917c02f6a4ea2416520397bc0b6a5f79a553ee092a116a4177e6d19b9
1d457324cbe10e73b26ccfbbe9b797e6972b85d4ba1419c4ab233b0ec427fcc1
2394d12e4577671d6d8a98826b3712c6c321b2d3fdc67d335ee329415631cebb
24ae7b9ac5220f301dcfc8032ba2e78994ef99a7d859c7c343c5829259e318af
25ffc83cc41de6b1008a7a71b61931a10d8a8379c36b32eaa33d2f76135302d7
272ec4c2207545c671ade6cbabdc91a23409cf238731cb2390e5440c13281e2c
28fb91355106692115c5ca2c04cd15b441692c106ed07bd4cd398d14568b8f0f
292f853f9ef0e448c5536987fe87197f401bafcde3e0857e17de1f0676f5b2eb
2ac577ea78b268c5160027844c41d409e0a857b9651dde69561dd6a69bb7ad8d
2bc0406454463b7cca251018ae904ae21c02f0e835acd296c5a8229074756245
30c714bf4216e577686d238b98561d093672cb25bf90baab50dd956f75cda4b3
3101beb680551391e1b52cf702681807fe88f248ba4c41eeed398ad835f7ac80
31a87e09bc3fc7ccb2149b418299ecae339b11000c5c0c4f0ff574cbe8b2318d
329bb171b8530032a8731ec39e14a0e80ddef531cc60d68d37cc8f1011bd0f3f
340a49ba6b22c47b01b4aa9e42bc9b6b75f0a3b7938724ccf9347579cd0a0668
34cf4cbc97aba634d40287ae9d58896d84105879cd2173ad0361662222f94aee
35525e7dd09f30770f4e568573d86e80d72f8dff50036ea684abf4545c2782da
360ec0a5e7fd9eb35367277e9257aa6378fedb7bbf0bc53ad8e3886820086b09
382f122a9d53473605b8372e49a31660d0193e38ca95f5e8edd1cc5dcf7ee27e
38c872afb161a43f9bcfad5edefd2d2ee6583001be855fbee5be6069564523bc
38d942c37363629ce7c383d43a2880d7851302037218acbf27281b044f1b6861
3d8778a246ce2e2adfd3feeb4c8a60007f0c9a8a481503136a6ee80b7269d28e
3da9f17f868d54688d41272be758db97faba155afdf559ade101edd299fb2b62
4117699ce11d0dab6c19cf61dd4ca27aaa826d2807c3462a624daa20dae58a95
42d9492da8ce7bf85afd06946f26c71ce280c08974bfdebaa203febd000fdd60
43f804d38a294c6df1ce8ee64fb95ad0ff5a8d6d5685d9537df02212668a1dff
44a9acb685e5eefe17f7dbf12979ca0ad98d742a0c90e8cd7f14eb7e52716fe7
450f3ba4e47ee174bd9692b396f264b907d37d2528f53911760f3d0edb785f7e
46e1a5317649fd50f6f2cd67bbb8efb9a176e613d75442987855ba686b7682bf
471b6be282f70bd7404c7851171f4c3905a09f63c3d249fae1d36c8d6944fdf4
478e96615c10014582839fa4322b9eb45aba6731060c2315fc793020ecc45312
486dbb49fb36a8b8e7bb750b738fab6a2bd3aee598b3a71d8da405245447dd0f
494e6ad3ea844634436d169312c020a27761bd7fc0ae20649624296655c41cfb
4b8b01e2db6169d8257d0342cd62b76025e9003ba2e73a0bade425ef6af5b90b
4be18a8f3737b5c2ea4c46e00933d3bc636838cdb283cf4b89bfc2d2814d2222
4bfeaa13380e6ad01a2461fb050358e9b6a83aef5697c5ec1dd3a1313752bdd5
4d9a0eb909eb2995442424b569d668de4f9e175558a2b288b1c382666e9af0f4
4fca7e9d2305082e22ac89090f8b7e9488602b6b4ef27dd30c9342f9c36b0c1e
4feba251a69abc0926f05804e759752ad346892f397ffdac23ab18a7b5b009e8
53303915256578353cd06340f59654a24cd04b404d2bfc0851bbebc03d946dc1
53b4ab18872c599c620b3d329d3894f9c2973d3339b4ca4679e6afd4215a01f0
57b19a7a79fcf081749d34fdd3a96cbc11419416b760a3be213aaf509097de17
5d55ce9c3ac7a5f37a38813a2deed310abde9e63d0d36912e2e5e59751ca66c7
5da4ec024f5d8814b0f272f9e9ba8457e0c1615c7e25a4fda2dcf550eb46efe3
5de89f9d56f5fbeb9ac1a79ae0edc74a653d53910e82b14d09b0ad5f6f29d413
6095256b5d03a355c7dd87945ee5022f7a17135e2cba4f28834598cec0b09238
61be5239a27eb231bc538ab7164a87e579ff695783709cb9f8eafcf71f3b4ccb
61fe6af974028ea3358d36fa08e7b5a7df61010e4e91f2ff33914012a24084fe
62901637b079ad004302620acc29667e05931a0bf2f8f8f0a992f863b7a0febd
63fa00bcc8093c9fc6652d02aebfe2e54e99ebad34954f877bdb51e655bdc5e2
64bf9288344a9fbdb4f273c888a10783201bf1a782d5471c82a8e7e7fa3feaed
67e8edd6b472ee4f120a8576233e3954b0735bc261ff1aff11fc0629e1b2d17c
6c76972839a5126e9e07e4958eb6b5ed3ec40985e62564c9d31adcac47486da6
6e91aaec2cb3510b97bb0655abdb08942dbefd617b169d0cd97b23fc48e68b2b
72790a1735404379453c3f2c9f095b3c326f10c6efb14485931bac45075afbb9
7b1eaaaf180a13c29b6dddc3b0ae23333b4397e0f3c065b4c86da2f2530a5f89
7d68e1b3634db2da8c394ef1754ae0bb9e0fe14e550643e0b913464ce66ba6ac
8136d38f63fc0dc0045fc8f16f581ef8bf1b7882c834322cc6216b3f5c1d577d
84d0f368d9fcacc627d966edb4e5c47a57b081455bd7eaf5fc8d5904d95b9b2f
85b0fe439768c208c0b3d9157178b8a1ac48fba8a191a3d8d7f1c3c1dcb1dcbd
8af8ed19513c17a73f34a27b342003a52850988e6aa67c97c808f340d5f09878
8b9180ed5e3b5e2d1acd5e2215070d59a589eae5de6ccd840e9e700acb71dcec
901a0b166ebe1970fd7e9d6d1c85791718ab530f1c63d293e9192063cebd20bf
917106b3d05f0bda89390297ea5672b298a0bf21bd494a53ba930c235522dd94
958f778236afbca87940af06f9fae60d4170bedfe89275710a3408d2ad9b92a4
98aabe4d6eacbd5bb3bffeeb71a0946e9a7241984ef448a981d8f64618b60453
9a1eb559f60a9f2344882c89cc97365185663d3507382c35d77a30ad5bfda98a
9c2c86e88fe2074f9ddbd073add93e47208ae95d2947deb81e4da32c983b01d5
9e41e783ec4cfc524c1666d1d5a4c805f8e92be52b030d130acfb31105e1e04c
9f46649ea544819982ea288c6f386dd67d46da0f453f95da542196372b79731e
9ff3d76471ddf3e6dc85d985ac7911883108c186d71bca9fdaf4524de72ed421
a171e64ec4287990b354e03ec80aa0b83e9c01be406cf9af7c232ec40439e7e5
a3281e768c022f387f51e633512eb2baeb930c850855b5dd884c0acc64bee312
a3cf00c109d907e543bc4f6dbc85eb31068f94515251347e9e57509b52ee3d74
a5ed5a045a88a29a2a50dcdc411f10ebc4f5bb18df64bfa1fbd1cbd6b0fe1c24
a6333929a02027e96ecf154218e5fc09e7e64e629c4284d98766878a09d93988
ab8f559ef6670cda1ce49b4a2dda28eaefc6f6f384cf9835484569cf89a986bb
abd2c31c501f8efcd7dcb8bfda286fd337d79183b340d7fd1bc81a37f8d8a1cc
ac8778041fdb7f2e08ceb574c9a766247ea26f1a7d90fa854c4efcf4b361a957
b13800888b404eb02827c017d56ae6e80c9a3a4d6fa2bec809a3ca261e2ebde1
b1442e85b03bdcaf66dc58c7abb98745dd2687d86350be9a298a1d9382ac849b
b4241bbc1b258b28db128b7ba8bc1c063982c7b110f25ab5ae91449e2433d0a8
b697be2ac6551cd74ebd7ccbe571f934ba35440eba59039084641ca6e823319a
b81b00bc7e76a7bb3b4c63f58208f092f0dee448ef77b1a117822fa9dbcf0e89
bb6b129d41ceaa66c9917448148b4120bd94630097e9a884756505b67bc54108
bd362f4e6ebce8ac52397d018782ec0dd387292b6edd2d33809f0eec847ad114
bf0808bd9c80866718bc07d9445c6fdadadabe21cc341d4fe156a1b09708d3fd
c02addcf940dcfd73293ccb530238f1f1737d33a6f61f324ef09ad1c69fcf594
c2636d239c265a5656677b6ed3f842f55edaf2040281669bcf3d173c8fbf4e3f
c4abf725ca2c888df89bee0a81a50fc7dfc69777cec49ef80ceef97123983f47
c4ae91e138391f227e39aa545c907ad7ecc287f64db772dde06ebb86bd5896ad
c626dabe59f1e78ba16b99eec8c8291f67ce15788b7556911f68b9be562ac5bb
cf4724b2f736ed1a0ae6bc28f1ead963d9cd2c1fd87b6ef32e7799fc1c5c8bda
cf79a232f8fe7bd21ac01c89f6e1c3774e8914bf8ae900ae979877504662699d
cf7fcc9f75c8717897bfaef72f303fab423ce1b70c98512aeb3677e4af988dee
d0928d10c6a9b3d790fc7e11c7899f435f4374ddc31f7fefdd10e1e6e1d55e5d
d56ddb6d10ce41c10ff7f13b8b651cfea5afaf42a99421d728314cc639abe3fa
d632f1fd8fd7e6f6a9fbbdf2ad865c79432d41f8e203db015dfb473005243d95
d63969cac377eba8dc163b0ba842d53d263a6bbb31f1a6e59f3314da8d02de11
d7dd0007fc5d64b48c0fd0b26382a8c93b93ca82a9b32a7244cc73f63ba5393c
d888d58ad34eaf2c795253ddc129cd07e5d7904bf6583614a4338e21901cd4c0
d8efad9b8eeac3ab790af7cdc4390945ee3085d4f63f3bcde1e8b6c30e9f3a4f
d961b08e4321250926de6f79087594975fe20ad1518de8f91eb711af5d1a6ef8
daa5cbff105aa4dd98b3982e70a45b7668f394e78b3e5b8a8a2ed470fa83c9c0
db62c4431217c039c1b55093816e6a09be4e87fe931523f74a9da9c83d497339
ddd056ea0784914f17c6730b6fe3b438edc90fb3587c1aedd907ee0f13225d11
df790197e64683df0e6a96ff423dc23bd96010b5aa6bee119c148b70f6dc33ca
e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
e5429ce4c488099db846eb6568ffd7965bca538d9a28cec723bf561c372880b3
e6d37686ce0a609903b11061c8f5a97f4f61e986d84ca1b366e2739a13aca87b
e75ca65b543408f55b9fa0b19d8a28e21b6d710a5447a25a22cf6b786d428527
e820733377d4af31fd643ac9a24856e8f33ca799f97259e59c868302a513c874
e98439db943f5748a9bcc5f687bb3b66b3c50f9b77cf3d4eb4ad2fd53aed1258
e9dfb181b7284e1d5674c9497da7aa98db42987a389b12f57b344285889bf893
ea7f8924b70229fe13fe0587bf81b59fa5a235690c936950f09cd0de156e013e
eee8aa7d4074bff36d1654782539f3ba2d29421d11fe2fcdd327d3f5bf750f8e
eef945f7b56946036572f7b2f4067b0c3c139440720704f39f1e25e7e250a57f
ef1955ae757c8b966c83248350331bd3a30f658ced11f387f8ebf05ab3368629
f44af7fb8b5552625fa13bc43ac178243c267b6f9677a228603e7016fd051b06
f50db6abd4c6f1298f381d938cee3dbc3fc2efd813723b5cbe62e2b215f036cc
f9e9d6c9d3b76ddbbaf7cd44bbcb5e7c0eb9cdb69bb4c3895117f2341474b75f
fa53fcd8da139d256c0ca83b69cb37473ca627b6052368ed3327c80d9fb61e25
fb19521eeb71c0b7bcdcbf3f457b81aac65f795eb7bda13b4c305b1f23ffa740
fb9cbcc030c3111a1c91b31feab02da45e55a4440b784cb6b4a4f743cd99edf7

www.searchenginejournal.com Open in urlscan Pro 148.251.128.81 Public Scan

Summary

urlscan.io Verdict: No classification

Domain & IP information

Screenshot Live screenshot Full Image

Page Title

Page URL History Show full URLs

Detected technologies

Page Statistics

158 Requests

99 %HTTPS

57 %IPv6

28 Domains

38 Subdomains

35 IPs

5 Countries

2906 kBTransfer

7065 kBSize

34 Cookies

31 Outgoing links

Page URL History

Redirected requests

158 HTTP transactions Everything HTML Script AJAX CSS Image Expand all 15 data transactions

Request headers

Response headers

Redirect headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

Request headers

Response headers

www.searchenginejournal.com Open in urlscan Pro
148.251.128.81 Public Scan

Screenshot
Live screenshot

Full Image

158
Requests

99 %
HTTPS

57 %
IPv6

28
Domains

38
Subdomains

35
IPs

5
Countries

2906 kB
Transfer

7065 kB
Size

34
Cookies

158 HTTP transactions
15 data transactions