I use IA for "problem" websites, e.g., ones that rely on SNI, i.e., ones hosted at certain CDNs. I simply add add these sites to a list and the local proxy does the rest.
http-request set-uri https://web.archive.org/web/1if_/http://%[req.hdr(host)]%[pathq] if { hdr(host) -m str -f list }
IA "hosts" an enormous number of sites without the need for SNI (plaintext hostnames sent over the wire).
EDIT: @sebow the way they (re)format the HTML is less friendly to the text-only browser I use.
What’s your issue with SNI/threat model? If you use a non-SNI site, anyone can tell which site you are visiting since there’s only one domain on that IP.
Seconding that curiosity. Pretty much every web server I've built uses SNI (at least if it's hosting sites under multiple domains), and the only "downside" of which I'm aware is the lack of IE6 support.
There is a difference between making something "impossible" and making something "easier". Performing reverse DNS lookups, or otherwise trying to maintain a global table of 1:1 domain:IP mappings and perform lookups in real-time, is nowhere near as easy nor reliable as sniffing SNI. IME, it is neither easy nor reliable, nor worth the effort. SNI is the preferred method. SNI is easier. SNI is 100% reliable for detecting what hostname the user is trying to access.
What is the point of so-called "DNS privacy/Private DNS" if "anyone can tell which site you are visiting" simply by observing IP addresses, without any need to see domainnames.
If SNI (plaintext hostnames sent over the wire) is a non-issue, then why are people working on encrypted Client Hello in TLS1.3.
This is a neat shortcut to simply get the very first archived version! I often have to go to /*/ and manually click on one of them, which is very tiring.
There might be, although I would not be surprised if it was slower than the one for the link to the first because the link to the latest is dynamic. A two-step "shortcut" is to use Lua with the proxy to retrieve the link to the latest then follow that link.
To get the link to the latest, can use memento. For example,
usage: echo example.com|1.sh
#! /bin/sh
read x;
curl -A "" https://web.archive.org/web/$(curl -A "" -s "https://web.archive.org/cdx/search/cdx?url=$x&fl=timestamp,original&limit=-1"|tr \\40 /)
Why is IA not globally distributed, like a CDN?
I use IA for "problem" websites, e.g., ones that rely on SNI, i.e., ones hosted at certain CDNs. I simply add add these sites to a list and the local proxy does the rest.
IA "hosts" an enormous number of sites without the need for SNI (plaintext hostnames sent over the wire).EDIT: @sebow the way they (re)format the HTML is less friendly to the text-only browser I use.