Why Prefetch Is Broken

May 27th, 2021
privacy, tech
When coding a webpage, sometimes you know something is very likely to be needed, even if it's not needed yet. You can give the browser a hint:
<link rel=prefetch href=url>
The browser will take a note, and then when it doesn't have anything more important to do it might request url. Later on, if it does turn out to need url, it will already have it.

For example, I wrote a slideshow where each slide was essentially:

Slide N:
<img src=img_N>
<link rel=prefetch href=img_N+1>
Prefetching the image for slide N+1 when viewing slide N made each transition practically instant.

This works for images, but also works for CSS, JS, HTML, anything! Or, at least, it used to.

The browser stores URLs it fetches in a cache. At its simplest this looks like a big dictionary, from url to the contents of that url:

a.test/js javascript1
b.test/js javascript2

Unfortunately, attackers can abuse this to learn about your browsing on other sites, and all the major browsers (Safari, Chrome, Firefox) now have partitioned their cache. This means if you are on a.test and load a.test/js that JS will not be reused if you go to b.test and load a.test/js again. The dictionary's keys look like (site, url):

a.test:a.test/js javascript1
b.test:a.test/js javascript1
b.test:b.test/js javascript2

Even if the keys a.test:a.test/js and b.test:a.test/js both have exactly the same JS bytes, they need to be kept separate to avoid a privacy leak.

So now imagine you are a modern browser visiting a.test and you encounter:

<link rel=prefetch href=b.test/index.html>
Where should you store it in your cache? Well, it depends what the user is going to do. If they are going to click on a link to b.test/index.html, then when they need the HTML they will be visiting b.test and so you want to store it as b.test:b.test/index.html. On the other hand, if it's going to load in an iframe, the user will still be on a.test and so you want to store it as a.test:b.test/index.html. You just don't know. Just guess?

The guess is a risky one: if you store it under the wrong key then you'll have fetch the same resource again just to store it under the right key. Users will see double fetching.

It turns out browsers guess differently here. I made test pages (iframe, new page) and while Firefox guesses you'll load it in an iframe, Safari (with the experimental LinkPrefetch setting enabled) and Chrome guess you'll load it in a new page.

Except, I think this implies more of a decision than there probably actually was. I doubt anyone explicitly considered the probability that a prefetched resource would be used by an iframe. Instead, my guess is when updating an enormous amount of code to add cache keys, multiple developers just ended up coding different things.

I've filed a spec issue (#6723) proposing:

<link rel=prefetch href=b.test/index.html as=iframe>
<link rel=prefetch href=b.test/index.html as=document>
Here's hoping browsers are interested in fixing this, and stopping those double fetches.

(Disclosure: I work for Google, but not on Chrome. Speaking only for myself.)

Comment via: facebook, lesswrong, hacker news

Recent posts on blogs I like:

Abigail Shrier's Bad Therapy: Surveys

Surveys matter!

via Thing of Things April 12, 2024

Clarendon Postmortem

I posted a postmortem of a community I worked to help build, Clarendon, in Cambridge MA, over at Supernuclear.

via Home March 19, 2024

How web bloat impacts users with slow devices

In 2017, we looked at how web bloat affects users with slow connections. Even in the U.S., many users didn't have broadband speeds, making much of the web difficult to use. It's still the case that many users don't have broadband speeds, both …

via Posts on March 16, 2024

more     (via openring)