Tag: common crawl

Articles and experiments related to common crawl.

Your Attention Is All I Need

I measured the external link ratios of 95 websites across a decade of web archive data (2014 vs 2024). The finding: news publishers have dramatically reduced the number of links they make to other sites, and a growing number of pages have become invisible to crawlers entirely. The open web's link graph is thinning, and I think I know why.

Read article

Stay in the loop.

I'm trialing a newsletter. Join for monthly insights into web dev, Chrome, and the open web.

alternate_email

Get in touch

Open to chat about Chrome or Web development.

Book a consultation