Scraping

I've been looking at Kasada for a while now, and every time I tried to approach it in a simple way. If you send the right token, you get the page and move on. That's exactly what I did in THE LAB #76, and also the first time I ran into it back in 2022, wh

X has sent cease-and-desist letters to Nitter, the open source project behind privacy-friendly X front ends, demanding its instances and code repository be taken down over alleged scraping.

This is a guest post written by the Hyper Solution team. For an independent benchmark of proxy prices, visit our Proxy Pricing Benchmark tool.We came up in the sneakerbotting world. When you are racing thousands of other bots for a pair of shoes that sell

There's no doubt that Scrapy is one of the most widely used libraries for web scraping. What made it so successful is its unique architecture and structured approach to building web spiders.GoScrapy tries to replicate the same philosophy in Go, taking adv

The ratio was 6:1 in March.

Also here's a cool unrelated photo of a chipmunk because I need some chill

Every few weeks a new headless browser lands on GitHub promising the same thing: a clean fingerprint, a tiny footprint, and anti-bot bypasses for free. Most of them are patched Chromium or patched Firefox. Obscura is not. It is a browser engine written fr

August 2022. Inside a hotel room in Tuscany, quite bored because of the rain, I started a project that I had been thinking about for some time. A blog about web scraping. Never imagined that someone would have read it. It was just an excuse for writing do

Open-source project ShieldFont changes the text that basic AI scrapers extract while preserving what people see, offering websites another defence against unauthorised data collection