Anti-Bot on Web Scraping Python https://webscrapingpython.com/tags/anti-bot/ Recent content in Anti-Bot on Web Scraping Python Hugo en-us Tue, 03 Mar 2026 10:00:00 +0100 CAPTCHAs: What Works, What's Legal, What's Not https://webscrapingpython.com/posts/captcha-overview/ Tue, 03 Mar 2026 10:00:00 +0100 https://webscrapingpython.com/posts/captcha-overview/ <p>CAPTCHAs are the point where scraping stops being a technical problem and starts being a legal and ethical one. Here&rsquo;s the honest landscape.</p> User-Agents and Browser Fingerprinting https://webscrapingpython.com/posts/user-agent-fingerprinting/ Tue, 21 Oct 2025 10:00:00 +0200 https://webscrapingpython.com/posts/user-agent-fingerprinting/ <p>The default <code>requests</code> User-Agent (<code>python-requests/2.x</code>) is the fastest possible way to get blocked. But modern anti-bot stacks look at far more than one header.</p> Proxies and Rotating IPs: When You Actually Need Them https://webscrapingpython.com/posts/proxies-rotating-ips/ Tue, 30 Sep 2025 10:00:00 +0200 https://webscrapingpython.com/posts/proxies-rotating-ips/ <p>Most scraping tutorials reach for proxies on page one. In reality, you should reach for them last — after you&rsquo;ve verified a single IP with a good <code>User-Agent</code> and sensible rate limit actually gets blocked.</p>