Framework on Web Scraping Python https://webscrapingpython.com/tags/framework/ Recent content in Framework on Web Scraping Python Hugo en-us Tue, 30 Dec 2025 10:00:00 +0100 Scrapy Basics: When to Upgrade from requests https://webscrapingpython.com/posts/scrapy-basics/ Tue, 30 Dec 2025 10:00:00 +0100 https://webscrapingpython.com/posts/scrapy-basics/ <p><code>requests</code> + <code>BeautifulSoup</code> is fine until you&rsquo;re managing queues, retries, deduplication, concurrency, and pipeline logic by hand. That&rsquo;s when Scrapy starts earning its keep.</p>