Architecture on Web Scraping Python https://webscrapingpython.com/tags/architecture/ Recent content in Architecture on Web Scraping Python Hugo en-us Tue, 13 Jan 2026 10:00:00 +0100 Scrapy Pipelines and Middlewares Explained https://webscrapingpython.com/posts/scrapy-pipelines-middlewares/ Tue, 13 Jan 2026 10:00:00 +0100 https://webscrapingpython.com/posts/scrapy-pipelines-middlewares/ <p>Scrapy&rsquo;s two extension points look similar but do opposite things. Middleware sits between Scrapy and the network; pipelines sit between the spider and storage.</p>