middlewares.py
settings.py 第55行
DOWNLOADER_MIDDLEWARES = { ‘scrapy1.middlewares.Scrapy1DownloaderMiddleware‘: 543, }
LOG_LEVEL = ‘ERROR‘
myspider.py
class TestSpider(scrapy.Spider): name = ‘qiubai‘ # allowed_domains = [‘www.xxx.com‘] start_urls = [‘https://www.baidu.com/s?wd=ip‘] def parse(self, response): print(response)
原文：https://www.cnblogs.com/NachoLau/p/10473393.html