scrapy is a good spider server
参考文档
scrapy startproject test1
scrapy genspider testspider www.baidu.com
scrapy parse --spider=testspider -d 3 'https://www.cnblogs.com/notfind/p/11633706.html'
原文:https://www.cnblogs.com/MagicalFool/p/12187721.html