首页 > 其他 > 详细

爬虫练习

时间:2018-10-26 22:48:11      阅读:191      评论:0      收藏:0      [点我收藏+]
#!/usr/bin/env python
# -*- coding:utf-8 -*-
import urllib.request#这里必须要加request
import urllib.parse
import requests
import sys
#sys.Setdefaultencoding(‘utf-8‘)
import urllib
import json
import time
from bs4 import BeautifulSoup
#发起GET请求
# url = ‘http://kaoshi.edu.sina.com.cn/college/scorelist?tab=batch&wl=1&local=2&batch=&syear=2013‘
# response = urllib.request.urlopen(url=url)
# result = response.read().decode(‘utf-8‘)#解码后可以正常输出
# print(result)
#发起POST请求
url = "http://shuju.wdzj.com/plat-info-59.html"
data = urllib.parse.urlencode({type1:x,type2:0,status:0}).encode(utf-8)
request = urllib.request.Request(url=url,data=data)
#opener = urllib.build_open(urllib.HTTPCookieProcessor()) #跟上述差不多,只是了一个data
response = urllib.request.urlopen(request)
result = response.read().decode(utf-8)
print(result)
result = result.replace(<html><head></head><body><pre style="word-wrap: break-word; white-space: pre-wrap;">, ‘‘)
result = result.replace(</pre></body></html>, ‘‘)
for key in json.loads(result,strict=False).keys():
    print(key)
#报错:json.decoder.JSONDecodeError: Expecting value: line 1 column 2 (char 1)

 

爬虫练习

原文:https://www.cnblogs.com/lifengwu/p/9858998.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!