首页 > 其他 > 详细

请求头爬虫

时间:2021-03-28 17:47:57      阅读:30      评论:0      收藏:0      [点我收藏+]

import requests
import json

url = ‘https://search.lionairthai.com/SL/Flight.aspx/GetFlightSearch‘
headers = {‘accept‘: ‘application/json, text/javascript, */*; q=0.01‘,
‘accept-encoding‘: ‘gzip, deflate, br‘,
‘accept-language‘: ‘zh-CN,zh;q=0.9‘,
‘content-length‘: ‘11‘,
‘content-type‘: ‘application/json; charset=UTF-8‘,
‘cookie‘: ‘__ssds=2; _ga=GA1.3.1021526661.1615344085; __ssuzjsr2=a9be0cd8e; __uzmaj2=3c9decbe-232c-4b4f-b590-649bb9522b47; __uzmbj2=1615344238; cf_chl_2=c4ef57baf6f18b9; cf_chl_prog=a17; cf_clearance=8a2d0edc7f73b20add7cace657fa5e899aa87500-1615876437-0-250; AWSELB=F3BBC79B045A402DF4C90E4686D51681E3D3302EB8A05241562F0A898AF13D3357F387AEE915059872D23438E7BA519A35E800137FDFEE33C495D3DC19938A7362652567CA; AWSELBCORS=F3BBC79B045A402DF4C90E4686D51681E3D3302EB8A05241562F0A898AF13D3357F387AEE915059872D23438E7BA519A35E800137FDFEE33C495D3DC19938A7362652567CA; __cf_bm=07f6a88757aa0d7ed4ebb41da74aac69a286d50b-1615876440-1800-AU1O1g2YGaMYstxhd+FYsb2Tni62UGEh7k95cnCaalJ/3/G+s8dZcbK4wbmiHYTiqWaoB058EJenbC+eawPw4jpbmxLuPX7D+Vuq9Ro+ycotgEz5J2nwzOyVKKgf89wOg9s7dP10PV3qrqCa5H3inL1XtuJoZxNZpEVPG1KiLIA0bAaP9G46FNuUIImIO/d//Q==; _gid=GA1.2.911798378.1615876501; _gat=1; _gat_UA-148440552-1=1; __utma=78513033.1021526661.1615344085.1615529447.1615876503.8; __utmc=78513033; __utmt=1; __utmb=78513033.1.10.1615876503; _dc_gtm_UA-67738523-1=1; ASP.NET_SessionId=1rf3ccz1rrn2ksj3fh5wpdj4; _gid=GA1.3.911798378.1615876501; ref=refer=https://search.lionairthai.com/; CurrentCustomerInfo=CurrentEncryptCustomer=17Dck4bhvKyYuayH/v/XPEoZmmwLN5gE; CustomerInfo=CustomerUserID=207&Culture=en-GB&isAF=1&CurrentEncryptCustomer=17Dck4bhvKyYuayH/v/XPEoZmmwLN5gE&B2BID=0&UserLoginID=0&QueryString=YWlkPTIwNyZkZXBDaXR5PURNSyZhcnJDaXR5PUNOWCZKdHlwZT0yJmRlcERhdGU9MzElMmYwMyUyZjIwMjEmYXJyRGF0ZT0wMSUyZjA0JTJmMjAyMSZhZHVsdDE9MSZjaGlsZDE9MCZpbmZhbnQxPTAmcHJvbW90aW9uY29kZT0mZGY9VUsmYWZpZD0wJmIyYj0wJlN0PWZhJkRGbGlnaHQ9ZmFsc2Umcm9vbWNvdW50PTEmc2lkPU1RQTVBRElBTGdBeUFEVUFOQUF1QURnQU9RQXVBREVBTkFBMkFBJTNkJTNkJmN1bHR1cmU9ZW4tR0ImdXI9bGlvbmFpcnRoYWkuY29t; __uzmcj2=5989243343004; __uzmdj2=1615876521‘,
‘origin‘: ‘https://search.lionairthai.com‘,
‘referer‘: ‘https://search.lionairthai.com/‘,
‘user-agent‘: ‘Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.190 Safari/537.36‘,
‘x-requested-with‘: ‘XMLHttpRequest‘}

data = {‘t‘:‘3E4‘}

response = requests.post(url=url, headers=headers, data=json.dumps(data))
res = response.json()
jsons = json.dumps(res)
with open(‘lionairthai-spider-json.txt‘, ‘w‘, encoding=‘utf-8‘) as f:
f.write(jsons)
print(jsons)

请求头爬虫

原文:https://www.cnblogs.com/thaimj1314520/p/14588631.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!