首页 > 编程语言 > 详细

Python异步请求案例

时间:2021-08-11 09:37:22      阅读:17      评论:0      收藏:0      [点我收藏+]

 

import asyncio
import aiohttp
import time


def test(number):
  start = time.time()

  async def get(url):
    session = aiohttp.ClientSession(connector=aiohttp.TCPConnector(limit=64, verify_ssl=False))
    response = await session.get(url)
    await response.text()
    await session.close()
    return response
  
  async def request():
    url = https://static1.scrape.center/
    await get(url)

  tasks = [asyncio.ensure_future(request()) for _ in range(number)]
  loop = asyncio.get_event_loop()
  loop.run_until_complete(asyncio.wait(tasks))

  end = time.time()
  print(Number:, number, Cost time:, end - start)


for number in [1, 3, 5, 10]:
  test(number)

 

 

结果如下:

Number: 1 Cost time: 0.4136490821838379
Number: 3 Cost time: 0.17262792587280273
Number: 5 Cost time: 0.17714190483093262
Number: 10 Cost time: 0.16022205352783203

 

摘自拉勾教育《52讲轻松搞定网络爬虫》之异步爬虫的原理和解析

Python异步请求案例

原文:https://www.cnblogs.com/zhzhang/p/15126640.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!