首页 > Web开发 > 详细

use selenium in scrapy webdriver

时间:2015-05-03 20:16:48      阅读:932      评论:0      收藏:0      [点我收藏+]

https://pypi.python.org/pypi/selenium

from selenium import webdriver
from selenium.webdriver.common.keys import Keys

browser = webdriver.Firefox()

browser.get(http://www.yahoo.com)
assert Yahoo in browser.title

elem = browser.find_element_by_name(p)  # Find the search box
elem.send_keys(seleniumhq + Keys.RETURN)

browser.quit()

//do get all contents

driver = webdriver.Chrome()
driver.get("http://www.ask.com")

print driver.title
inputElement = driver.find_element_by_name("q")

# type in the search
inputElement.send_keys("baseball hats")
# submit the form (although google automatically searches now without submitting)
inputElement.submit()

try:
    WebDriverWait(driver, 10).until(EC.title_contains("baseball"))
    print driver.title
    output = driver.page_source
    print(output)
finally:
    driver.quit()

 

iframes = driver.find_elements_by_tag_name("iframe")

for iframe in iframes
    driver.switch_to_default_content()
    driver.switch_to_frame(iframe)

    output = driver.page_source
    print(output)

 

use selenium in scrapy webdriver

原文:http://www.cnblogs.com/feika/p/4474473.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!