scrachy.middleware.selenium.SeleniumMiddleware

class scrachy.middleware.selenium.SeleniumMiddleware(settings: Settings, *args, **kwargs)

Bases: object

A downloader middleware that uses a Selenium WebDriver to download the content and return an HtmlResponse if the incoming Response is an instance of SeleniumRequest. Otherwise, it returns None to let another downloader process it.

__init__(settings: Settings, *args, **kwargs)

Methods

__init__(settings, *args, **kwargs)
from_crawler(crawler)
get(name)
process_request(request[, spider])
spider_closed([spider])

Attributes

driver
driver_extensions
driver_name
driver_options
webdriver_import_base