scrachy.http_

Additional Request and Response classes for working with Selenium and the AlchemyCacheStorage backend.

Note: Naming this module http causes a circular import error, so I’ve appended an underscore to avoid conflicts.

Classes

CachedHtmlResponse(*args, **kwargs)

A subclass of scrapy.http.HttpResponse that contains a subset of the extra information stored in the cache.

CachedResponseMixin([scrape_timestamp, ...])

A subclass of scrapy.http.HttpResponse that contains a subset of the extra information stored in the cache.

CachedTextResponse(*args, **kwargs)

A subclass of scrapy.http.HttpResponse that contains a subset of the extra information stored in the cache.

CachedXmlResponse(*args, **kwargs)

A subclass of scrapy.http.HttpResponse that contains a subset of the extra information stored in the cache.

ScriptExecutor(*args, **kwargs)

SeleniumRequest(*args, **kwargs)

A subclas of scrapy.http.Request that provides extra information for downloading pages using Selenium.

WaitCondition(*args, **kwargs)