scrachy

Scrachy provides several middleware and utility classes to improve the functionality of scrapy.

Modules

scrachy.addons

The addons provided by Scrachy.

scrachy.cli

Command line programs.

scrachy.content

Classes and utilities for extracting textual content from the HTML body.

scrachy.db

Classes and utilities for working with SqlAlchemy and other database related functionality.

scrachy.exceptions

Project specific exceptions

scrachy.http_

Additional Request and Response classes for working with Selenium and the AlchemyCacheStorage backend.

scrachy.middleware

The provided middleware.

scrachy.settings

Anything related to the settings for this project.

scrachy.utils

Utilities that don't easily fall into other categories.