An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.
29
공개 저장소
74,276
총 별점
808
팔로워
Scrapy, a fast high-level web crawling & scraping framework for Python.
A service daemon to run Scrapy spiders
A pure-python HTML screen-scraping library
Scrapy project to scrape public web directories (educational) [DEPRECATED]
This is a sample Scrapy project for educational purposes
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors
Command line client for Scrapyd server
Python library of web-related functions
CSS Selectors for Python
Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python
Fill HTML login forms automatically
이 저장소에 대한 설명이 제공되지 않았습니다.
A pure-Python robots.txt parser with support for modern conventions.
Common interface for data container classes
The scrapy.org website (old code)
Library to populate items using XPath and CSS with a convenient API
A crawler for http://books.toscrape.com
A CLI for benchmarking Scrapy.
A linter for Scrapy projects.
Performance-focused replacement for Python urllib
A fork of http://pydispatcher.sourceforge.net/ with PyPy support
https://mimesniff.spec.whatwg.org/ implementation for Python
base component forked from Chromium source https://chromium.googlesource.com/chromium/src/base/
[Archived] Library to populate Scrapy items using XPath and CSS with a convenient API
Python library to build HTTP requests out of HTML forms
url component from Chromium source code, forked from https://chromium.googlesource.com/chromium/src/url
GSoC2014 - Scrapy Integration tests project
Codespeed for scrapy-bench
Sphinx extension for documentation in the Scrapy ecosystem