Web Scraping Libraries

Build your own scrapers, with these FREE developer libraries in various languages.

Filters

Use Cases
Scraping Features
Programming Languages
Output Formats
Authentication Support
Community and Support

Jsoup

Java library for HTML/XML parsing, data extraction, and element manipulation.

Data Extraction HTML Data Parsing and Transformation Active Community Tutorials and Examples Java Session Handling
DOMParser Icon

DOMParser

Convert XML/HTML strings into DOM documents for easy manipulation via JavaScript.

Data Extraction HTML XML Data Parsing and Transformation Extensive Documentation JavaScript/Node.js

BeautifulSoup

Python library for easy web scraping and data extraction from HTML/XML documents.

Data Extraction HTML Data Parsing and Transformation Support Channels (Forums, Chat, Email) Python
Html Agility Pack Icon

Html Agility Pack

.NET library for parsing and manipulating malformed HTML, supports XPath and LINQ queries.

Data Extraction HTML Data Parsing and Transformation Extensive Documentation Tutorials and Examples C#
lxml Icon

lxml

Efficient XML/HTML processing with Python's lxml library.

Data Extraction XML HTML Data Parsing and Transformation Active Community Extensive Documentation Tutorials and Examples Python

LMXL

Python library for efficient XML/HTML processing with XPath, XSLT, and schema validation.

Data Extraction XML HTML Data Parsing and Transformation Extensive Documentation Python
Cheerio Icon

Cheerio

JavaScript library for efficient HTML/XML parsing with jQuery-like syntax.

Data Extraction XML HTML Data Parsing and Transformation Active Community Extensive Documentation JavaScript/Node.js

PyQuery

Python library for HTML parsing and web scraping with jQuery-like syntax.

Data Extraction Data Parsing and Transformation Active Community Python

htmlparser2

Efficient Node.js HTML/XML parser for high-performance web scraping and data extraction.

Data Extraction Data Parsing and Transformation Regular Updates JavaScript/Node.js

trafilatura

Web text extraction tool for efficient crawling and content extraction.

Web Crawling Data Extraction Content Aggregation JSON CSV XML HTML Multi-threading/Concurrency Data Parsing and Transformation Active Community Regular Updates Extensive Documentation Python

jusText

Heuristic tool for extracting meaningful text from HTML pages.

Data Extraction Active Community Python

html5lib

Python library for accurate HTML parsing, supports error recovery and multiple tree formats.

Data Extraction XML HTML Data Parsing and Transformation Extensive Documentation Python
Pipet Icon

Pipet

A command-line web scraper supporting HTML parsing, JSON parsing, and client-side JavaScript evaluation

Web Crawling Data Extraction JSON Data Parsing and Transformation Go
Nokogiri Icon

Nokogiri

Ruby gem for parsing and manipulating XML/HTML with CSS3 selectors and XPath expressions.

Data Extraction XML HTML Data Parsing and Transformation Active Community Extensive Documentation Tutorials and Examples Ruby
Scrapling Icon

Scrapling

Scrapling is a fast, adaptive Python web scraper that bypasses anti-bot measures and outperforms libraries like BeautifulSoup.

Web Crawling Data Extraction HTML JavaScript Rendering Headless Browser Support Proxy Support Multi-threading/Concurrency Active Community Python JavaScript/Node.js

Parsel

Streamlines web scraping with CSS, XPath, and regex for HTML/XML data extraction.

Data Extraction Data Parsing and Transformation Extensive Documentation Python
Newspaper Icon

Newspaper

Efficiently extracts and parses online news articles using Python.

Data Extraction Content Aggregation Plain Text Data Parsing and Transformation Active Community Extensive Documentation Python
Parse5 Icon

Parse5

High-performance HTML parser for Node.js following the WHATWG standard.

HTML Data Parsing and Transformation Extensive Documentation JavaScript/Node.js

...