Skip to content
Advertisement

Tools

335 results

webclaw

Collection & Scraping
Open source

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API

Text
Open Source

browserless

Collection & Scraping
Open source

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a p

Text
Open Source

invisible_playwright

Collection & Scraping
Open source

Anti-Detect Browser that passes every bot detection test. Drop-in Playwright replacement.

Multimodal
Open Source

selectolax

Collection & Scraping
Open source

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

Multimodal
Open Source

dvc

Quality & Versioning
Open source

🦉 Data Versioning and ML Experiments

Multimodal
Open Source

lakeFS

Quality & Versioning
Open source

lakeFS - Data version control for your data lake | Git for data

Multimodal
Open Source

quilt

Quality & Versioning
Open source

Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through…

Text
Open Source

Oxen

Quality & Versioning
Open source

Lightning fast data version control system for large repositories of data. Feels like git, pushes and pulls like oxen.

Multimodal
Open Source

data-drift

Quality & Versioning
Open source

Metrics Observability & Troubleshooting

Text
Open Source

rod

Collection & Scraping
Open source

A Chrome DevTools Protocol driver for web automation and scraping.

Multimodal
Open Source

firecrawl-mcp-server

Collection & Scraping
Open source

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Text
Open Source

pydoll

Collection & Scraping
Open source

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

Multimodal
Open Source

trafilatura

Collection & Scraping
Open source

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON,

Text
Open Source

curl_cffi

Collection & Scraping
Open source

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints

Multimodal
Open Source

ferret

Collection & Scraping
Open source

Declarative data automation language and Go runtime for structured extraction workflows.

Text
Open Source

google-maps-scraper

Collection & Scraping
Open source

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews numb

Multimodal
Open Source

skills

Collection & Scraping
Open source

Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck

Multimodal
Open Source

patchright

Collection & Scraping
Open source

Undetected version of the Playwright testing and automation library.

Multimodal
Open Source

php-curl-class

Collection & Scraping
Open source

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

Multimodal
Open Source

oxylabs-ai-studio-py

Collection & Scraping
Open source

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawl

Text
Open Source

VirtualBrowser

Collection & Scraping
Open source

Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=git

Multimodal
Open Source

Scrapling

Collection & Scraping
Open source

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Multimodal
Open Source

scrapy

Collection & Scraping
Open source

Scrapy, a fast high-level web crawling & scraping framework for Python.

Multimodal
Open Source
Advertisement