Skip to content
Advertisement

Collection & Scraping

42 results

zdh_web

Collection & Scraping
Open source

大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台,包含数据采集,调度,权限,审批流,私域营销等模块

Multimodal
Open Source

cloudquery

Collection & Scraping
Open source

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability manageme

Multimodal
Open Source

brightdata-mcp

Collection & Scraping
Open source

A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.

Text
Open Source

spider

Collection & Scraping
Open source

Get web data for AI agents and LLMs

Text
Open Source

twscrape

Collection & Scraping
Open source

Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.

Multimodal
Open Source

grab

Collection & Scraping
Open source

Web Scraping Framework

Multimodal
Open Source

HeadlessX

Collection & Scraping
Open source

The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for

Multimodal
Open Source

webclaw

Collection & Scraping
Open source

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API

Text
Open Source

browserless

Collection & Scraping
Open source

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a p

Text
Open Source

invisible_playwright

Collection & Scraping
Open source

Anti-Detect Browser that passes every bot detection test. Drop-in Playwright replacement.

Multimodal
Open Source

selectolax

Collection & Scraping
Open source

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

Multimodal
Open Source

curl_cffi

Collection & Scraping
Open source

Python binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints

Multimodal
Open Source

VirtualBrowser

Collection & Scraping
Open source

Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器, 免费的web3空投专用指纹浏览器 https://virtualbrowser.cc/?src=git

Multimodal
Open Source

oxylabs-ai-studio-py

Collection & Scraping
Open source

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawl

Text
Open Source

php-curl-class

Collection & Scraping
Open source

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

Multimodal
Open Source

patchright

Collection & Scraping
Open source

Undetected version of the Playwright testing and automation library.

Multimodal
Open Source

skills

Collection & Scraping
Open source

Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck

Multimodal
Open Source

google-maps-scraper

Collection & Scraping
Open source

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews numb

Multimodal
Open Source

ferret

Collection & Scraping
Open source

Declarative data automation language and Go runtime for structured extraction workflows.

Text
Open Source

trafilatura

Collection & Scraping
Open source

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON,

Text
Open Source

pydoll

Collection & Scraping
Open source

Pydoll is a library for automating chromium-based browsers without a WebDriver, offering realistic interactions.

Multimodal
Open Source

firecrawl-mcp-server

Collection & Scraping
Open source

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

Text
Open Source
Advertisement