Skip to content
Advertisement

Curation & Cleaning

44 results

riko

Curation & Cleaning
Open source

A Python stream processing engine modeled after Yahoo! Pipes

Multimodal
Open Source

docetl

Curation & Cleaning
Open source

A system for agentic LLM-powered data processing and ETL

Text
Open Source

vector

Curation & Cleaning
Open source

A high-performance observability data pipeline.

Multimodal
Open Source

mage-ai

Curation & Cleaning
Open source

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Multimodal
Open Source

flink-cdc

Curation & Cleaning
Open source

Flink CDC is a streaming data integration tool

Multimodal
Open Source

Daft

Curation & Cleaning
Open source

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any s

Image
Open Source

sqlmesh

Curation & Cleaning
Open source

Scalable and efficient data transformation framework - backwards compatible with dbt.

3D / Point Cloud
Open Source

peerdb

Curation & Cleaning
Open source

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Multimodal
Open Source

ethereum-etl

Curation & Cleaning
Open source

Python scripts for ETL (extract, transform and load) jobs for Ethereum blocks, transactions, ERC20 / ERC721 tokens, tran

Multimodal
Open Source

devlake

Curation & Cleaning
Open source

Apache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps too

Multimodal
Open Source

mara-pipelines

Curation & Cleaning
Open source

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Multimodal
Open Source

data-engineering-wiki

Curation & Cleaning
Open source

The best place to learn data engineering. Built and maintained by the data engineering community.

Multimodal
Open Source

extractous

Curation & Cleaning
Open source

Fast and efficient unstructured data extraction. Written in Rust with bindings for many languages.

Text
Open Source

NeumAI

Curation & Cleaning
Open source

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Text
Open Source

quokka

Curation & Cleaning
Open source

Making data lake work for time series

Multimodal
Open Source

mlops-python-package

Curation & Cleaning
Open source

A comprehensive Python package template to kickstart and standardize your MLOps initiatives and data pipelines.

Multimodal
Open Source

kedro

Curation & Cleaning
Open source

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create dat

Multimodal
Open Source

dagster

Curation & Cleaning
Open source

An orchestration platform for the development, production, and observation of data assets.

Multimodal
Open Source

data-science-on-gcp

Curation & Cleaning
Open source

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

Multimodal
Open Source

spotlight

Curation & Cleaning
Open source

Interactively explore unstructured datasets from your dataframe.

Image
Open Source
Advertisement