Trending

SurrealDB is sacrificing data durability to make benchmarks look better

On creating spreadsheets/structured datasets from the web

[P] Vibe datasetting- Creating syn data with a relational model

Autovacuum Tuning: Stop Table Bloat Before It Hurts

A Quick(ish) Introduction to Tuning Postgres

[D] looking for advice: end2end pipeline

[D] Build an in-house data labeling team vs. Outsource to a vendor?

I'm curating a list of every document parser out there and running tests on their features. Link in the comment.

How to avoid Bad Data before it breaks your Pipeline with Great Expectations in Python ETL…

apache

Save item

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

pathwaycom

Save item

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

apache

Save item

dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

apache

Save item

seatunnel

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

apache

Save item

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Unstructured-IO

Save item

unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.