Trending

Speeding up PostgreSQL dump/restore snapshots

Sqawk: A fusion of SQL and Awk: Applying SQL to text-based data files

Data preparation for function tooling is boring

Ask HN: How are you cleaning and transforming data before imports/uploads?

TPSV, an Alternative to TSV (and CSV)

Ask HN: What is the simplest data orchestration tool you've worked with?

[D] Build an in-house data labeling team vs. Outsource to a vendor?

I'm curating a list of every document parser out there and running tests on their features. Link in the comment.

How to avoid Bad Data before it breaks your Pipeline with Great Expectations in Python ETL…

finally found a digital marketing ETL tool that doesn’t make things harder

Properly handling missing values [D]

Tools recommendations for unstructured to structured database.

apache

Save item

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

pathwaycom

Save item

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

apache

Save item

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Unstructured-IO

Save item

unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.