Trending

Removing newlines in FASTA file increases ZSTD compression ratio by 10x

Pgstream: Postgres streaming logical replication with DDL changes

NASA's Guardian Tsunami Detection Tech Catches Wave in Real Time

Observable Notebooks Data Loaders

Adding OR logic forced us to confront why users preferred raw SQL

Debian 13, Postgres, and the US/* time zones

How Palantir Is Mapping Everyone's Data for the Government

Senator demands to know status of 'duplicate' SSA database 'immediately'

How the tz database works (2020)

[P] Volga - Real-Time Data Processing Engine for AI/ML

New deepseek v3 vs R1 (first is v3)

[D] Locally hosted DataBricks solution?

Incremental combinations without caching

The correct way to model a date range

Coding with company dataset

[R] What is the best model(s) to convert pdfs to text?

Let's Parse and Search through the JFK Files

[D] Should my dataset be balanced?

simdjson

Save item

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

milvus-io

Save item

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

apache

Save item

doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

lancedb

Save item

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

cvat-ai

Save item

cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

Unstructured-IO

Save item

unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

StarRocks

Save item

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

great-expectations

Save item

great_expectations

Always know what to expect from your data.

run-llama

Save item

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.