Trending

A faster way to copy SQLite databases between computers

Fivetran to acquire Census

Retailers will soon have only about 7 weeks of full inventories left

Dataframely: A polars-native data frame validation library

ArkFlow: High-performance Rust stream processing engine

Beyond Performance: Measuring the Environmental Impact of Analytical Databases

Packed Data Support in Haskell

Backblaze responds to claims of "sham accounting," customer backups at risk

Reverse Geocoding Is Hard

Current data controls against a synthetic flood [D]

The concept of fallback in agent pipelines and how Lyzr makes it surprisingly seamless

[D] DE vs Gen AI/ML

Original Fallout creator was ordered to destroy source code, then Interplay lost its official archive | Archives should always have redundancies

Used EV batteries could power vehicles, houses or even towns if their manufacturers share vital data

[D] Is Starting as a Data Engineer a Good Path to Become an ML Engineer Later?

Advanced Data Analysis (Code Execution) now in Open WebUI!

DOGE is building a master database for immigration enforcement, sources say

DOGE is building a master database for immigration enforcement, sources say

apache

Save item

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

lancedb

Save item

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

maplibre

Save item

martin

Blazing fast and lightweight PostGIS, MBtiles and PMtiles tile server, tile generation, and mbtiles tooling.

apache

Save item

superset

Apache Superset is a Data Visualization and Data Exploration Platform

redisson

Save item

redisson

Redisson - Valkey and Redis Java client. Real-Time Data Platform. Sync/Async/RxJava/Reactive API. Over 50 Valkey and Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache..

dora-rs

Save item

dora

DORA (Dataflow-Oriented Robotic Architecture) is middleware designed to streamline and simplify the creation of AI-based robotic applications. It offers low latency, composable, and distributed dataflow capabilities. Applications are modeled as directed graphs, also referred to as pipelines.

simdjson

Save item

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

milvus-io

Save item

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

facebookresearch

Save item

faiss

A library for efficient similarity search and clustering of dense vectors.