Trending

Notes by djb on using Fil-C (2025)

SQLite concurrency and why you should care about it

On Having a Data Object

Replacing EBS and Rethinking Postgres Storage from First Principles

Frozen DuckLakes for Multi-User, Serverless Data Access

Alphabet tops $100B quarterly revenue for first time, cloud grows 34%

Show HN: Automate Robot Data Quality Improvement

Database backups, dump files and restic

Sick: Indexed deduplicated binary storage for JSON-like data structures

Notes by djb on using Fil-C (2025)

IRS open-sourced the fact graph it uses for tax law

Samsung building facility with 50,000 Nvidia GPUs to automate chip manufacturing

How I solved nutrition aligned to diet problem using vector database

[D] Looking for guidance on open-sourcing a hierarchical recommendation dataset (user–chapter–series interactions)

Jet engine shortages threaten AI data center expansion as wait times stretch into 2030

Extremely fast data compression library

China unveils ‘mini fridge’ AI server that uses 90% less power than other systems

Amazon strategised about keeping its datacentres’ full water use secret, leaked document shows

Unstructured-IO

Save item

unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

facebookresearch

Save item

faiss

A library for efficient similarity search and clustering of dense vectors.

rclone

Save item

rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

NVIDIA

Save item

warp

A Python framework for accelerated simulation, data generation and spatial computing.

ranaroussi

Save item

yfinance

Download market data from Yahoo! Finance's API

dlt-hub

Save item

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

dbt-labs

Save item

dbt-utils

Utility functions for dbt projects.

jsvine

Save item

pdfplumber

Plumb a PDF for detailed information about each char, rectangle, line, et cetera — and easily extract text and tables.

apache

Save item

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics