DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated less than a minute ago

316
305
mudil
3 months ago
big-datadata-engineeringaidata-sciencesystem-design
161
193
rbanffy
3 months ago
pci-epci-e-8.0hardwarepci-expressdata-engineeringpciestoragesystem-designperformance
20
4
jinqueeny
3 months ago
data-engineeringdata-lakesetlwebscrapingdata-automation
HN

The Equality Delete Problem in Apache Iceberg

blog.dataengineerthings.org
59
31
dkgs
3 months ago
data-engineeringbig-dataapache-icebergdata-lakessystem-designetl
63
13
talatuyarer
3 months ago
data-lakesapache-icebergbig-datadata-engineering
HN

Show HN: 1 Million Rows

1mrows.pages.dev
21
30
ankitchhatbar
3 months ago
data-engineeringperformancedatabasesbig-datashow-hn
86
23
akshayka
3 months ago
mlopsdata-flowpythondata-engineeringdataflow
HN

Our European search index goes live

blog.ecosia.org
179
87
maelito
3 months ago
indexdata-engineeringbig-datasearchcloudwebdevapiindexingsearch-engine
HN

I prefer human-readable file formats

adele.pollux.casa
63
51
Bogdanp
3 months ago
data-serializationdata-engineeringdatadata-formathuman-readabledata-formatsfile-formatsdata-sciencedata-standards
1212350

Reddit

Top posts from tech subreddits• Updated 12 minutes ago

24
1
mlivesocial
about 16 hours ago
r/artificialinfrastructure-as-codedata-centercloudbig-datadata-centerssystem-designdatacenterdata-engineering
92
31
craigkerstiens
2 days ago
r/programmingpostgresdata-lakesdata-engineering
0
0
SP3NGL3R
1 day ago
r/codingmd5encryptionwebdevcryptographypythonsecuritydata-engineeringexcel
2
1
rtbot2
1 day ago
r/realtechaichinadata-engineering
2
1
rtbot2
1 day ago
r/realtechaicloudbig-dataserverlessdata-engineering
0
2
iamisakfixer
1 day ago
r/codingaiai-ethicsai-researchmlopsdata-engineering
1
1
rtbot2
3 days ago
r/realtechinfrastructure-as-codebig-datadata-engineering
Reddit

Notes by djb on using Fil-C (2025)

cr.yp.to
18
1
self
4 days ago
r/programmingfil-cwebdevnotesfrontenddata-engineeringself-hosted
555
61
R2_SWE2
5 days ago
r/programmingknowledge-graphstaxtax-lawopen-sourcedata-engineering
243

Hugging Face Trending

Popular models from Hugging Face• Updated 13 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 26 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,829
16,111
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,449
365
pythonopen-sourcedata-engineeringetl
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,956
2,457
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,835
7,790
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,571
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,049
5,954
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
49,303
1,440
pythonetlllmragdata-engineering
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
38,222
3,490
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
simdjsonsimdjson

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++
22,642
1,164
performancebig-datac++data-engineeringjsoncppdatabases
26