DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 6 minutes ago

HN

Async I/O on Linux in databases

blog.canoozie.net
182
88
jtregunna
4 months ago
asyncdatabasessystem-designperformancelinuxasync-i-odata-engineering
47
17
belter
4 months ago
clouddata-centerbig-datadata-engineeringamazonsustainability
330
103
Bogdanp
4 months ago
data-engineeringself-hostedstoragebackupdiyhome-office
58
9
heavyset_go
4 months ago
data-engineeringdata-scienceaibig-data
60
28
kristianp
4 months ago
aidata-engineeringcli-toolscode-analysisdeveloper-toolsnlp
197
181
josefresco
4 months ago
data-sciencedata-engineeringbig-data
73
13
hundredwatt
4 months ago
data-engineeringbig-dataperformancesystem-designdata-science
25
11
h-bradio
4 months ago
ainlpgenerative-aimlopsdata-engineeringdata-science
52
8
Sheldon_fun
4 months ago
streamingdata-engineeringstream-processingopen-source
1272950

Reddit

Top posts from tech subreddits• Updated 14 minutes ago

22
1
mlivesocial
about 6 hours ago
r/artificialinfrastructure-as-codedata-centercloudbig-datadata-centerssystem-designdatacenterdata-engineering
92
31
craigkerstiens
1 day ago
r/programmingpostgresdata-lakesdata-engineering
0
0
SP3NGL3R
about 19 hours ago
r/codingmd5encryptionwebdevcryptographypythonsecuritydata-engineeringexcel
2
1
rtbot2
about 24 hours ago
r/realtechaichinadata-engineering
2
1
rtbot2
1 day ago
r/realtechaicloudbig-dataserverlessdata-engineering
0
2
iamisakfixer
1 day ago
r/codingaiai-ethicsai-researchmlopsdata-engineering
1
1
rtbot2
2 days ago
r/realtechinfrastructure-as-codebig-datadata-engineering
Reddit

Notes by djb on using Fil-C (2025)

cr.yp.to
18
1
self
3 days ago
r/programmingfil-cwebdevnotesfrontenddata-engineeringself-hosted
555
61
R2_SWE2
5 days ago
r/programmingknowledge-graphstaxtax-lawopen-sourcedata-engineering
243

Hugging Face Trending

Popular models from Hugging Face• Updated 33 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,814
16,109
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,441
365
pythonopen-sourcedata-engineeringetl
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,947
2,456
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,820
7,788
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,567
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,049
5,954
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
49,303
1,440
pythonetlllmragdata-engineering
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
38,222
3,490
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
simdjsonsimdjson

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++
22,642
1,164
performancebig-datac++data-engineeringjsoncppdatabases
26