DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 1 minute ago

6
xupybd
3 months ago
data-engineeringdatabasessystem-designformal-methods
HN

Virtual 6NF

minimalmodeling.substack.com
18
4
Bogdanp
3 months ago
data-engineeringdata-lakesetlolapdatabase-designnormalization
138
49
KraftyOne
3 months ago
databasespostgresdata-engineeringdatabase-tuningsystem-design
396
187
jcusch
3 months ago
data-storagedata-structurespersonal-knowledge-managementnotetakingknowledge-graphsdata-lakesself-hostingself-hostedlocal-storagedeveloper-toolslocal-firstdata-engineering
42
14
bobajeff
3 months ago
mlopsdeep-learningllmaidata-engineering
136
25
badmonster
3 months ago
data-sciencemlopsdata-engineeringai
29
joelg
3 months ago
big-datadata-engineeringsystem-design
HN

Sweatshop Data Is Over

mechanize.work
38
17
whoami_nr
3 months ago
data-sciencebig-datadata-engineeringaimlops
HN

We'd be better off with 9-bit bytes

pavpanchekha.com
167
300
luu
3 months ago
computer-visiondata-storagebit-operationsbig-datasystems-designdata-bitsbit-manipulationcomputer-architecturebitsdata-representationcomputer-hardwarebit-architecturesystem-designperformancedata-engineeringbitsystems
1222450

Reddit

Top posts from tech subreddits• Updated 1 minute ago

24
1
mlivesocial
about 15 hours ago
r/artificialinfrastructure-as-codedata-centercloudbig-datadata-centerssystem-designdatacenterdata-engineering
92
31
craigkerstiens
1 day ago
r/programmingpostgresdata-lakesdata-engineering
0
0
SP3NGL3R
1 day ago
r/codingmd5encryptionwebdevcryptographypythonsecuritydata-engineeringexcel
2
1
rtbot2
1 day ago
r/realtechaichinadata-engineering
2
1
rtbot2
1 day ago
r/realtechaicloudbig-dataserverlessdata-engineering
0
2
iamisakfixer
1 day ago
r/codingaiai-ethicsai-researchmlopsdata-engineering
1
1
rtbot2
3 days ago
r/realtechinfrastructure-as-codebig-datadata-engineering
Reddit

Notes by djb on using Fil-C (2025)

cr.yp.to
18
1
self
3 days ago
r/programmingfil-cwebdevnotesfrontenddata-engineeringself-hosted
555
61
R2_SWE2
5 days ago
r/programmingknowledge-graphstaxtax-lawopen-sourcedata-engineering
243

Hugging Face Trending

Popular models from Hugging Face• Updated 43 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,827
16,110
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,448
365
pythonopen-sourcedata-engineeringetl
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,956
2,457
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,835
7,789
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,571
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,049
5,954
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
49,303
1,440
pythonetlllmragdata-engineering
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
38,222
3,490
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
simdjsonsimdjson

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++
22,642
1,164
performancebig-datac++data-engineeringjsoncppdatabases
26