DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 4 minutes ago

37
6
reimisdev
3 months ago
rustaidata-engineeringfile-recognitionframeworkdeveloper-toolssoftware-framework
162
98
Lwrless
3 months ago
financial-technologydata-engineeringquantitative-tradingsystem-designhigh-frequency-tradingsoftwarealgorithmic-tradingopen-source
HN

How to Scale Proteomics

asimov.press
23
9
surprisetalk
3 months ago
data-engineeringmass-spectrometrydata-sciencebig-databioinformaticsscalabilitygenomics
46
6
cameronoliver
3 months ago
geospatialdata-engineeringdistributed-systemsversion-control
181
105
marklit
3 months ago
compressionzstandardlz4data-engineeringperformancezstd
266
126
barbinbrad
3 months ago
software-developmententerprise-softwaresystem-designsoftware-engineeringdata-engineeringenterprise-resource-planning
182
187
mooreds
3 months ago
big-datadata-engineeringgovernmentaidata-science
122
85
rbanffy
3 months ago
data-engineeringstoragessddatacenterdata-storage
HN

Sources of Truth – By John Cutler

cutlefish.substack.com
8
kiyanwang
3 months ago
data-engineeringsystem-designproduct-managementknowledge-graphsdata-scienceproductivitynotetakingdistributed-systemsdata-architecture
1232550

Reddit

Top posts from tech subreddits• Updated 1 minute ago

24
1
mlivesocial
about 13 hours ago
r/artificialinfrastructure-as-codedata-centercloudbig-datadata-centerssystem-designdatacenterdata-engineering
92
31
craigkerstiens
1 day ago
r/programmingpostgresdata-lakesdata-engineering
0
0
SP3NGL3R
1 day ago
r/codingmd5encryptionwebdevcryptographypythonsecuritydata-engineeringexcel
2
1
rtbot2
1 day ago
r/realtechaichinadata-engineering
2
1
rtbot2
1 day ago
r/realtechaicloudbig-dataserverlessdata-engineering
0
2
iamisakfixer
1 day ago
r/codingaiai-ethicsai-researchmlopsdata-engineering
1
1
rtbot2
3 days ago
r/realtechinfrastructure-as-codebig-datadata-engineering
Reddit

Notes by djb on using Fil-C (2025)

cr.yp.to
18
1
self
3 days ago
r/programmingfil-cwebdevnotesfrontenddata-engineeringself-hosted
555
61
R2_SWE2
5 days ago
r/programmingknowledge-graphstaxtax-lawopen-sourcedata-engineering
243

Hugging Face Trending

Popular models from Hugging Face• Updated 2 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 15 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,824
16,110
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,448
365
pythonopen-sourcedata-engineeringetl
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,954
2,457
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,834
7,789
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,569
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,049
5,954
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
49,303
1,440
pythonetlllmragdata-engineering
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
38,222
3,490
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
simdjsonsimdjson

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++
22,642
1,164
performancebig-datac++data-engineeringjsoncppdatabases
26