DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 13 minutes ago

HN

Observable Notebooks Data Loaders

observablehq.com
73
19
mbostock
about 2 months ago
data-loadingdata-engineeringdata-lakesnotebooks
67
66
ak_builds
about 2 months ago
system-designdata-engineeringdatabasessqldatabase-tuning
260
134
move-on-by
about 2 months ago
debianpostgresdata-engineeringlinuxdatabasessystem-design
183
69
mdhb
about 2 months ago
data-engineeringbig-dataknowledge-graphsdata-sciencedata-visualizationdata-lakes
61
15
raw_anon_1111
about 2 months ago
data-engineeringdatabase-tuningsystem-designdatabasesecuritycybersecurityprivacygovernment
HN

How the tz database works (2020)

yatsushi.com
63
11
jumbosushi
2 months ago
data-engineeringdatabase-tuningsystem-designtime-keepingdatabasetime-series
HN

Rewriting Dataframes for MicroHaskell

mchav.github.io
54
4
internet_points
about 2 months ago
data-sciencedata-engineeringmlopsfunctional-programming
HN

A love letter to the CSV format (2024)

medialab.sciencespo.fr
61
64
jordigh
about 2 months ago
data-engineeringdatabasescsvdata-lakesetldata-science
7
forthelastime
2 months ago
data-engineeringdata-lakesiceberg
1141651

Reddit

Top posts from tech subreddits• Updated 13 minutes ago

126
56
BaselineITC
about 5 hours ago
r/AI_Agentsaidata-sciencemlopsdata-engineering
24
1
mlivesocial
1 day ago
r/artificialinfrastructure-as-codedata-centercloudbig-datadata-centerssystem-designdatacenterdata-engineering
92
31
craigkerstiens
2 days ago
r/programmingpostgresdata-lakesdata-engineering
0
0
SP3NGL3R
1 day ago
r/codingmd5encryptionwebdevcryptographypythonsecuritydata-engineeringexcel
2
1
rtbot2
2 days ago
r/realtechaichinadata-engineering
2
1
rtbot2
2 days ago
r/realtechaicloudbig-dataserverlessdata-engineering
0
2
iamisakfixer
2 days ago
r/codingaiai-ethicsai-researchmlopsdata-engineering
1
1
rtbot2
3 days ago
r/realtechinfrastructure-as-codebig-datadata-engineering
Reddit

Notes by djb on using Fil-C (2025)

cr.yp.to
18
1
self
4 days ago
r/programmingfil-cwebdevnotesfrontenddata-engineeringself-hosted
243

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 9 minutes ago

mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,094
5,962
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
43,094
15,903
data-engineeringpythonworkflowapacheworkflow-orchestrationetlworkflow-automation
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,477
371
pythonopen-sourcedata-engineeringetl
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,977
3,417
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffersmemory-optimizationmemory-efficientdata-serialization
apacheapache

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++
16,121
3,897
data-engineeringbig-datacolumnar-databasesdatabasesapacheapache-arrowdata-lakesetl
apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,829
16,111
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,956
2,457
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,835
7,790
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,571
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
26