Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 10 minutes ago

HN

52 Year old data tape could contain Unix history

theregister.com

142

rbanffy

about 9 hours ago

data-engineering big-data data-lakes storage

HN

Transducer: Composition, Abstraction, Performance

funktionale-programmierung.de

97

defmarco

5 days ago

architecture performance abstraction system-design data-engineering

HN

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

544

costco

3 days ago

ai data-science nlp mlops model-serving data-engineering

HN

I analyzed the lineups at the most popular nightclubs

dev.karltryggvason.com

161

kalli

2 days ago

webdev frontend fullstack data-science data-analytics big-data data-engineering data-analysis analytics entertainment nightlife social-analysis

HN

The APM paradox: Too much data, too few answers

honeybadger.io

6

todsacerdoti

6 days ago

data-science big-data data-analytics data-engineering monitoring

HN

Absurd Workflows: Durable Execution with Just Postgres

lucumr.pocoo.org

123

ingve

6 days ago

data-engineering database-tuning databases system-design postgres sql

HN

Moving tables across PostgreSQL instances

ananthakumaran.in

69

ananthakumaran

7 days ago

data-engineering databases postgresql etl system-design

HN

Building blobd: single-machine object store with sub-ms reads and 15 GB/s upload

blog.wilsonl.in

41

charlieirish

5 days ago

system-design data-engineering storage performance high-performance

HN

Optimizing Datalog for the GPU

danglingpointers.substack.com

112

blakepelton

4 days ago

data-engineering gpu optimization

Reddit

Top posts from tech subreddits• Updated 1 minute ago

Reddit

Chinese companies allegedly smuggled in $1bn worth of Nvidia AI chips in the last three months, despite increasing export controls — some companies are already flaunting future B300 availability

tomshardware.com

3

rtbot2

4 months ago

r/realtech ai ai-ethics nvidia china big-data data-engineering

Reddit

Energy and tech companies said they’re investing $90B in Pennsylvania. Fossil fuel projects make up the largest category among the developments

penncapital-star.com

1

rtbot2

4 months ago

r/realtech energy big-data data-engineering

Reddit

Big Tech collects revenue from Uyghur genocide-linked ‘Chinese military companies’

washingtonexaminer.com

2

rtbot2

4 months ago

r/realtech data-science ai-ethics cybersecurity big-data security data-engineering

Reddit

What makes SQL special

technicaldeft.com

34

zetter

4 months ago

r/programming data-management databases sql system-design data-engineering

Reddit

Redis on Fire and Power Out? Save Your Data Before It Vanishes!

medium.com

0

zarinfam

4 months ago

r/coding databases monitoring redis data-engineering

Reddit

Trucking's uneasy relationship with new tech

bbc.com

1

rtbot2

4 months ago

r/realtech self-driving ai transportation big-data data-engineering

Reddit

How Go 1.24's Swiss Tables saved hundreds of gigabytes

datadoghq.com

197

ketralnis

4 months ago

r/programming golang data-structures performance data-engineering go

Reddit

Am I gaslighting myself or the original MongoDB is web-scale video never existed?

youtube.com

43

PaulBardes

4 months ago

r/programming databases big-data mongodb data-engineering

Reddit

I made a 1000 hour NSFW TTS dataset

reddit.com

1243

hotroaches4liferz

4 months ago

r/LocalLLaMA ai data-science datasets text-to-speech deep-learning mlops data-engineering nlp generative-ai

Hugging Face Trending

Popular models from Hugging Face• Updated 37 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,829

16,111

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust

35,956

2,457

rust data-engineering data-science vector-databases performance dataframes

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,835

7,790

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,571

1,486

kubernetes backup vmware-tanzu data-engineering cloud