Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 3 minutes ago

HN

52 Year old data tape could contain Unix history

theregister.com

86

rbanffy

about 4 hours ago

data-engineering big-data data-lakes storage

HN

Transducer: Composition, Abstraction, Performance

funktionale-programmierung.de

97

defmarco

4 days ago

architecture performance abstraction system-design data-engineering

HN

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

544

costco

3 days ago

ai data-science nlp mlops model-serving data-engineering

HN

I analyzed the lineups at the most popular nightclubs

dev.karltryggvason.com

161

kalli

2 days ago

webdev frontend fullstack data-science data-analytics big-data data-engineering data-analysis analytics entertainment nightlife social-analysis

HN

The APM paradox: Too much data, too few answers

honeybadger.io

6

todsacerdoti

6 days ago

data-science big-data data-analytics data-engineering monitoring

HN

Absurd Workflows: Durable Execution with Just Postgres

lucumr.pocoo.org

123

ingve

5 days ago

data-engineering database-tuning databases system-design postgres sql

HN

Moving tables across PostgreSQL instances

ananthakumaran.in

69

ananthakumaran

7 days ago

data-engineering databases postgresql etl system-design

HN

Building blobd: single-machine object store with sub-ms reads and 15 GB/s upload

blog.wilsonl.in

41

charlieirish

4 days ago

system-design data-engineering storage performance high-performance

HN

Optimizing Datalog for the GPU

danglingpointers.substack.com

112

blakepelton

4 days ago

data-engineering gpu optimization

Reddit

Top posts from tech subreddits• Updated 18 minutes ago

Reddit

[P] DocStrange - Open Source Document Data Extractor with free cloud processing

reddit.com

2

LostAmbassador6872

3 months ago

r/MachineLearning cloud open-source data-engineering

Reddit

In Trump’s Washington, Palantir is winning big

washingtonpost.com

5714

rezwenn

3 months ago

r/technology ai government big-data data-engineering

Reddit

N+1 query problem : what it is, why it hurts performance, and how to fix it

namitjain.com

61

Namit2111

3 months ago

r/programming databases database-optimization performance system-design data-engineering

Reddit

I created a persistent memory for an AI assistant I'm developing, and am releasing the memory system

reddit.com

160

Savantskie1

3 months ago

r/LocalLLaMA ai knowledge-graphs mlops data-engineering self-hosted

Reddit

S. Korea likely to defer decision on Google's potential transfer of high-precision map data

m-en.yna.co.kr

1

rtbot2

3 months ago

r/realtech ai maps cloud big-data data-engineering

Reddit

[D] How to deal with a highly skewed response variable in a football transfer dataset?

reddit.com

2

Best_Celebration_933

3 months ago

r/MachineLearning data-science mlops data-engineering

Reddit

India’s approved semiconductor projects to produce 24 billion chips

bisinfotech.com

1

rtbot2

3 months ago

r/realtech industry-news ai china semiconductors semiconductor data-engineering

Reddit

Factories are the New AI power users.

i.redd.it

67

Yavero

3 months ago

r/artificial ai deep-learning mlops data-engineering

Reddit

Understanding WAL in Plain English (And How to Stop It Filling Your Disk)

medium.com

1

Temporary_Depth_2491

3 months ago

r/coding postgres databases storage database-tuning write-ahead-logging system-design data-engineering storage-management

Hugging Face Trending

Popular models from Hugging Face• Updated less than a minute ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 14 minutes ago

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,829

16,111

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust

35,956

2,457

rust data-engineering data-science vector-databases performance dataframes

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,835

7,790

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,571

1,486

kubernetes backup vmware-tanzu data-engineering cloud