Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 9 minutes ago

HN

52 Year old data tape could contain Unix history

theregister.com

23

rbanffy

about 1 hour ago

data-engineering big-data data-lakes

HN

Transducer: Composition, Abstraction, Performance

funktionale-programmierung.de

97

defmarco

4 days ago

architecture performance abstraction system-design data-engineering

HN

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

544

costco

3 days ago

ai data-science nlp mlops model-serving data-engineering

HN

I analyzed the lineups at the most popular nightclubs

dev.karltryggvason.com

161

kalli

2 days ago

webdev frontend fullstack data-science data-analytics big-data data-engineering data-analysis analytics entertainment nightlife social-analysis

HN

The APM paradox: Too much data, too few answers

honeybadger.io

6

todsacerdoti

5 days ago

data-science big-data data-analytics data-engineering monitoring

HN

Absurd Workflows: Durable Execution with Just Postgres

lucumr.pocoo.org

123

ingve

5 days ago

data-engineering database-tuning databases system-design postgres sql

HN

Moving tables across PostgreSQL instances

ananthakumaran.in

69

ananthakumaran

6 days ago

data-engineering databases postgresql etl system-design

HN

Building blobd: single-machine object store with sub-ms reads and 15 GB/s upload

blog.wilsonl.in

41

charlieirish

4 days ago

system-design data-engineering storage performance high-performance

HN

Optimizing Datalog for the GPU

danglingpointers.substack.com

112

blakepelton

4 days ago

data-engineering gpu optimization

Reddit

Top posts from tech subreddits• Updated 3 minutes ago

Reddit

I Built an Open-Source Perplexity for Finance with Bloomberg-level data access

reddit.com

10

Yamamuchii

3 months ago

r/AI_Agents data-science financial-data big-data open-source data-engineering

Reddit

UK Government urges citizens to delete old emails and pictures as data centres require vast amounts of water to cool their systems

gov.uk

1

rtbot2

3 months ago

r/realtech environment cloud big-data data-engineering

Reddit

Creating an AI data scraper

reddit.com

2

Adventurous_Act_3504

3 months ago

r/AI_Agents ai webdev web-scraping data-engineering

Reddit

Thousands of files on rogue California cops made public via searchable database

the-independent.com

1

rtbot2

3 months ago

r/realtech public-data law-enforcement databases search big-data security data-engineering searchable-database

Reddit

Trump announces 100% tariff on computer chips. Here's what it could mean for your wallet.

usatoday.com

4711

Proud_Tie

3 months ago

r/technology ai ai-ethics security data-engineering

Reddit

Residents cheer as Tucson rejects Amazon's massive Project Blue data center campus in Arizona

datacenterdynamics.com

5385

Wagamaga

3 months ago

r/technology local-news data-center cloud local-government big-data data-centers data-engineering

Reddit

Residents cheer as Tucson rejects Amazon's massive Project Blue data center campus in Arizona

datacenterdynamics.com

1

rtbot2

3 months ago

r/realtech local-news data-center cloud big-data data-engineering

Reddit

Samsung's revived Z-NAND targets 15x performance increase over traditional NAND — once a competitor to Intel's Optane, Z-NAND makes a play for AI datacenters

tomshardware.com

1

rtbot2

3 months ago

r/realtech ai storage big-data data-engineering

Reddit

Why Kafka became essential for my AI agent projects

reddit.com

174

Warm-Reaction-456

3 months ago

r/AI_Agents ai kafka mlops data-engineering distributed-systems

Hugging Face Trending

Popular models from Hugging Face• Updated 22 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 35 minutes ago

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,829

16,111

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust

35,956

2,457

rust data-engineering data-science vector-databases performance dataframes

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,835

7,790

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,571

1,486

kubernetes backup vmware-tanzu data-engineering cloud