Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 3 minutes ago

HN

Show HN: I built a dashboard to compare mortgage rates across 120 credit unions

finfam.app

56

mhashemi

about 3 hours ago

webdev frontend fullstack api fintech data-engineering backend

HN

MinIO is now in maintenance-mode

github.com

380

hajtom

about 8 hours ago

cloud data-engineering self-hosted storage data-lakes

HN

Tidyverse: R Packages for Data Science

tidyverse.org

43

cl3misch

7 days ago

data-science r tidyverse data-engineering

HN

Super fast aggregations in PostgreSQL 19

cybertec-postgresql.com

214

jnord

8 days ago

data-lakes sql databases postgresql etl system-design data-engineering

HN

Mapping Every Dollar of America's $5T Healthcare System

healthisotherpeople.substack.com

122

brandonb

about 9 hours ago

data-science big-data health healthcare system-design data-engineering

HN

IBM CEO says there is 'no way' spending on AI data centers will pay off

businessinsider.com

759

nabla9

1 day ago

ai-research ai data-engineering cloud ai-ethics data-centers ibm

HN

Python Data Science Handbook

jakevdp.github.io

284

cl3misch

1 day ago

data-science python books data-engineering book

HN

Show HN: Marmot – Single-binary data catalog (no Kafka, no Elasticsearch)

github.com

84

charlie-haley

1 day ago

data-engineering data-lakes system-design databases open-source

HN

Genesis DB is a event sourcing database and there are the technical insights

docs.genesisdb.io

7

patriceckhart

7 days ago

databases event-sourcing system-design data-engineering

Reddit

Top posts from tech subreddits• Updated 12 minutes ago

Reddit

How are you all researching custom data points at scale? I’m running into the limits of manual scraping

reddit.com

45

Healthy_Spirit_1237

7 days ago

r/AI_Agents data-science big-data web-scraping data-engineering

Reddit

How to Build a Rust Based NASDAQ ITCH Parser to process millions of messages per second?

lunyn.com

9

capitanturkiye

7 days ago

r/programming high-performance high-availability system-design data-engineering rust

Reddit

Britain plots atomic reboot as datacenter demand surges

theregister.com

800

Logical_Welder3467

9 days ago

r/technology cloud big-data data-engineering

Reddit

An entire PS5 now costs less than 64GB of DDR5 memory, even after a discount — simple memory kit jumps to $600 due to DRAM shortage, and it's expected to get worse into 2026

tomshardware.com

1

rtbot2

9 days ago

r/realtech hardware big-data data-engineering memory

Reddit

I cant stop doomscrolling Google maps so I built AI that researches anywhere on Earth

reddit.com

99

Yamamuchii

10 days ago

r/AI_Agents ai data-science webdev geospatial mlops data-engineering nlp generative-ai

Reddit

Top Economist Warns That AI Data Center Investments Are "Digital Lettuce" That's Already Starting to Wilt

futurism.com

129

wiscowall

11 days ago

r/artificial ai ai-ethics cloud big-data data-engineering

Reddit

SK Hynix to ramp up 1c DRAM production 8-fold in 2026

kedglobal.com

1

rtbot2

13 days ago

r/realtech semiconductors manufacturing big-data data-engineering

Reddit

First it was GPUs and electricity, now AI is eating up the memory industry

finance.yahoo.com

7100

HellYeahDamnWrite

14 days ago

r/technology ai ai-ethics deep-learning data-engineering

Reddit

xAI CEO Elon Musk, Nvidia CEO Jensen Huang, announced a new 500 megawatt data center for xAI in partnership with Saudi Arabia’s Humain AI company, powered by Nvidia’s computing chips.

v.redd.it

77

ControlCAD

14 days ago

r/artificial ai nvidia cloud big-data data-engineering generative-ai

Hugging Face Trending

Popular models from Hugging Face• Updated 30 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 3 hours ago

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go

41,335

3,680

vector-databases cloud go data-engineering vector-search milvus databases

perspective-dev

perspective

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.

C++

9,982

1,262

data-visualization data-engineering big-data

facebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++

38,272

4,142

vector-search embeddings data-engineering machine-learning data-science c++faiss ai

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,596

1,489

kubernetes backup vmware-tanzu data-engineering cloud

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl