Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 12 minutes ago

HN

Show HN: I built a dashboard to compare mortgage rates across 120 credit unions

finfam.app

64

mhashemi

about 4 hours ago

webdev frontend fullstack api fintech data-engineering backend

HN

MinIO is now in maintenance-mode

github.com

383

hajtom

about 8 hours ago

cloud data-engineering self-hosted storage data-lakes

HN

Tidyverse: R Packages for Data Science

tidyverse.org

43

cl3misch

7 days ago

data-science r tidyverse data-engineering

HN

Super fast aggregations in PostgreSQL 19

cybertec-postgresql.com

214

jnord

8 days ago

data-lakes sql databases postgresql etl system-design data-engineering

HN

Mapping Every Dollar of America's $5T Healthcare System

healthisotherpeople.substack.com

122

brandonb

about 10 hours ago

data-science big-data health healthcare system-design data-engineering

HN

IBM CEO says there is 'no way' spending on AI data centers will pay off

businessinsider.com

759

nabla9

1 day ago

ai-research ai data-engineering cloud ai-ethics data-centers ibm

HN

Python Data Science Handbook

jakevdp.github.io

284

cl3misch

1 day ago

data-science python books data-engineering book

HN

Show HN: Marmot – Single-binary data catalog (no Kafka, no Elasticsearch)

github.com

84

charlie-haley

1 day ago

data-engineering data-lakes system-design databases open-source

HN

Genesis DB is a event sourcing database and there are the technical insights

docs.genesisdb.io

7

patriceckhart

7 days ago

databases event-sourcing system-design data-engineering

Reddit

Top posts from tech subreddits• Updated 12 minutes ago

Reddit

Im 15 trying to learn coding to maybe become an ai engineering or hell make my own chatbot for companies and stuff but iv been having problems with storing data to be able to instruct the code

reddit.com

1

Clear-Library-7811

about 2 months ago

r/coding ai mlops data-engineering

Reddit

Buyer Beware: Azure SQL Managed Instance Storage is Regularly as Slow as 60 Seconds

kendralittle.com

102

grauenwolf

about 2 months ago

r/programming azure storage sql database-performance performance data-engineering

Reddit

858TB of government data may be lost for good after South Korea data center fire

datacenterdynamics.com

1

rtbot2

about 2 months ago

r/realtech cloud big-data security data-engineering

Reddit

Without data centers, GDP growth was 0.1% in the first half of 2025, Harvard economist says

fortune.com

182

esporx

about 2 months ago

r/artificial economics big-data data-centers data-engineering

Reddit

Walrus: A 1 Million ops/sec, 1 GB/s Write Ahead Log in Rust

nubskr.com

50

Ok_Marionberry8922

about 2 months ago

r/programming logging database-tuning database performance data-engineering rust

Reddit

By using streetlamps as chargers, researchers created a scalable model for cost-effective EV charging

psu.edu

3

rtbot2

about 2 months ago

r/realtech renewable-energy energy ai infrastructure-as-code electric-vehicles sustainability data-engineering

Reddit

U.S. tech giants hit pause on India data center deals under weight of trade uncertainty

cnbc.com

2

rtbot2

about 2 months ago

r/realtech infrastructure-as-code cloud trade big-data data-centers security data-engineering

Reddit

Personal data storage is an idea whose time has come

blog.muni.town

1

rtbot2

about 2 months ago

r/realtech data-storage data-lakes privacy security data-engineering self-hosted

Reddit

AI data centers are swallowing the world's memory and storage supply, setting the stage for a pricing apocalypse that could last a decade

tomshardware.com

1637

Logical_Welder3467

about 2 months ago

r/technology ai data-centers data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 8 minutes ago

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go

41,347

3,680

vector-databases cloud go data-engineering vector-search milvus databases

perspective-dev

perspective

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.

C++

9,985

1,262

data-visualization data-engineering big-data

facebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++

38,274

4,142

vector-search embeddings data-engineering machine-learning data-science c++faiss ai

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,596

1,489

kubernetes backup vmware-tanzu data-engineering cloud

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl