Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 2 minutes ago

HN

52 Year old data tape could contain Unix history

theregister.com

59

rbanffy

about 3 hours ago

data-engineering big-data data-lakes storage

HN

Transducer: Composition, Abstraction, Performance

funktionale-programmierung.de

97

defmarco

4 days ago

architecture performance abstraction system-design data-engineering

HN

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

544

costco

3 days ago

ai data-science nlp mlops model-serving data-engineering

HN

I analyzed the lineups at the most popular nightclubs

dev.karltryggvason.com

161

kalli

2 days ago

webdev frontend fullstack data-science data-analytics big-data data-engineering data-analysis analytics entertainment nightlife social-analysis

HN

The APM paradox: Too much data, too few answers

honeybadger.io

6

todsacerdoti

5 days ago

data-science big-data data-analytics data-engineering monitoring

HN

Absurd Workflows: Durable Execution with Just Postgres

lucumr.pocoo.org

123

ingve

5 days ago

data-engineering database-tuning databases system-design postgres sql

HN

Moving tables across PostgreSQL instances

ananthakumaran.in

69

ananthakumaran

7 days ago

data-engineering databases postgresql etl system-design

HN

Building blobd: single-machine object store with sub-ms reads and 15 GB/s upload

blog.wilsonl.in

41

charlieirish

4 days ago

system-design data-engineering storage performance high-performance

HN

Optimizing Datalog for the GPU

danglingpointers.substack.com

112

blakepelton

4 days ago

data-engineering gpu optimization

Reddit

Top posts from tech subreddits• Updated 2 minutes ago

Reddit

Trump says he plans to put a 100% tariff on computer chips, likely pushing up cost of electronics

apnews.com

3131

Mereo110

3 months ago

r/technology ai ai-ethics security data-engineering

Reddit

Trump demands if Taiwan wants the same 15% tariff as Japan and South Korea, TSMC must acquire 49% of Intel and invest an additional $400 billion in the U.S.

mnews.tw

7552

LegendaryTanuki

3 months ago

r/technology geopolitics ai ai-ethics trade-policy semiconductors big-data ai-research data-engineering

Reddit

Most people building AI data scrapers are making the same expensive mistake

reddit.com

39

beeaniegeni

3 months ago

r/AI_Agents ai data-science web-scraping data-engineering

Reddit

[D]Improving Hybrid KNN + Keyword Matching Retrieval in OpenSearch (Hit-or-Miss Results)

reddit.com

6

MylarSome

3 months ago

r/MachineLearning ai search open-search vector-search information-retrieval knn data-engineering

Reddit

Foxconn says EV sales are so slow it's converting a factory to build AI servers instead

theregister.com

3

rtbot2

3 months ago

r/realtech ai ai-ethics manufacturing serverless data-engineering

Reddit

Gathered Stock Price API data so you don't have to

reddit.com

28

mc587

3 months ago

r/webdev api webdev financial-data data-engineering

Reddit

[P] DocStrange - Open Source Document Data Extractor with free cloud processing for 10k docs/month

reddit.com

43

LostAmbassador6872

3 months ago

r/MachineLearning cloud open-source data-engineering

Reddit

AWS accused of a ‘digital execution’ after it deleted 10 years of users' data without warning — software engineer details “complete digital annihilation” at the hands of AWS admins, claims false excuses given for account deletion

tomshardware.com

1

rtbot2

3 months ago

r/realtech cloud security aws data-engineering

Reddit

Palantir tops $1 billion in revenue for the first time, boosts guidance

cnbc.com

1

rtbot2

3 months ago

r/realtech ai big-data data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,990

3,420

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

376

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,829

16,111

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust

35,956

2,457

rust data-engineering data-science vector-databases performance dataframes

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,835

7,790

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,571

1,486

kubernetes backup vmware-tanzu data-engineering cloud