Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 14 minutes ago

HN

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

544

costco

2 days ago

ai data-science nlp mlops model-serving data-engineering

HN

I analyzed the lineups at the most popular nightclubs

dev.karltryggvason.com

161

kalli

1 day ago

webdev frontend fullstack data-science data-analytics big-data data-engineering data-analysis analytics entertainment nightlife social-analysis

HN

The APM paradox: Too much data, too few answers

honeybadger.io

6

todsacerdoti

5 days ago

data-science big-data data-analytics data-engineering monitoring

HN

Absurd Workflows: Durable Execution with Just Postgres

lucumr.pocoo.org

123

ingve

5 days ago

data-engineering database-tuning databases system-design postgres sql

HN

Moving tables across PostgreSQL instances

ananthakumaran.in

69

ananthakumaran

6 days ago

data-engineering databases postgresql etl system-design

HN

Building blobd: single-machine object store with sub-ms reads and 15 GB/s upload

blog.wilsonl.in

41

charlieirish

3 days ago

system-design data-engineering storage performance high-performance

HN

Optimizing Datalog for the GPU

danglingpointers.substack.com

112

blakepelton

3 days ago

data-engineering gpu optimization

HN

Recovering videos from my Sony camera that I stupidly deleted

jeffgeerling.com

71

speckx

15 days ago

digital-forensics video-recovery data-recovery video-editing storage home-office storage-recovery file-recovery data-engineering self-hosted

HN

Server DRAM prices surge 50% as AI-induced memory shortage hits hyperscalers

tomshardware.com

104

walterbell

3 days ago

ai data-engineering serverless big-data data-science

Reddit

Top posts from tech subreddits• Updated 5 minutes ago

Reddit

EU fines Google $3.5 billion for abusing dominance in digital ad market

techspot.com

1

rtbot2

about 2 months ago

r/realtech regulation ai ai-ethics webdev privacy big-data data-engineering

Reddit

[Project] Otters 🦦 - A minimal vector search library with powerful metadata filtering

reddit.com

12

AtharvBhat

about 2 months ago

r/MachineLearning rag knowledge-graphs vector-search data-engineering embeddings

Reddit

[D] How to Automate parsing of Bank Statement PDFs to extract transaction level data

reddit.com

4

Anmol_garwal

2 months ago

r/MachineLearning automation pdf data-engineering nlp

Reddit

HF releases 3T tokens dataset sourced entirely from PDFs.

reddit.com

343

Other_Housing8453

2 months ago

r/LocalLLaMA data-science data-engineering nlp

Reddit

What’s the biggest data governance challenge you face when building cross-agent pipelines?

reddit.com

2

rwitt101

2 months ago

r/AI_Agents data-lakes etl data-engineering

Reddit

Business Rules In Database Movement

medium.com

68

vbilopav89

2 months ago

r/programming databases system-design etl data-engineering

Reddit

[p] Why per row context understanding is important for data transformations and here's how you can use LLMs to do so

reddit.com

2

metalvendetta

2 months ago

r/MachineLearning data-science llm transformers data-engineering nlp

Reddit

European Commission fines Google €2.95 billion over abusive practices in online advertising technology

ec.europa.eu

2

rtbot2

2 months ago

r/realtech ai ai-ethics webdev privacy big-data data-engineering

Reddit

Archived JSON of NYT Crosswords

reddit.com

42

Brilliant-Kick2708

2 months ago

r/webdev json webdev pwa other data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated 42 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++

24,984

3,419

c++google performance cpp developer-tools data-engineering serialization flatbuffers memory-optimization memory-efficient data-serialization

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python

4,494

375

python open-source data-engineering etl

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python

37,121

5,966

ai data-science python data-engineering mlops knowledge-graphs rag model-serving

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

43,110

15,905

data-engineering python workflow apache workflow-orchestration etl workflow-automation

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

16,122

3,898

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,829

16,111

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust

35,956

2,457

rust data-engineering data-science vector-databases performance dataframes

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,835

7,790

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,571

1,486

kubernetes backup vmware-tanzu data-engineering cloud